web scraping

  1. P

    Web scraping not working

    Trying my hand at web-scraping again. I want to grab a specific text from a website, and to do so the first part of my code dumps the website's response into a cell of the worksheet. Here is the code: Sub Test() Dim URL As String Dim HTTPObject, HTMLObject As Object URL =...
  2. A

    VBA getElementsByTagName fail to catch "td" tag elements

    I need some help from the smart guys here on the site. The code snippet below don't give any errors and it looks that it works fine, but the TD element collection stays empty and the innerText is empty too. That while the data are showing in a visual browser as You can see in the image below...
  3. P

    IE VBA Web Scrapping Table extract issue

    Hello Guys, i have below code that copy table on current webpage but when i change that page it not getting new table. note both the tables have same format, with little change in content, Dim i As SHDocVw.InternetExplorer Set i = New InternetExplorer Dim clipboard As MSForms.DataObject...
  4. M

    Convert HTML doc to XML for xPath Parsing

    I am trying to find a good way to convert an HTML document to XML so I can use an Xpath expression for parsing. As a test I'd like to get this xpath expression to pull information from What Is My IP❓ Shows your real public IP address - IPv4 - IPv6 //*[@id="post-7"]/div[1]/div[1]/div/ul/li[2] So...
  5. P

    VBA Wesite Login

    **Definitely a beginner. Please bear with me. First attempt at web scrapping.** I need the following URL to auto-login and retrieve a table from the website. I have pieced together VBA code from different websites to fill in the login information and hopefully pull a table but I am unable to...
  6. P

    Web Scraping, get HTML data from web

    I have used Excel VBA to navigate to a web site. I am trying to pull data from a specific part of the website. When I inspect the element the following is displayed: <span id="Status">Ready to Drop Ship</span> Does anyone know how to get the data "Ready to Drop Ship" from the above HTML code...
  7. E

    Object variable or With block not set error when trying to fill in input fields on a website

    Hi, I am writing the following code which allows me to proceed to a website that I need to gather info from to then export into excel. I am very new to HTML web scraping with VBA and I am currently writing it line by line and testing it as I go. Sub GoToMarketingScents() 'navigate to...
  8. P

    vba code to get element from label name

    Hi, I need to select option "Assigned to anyone" from below code. it looks like drop down list. HTML for it is as below <select class="form-control ng-pristine ng-untouched ng-valid ng-not-empty" ng-model="viewOptions.assignedToMe" ng-options="opt.value as opt.label for opt in...
  9. M

    Clicking a web page button via VBA

    Hi, I have been attempting to automate a web scraping process and I am needing to click a button on the web page; however, my object is constantly empty. Here is the html code: <div class="pull-right"> <button class="btn btn-primary js-export-customer"><span...
  10. S

    Downloading multiple tables from a site at once

    Hello everyone, I am trying to download a bunch of tables from a site (allowed by the site administrator). I can use the site's filters/search tools and get all my data by year on a web page. However I need 20 or so years worth of data, so I have to click on each year one by one to access the...
  11. M

    Changing a loop and finding a HREF links using VBA and appending fetched links from sheet

    Hi all, My problem is two-fold. I have a worksheet already created that has a list of Football Leagues (in the rows), the columns hold the data. I have some code that fetches data from a website and populates this sheet (each row contains data corresponding to a league). It currently works, but...
  12. B

    excel vba and Javascript:_doPostback download file to excel

    Hi Team, I want to download a file to my local worksheet from the site: https://www.bseindia.com/corporates/List_Scrips.aspx# below is my code which I tried after doing some research. challenge is, how to avoid the page resubmit (retry, cancel warning window) secondly, I need to download the...
  13. E

    Follow Hyperlink VBA Webscraping

    Hi guys, I'm trying to automate through vba a script that will follow a list of hyperlinks to Google search results and to copy the phone number listed for each link (phone numbers in google searches are listed on the right hand side). Example link showing the phone number on the right hand...
  14. M

    Web Scraping into Excel

    Hi, I would like to create a spreadsheet that I can refresh and pull in each weeks English premier League fixtures, each week I would like to refresh this and see the weeks future fixtures. I have tried to use the import function from Data/From Web and selected the box with the table of...
  15. D

    VBA to change date in Data picker on web page

    Sub getdata()<code style="margin: 0px; padding: 0px; font-style: inherit; font-weight: inherit; line-height: 12px;"> Dim ie As New InternetExplorer ie.Visible = True ie.navigate "https://app.scheduleonce.com/Home.aspx" With ie While .Busy Or .readyState <> READYSTATE_COMPLETE: DoEvents: Wend...
  16. C

    VBA Getting Elements By ClassName

    I trying to get a list the of items based on the class name list-group-item on this page (https://www.cattle.com/markets/archive.aspx?code=TV_LS153) and then populate them across column fields and I need the dates to stay in the same form as yyyy-mm-yy format. My spreadsheet in column A hold the...
  17. Ombir

    Exccute Javascript in IE

    Hi, I want to click on button on a webpage which doesn't contains button tag. I think it is associated with javascript code execution. Below is the Html Code of complete webpage. <!DOCTYPE html> <html> <head> ****** http-equiv="Content-Type" content="text/html; charset=utf-8" /> ******...
  18. G

    Macro/function to search a webpage and look for a Text/Word

    I have written a VBA code (function) to check whether a URL exists and returns true if it exists. Now I want to further check the page for a known text (in HTML) for example - to check whether a google map exists in the page - to check whether a image (known file name) is embedded in the page -...
  19. W

    Web Scraping code question, specific site

    I can't for the life of my re-code a custom project of ours to deal with changes on the following website. I'm not 100% sure what the developer was going after in the code below, but maybe the site changed?? I removed part of the code that used to attempt to scrape whether the number is a...
  20. C

    Web Scraping with VBA - problems clicking a button

    I've got most of a scraping code figured out - I'm trying to get the 1st and 2nd halfs from a link like this: Lafayette Leopards vs. Villanova Wildcats - Box Score - November 11, 2016 | FOX Sports. The link initially defaults to the box score - but I'm able to code in clicking on the...

Some videos you may like

This Week's Hot Topics

Top