web scraping

  1. S

    WinHttpRequest with POST times out

    Hello all, I'm trying to import some data for a fund listed on the Luxembourg SE. When I go to the site, I can insert the ISIN code, LU1883863935, in the search field and from there I can read the exchange symbol, 294814. As I'm trying to get the data into Excel, I can see when I use Inspect...
  2. S

    Read information inside html

    Hello :) I have this URL: Candriam Equities L Australia Class C AUD Cap, LU0078775011:AUD historical prices - FT.com. Using Chrome I can inspect the elements and there I need to be able to read the information about symbol=3280 from data-module-name="HistoricalPricesApp" I've tried various ways...
  3. N

    Web Scraping

    Hello, I need help trying to get the 1st line of the following 10-day forecast. Here is my code to get the forecast for Miami, FL on Weather.com. I am not able to get the current date or the first date in the summary. Please help. Thanks and take care. Sub MiamiWeather() Dim ieObj As...
  4. P

    Web scraping not working

    Trying my hand at web-scraping again. I want to grab a specific text from a website, and to do so the first part of my code dumps the website's response into a cell of the worksheet. Here is the code: Sub Test() Dim URL As String Dim HTTPObject, HTMLObject As Object URL =...
  5. A

    VBA getElementsByTagName fail to catch "td" tag elements

    I need some help from the smart guys here on the site. The code snippet below don't give any errors and it looks that it works fine, but the TD element collection stays empty and the innerText is empty too. That while the data are showing in a visual browser as You can see in the image below...
  6. P

    IE VBA Web Scrapping Table extract issue

    Hello Guys, i have below code that copy table on current webpage but when i change that page it not getting new table. note both the tables have same format, with little change in content, Dim i As SHDocVw.InternetExplorer Set i = New InternetExplorer Dim clipboard As MSForms.DataObject...
  7. M

    Convert HTML doc to XML for xPath Parsing

    I am trying to find a good way to convert an HTML document to XML so I can use an Xpath expression for parsing. As a test I'd like to get this xpath expression to pull information from What Is My IP❓ Shows your real public IP address - IPv4 - IPv6 //*[@id="post-7"]/div[1]/div[1]/div/ul/li[2] So...
  8. P

    VBA Wesite Login

    **Definitely a beginner. Please bear with me. First attempt at web scrapping.** I need the following URL to auto-login and retrieve a table from the website. I have pieced together VBA code from different websites to fill in the login information and hopefully pull a table but I am unable to...
  9. P

    Web Scraping, get HTML data from web

    I have used Excel VBA to navigate to a web site. I am trying to pull data from a specific part of the website. When I inspect the element the following is displayed: <span id="Status">Ready to Drop Ship</span> Does anyone know how to get the data "Ready to Drop Ship" from the above HTML code...
  10. E

    Object variable or With block not set error when trying to fill in input fields on a website

    Hi, I am writing the following code which allows me to proceed to a website that I need to gather info from to then export into excel. I am very new to HTML web scraping with VBA and I am currently writing it line by line and testing it as I go. Sub GoToMarketingScents() 'navigate to...
  11. P

    vba code to get element from label name

    Hi, I need to select option "Assigned to anyone" from below code. it looks like drop down list. HTML for it is as below <select class="form-control ng-pristine ng-untouched ng-valid ng-not-empty" ng-model="viewOptions.assignedToMe" ng-options="opt.value as opt.label for opt in...
  12. M

    Clicking a web page button via VBA

    Hi, I have been attempting to automate a web scraping process and I am needing to click a button on the web page; however, my object is constantly empty. Here is the html code: <div class="pull-right"> <button class="btn btn-primary js-export-customer"><span...
  13. S

    Downloading multiple tables from a site at once

    Hello everyone, I am trying to download a bunch of tables from a site (allowed by the site administrator). I can use the site's filters/search tools and get all my data by year on a web page. However I need 20 or so years worth of data, so I have to click on each year one by one to access the...
  14. M

    Changing a loop and finding a HREF links using VBA and appending fetched links from sheet

    Hi all, My problem is two-fold. I have a worksheet already created that has a list of Football Leagues (in the rows), the columns hold the data. I have some code that fetches data from a website and populates this sheet (each row contains data corresponding to a league). It currently works, but...
  15. B

    excel vba and Javascript:_doPostback download file to excel

    Hi Team, I want to download a file to my local worksheet from the site: https://www.bseindia.com/corporates/List_Scrips.aspx# below is my code which I tried after doing some research. challenge is, how to avoid the page resubmit (retry, cancel warning window) secondly, I need to download the...
  16. E

    Follow Hyperlink VBA Webscraping

    Hi guys, I'm trying to automate through vba a script that will follow a list of hyperlinks to Google search results and to copy the phone number listed for each link (phone numbers in google searches are listed on the right hand side). Example link showing the phone number on the right hand...
  17. M

    Web Scraping into Excel

    Hi, I would like to create a spreadsheet that I can refresh and pull in each weeks English premier League fixtures, each week I would like to refresh this and see the weeks future fixtures. I have tried to use the import function from Data/From Web and selected the box with the table of...
  18. D

    VBA to change date in Data picker on web page

    Sub getdata()<code style="margin: 0px; padding: 0px; font-style: inherit; font-weight: inherit; line-height: 12px;"> Dim ie As New InternetExplorer ie.Visible = True ie.navigate "https://app.scheduleonce.com/Home.aspx" With ie While .Busy Or .readyState <> READYSTATE_COMPLETE: DoEvents: Wend...
  19. C

    VBA Getting Elements By ClassName

    I trying to get a list the of items based on the class name list-group-item on this page (https://www.cattle.com/markets/archive.aspx?code=TV_LS153) and then populate them across column fields and I need the dates to stay in the same form as yyyy-mm-yy format. My spreadsheet in column A hold the...
  20. Ombir

    Exccute Javascript in IE

    Hi, I want to click on button on a webpage which doesn't contains button tag. I think it is associated with javascript code execution. Below is the Html Code of complete webpage. <!DOCTYPE html> <html> <head> ****** http-equiv="Content-Type" content="text/html; charset=utf-8" /> ******...

Watch MrExcel Video

This Week's Hot Topics

We've detected that you are using an adblocker.

We have a great community of people providing Excel help here, but the hosting costs are enormous. You can help keep this site running by allowing ads on MrExcel.com.
Allow Ads at MrExcel

Which adblocker are you using?

Disable AdBlock

Follow these easy steps to disable AdBlock

1)Click on the icon in the browser’s toolbar.
2)Click on the icon in the browser’s toolbar.
2)Click on the "Pause on this site" option.
Go back

Disable AdBlock Plus

Follow these easy steps to disable AdBlock Plus

1)Click on the icon in the browser’s toolbar.
2)Click on the toggle to disable it for "mrexcel.com".
Go back

Disable uBlock Origin

Follow these easy steps to disable uBlock Origin

1)Click on the icon in the browser’s toolbar.
2)Click on the "Power" button.
3)Click on the "Refresh" button.
Go back

Disable uBlock

Follow these easy steps to disable uBlock

1)Click on the icon in the browser’s toolbar.
2)Click on the "Power" button.
3)Click on the "Refresh" button.
Go back