web scraping

  1. M

    Web Scraping into Excel

    Hi, I would like to create a spreadsheet that I can refresh and pull in each weeks English premier League fixtures, each week I would like to refresh this and see the weeks future fixtures. I have tried to use the import function from Data/From Web and selected the box with the table of...
    • MrPink1986
    • Thread
    • fixtures vba & excel web data import macro web scraping weeks
    • Replies: 2
    • Forum: Excel Questions
  2. D

    VBA to change date in Data picker on web page

    Sub getdata()<code style="margin: 0px; padding: 0px; font-style: inherit; font-weight: inherit; line-height: 12px;"> Dim ie As New InternetExplorer ie.Visible = True ie.navigate "https://app.scheduleonce.com/Home.aspx" With ie While .Busy Or .readyState <> READYSTATE_COMPLETE: DoEvents: Wend...
  3. C

    VBA Getting Elements By ClassName

    I trying to get a list the of items based on the class name list-group-item on this page (https://www.cattle.com/markets/archive.aspx?code=TV_LS153) and then populate them across column fields and I need the dates to stay in the same form as yyyy-mm-yy format. My spreadsheet in column A hold the...
  4. Ombir

    Exccute Javascript in IE

    Hi, I want to click on button on a webpage which doesn't contains button tag. I think it is associated with javascript code execution. Below is the Html Code of complete webpage. <!DOCTYPE html> <html> <head> ****** http-equiv="Content-Type" content="text/html; charset=utf-8" /> ******...
    • Ombir
    • Thread
    • allocation button internet explorer vba web scraping
    • Replies: 4
    • Forum: Excel Questions
  5. G

    Macro/function to search a webpage and look for a Text/Word

    I have written a VBA code (function) to check whether a URL exists and returns true if it exists. Now I want to further check the page for a known text (in HTML) for example - to check whether a google map exists in the page - to check whether a image (known file name) is embedded in the page -...
  6. W

    Web Scraping code question, specific site

    I can't for the life of my re-code a custom project of ours to deal with changes on the following website. I'm not 100% sure what the developer was going after in the code below, but maybe the site changed?? I removed part of the code that used to attempt to scrape whether the number is a...
  7. C

    Web Scraping with VBA - problems clicking a button

    I've got most of a scraping code figured out - I'm trying to get the 1st and 2nd halfs from a link like this: Lafayette Leopards vs. Villanova Wildcats - Box Score - November 11, 2016 | FOX Sports. The link initially defaults to the box score - but I'm able to code in clicking on the...
  8. D

    Auto populating text fields on websites and scraping the web

    I created a macro that automatically populated different fields on a website / online application that'd then give me results based on my inputs (which I then would have to "scrape" the results for my Excel reports). Recently the tool just had an update to its UI so now when I click view source...
  9. B

    VBA to Identify Webpart. Need IE HTML Expert.

    Hello, I am trying to scrape data from a web query using VBA. The problem I have run into is that I can't find a way to copy the data I actually want. I have tried everything I could find on the forums (document.body document.innertext, document.outerHTML, etc.), but nothing is capturing the...
  10. V

    Extract links from web site using VBA

    Hi everyone, The following web site lists 63 products (fragrances): Dolce&Gabbana Perfumes And Colognes Using VBA, I would like to extract all the links to each of the 63 products in an excel file. An example of an outcome would be: /perfume/Dolce-Gabbana/Dolce-Gabbana-Pour-Homme-15336.html...
  11. V

    Extracting tables from web site using vba

    Hi everyone, I am interested in extracting the 2 "Longevity" and "Sillage" tables from the link below in excel using VBA: Burberry Brit for Men Burberry cologne - a fragrance for men 2004 Currently, I am able to do so using the following code: Longevity =...
    • viktor4e
    • Thread
    • vba & excel web scrape web scraping web scrapping
    • Replies: 12
    • Forum: Excel Questions
  12. G

    IE 11 automation Select an item in the dropdown list

    Hey guy, I am trying to perform some web scraping, but I cannot get the dropdown list filled. I already serached many websites and forums without any success. In the code below I demonstrate some of the attempts that I have tried unsuccessfully, but doesn't mean that I ran the code that way...
    • guyreys
    • Thread
    • drop down fill form ie automation vba web scraping
    • Replies: 2
    • Forum: Excel Questions
  13. C

    Looking for some help with HTML/Excel Web Scraping

    So the following code hopes to return the entirety of the play-by-play table at a link like this: Providence vs. Villanova - Play-By-Play - January 24, 2016 - ESPN. Sub test() Set IE = CreateObject("InternetExplorer.Application") my_url =...
  14. M

    GetElementById not working for HTML Table scrape

    Really stumped here. I've managed to scrape a website's results page (Insurance eligibility) and get some results I want and dump it into my Excel file....except for one. I've tried numerous variations of the getelementbyid/classname/ This is my current code which isn't working, and yes, I am...
    • mnoah
    • Thread
    • getelement getelementsbyid html scrape vba web scraping
    • Replies: 2
    • Forum: Excel Questions
  15. J

    VBA Web Scrapping Compatibility Issue ? Run time Error 5 on one computer but not the anyother

    I have a Thinkpad and so does two of my other co-workers, the other has an HP and we all have the same version of Microsoft office. This VBA Code works perfectly on all the computers expect one, the HP. I turned the text below red that is coming up and causing an error. Private Sub...
    • jcrone
    • Thread
    • compatability runtime 5 error thinkpad web scraping
    • Replies: 5
    • Forum: Excel Questions
  16. K

    Selecting IE Hyperlink - Excel VBA

    Hi all - This is my first post to the forums although I have already found tons of useful information on here in the past. My question is related to building a web scraping macro. I have gotten as far as navigating to the website, entering username and password, selecting the 1st hyperlink...
  17. K

    Excel VBA to Sign Into and then Extract Data from a Website

    Hello Mr. Excel folks! I have made great strides on my attempts to automate logging into, and then extracting data, from a website. I have gotten all the way to the point where the data is indeed in excel! However, the data is all going in only one column, column A, and I cannot figure out how...
  18. K

    Web Query Loop to scrape Data

    Hi again all, I'm think I made my first post too wordy and overly complicated things..... I have a column of URLs in column A of "Sheet1". I have a web Query on "Sheet2". I want a macro to loop through all URLs in column A of "Sheet1", changing the WebQuery to use the URL as it's connection...
    • Kc7487
    • Thread
    • macro loop vba web queries web queries looping web scraping
    • Replies: 0
    • Forum: Excel Questions
  19. V

    web scraping using excel vba in the following possible

    Hi @all, first of all I am not a native english guy, so apologies if my english has mistakes. But I am so much curious how to solve the following problem. Since a few months I am interested in web scraping by using Excel vba. But take a look first at this html Code. I want to extract the...
  20. E

    copy data from table from locally stored html to excel worksheet

    I got the code below from another site and it seems to be working fine. However, it is using a page from the web. I can't modify it to work on locally stored html files. Please help. Sub HTML_Table_To_Excel() Dim htm As Object Dim Tr As Object Dim Td As Object Dim Tab1 As Object...
    • erin00
    • Thread
    • html tables excel macro vba & excel web scraping
    • Replies: 0
    • Forum: Excel Questions

We've detected that you are using an adblocker.

We have a great community of people providing Excel help here, but the hosting costs are enormous. You can help keep this site running by allowing ads on MrExcel.com.
Allow Ads at MrExcel

Which adblocker are you using?

Disable AdBlock

Follow these easy steps to disable AdBlock

1)Click on the icon in the browser’s toolbar.
2)Click on the icon in the browser’s toolbar.
2)Click on the "Pause on this site" option.
Go back

Disable AdBlock Plus

Follow these easy steps to disable AdBlock Plus

1)Click on the icon in the browser’s toolbar.
2)Click on the toggle to disable it for "mrexcel.com".
Go back

Disable uBlock Origin

Follow these easy steps to disable uBlock Origin

1)Click on the icon in the browser’s toolbar.
2)Click on the "Power" button.
3)Click on the "Refresh" button.
Go back

Disable uBlock

Follow these easy steps to disable uBlock

1)Click on the icon in the browser’s toolbar.
2)Click on the "Power" button.
3)Click on the "Refresh" button.
Go back
Back
Top