Automatically extract website data to a spreadsheet

[Corried]

Hello, Thank you for sharing..

I am looking for courses on how to automatically extract data from a website to an excel spreadsheet.

The excel file contains fifty links. Each link has the same process, to create a stock market report for fifty companies. Use macro and chrome to generate data.

Can anyone show me a step by step process on how I can do this?

Please watch the video and Excel workbook below to learn more.

Example STOCK REPORT CARD

Sheet2 CORRIE STOCK REPORT CARD Websites Top 100,Company,Symbol,P/E,Price,Sales Growth Yr Over Yr,Sales, Revenue, Net Income in B=billion or M=million,52-Week Low & High,5 Year High & Low,Market Cap; # Shares,Debt/Equity Ratio,Net Profit,Company: Insider Trading,Operating Margins,Description,New...

docs.google.com

I hope you all understand.

Cheers

 

[Worf]

1. The thread below has some explanations at post #4
2. It worked for me with Edge, please try it. Note that probably a driver update is necessary.

import data from Web

Dear ALL, I follow your video, I want to import data from Web of this link https://racing.hkjc.com/racing/information/english/Racing/JockeysRides.aspx When I run from web, in explore I read the link, document, does not have TABLE, but I can read table and data, on TABLE VIEW and DATA VIW, when...

www.mrexcel.com

Public driver As New EdgeDriver

 

[Corried]

1. The thread below has some explanations at post #4
2. It worked for me with Edge, please try it. Note that probably a driver update is necessary.

import data from Web

Dear ALL, I follow your video, I want to import data from Web of this link https://racing.hkjc.com/racing/information/english/Racing/JockeysRides.aspx When I run from web, in explore I read the link, document, does not have TABLE, but I can read table and data, on TABLE VIEW and DATA VIW, when...

www.mrexcel.com

View attachment 61809

Public driver As New EdgeDriver

Good day Worf

It took me sometime to figure out how to install Edge Driver.

Below are links to walk members through this step-by-step process:

How to Automate Edge Browser using Excel Macros

SeleniumBasic v2.0.9.0 Installation

Release SeleniumBasic v2.0.9.0 · florentbr/SeleniumBasic

CHANGELOG.txt

github.com

Microsoft Edge WebDriver Version

Microsoft Edge WebDriver | Microsoft Edge Developer

developer.microsoft.com

 

[Corried]

1. The thread below has some explanations at post #4
2. It worked for me with Edge, please try it. Note that probably a driver update is necessary.

import data from Web

Dear ALL, I follow your video, I want to import data from Web of this link https://racing.hkjc.com/racing/information/english/Racing/JockeysRides.aspx When I run from web, in explore I read the link, document, does not have TABLE, but I can read table and data, on TABLE VIEW and DATA VIW, when...

www.mrexcel.com

View attachment 61809

Public driver As New EdgeDriver

I am sorry, Wolf. I did not want to disturb you.

I have not found the solution to fix this problem

Both Edge & Chrome give the same error.

EdgeDriver Error.webm

drive.google.com

Searched online for hours. Nothing.?

 

[Worf]

Can you try it using another computer?

 

[Corried]

Can you try it using another computer?

Thanks Wolf for your recommendation. I am not sure. Can you send me your file copy?

I've used my wife laptop. I'm not sure why I am getting the same error:

[b2] = driver.FindElementByCss("#root > div:nth-child(1) > div > div.mainContentLayout-DS-EntryPoint1-1 > div > div > div:nth-child(1) >" & _
" div > div.firstSection-DS-EntryPoint1-1 > div.quoteInfo-DS-EntryPoint1-1 > div.title-DS-EntryPoint1-1 > span.displayName-DS-EntryPoint1-1").Text

 

[Worf]

Here is my test file:

scrap.xlsm

 

[Worf]

Also, try this code that uses a different page just to see what happens:

Sub HongKongFoo()
Dim driver As New ChromeDriver, pt
driver.get "https://racing.hkjc.com/racing/information/english/Racing/JockeysRides.aspx"
Application.Wait Now + TimeValue("0:00:06")
Set pt = driver.FindElementByXPath("/html/body/div[1]/div[3]/div/table")
MsgBox pt.FindElementsByTag("tr").Count, 64, "Number of table rows"
End Sub

 

[Corried]

Also, try this code that uses a different page just to see what happens:

Sub HongKongFoo()
Dim driver As New ChromeDriver, pt
driver.get "https://racing.hkjc.com/racing/information/english/Racing/JockeysRides.aspx"
Application.Wait Now + TimeValue("0:00:06")
Set pt = driver.FindElementByXPath("/html/body/div[1]/div[3]/div/table")
MsgBox pt.FindElementsByTag("tr").Count, 64, "Number of table rows"
End Sub

Wow... Can a plugin prevents these problems.
Below is my error...

I am not sure how to move forward from here...

Wow....webm

drive.google.com

 

[Worf]

Guess what? My home computer stopped working again.

I ordered a new one today, but it will take weeks to arrive, Dell Brazil is rather slow.

Here at work I cannot install Selenium, but I will think of some suggestion for you.

 

[Worf]

Concerning the Hong Kong site, the jockey table was not available when you tested, try it at a moment when it is there.

My idea using another page is to determine if the MSN site has some scraping blocking mechanism or something, because I was also getting errors sometimes.