webpage data scraping excel vba

crazyjk

New Member
Joined
Nov 23, 2017
Messages
1
Hi guys, I am newbie to html and web data scraping using vba. I have no problems getting data from a table on the webpage, but I bumped into two issues. On the webpage, it only shows one page of table data, at the bottom I can click page 2, 3 and NEXT. Using control+U to see the html codes, I can see all information are loaded and neatly organised as tr rows.

I assume ie.document can store all elements, as what I can see using control +U in Chrome. And when I try to retrieve the tr innertext by using getelementByTagName("tr"), vba just skipped all tr elements which is supposed to be on other pages of the table. Pardon me if I dont explain well, and I couldnt paste the link and html codes here as it may contain confidential information. I wonder if someone ever bumped into similar issues, and not much information can be found on Dr google.

Thank you in advance!

Code:
ieDoc = ieApp.Document

For Each HTMLRow In ieDoc.getElementsByTagName("tr")

Debug.print HTMLRow.innertext
 

Excel Facts

Return population for a City
If you have a list of cities in A2:A100, use Data, Geography. Then =A2.Population and copy down.
Master Excel Bundle

Excel contains over 450 functions, with more added every year. That’s a huge number, so where should you start? Right here with this bundle.

Forum statistics

Threads
1,167,463
Messages
5,853,892
Members
431,602
Latest member
myuzejuk

We've detected that you are using an adblocker.

We have a great community of people providing Excel help here, but the hosting costs are enormous. You can help keep this site running by allowing ads on MrExcel.com.
Allow Ads at MrExcel

Which adblocker are you using?

Disable AdBlock

Follow these easy steps to disable AdBlock

1)Click on the icon in the browser’s toolbar.
2)Click on the icon in the browser’s toolbar.
2)Click on the "Pause on this site" option.
Go back

Disable AdBlock Plus

Follow these easy steps to disable AdBlock Plus

1)Click on the icon in the browser’s toolbar.
2)Click on the toggle to disable it for "mrexcel.com".
Go back

Disable uBlock Origin

Follow these easy steps to disable uBlock Origin

1)Click on the icon in the browser’s toolbar.
2)Click on the "Power" button.
3)Click on the "Refresh" button.
Go back

Disable uBlock

Follow these easy steps to disable uBlock

1)Click on the icon in the browser’s toolbar.
2)Click on the "Power" button.
3)Click on the "Refresh" button.
Go back
Top