webpage data scraping excel vba

crazyjk

New Member
Joined
Nov 23, 2017
Messages
1
Hi guys, I am newbie to html and web data scraping using vba. I have no problems getting data from a table on the webpage, but I bumped into two issues. On the webpage, it only shows one page of table data, at the bottom I can click page 2, 3 and NEXT. Using control+U to see the html codes, I can see all information are loaded and neatly organised as tr rows.

I assume ie.document can store all elements, as what I can see using control +U in Chrome. And when I try to retrieve the tr innertext by using getelementByTagName("tr"), vba just skipped all tr elements which is supposed to be on other pages of the table. Pardon me if I dont explain well, and I couldnt paste the link and html codes here as it may contain confidential information. I wonder if someone ever bumped into similar issues, and not much information can be found on Dr google.

Thank you in advance!

Code:
ieDoc = ieApp.Document

For Each HTMLRow In ieDoc.getElementsByTagName("tr")

Debug.print HTMLRow.innertext
 

Excel Facts

Did you know Excel offers Filter by Selection?
Add the AutoFilter icon to the Quick Access Toolbar. Select a cell containing Apple, click AutoFilter, and you will get all rows with Apple

Watch MrExcel Video

Forum statistics

Threads
1,129,557
Messages
5,637,043
Members
416,955
Latest member
Gohar hussain

We've detected that you are using an adblocker.

We have a great community of people providing Excel help here, but the hosting costs are enormous. You can help keep this site running by allowing ads on MrExcel.com.
Allow Ads at MrExcel

Which adblocker are you using?

Disable AdBlock

Follow these easy steps to disable AdBlock

1)Click on the icon in the browser’s toolbar.
2)Click on the icon in the browser’s toolbar.
2)Click on the "Pause on this site" option.
Go back

Disable AdBlock Plus

Follow these easy steps to disable AdBlock Plus

1)Click on the icon in the browser’s toolbar.
2)Click on the toggle to disable it for "mrexcel.com".
Go back

Disable uBlock Origin

Follow these easy steps to disable uBlock Origin

1)Click on the icon in the browser’s toolbar.
2)Click on the "Power" button.
3)Click on the "Refresh" button.
Go back

Disable uBlock

Follow these easy steps to disable uBlock

1)Click on the icon in the browser’s toolbar.
2)Click on the "Power" button.
3)Click on the "Refresh" button.
Go back
Top