At the moment I'm using VBA to create a list of URLs as a collection and then loop through them and scrape some basic info. It all works fine but takes ~3 seconds per URL. Sometimes I have 50+ urls to go through so it takes longer than ideal.
I use a for each loop as below where ScrapeWebsite is a sub which loads a url and retrieves the required info.
For Each url In URLList
ScrapeWebsite(url)
Next url
Is there any easy(ish) way to run all (or a portion) of the urls at the same time to save time? I've looked up a bit about swarms but it seems a little complicated for me...
I use a for each loop as below where ScrapeWebsite is a sub which loads a url and retrieves the required info.
For Each url In URLList
ScrapeWebsite(url)
Next url
Is there any easy(ish) way to run all (or a portion) of the urls at the same time to save time? I've looked up a bit about swarms but it seems a little complicated for me...