Grab Search Results Macro

[gswizzle]

Hello all! I'm trying to grab the search result URLS from this search (motorcycle -sign -vest -camper -scooter -jacket -goggles -kids -helmet -gloves -attorney -repairs -parts -stock -trailer on SearchTempest), and paste them into the A column of my worksheet.

This is what I have so far

Sub UrlGrab()



Dim URL As String
Dim HTMLdoc As Object
Dim Anchor As Object
Dim Anchors As Object




URL = "http://www.searchtempest.com/search?search_string=motorcycle+-sign+-vest+-camper+-scooter+-jacket+-goggles+-kids+-helmet+-gloves+-attorney+-repairs+-parts+-stock+-trailer&category=8&Region=na&cityselect=zip&location=37923&maxDist=1500&region_us=1&srchType=&hasPic=&keytype=adv&minAsk=&maxAsk=&subcat=sss"
    


     Set XMLHTTP = CreateObject("WinHttp.WinHttpRequest.5.1")
     XMLHTTP.Open "GET", URL, False
     XMLHTTP.send
           
     text = XMLHTTP.responseText
     Set HTMLdoc = CreateObject("htmlfile")
            HTMLdoc.Write text
            HTMLdoc.Close
    


  Set Anchors = HTMLdoc.getElementsByTagName("gs-result")
              
            For Each Anchor In Anchors
                If Anchor.className = "gs-title" Then
                    Rng.Offset(row, 0).Value = Anchor.href
                    row = row + 1
                End If
            Next Anchor
  


    MsgBox "Done!"
End Sub

But nothing happens when I execute this, and only the Message Box appears. Any help is appreciated!

 

[John_w]

Probably because "gs-result" isn't a HTML tag; try "A" instead. Or maybe getElementsByName("gs-result"). I haven't looked at the HTML.

Oh. Cross-posted http://www.excelforum.com/excel-programming-vba-macros/1119870-help-grabbing-search-urls.html

Please read and comply with http://www.excelguru.ca/content.php?184

 

[gswizzle]

John,
This is what I've updated my code to:

Sub UrlGrab()





Dim URL As String
Dim HTMLdoc As Object
Dim Anchor As Object
Dim Anchors As Object
Dim XMLHTTP As Object
Dim Text As String
Dim Row As Long
Dim Rng As Range


    


URL = "http://www.searchtempest.com/search?search_string=motorcycle+-sign+-vest+-camper+-scooter+-jacket+-goggles+-kids+-helmet+-gloves+-attorney+-repairs+-parts+-stock+-trailer&category=8&Region=na&cityselect=zip&location=37923&maxDist=1500&region_us=1&srchType=&hasPic=&keytype=adv&minAsk=&maxAsk=&subcat=sss"
    




     Set XMLHTTP = CreateObject("WinHttp.WinHttpRequest.5.1")
     XMLHTTP.Open "GET", URL, False
     XMLHTTP.send
           
     Text = XMLHTTP.responseText
     Set HTMLdoc = CreateObject("htmlfile")
            HTMLdoc.Write Text
            HTMLdoc.Close
    




  Set Anchors = HTMLdoc.getElementsByTagName("A")
              
            For Each Anchor In Anchors
                If Anchor.className = "gs-title" Then
                    Rng.Offset(Row, 0).Value = Anchor.href
                    Row = Row + 1
                End If
            Next Anchor
  




    MsgBox "Done!"
End Sub

And still nothing appears. Am I still calling getElementsByTagName incorrectly?

Thanks!