XMLHTTP problems

[L_P]

I'm trying to extract data from some webpages. I'm pulling in the html with an XMLHTTP object and extracting the desired information with Regex.

The following code works fine for vanilla ".html" pages:

    Dim pageHTML As String
    Dim oXMLHTTP As Object
    Set oXMLHTTP = CreateObject("MSXML2.XMLHTTP.6.0")
    :
    :
    oXMLHTTP.Open "GET", urlString, False
    oXMLHTTP.send ""
            
    If oXMLHTTP.Status <> 200 Then
        errorStr = oXMLHTTP.statusText
        GoTo HandleError
    Else
        htmlStr= oXMLHTTP.responseText
    End If

In that case, I get the full html code into htmlStr, whence I can extract the desired info.

BUT
​

When I try it on other sorts of pages, such as .asp and .php, all I get in oXMLHTTP.responseText is a "html" tag.

I'm trying to parse simple pages - ones that take no variables or parameters. E.g.: http://www.quoteland.com/random.asp . I just want to get back the html code that shows up as the page source in my browser when I surf to such sites.


After several hours of searching the web, all I've been able to come up with is that maybe I need to do something with setRequestHeader. Or maybe I need some sort of "POST" rather than "GET". Or something.

Nowhere have I been able to find a simple explanation of the XMLHTTP functionality, nor instructions on how I need to configure the object in order to get the HTML code generated by .asp, .php, and similarly flavored URLs.



Um.... HELP?!!!


Thanks,
LP

 

[excel-yes]

"Nowhere have I been able to find a simple explanation of the XMLHTTP functionality"

Tell me about it!!! I found out about it a couple of days ago and the only thing online I can find are "this is how to go to a page and get the results" ??? I don't think hardly any of the experts even know how to use xmlhttp in vba. Frustrating!