Automatically extract div labels from link

[AmazingTrans]

Hi there excel gurus!

I have this website link for example on cell A1, eg: "Part number", and would like a method to extract the part description from the website to another cell. (I'm willing to use selenium etc).
Could someone guide me how i can do this?

 

[John_w]

Try this macro as a starting point. The site works with IE, so we can use IE automation and the built-in HTML library. Therefore, you must set references to MS Internet Explorer and MS HTML Object library, via Tools -> References in the VBA editor.

Public Sub IE_Get_Data()

    Dim IE As InternetExplorer
    Dim HTMLdoc As HTMLDocument
    Dim table As HTMLTable
    Dim tCell As HTMLTableCell
            
    Set IE = New InternetExplorer
    With IE
        .navigate "https://mall.industry.siemens.com/mall/en/us/Catalog/Search?searchTerm=6ES71316BF000CA0&tab=Product"
        .Visible = True
        While .Busy Or .readyState <> READYSTATE_COMPLETE: DoEvents: Wend
        Set HTMLdoc = .document
    End With
    
    Do
        Set table = HTMLdoc.getElementById("ProductGrid")
        DoEvents
    Loop While table Is Nothing
    For Each tCell In table.getElementsByClassName("ProductName")
        Debug.Print tCell.Children(1).innerText
    Next

End Sub

The URL returns 2 products and the macro extracts both product descriptions.

 

[AmazingTrans]

Try this macro as a starting point. The site works with IE, so we can use IE automation and the built-in HTML library. Therefore, you must set references to MS Internet Explorer and MS HTML Object library, via Tools -> References in the VBA editor.

Public Sub IE_Get_Data()

    Dim IE As InternetExplorer
    Dim HTMLdoc As HTMLDocument
    Dim table As HTMLTable
    Dim tCell As HTMLTableCell
           
    Set IE = New InternetExplorer
    With IE
        .navigate "https://mall.industry.siemens.com/mall/en/us/Catalog/Search?searchTerm=6ES71316BF000CA0&tab=Product"
        .Visible = True
        While .Busy Or .readyState <> READYSTATE_COMPLETE: DoEvents: Wend
        Set HTMLdoc = .document
    End With
   
    Do
        Set table = HTMLdoc.getElementById("ProductGrid")
        DoEvents
    Loop While table Is Nothing
    For Each tCell In table.getElementsByClassName("ProductName")
        Debug.Print tCell.Children(1).innerText
    Next

End Sub

The URL returns 2 products and the macro extracts both product descriptions.

Hi John, it works great. I appreciate it!
I have another cell i would like to get, how do i get this price here given that id ?

 

[John_w]

Maybe table.getElementById("ListPriceDiv_0").innerText. If there are multiple products I guess you would need to construct the id string in a loop ("ListPriceDiv_" & n), where n is the loop variable, starting at zero until an element with that id doesn't exist.