Scrape from webpages without table and classes

[Bruzio]

Hi to everyone, surfing I found this website BsportsFan It has some interesting data.
The landing pages haven't tables or classes so I wasn't able to get that data. A few months ago @smozgur who I greet, made a vba code for me, I'm still using that sheet, maybe also using this website.
Inspecting the site I found this info:

The destination url is https://app.bsportsfan.com/events/inplay, by clicking on an event i found:

The destination url is https://app.bsportsfan.com/event/odds?id=3225440.
By changing the id I can find all the data for each event.

My goal is to have this data in a sheet.
I would like to know what tools I need to use.
I apologize if mine are trivial requests.

Thank you for your attention and have a nice day

 

[John_w]

The delimiters are different too, comma or dash or slash.
When there's the delimiter I would need to have the average of the two values, I tried with Average(Split.... with no success.

oddsTypes = Split("home_od,draw_od,away_od,home_od,handicap,away_od,over_od,handicap,under_od", ",")

Is this the string to edit?

No, oddsTypes is the list of JSON field names for the different types of odds which are extracted.

Try something like this to calculate the average when there are 2 values. I've done it for the comma and slash separators. I don't know about the dash separator - how would you distinguish it from "-" for negative values?

Replace:

                                        If Not IsEmpty(odds(company)(times(i))(divs(j))) Then
                                            .Cells(r, c + i * 9 + j * 3 + k).Value = odds(company)(times(i))(divs(j))(oddsTypes(k + j * 3))
                                        End If

with:

                                        If Not IsEmpty(odds(company)(times(i))(divs(j))) Then
                                            Dim oddsString As String, parts As Variant
                                            oddsString = odds(company)(times(i))(divs(j))(oddsTypes(k + j * 3))
                                            parts = Split(oddsString, ",")
                                            If UBound(parts) = 0 Then parts = Split(oddsString, "/")
                                            If UBound(parts) = 0 Then
                                                .Cells(r, c + i * 9 + j * 3 + k).Value = oddsString
                                            Else
                                                .Cells(r, c + i * 9 + j * 3 + k).Value = (CSng(parts(0)) + CSng(parts(1))) / 2  'average
                                            End If
                                        End If
                                    End If

 

[Bruzio]

I don't know about the dash separator - how would you distinguish it from "-" for negative values?

Yes, I think isn't possible to distinguish, no problem for this.

The code works but the average not, for example:

+2/2.5 = 2.25 instead it returns 13,5

Qatar U23 League

Al Khor U23

Al Gharafa U23

0-0

11

12,50

7,40

1,11

1,98

13,5

1,86

1,82

3,5

2,00

 

[John_w]

Which company is this?

 

[Bruzio]

Which company is this?

188Bet with "/" as separator.

I tried with Bet365, it returns 22.5, with "," as separator

 

[John_w]

What is the match id?

 

[Bruzio]

It was 3271080.

https://app.bsportsfan.com/event/odds?id=3271080

 

[John_w]

I can't reproduce. +2/2.5 calculates as 2.25 for me. Time to do some debugging for yourself.

I use this to put the raw odds and calculated value in the cell:

                                                .Cells(r, c + i * 9 + j * 3 + k).Value = oddsString & " = " & (CSng(parts(0)) + CSng(parts(1))) / 2 'average

 

[Bruzio]

Hi, I'm trying right now

Nepal B Division

Ranipokhari Corner Team

Naya Basti Yuwa Club

2-2

72

3,1

3,4

2

1,975

0.0,+0.5 = 2,5

id 3277454
company Bet365

Maybe there are problems with decimals because it should be 0.25

Australia W-League

Western Sydney Wanderers Women

Melbourne City Women

0

3,5

4,2

1,666

1,825

+0.5,+1.0 = 7,5

Here it should be 0,75

I tried with

.Cells(r, c + i * 9 + j * 3 + K).Value = oddsString & " = " & ((CSng(parts(0)) + CSng(parts(1))) / 2) / 10

It works but is an illogical calculation

Nepal B Division

Ranipokhari Corner Team

Naya Basti Yuwa Club

2-2

83

3,1

3,4

2

1,975

0.0,+0.5 = 0,25

1,825

Australia W-League

Western Sydney Wanderers Women

Melbourne City Women

0-0

10

3,5

4,2

1,666

1,825

+0.5,+1.0 = 0,75

1,975

 

[Bruzio]

.Cells(r, c + i * 9 + j * 3 + K).Value = oddsString & " = " & ((CSng(parts(0)) + CSng(parts(1))) / 20)

It works too

Australia W-League

Western Sydney Wanderers Women

Melbourne City Women

0-0

18

3,5

4,2

1,666

1,825

+0.5,+1.0 = 0,75

1,975

Here with 188Bet so with "/"

Australia W-League

Western Sydney Wanderers Women

Melbourne City Women

0-0

20

3,45

3,75

1,77

1,85

+0.5/1 = 0,3

1,99

 

[Bruzio]

Hi @John_w, for a other method I'm using

For r = 4 To 10  '.Cells(.Rows.Count, "A").End(xlUp).Row  'test on id rows 4-10
      
            id = .Cells(r, "A").Value

The IDs come from formulas and I have this result:

1996563	Israel Liga Bet North	Tzeirei Kfar Kanna	Hapoel Ironi Karmiel	1	0	16
1996453	International Match	United Arab Emirates	India	2	0	45				1.39	4.00	7.40	2.02	1.25	1.90	1.90	2.25	2.00
1996448	U21 International	Ukraine U21	Slovakia U21	0	0	46				2.38	3.05	2.67	1.81	0	2.03	1.84	2.5	1.98
1996447	U21 International	North Macedonia U21	Bulgaria U21	2	1	55				3.05	3.25	2.08	2.04	-0.25	1.80	1.89	2.75	1.93
										3.05	3.25	2.08	2.04	-0.25	1.80	1.89	2.75	1.93
										3.05	3.25	2.08	2.04	-0.25	1.80	1.89	2.75	1.93
										3.05	3.25	2.08	2.04	-0.25	1.80	1.89	2.75	1.93
										3.05	3.25	2.08	2.04	-0.25	1.80	1.89	2.75	1.93
										3.05	3.25	2.08	2.04	-0.25	1.80	1.89	2.75	1.93
										3.05	3.25	2.08	2.04	-0.25	1.80	1.89	2.75	1.93
										3.05	3.25	2.08	2.04	-0.25	1.80	1.89	2.75	1.93
										3.05	3.25	2.08	2.04	-0.25	1.80	1.89	2.75	1.93
										3.05	3.25	2.08	2.04	-0.25	1.80	1.89	2.75	1.93
										3.05	3.25	2.08	2.04	-0.25	1.80	1.89	2.75	1.93

How can I fix it?

Thanks