A very simple minus calculation based on same values but show difference?

[agasi]

When I compare a,b I get "True". But when I subtract a-b although it shows 0.00 if I increase decimals, it is not 0.00. Does anyone know why it shows the difference?​ a: 145.454545454545000000000000 b: 145.454545454545000000000000 Result: -0.000000000000426325641456 <tbody> </tbody><colgroup><col></colgroup> <tbody> </tbody><colgroup><col></colgroup>

<tbody>
</tbody><colgroup><col></colgroup>

 

[AliGW]

Are the values in A and B derived from formulae? If so, do you have the ROUND function applied?

 

[agasi]

They are derived from formula but no Round used.

 

[AliGW]

What are the formulae? And what are the values used in the formulae? Are any of those rounded?

 

[Tetra201]

When I compare a,b I get "True". But when I subtract a-b although it shows 0.00 if I increase decimals, it is not 0.00. Does anyone know why it shows the difference?​ a: 145.454545454545000000000000 b: 145.454545454545000000000000 Result: -0.000000000000426325641456 <tbody> </tbody> <tbody> </tbody>

<tbody>
</tbody>

In simple terms, this is the result of conversion of computer-readable binary numbers into human-readable decimals.

 

[agasi]

a: sum of the below (all hardcoded)

0.00000000000

29.54545454545

0.00000000000

115.90909090909

0.00000000000 b: (sum of A/325)*325 sum of A / 325.0000000000000000 * 325.0000000000000000 <tbody> </tbody><colgroup><col></colgroup>

<tbody>
</tbody><colgroup><col></colgroup>

 

[agasi]

Tetra, thanks. But is there any other way apart from using Round? It should be zero to match the look up criteria (zero).

 

[Tetra201]

There might be, but using ROUND(...,n) is the easiest way. You should always use it when comparing non-hardcoded floating-point numbers.

 

[agasi]

Tetra201, okay. Thanks.

 

[Tetra201]

You are welcome.