Sort of a fun one... has this been seen before... ...
# website
j
Sort of a fun one... has this been seen before... On the
launch
page I specified
0.3
and comes out in the resulting JSON file as
0.299999999999999988897769753748434595763683319091796875
😆 1
m
Yes, that has been seen before. Similar like you can’t precisely represent 1/3 in decimal as it would be 0.33333333333….the binary representation of 0.3 decimal is 2^^0.01001100110011001101…. So one needs to have a rounding function in the tool to mitigate.
i
Every programmer learns about IEEE 754 eventually, either the easy or the hard way
😆 1