• Valmond@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    6 months ago

    Probably more like the old precision problem. It ecists in C/C++ too and it’s just how fliats and ints work.

      • Blackmist@feddit.uk
        link
        fedilink
        English
        arrow-up
        0
        ·
        edit-2
        6 months ago

        I don’t think that’s how most programmers expect it to work at all.

        However most people would also expect 0.1+0.2==0.3 to return true, so what do I know.

        Floating point is something most of us ignore until it bites us in the ass. And then we never trust it again.

        • thebestaquaman@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          6 months ago

          I have to admit: If you (semi-)regularly use floating point comparisons in programming, I don’t know why you would ever expect 0.1 + 0.2 == 0.3 to return true. It’s common practice to check abs(a - b) < tol, where tol is some small number, to the point that common unit-testing libraries have built-in methods like assertEqual(a, b, tol) specifically for checking whether floats are “equal”.