• Valmond@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      4 months ago

      Probably more like the old precision problem. It ecists in C/C++ too and it’s just how fliats and ints work.

        • Blackmist@feddit.uk
          link
          fedilink
          English
          arrow-up
          0
          ·
          edit-2
          4 months ago

          I don’t think that’s how most programmers expect it to work at all.

          However most people would also expect 0.1+0.2==0.3 to return true, so what do I know.

          Floating point is something most of us ignore until it bites us in the ass. And then we never trust it again.

          • thebestaquaman@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            4 months ago

            I have to admit: If you (semi-)regularly use floating point comparisons in programming, I don’t know why you would ever expect 0.1 + 0.2 == 0.3 to return true. It’s common practice to check abs(a - b) < tol, where tol is some small number, to the point that common unit-testing libraries have built-in methods like assertEqual(a, b, tol) specifically for checking whether floats are “equal”.