Jump to content

Recommended Posts

Posted

I am formulating some ingredients for an in sect repellent and I am looking for results where by each component ingredient has no more than 2 decimal places. I have that done but instead of going up 1 gram at a time I decided to try and go up a 10th of a gram at a time, here's a simple count:

For $a = 0 To 100 Step 0.1
    ConsoleWrite($a & @CRLF)
Next

What I get instead is by the time it reaches 6.9, it should go to 7 but it goes:

5.99999999999999
6.09999999999999
6.19999999999999
6.29999999999999

I cannot make sense of it. I know once my loop gets to 100 gram area it always is a match but this for loop never yielded any results for me. Only when I added a consolewrite for the loop variable counter did I see this weirdness above.

Does anyone know what is going on?

  • Moderators
Posted

Morthawt,

Google "floating point arithmetic" - or search the forum as this has been discussed before many, many times.

Simple solution - make all of the loops increase in integers and do some division inside the calulations.

M23

Public_Domain.png.2d871819fcb9957cf44f4514551a2935.png Any of my own code posted anywhere on the forum is available for use by others without any restriction of any kind

Open spoiler to see my UDFs:

  Reveal hidden contents

 

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
  • Recently Browsing   0 members

    • No registered users viewing this page.
×
×
  • Create New...