Jump to content

Tried to get For loop granularity, ended up with recurring floaters.


Morthawt
 Share

Recommended Posts

I am formulating some ingredients for an in sect repellent and I am looking for results where by each component ingredient has no more than 2 decimal places. I have that done but instead of going up 1 gram at a time I decided to try and go up a 10th of a gram at a time, here's a simple count:

For $a = 0 To 100 Step 0.1
    ConsoleWrite($a & @CRLF)
Next

What I get instead is by the time it reaches 6.9, it should go to 7 but it goes:

5.99999999999999
6.09999999999999
6.19999999999999
6.29999999999999

I cannot make sense of it. I know once my loop gets to 100 gram area it always is a match but this for loop never yielded any results for me. Only when I added a consolewrite for the loop variable counter did I see this weirdness above.

Does anyone know what is going on?

Link to comment
Share on other sites

  • Moderators

Morthawt,

Google "floating point arithmetic" - or search the forum as this has been discussed before many, many times.

Simple solution - make all of the loops increase in integers and do some division inside the calulations.

M23

Public_Domain.png.2d871819fcb9957cf44f4514551a2935.png Any of my own code posted anywhere on the forum is available for use by others without any restriction of any kind

Open spoiler to see my UDFs:

Spoiler

ArrayMultiColSort ---- Sort arrays on multiple columns
ChooseFileFolder ---- Single and multiple selections from specified path treeview listing
Date_Time_Convert -- Easily convert date/time formats, including the language used
ExtMsgBox --------- A highly customisable replacement for MsgBox
GUIExtender -------- Extend and retract multiple sections within a GUI
GUIFrame ---------- Subdivide GUIs into many adjustable frames
GUIListViewEx ------- Insert, delete, move, drag, sort, edit and colour ListView items
GUITreeViewEx ------ Check/clear parent and child checkboxes in a TreeView
Marquee ----------- Scrolling tickertape GUIs
NoFocusLines ------- Remove the dotted focus lines from buttons, sliders, radios and checkboxes
Notify ------------- Small notifications on the edge of the display
Scrollbars ----------Automatically sized scrollbars with a single command
StringSize ---------- Automatically size controls to fit text
Toast -------------- Small GUIs which pop out of the notification area

 

Link to comment
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
 Share

  • Recently Browsing   0 members

    • No registered users viewing this page.
×
×
  • Create New...