Sign in to follow this  
Followers 0
zeropointone

0.0999999999999996

7 posts in this topic

$Variable = 4.1
$Variable -= 4
MsgBox(0, "", $Variable)
 

When I run the above code, I see the number 0.0999999999999996.  I'm running the lastest version of autoit.

What am I doing wrong?

Or, if it's a bug, is there a workaround?

Share this post


Link to post
Share on other sites



#2 ·  Posted (edited)

Hmm. Try this..

$Variable = 4.1
$Variable -= 4
MsgBox(0, "", Ceiling($Variable))
Edited by somdcomputerguy

- Bruce /*somdcomputerguy */  If you change the way you look at things, the things you look at change.

Share this post


Link to post
Share on other sites

#3 ·  Posted (edited)

zeropointone,

It is not a bug - at least not in Autoit as it affects all computers. Google "floating point arithmetic" and you will learn more than you wish or need to know. ;)

M23

Edit: Welcome to the forum, by the way. :)

Edited by Melba23
1 person likes this

Any of my own code posted anywhere on the forum is available for use by others without any restriction of any kind._______My UDFs:

Spoiler

ArrayMultiColSort ---- Sort arrays on multiple columns
ChooseFileFolder ---- Single and multiple selections from specified path treeview listing
Date_Time_Convert -- Easily convert date/time formats, including the language used
ExtMsgBox --------- A highly customisable replacement for MsgBox
GUIExtender -------- Extend and retract multiple sections within a GUI
GUIFrame ---------- Subdivide GUIs into many adjustable frames
GUIListViewEx ------- Insert, delete, move, drag, sort, edit and colour ListView items
GUITreeViewEx ------ Check/clear parent and child checkboxes in a TreeView
Marquee ----------- Scrolling tickertape GUIs
NoFocusLines ------- Remove the dotted focus lines from buttons, sliders, radios and checkboxes
Notify ------------- Small notifications on the edge of the display
Scrollbars ----------Automatically sized scrollbars with a single command
StringSize ---------- Automatically size controls to fit text
Toast -------------- Small GUIs which pop out of the notification area

 

Share this post


Link to post
Share on other sites

Oh, that makes sense.  I just ran the equivalent code with a float in C++, and sure enough the same thing happened!

The solution I'm using is:

$Variable = 4.1
$Variable -= 4
$Variable = Round($Variable, 1)

somdcomputerguy - Ceiling() is no good in this case, as it returns a whole number.

Thanks for the help!

Share this post


Link to post
Share on other sites

somdcomputerguy - Ceiling() is no good in this case, as it returns a whole number.

Oops..

$Variable = 4.1
$Variable -= 4
MsgBox(0, "", "." & Ceiling($Variable))

:muttley:


- Bruce /*somdcomputerguy */  If you change the way you look at things, the things you look at change.

Share this post


Link to post
Share on other sites

Ceiling is still not the right function to use. It is returning the whole number 1, not .1; just because a period is placed in front of it doesn't mean it returns what it should.


√-1 2^3 ∑ π, and it was delicious!

Share this post


Link to post
Share on other sites

.. just because a period is placed in front of it doesn't mean it returns what it should.

I realize that, I was just being sortof a smartass.. :)


- Bruce /*somdcomputerguy */  If you change the way you look at things, the things you look at change.

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!


Register a new account

Sign in

Already have an account? Sign in here.


Sign In Now
Sign in to follow this  
Followers 0