1.003 * 1000 = 1002.99999989

[luciffer 0]

First i don't know if this is something that you already know. But eater i have some error in coding or AutoIT wasn't designed to do this way.

Its a simple function that calculates four digits in decimal number, eg. 1.256 returns 1256, at least what it suppose to do.

But when i run the code below instead of numbers 1003 i get 1002. It turned out that when 1.003 gets multiplied with 1000 it becomes 1002.99999999989 instead of 1003.

So is this normal because of float number representation in PC or something else I'm not aware of?

Func Temperature($T)
Local $C0, $C1, $C2, $C3
$T = $T *1000
$C0 = Int($T / 1000)
$C1 = Int(($T - ($C0 * 1000)) / 100)
$C2 = Int(($T - ($C0 * 1000) - ($C1 *100))/10)
$C3 = Int($T - ($C0 * 1000) - ($C1 *100) - ($C2 *10))
ToolTip($C0 & $C1 & $C2 & $C3,500,0)
Sleep(3000)
EndFunc

Temperature(1.003)

[water 2,365]

That's a problem with the internal representation of decimal numbers as binary. There has been a lengthy discussion about this lately. I will post the link as soon as I find it.

Edit: Here is the

Edited October 1, 2012 by water

[bogQ 91]

from help file

Example

Local $var = Int(10.793) ;$var is the integer 10

so why are you using Int? shudnt you use

$C3 = Round($somedata, 0) ?!

Edited October 1, 2012 by bogQ