Math in Hex() function

[Kerros]

I ran into a strange issue today while updating one of my scripts. When I tried to do some simple division on a variable and then convert it to hex, I do not get the expected value returned.

An example:

$Size = 128*2
ConsoleWrite('128*2 = '&$Size&@CRLF)
ConsoleWrite('Hex() returns: '&hex($Size)&@CRLF)

$Size = 256
ConsoleWrite('256 = '&$Size&@CRLF)
ConsoleWrite('Hex() returns: '&hex($Size)&@CRLF)
$Size = 512/2
ConsoleWrite('512/2 = '&$Size&@CRLF)
ConsoleWrite('Hex() returns: '&hex($Size)&@CRLF)

Returns

128*2 = 256
Hex() returns: 00000100
256 = 256
Hex() returns: 00000100
512/2 = 256
Hex() returns: 4070000000000000

I am running version: 3.3.8.1

While I can work around this issue in the script, I would like to understand better what is going on.

Thank you,

Kerros

[JohnOne]

There have been changes to Hex()

It internally detects doubles, So my guess would be that the result of a division will be classed as a double.

Edited May 16, 2012 by JohnOne

[Kerros]

Thanks John that was the insight that I was needing. While I'm doing error checking earlier in the script to verify that the value is an int as I expect. I was not doing so right before sending to the hex function.

I tried doing the hex function on a double to verify your thought and I did get the expected result

ConsoleWrite('Hex on a double: '&hex(52.5)&@CRLF)
Output:
Hex on a double: 404A400000000000

Posting an example of the solution

$Size = Int(512/2)
ConsoleWrite('512/2 = '&$Size&@CRLF)
ConsoleWrite('Hex() returns: '&hex($Size)&@CRLF)

Output

Int(512/2) = 256
Hex() returns: 00000100

Kerros