dgm5555 Posted November 3, 2012 Posted November 3, 2012 (edited) Am I doing/expecting something wrong? Hex division is producing incorrect values Running from SciTE - AutoIt3Wrapper v.2.1.0.33 (oops: autoit version is 3.3.8.1255) ConsoleWrite(0xFF0000/0xFFFF & @CRLF) ; expect 0xFF or 255 ; actual output is 255.003891050584 = INCORRECT[/autoit] (ignore the bitshift bit of the title, I figured that out) Thanks to anyone who can help David Edited November 3, 2012 by dgm5555
trancexx Posted November 3, 2012 Posted November 3, 2012 Dividing any two numbers results in double precision number type. If you want integer then use function Int() on your result. ♡♡♡ . eMyvnE
water Posted November 3, 2012 Posted November 3, 2012 We don't need the version of the SciTE editor but the AutoIt version. Run MsgBox(0, "", "AutoIt version: " & @AutoItVersion) My UDFs and Tutorials: Spoiler UDFs: Active Directory (NEW 2024-07-28 - Version 1.6.3.0) - Download - General Help & Support - Example Scripts - Wiki ExcelChart (2017-07-21 - Version 0.4.0.1) - Download - General Help & Support - Example Scripts OutlookEX (2021-11-16 - Version 1.7.0.0) - Download - General Help & Support - Example Scripts - Wiki OutlookEX_GUI (2021-04-13 - Version 1.4.0.0) - Download Outlook Tools (2019-07-22 - Version 0.6.0.0) - Download - General Help & Support - Wiki PowerPoint (2021-08-31 - Version 1.5.0.0) - Download - General Help & Support - Example Scripts - Wiki Task Scheduler (2022-07-28 - Version 1.6.0.1) - Download - General Help & Support - Wiki Standard UDFs: Excel - Example Scripts - Wiki Word - Wiki Tutorials: ADO - Wiki WebDriver - Wiki
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now