Jump to content

Recommended Posts

Posted

I have some numbers like below and the final $temp amount should be 450 exact but the calculation ended up with 450.00000000001..

i have no idea what's going wrong ?

$p = 4592.05
$1 = 679.41
$2 = 661.31
$3 = 660.04
$4 = 648.06
$5 = 963.85
$6 = 529.38

$childsum = 0

$childsum += $1
msgbox(0,"",$childsum)
$childsum += $2
msgbox(0,"",$childsum)
$childsum += $3
msgbox(0,"",$childsum)
$childsum += $4
msgbox(0,"",$childsum)
$childsum += $5
msgbox(0,"",$childsum)
$childsum += $6
msgbox(0,"",$childsum)

$temp = $p -$childsum
msgbox(0,"",$temp)
  • Moderators
Posted

chun914,

As all the amounts have 2 decimal places I would convert all of them to integers (i.e. multiply them by 100) so that I could use integer arithmetic to sum them. Then I would divide by 100 and use Round when I wanted the total back in 2 decimal place format. ;)

M23

Public_Domain.png.2d871819fcb9957cf44f4514551a2935.png Any of my own code posted anywhere on the forum is available for use by others without any restriction of any kind

Open spoiler to see my UDFs:

  Reveal hidden contents

 

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
  • Recently Browsing   0 members

    • No registered users viewing this page.
×
×
  • Create New...