Jump to content

Rounding Save Computing Power?

Recommended Posts

  • Moderators


Given that a floating point number takes the same amount of space in memory regardless of its actual value I would imagine the answer is "No", but I am quite ready to be proved wrong.


Edit: Love the Dilbert!

Edited by Melba23

Public_Domain.png.2d871819fcb9957cf44f4514551a2935.png Any of my own code posted anywhere on the forum is available for use by others without any restriction of any kind

Open spoiler to see my UDFs:


ArrayMultiColSort ---- Sort arrays on multiple columns
ChooseFileFolder ---- Single and multiple selections from specified path treeview listing
Date_Time_Convert -- Easily convert date/time formats, including the language used
ExtMsgBox --------- A highly customisable replacement for MsgBox
GUIExtender -------- Extend and retract multiple sections within a GUI
GUIFrame ---------- Subdivide GUIs into many adjustable frames
GUIListViewEx ------- Insert, delete, move, drag, sort, edit and colour ListView items
GUITreeViewEx ------ Check/clear parent and child checkboxes in a TreeView
Marquee ----------- Scrolling tickertape GUIs
NoFocusLines ------- Remove the dotted focus lines from buttons, sliders, radios and checkboxes
Notify ------------- Small notifications on the edge of the display
Scrollbars ----------Automatically sized scrollbars with a single command
StringSize ---------- Automatically size controls to fit text
Toast -------------- Small GUIs which pop out of the notification area


Link to post
Share on other sites

It would be very simple to test by running 2 timed runs, with a subset of the data, one with rounded floats and one without.

Let's assume that it did make a difference, which I don't think it does for the reason stated above, the answer to your question would still be relevant to your data set and the logic used to process it.  That's because you would have to offset the amount of "computing power" saved by rounding the floats with the amount of "computer power" used to round the floats to know for sure.  So, assuming again that it made a difference, no one would be able to accurately answer the question without testing it on your data using your processing logic.

Edited by TheXman
Link to post
Share on other sites
4 hours ago, Dana86 said:

Does anyone know if computing power is reduced when rounding floats into smaller decimal places? 

Depends how much you round, and how much processing is involved.

For instance, if you can round to integers and the interim processing doesn’t create more fp numbers, then very possibly.

To know for sure, we need an example of the processing and the tolerable precision loss involved.


Code hard, but don’t hard code...

Link to post
Share on other sites

your rounding adds compute time so probably uses more power if anything. but for all intents and purposes I don't think it amounts to anything significant

Edited by Earthshine

My resources are limited. You must ask the right questions


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
  • Recently Browsing   0 members

    No registered users viewing this page.

  • Create New...