I need some opinions on precision of calculation

Dan Wilson

Well-known Member
Joined
Feb 5, 2006
Messages
507
Office Version
  1. 365
Platform
  1. Windows
Good day. I am using Excel 2003 on Win XP Pro. This issue may take some time to detail, so please read on.

Over the last five years I have labored to create workbooks that will track, resolve and report the activities of the cash register in my business. In that time I have encountered many problems regarding the issue of floating point arithmetic. I have resolved most of the issues by using the ROUND function and lately, have been using FORMAT to show negative numbers in RED.

In perusing through the OPTIONS, I stumbled across a flag called Precision as Displayed. This looks like it might help my issue a LOT!

All of the calculations that I use in my workbooks all relate to money, thus no decimal calculation beyond 2 points is needed.

Please reply with your opinions about the pros and cons of setting the Precison as Displayed flag. My workbooks are reaching the point of being extremely large due to the number of calculations being done on the data.

Thanks in advance, Danno...
 

Excel Facts

Spell Check in Excel
Press F7 to start spell check in Excel. Be careful, by default, Excel does not check Capitalized Werds (whoops)
Precision as Displayed will work if you format all cells to .00, otherwise it will still use 15 decimal point precision even if you only enter two digits after the decimal point.
 
Upvote 0
Precision display

Good day xapie. Thank you for the quick response. I was hoping for a little more detail. Some of the columns on my worksheet are formatted to Number with 0 decimal points. Will this be affected? If I set the flag in the Options, will all of my worksheets be affected or just the one that is open? I have other workbooks that rely on 3 decimal points for accuracy.

Thanks, Danno...
 
Upvote 0
0 (zero) will work too.
The help for Excel says of that setting: "Permanently changes stored values in cells from full precision (15 digits) to whatever format, including decimal places, is displayed."
 
Upvote 0

Forum statistics

Threads
1,215,766
Messages
6,126,758
Members
449,336
Latest member
p17tootie

We've detected that you are using an adblocker.

We have a great community of people providing Excel help here, but the hosting costs are enormous. You can help keep this site running by allowing ads on MrExcel.com.
Allow Ads at MrExcel

Which adblocker are you using?

Disable AdBlock

Follow these easy steps to disable AdBlock

1)Click on the icon in the browser’s toolbar.
2)Click on the icon in the browser’s toolbar.
2)Click on the "Pause on this site" option.
Go back

Disable AdBlock Plus

Follow these easy steps to disable AdBlock Plus

1)Click on the icon in the browser’s toolbar.
2)Click on the toggle to disable it for "mrexcel.com".
Go back

Disable uBlock Origin

Follow these easy steps to disable uBlock Origin

1)Click on the icon in the browser’s toolbar.
2)Click on the "Power" button.
3)Click on the "Refresh" button.
Go back

Disable uBlock

Follow these easy steps to disable uBlock

1)Click on the icon in the browser’s toolbar.
2)Click on the "Power" button.
3)Click on the "Refresh" button.
Go back
Back
Top