I need some opinions on precision of calculation

Dan Wilson

Active Member
Joined
Feb 5, 2006
Messages
448
Office Version
  1. 365
Platform
  1. Windows
Good day. I am using Excel 2003 on Win XP Pro. This issue may take some time to detail, so please read on.

Over the last five years I have labored to create workbooks that will track, resolve and report the activities of the cash register in my business. In that time I have encountered many problems regarding the issue of floating point arithmetic. I have resolved most of the issues by using the ROUND function and lately, have been using FORMAT to show negative numbers in RED.

In perusing through the OPTIONS, I stumbled across a flag called Precision as Displayed. This looks like it might help my issue a LOT!

All of the calculations that I use in my workbooks all relate to money, thus no decimal calculation beyond 2 points is needed.

Please reply with your opinions about the pros and cons of setting the Precison as Displayed flag. My workbooks are reaching the point of being extremely large due to the number of calculations being done on the data.

Thanks in advance, Danno...
 

Excel Facts

Format cells as currency
Select range and press Ctrl+Shift+4 to format cells as currency. (Shift 4 is the $ sign).

xapie128

Board Regular
Joined
Aug 26, 2006
Messages
82
Precision as Displayed will work if you format all cells to .00, otherwise it will still use 15 decimal point precision even if you only enter two digits after the decimal point.
 

Dan Wilson

Active Member
Joined
Feb 5, 2006
Messages
448
Office Version
  1. 365
Platform
  1. Windows
Precision display

Good day xapie. Thank you for the quick response. I was hoping for a little more detail. Some of the columns on my worksheet are formatted to Number with 0 decimal points. Will this be affected? If I set the flag in the Options, will all of my worksheets be affected or just the one that is open? I have other workbooks that rely on 3 decimal points for accuracy.

Thanks, Danno...
 

xapie128

Board Regular
Joined
Aug 26, 2006
Messages
82
0 (zero) will work too.
The help for Excel says of that setting: "Permanently changes stored values in cells from full precision (15 digits) to whatever format, including decimal places, is displayed."
 

Forum statistics

Threads
1,137,206
Messages
5,680,191
Members
419,887
Latest member
Vasokir

We've detected that you are using an adblocker.

We have a great community of people providing Excel help here, but the hosting costs are enormous. You can help keep this site running by allowing ads on MrExcel.com.
Allow Ads at MrExcel

Which adblocker are you using?

Disable AdBlock

Follow these easy steps to disable AdBlock

1)Click on the icon in the browser’s toolbar.
2)Click on the icon in the browser’s toolbar.
2)Click on the "Pause on this site" option.
Go back

Disable AdBlock Plus

Follow these easy steps to disable AdBlock Plus

1)Click on the icon in the browser’s toolbar.
2)Click on the toggle to disable it for "mrexcel.com".
Go back

Disable uBlock Origin

Follow these easy steps to disable uBlock Origin

1)Click on the icon in the browser’s toolbar.
2)Click on the "Power" button.
3)Click on the "Refresh" button.
Go back

Disable uBlock

Follow these easy steps to disable uBlock

1)Click on the icon in the browser’s toolbar.
2)Click on the "Power" button.
3)Click on the "Refresh" button.
Go back
Top