Article ID: 111781
Article Last Modified on 1/18/2007
APPLIES TO
- Microsoft Access 1.0 Standard Edition
- Microsoft Access 1.1 Standard Edition
- Microsoft Access 2.0 Standard Edition
- Microsoft Access 95 Standard Edition
- Microsoft Access 97 Standard Edition
This article was previously published under Q111781
SYMPTOMS
Novice: Requires knowledge of the user interface on single-user computers.
When you calculate using floating-point numbers, the result is not always what you expect. For example, if you use the CInt() (convert to integer) function in the calculation
CInt(3.555 * 100)
you receive 356 as the result, as you expect. However, the calculation
CInt(4.555 * 100)
results in 455 instead of 456.
You may also see this behavior when type a number, and then move to another field or save the record. For example, you may type the number:
6,498,496.40
when you save the record the number may change to:
6,498,496.50
CAUSE
Errors similar to the example above occur in any programming language that uses floating-point numbers. This is because decimal fractions do not always have exact binary equivalents, which can result in rounding errors.
RESOLUTION
There are several methods you can use to avoid rounding errors when you are using floating-point numbers:
- If you are using Single numbers, convert them to Doubles and use formatting to hide the extra digits. If there are any rounding errors, they will occur at the end of the numbers where they will not affect the visible data.
Use the Currency data type. If you use currency values of four decimal places or less, rounding errors will not occur because these values are actually scaled integers rather than floating-point numbers. In code, use the at sign (@) character to use a Currency data type. For example, the calculation
CInt(4.555@ * 100)results in a value of 456.
Break the calculation into two or more steps. When you list a calculation in one long line, Visual Basic (in version 7.0) or Access Basic (in earlier versions) stores the intermediate values internally. For example, in the calculation
CInt(4.555 * 100)the value 455.5 is temporarily stored and used in the CInt() function. If you break the calculation into the two steps
x = 4.555 * 100 CInt(x)you avoid this internal storage and thus avoid the floating-point rounding error.
Additional query words: roundoff
Keywords: kbprb kbprogramming KB111781
