Microsoft KB Archive/57298

From BetaArchive Wiki
Knowledge Base


Math Coprocessor May Use Different Level of Precision

Article ID: 57298

Article Last Modified on 11/16/2006



APPLIES TO

  • Microsoft Excel 95 Standard Edition
  • Microsoft Excel 5.0c
  • Microsoft Excel 4.0c
  • Microsoft Excel 3.0a
  • Microsoft Excel 2.10d
  • Microsoft Excel 2.1 Standard Edition
  • Microsoft Excel 2.01
  • Microsoft Excel 2.0 Standard Edition



This article was previously published under Q57298

SUMMARY

In Microsoft Excel, when you perform calculations using numbers that contain decimals, you may receive slightly different (more accurate) results with a math coprocessor present.

MORE INFORMATION

If a math coprocessor is not present, Microsoft Excel uses math coprocessor emulation for its calculations. Calculations using a math coprocessor may use higher precision and therefore may return a slightly different number than the same calculation using the emulation.

The difference between emulation and coprocessor is that emulation is done entirely with double precision floats (8 bytes). The coprocessor may convert to a higher precision format (extended precision floats (10 bytes)) internally, but we always interface with it with double precision floats.

Therefore although a math coprocessor may give slightly higher precision, it doesn't always do so. Emulation always gives at least double precision accuracy.

For additional information, please see the following article(s) in the Microsoft Knowledge Base:

78113 : Excel: Floating-Point Arithmetic May Give Inaccurate Results



Additional query words: 2.00 2.01 2.10 2.20 3.00 4.00 4.00a 5.00c FPU

Keywords: KB57298