Microsoft KB Archive/131578

= FIX: Math Problem with INT Function =

Article ID: 131578

Article Last Modified on 9/30/2003

-

APPLIES TO


 * Microsoft Visual FoxPro 3.0 Standard Edition
 * Microsoft Visual FoxPro 3.0b Standard Edition

-



This article was previously published under Q131578



SYMPTOMS
The INT(nExpression) Function evaluates a numeric expression and returns incorrect values.



RESOLUTION
To work around this problem, change the SET DECIMAL setting to a larger more appropriate value such as 10 (the default is 2).



STATUS
Microsoft has confirmed this to be a problem in the Microsoft products listed at the beginning of this article. This problem has been fixed in Visual FoxPro 5.0 for Windows.



Steps to Reproduce Problem
Run the following code in Visual FoxPro: pnum1 = 1000000 pnum2 = 999999

SET DECI TO 2      && this is default

? int(pnum2/pnum1) && result is 1 it should be 0

SET DECI TO 10

? int(pnum2/pnum1) && result is 0, which is correct

Keywords: kbbug kbfix kbvfp500fix KB131578

-

[mailto:TECHNET@MICROSOFT.COM Send feedback to Microsoft]

© Microsoft Corporation. All rights reserved.