Article ID: 131578
Article Last Modified on 9/30/2003
APPLIES TO
- Microsoft Visual FoxPro 3.0 Standard Edition
- Microsoft Visual FoxPro 3.0b Standard Edition
This article was previously published under Q131578
SYMPTOMS
The INT(nExpression) Function evaluates a numeric expression and returns incorrect values.
RESOLUTION
To work around this problem, change the SET DECIMAL setting to a larger more appropriate value such as 10 (the default is 2).
STATUS
Microsoft has confirmed this to be a problem in the Microsoft products listed at the beginning of this article. This problem has been fixed in Visual FoxPro 5.0 for Windows.
MORE INFORMATION
Steps to Reproduce Problem
Run the following code in Visual FoxPro:
pnum1 = 1000000 pnum2 = 999999 SET DECI TO 2 && this is default ? int(pnum2/pnum1) && result is 1 it should be 0 SET DECI TO 10 ? int(pnum2/pnum1) && result is 0, which is correct
Keywords: kbbug kbfix kbvfp500fix KB131578