Posted By: null0000 Bug on FPU calculation - 12/10/13 08:56 PM
There is a bug on calculation of large amount of numbers with 2 decimal numbers.
PLD - gives: .10 SQL+: .05

Table defined as:
SQL> desc dropme_test
Name Type Nullable Default Comments
---- ------------ -------- ------- --------
COL1 NUMBER(22,2) Y

SQL+
[Linked Image]
PLD [Linked Image]
Setting [Linked Image]

windows 7
ora 10.2 64bit
pld 10.0.05.1710
Posted By: null0000 Re: Bug on FPU calculation - 12/10/13 08:58 PM
Data sample:
+000000420854067.50
+000000000000000.00
+000000000408640.63
+000000000001762.50
+000000000000000.00
+000000000034974.00
+000000000016843.91
+000000000000000.00
+000000000000000.00
-000000026293472.67
-000000036958788.40
-000000004267889.58
-000000055527262.86
-000000001585748.78
-000000000003168.00
-000000004265526.66
-000000001174908.54
-000000012318261.16
-000000000490548.21
-000000006070603.28
-000000923009320.85
-000000000063496.20

it is a financial data (signed), so precision is important
Posted By: null0000 Re: Bug on FPU calculation - 12/10/13 09:45 PM
Gentlemen, I've done some debugging for you...
[Linked Image]
[Linked Image]

I am dealing with finance -- so need to rely on tool 100%. Can you please expedite solution.
Thanks.
Posted By: Marco Kalter Re: Bug on FPU calculation - 12/11/13 10:33 AM
To keep the full Oracle precision, go to Tools > Preferences > SQL Window and enable the "Number fields to_char" option. Now all number fields will be returned as character strings with full Oracle precision.
© Allround Automations forums