Fixing rounding errors in primitives


RE: Fix of 1-4ring5.dat
#5
(2021-10-15, 18:20)Travis Cobbs Wrote: The attached file contains at least one set of incorrect rounding.

0.9239 * 6 = 5.5434. Both the current version of the primitive and your proposed fix use 5.5433. I have not checked every single point in the new file to see if it is correct, but the presence of one error means that every single point in the file needs to be re-checked. I don't know how you generated the new file, but if you plan to do this with other primitives, whatever is being done needs to be fixed.

Thanks. The file and related files have been updated accordingly. It took much less time this time around, since I knew where to look. Another positive change: Not as many of the related files have to be updated, compared to what I initially though.

I will continue onto 1-4ring7.dat.
Reply
« Next Oldest | Next Newest »



Messages In This Thread
Fix of 1-4ring5.dat - by Lasse Deleuran - 2021-10-15, 17:54
RE: Fix of 1-4ring5.dat - by Travis Cobbs - 2021-10-15, 18:20
RE: Fix of 1-4ring5.dat - by Lasse Deleuran - 2021-10-15, 18:30
RE: Fix of 1-4ring5.dat - by Lasse Deleuran - 2021-10-15, 20:06

Forum Jump:


Users browsing this thread: 1 Guest(s)