Thinking about doing a LDCad 1.7 version


RE: Thinking about doing a LDCad 1.7 version
(2020-04-24, 19:26)Roland Melkert Wrote: Probably best you don't want to fall in the rabbit hole known as the wonderful world of floating point precision Smile

Yeah…my fear is that I switch to 5 decimal places, and now I'm haunted by rounding errors that are .00001 instead of just .001!  Big Grin

Quote:The option only affects writing of files, reading will always use up to 19 decimal points.

The 19 comes from the maximum power of 10 in a 64 bit integer which is used to store the number after the dot before it's converted to double.

So, if I were to switch from say, 3 to 5 places, and I save a new file…then later I decide to go back to 3 places and re-save that file, it would round all the values down? (I suppose I could just try and see what happens.)
Reply
« Next Oldest | Next Newest »



Messages In This Thread
RE: Thinking about doing a LDCad 1.7 version - by N. W. Perry - 2020-04-24, 23:29

Forum Jump:


Users browsing this thread: 17 Guest(s)