(2020-04-24, 19:26)Roland Melkert Wrote: Probably best you don't want to fall in the rabbit hole known as the wonderful world of floating point precision
Yeah…my fear is that I switch to 5 decimal places, and now I'm haunted by rounding errors that are .00001 instead of just .001!
Quote:The option only affects writing of files, reading will always use up to 19 decimal points.
The 19 comes from the maximum power of 10 in a 64 bit integer which is used to store the number after the dot before it's converted to double.
So, if I were to switch from say, 3 to 5 places, and I save a new file…then later I decide to go back to 3 places and re-save that file, it would round all the values down? (I suppose I could just try and see what happens.)