Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

You can set x87 to round each operation result to 32-bit or 64-bit.

With this setting in operates internally exactly on those sizes.

Operating internally on 80-bits is just the default setting, because it is the best for naive users, who are otherwise prone to computing erroneous results.

This is the same reason why the C language has made "double" the default precision in constants and intermediate values.

Unless you do graphics or ML/AI, single-precision computations are really only for experts who can analyze the algorithm and guarantee that it is correct.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: