Skip to content
Snippets Groups Projects
Commit 756c13df authored by Ferdinand Bachmann's avatar Ferdinand Bachmann
Browse files

epicardium/rtc: fix numerically unstable subsecond decoding

the subsecond encoding function from epic_rtc_set_milliseconds and the
corresponding decoding function from epic_rtc_get_milliseconds are not
numerically stable.

i.e., encoding 5 milliseconds to 20 subsecs and immediately afterwards decoding
that yields 4 milliseconds.

Adding a bias of 999 (0.24 milliseconds) to the decoding function makes it
numerically stable, while never decoding any subsecond value to more than 999
milliseconds.
parent e0691c6d
No related branches found
No related tags found
Loading
Loading
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment