Skip to content

Conversation

@briandobbins
Copy link
Collaborator

@briandobbins briandobbins commented Jan 22, 2025

With 64-bit offsets, when comparing very large values found in ultra-high resolution configurations, the difference of the two iomap values can be greater than the size of a 32-bit integer, leading to undefined behavior, and causing incorrect reads.

Note that this change does technically double the instruction count for this part of the function from 3 -> 6 instructions under a couple of compilers looked at, but it didn't seem to have any practical impact on the few tests run. Submitting as-is for now, and if later more thorough tests show a performance problem, we can always do an ifdef based on type.

…of large values, when cast to an int, could lead to undefined behavior (integer overflow/underflow), resulting in data errors.
@jedwards4b jedwards4b merged commit a844617 into NCAR:main Jan 29, 2025
3 checks passed
@jedwards4b jedwards4b deleted the qsort_comparator_64bit_fix branch January 29, 2025 15:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants