Skip to content

Commit 285a93a

Browse files
committed
Add whats-new entry for CF datetime dtype inference speedup
1 parent 3be4237 commit 285a93a

1 file changed

Lines changed: 14 additions & 0 deletions

File tree

doc/whats-new.rst

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -104,6 +104,20 @@ Deprecations
104104
~~~~~~~~~~~~
105105

106106

107+
Performance
108+
~~~~~~~~~~~
109+
110+
- Skip data reads during CF datetime dtype inference when the output dtype is
111+
determinable from metadata alone (``use_cftime`` explicitly set, non-standard
112+
calendar, non-nanosecond ``time_unit``, non-chunked data, or when
113+
``valid_max`` / ``time_coverage_end`` / a narrow storage dtype bounds the
114+
possible values). This can significantly speed up
115+
:py:func:`open_dataset` / :py:func:`open_datatree` on remote-backed stores
116+
(zarr on S3, icechunk) with many time-encoded variables. A runtime
117+
dtype-mismatch guard on the lazy decode wrapper prevents the rare overflow
118+
case from being silently cast by dask.
119+
By `Alfonso Ladino <https://github.com/aladinor>`_.
120+
107121
Bug Fixes
108122
~~~~~~~~~
109123

0 commit comments

Comments
 (0)