Skip to content

update LocalDataPath and testing for python 3.13 support#1188

Merged
jmartin-tech merged 3 commits intoNVIDIA:mainfrom
jmartin-tech:feature/python3-13-support
Jun 27, 2025
Merged

update LocalDataPath and testing for python 3.13 support#1188
jmartin-tech merged 3 commits intoNVIDIA:mainfrom
jmartin-tech:feature/python3-13-support

Conversation

@jmartin-tech
Copy link
Collaborator

Updates required for python 3.13 support.

Impacts from refactor of pathlib and addition of the new PurePath class in cpython required implementation of a conditional method override for with_segments on 3.13+. This also required allowing ORDERED_SEARCH_PATHS locations to be considered valid LocalDataPath objects when the path does not already exist on the filesystem.

Verification

List the steps needed to make sure this thing works

  • Update automation tests pass

@jmartin-tech jmartin-tech marked this pull request as draft April 29, 2025 21:39
@leondz leondz added the architecture Architectural upgrades label May 2, 2025
Signed-off-by: Jeffrey Martin <jemartin@nvidia.com>
While we await a release or other resolution based on
google/sentencepiece#1084 limit windows testing to working versions

Signed-off-by: Jeffrey Martin <jemartin@nvidia.com>
@jmartin-tech jmartin-tech force-pushed the feature/python3-13-support branch from 2fd7334 to adc24fa Compare June 16, 2025 21:16
@jmartin-tech jmartin-tech marked this pull request as ready for review June 16, 2025 22:29
Copy link
Collaborator

@erickgalinkin erickgalinkin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM with the asterisk around sentencepiece support for 3.13.

strategy:
matrix:
python-version: ["3.10","3.12"]
python-version: ["3.10","3.12","3.13"]
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

intent with skipping 3.11 was to test lower & highest supported version. should we continue that pattern?

return LocalDataPath(projected)

if projected in self.ORDERED_SEARCH_PATHS:
return LocalDataPath(projected)
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nice

@leondz
Copy link
Collaborator

leondz commented Jun 27, 2025

considering creating a pypi pkg sentencepiece_313 in a few weeks

Signed-off-by: Jeffrey Martin <jemartin@nvidia.com>
@jmartin-tech jmartin-tech merged commit cd54d27 into NVIDIA:main Jun 27, 2025
17 of 18 checks passed
@jmartin-tech jmartin-tech deleted the feature/python3-13-support branch June 27, 2025 18:54
@github-actions github-actions bot locked and limited conversation to collaborators Jun 27, 2025
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

architecture Architectural upgrades

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants