Skip to content

Task: transformers 5 support#1582

Merged
jmartin-tech merged 8 commits intoNVIDIA:mainfrom
jmartin-tech:task/transformers-5-support
Feb 3, 2026
Merged

Task: transformers 5 support#1582
jmartin-tech merged 8 commits intoNVIDIA:mainfrom
jmartin-tech:task/transformers-5-support

Conversation

@jmartin-tech
Copy link
Collaborator

Update for transformers major version release.

Verification

List the steps needed to make sure this thing works

  • sanity test

Copy link
Collaborator

@erickgalinkin erickgalinkin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me -- support merging once all tests pass.

Copy link
Collaborator

@leondz leondz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks. Good luck w/ win.

@jmartin-tech jmartin-tech force-pushed the task/transformers-5-support branch 2 times, most recently from 6b96d0a to 44e9a86 Compare January 30, 2026 20:08
Comment on lines +43 to +47
if sys.platform == "win32" and klassname == "buffs.paraphrase.Fast":
# special case buff not currently supported on Windows
with pytest.raises(GarakException) as exc_info:
list(b.transform(a)) # process yield to see raise
assert "failed" in str(exc_info.value)
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Note this test should start to fail if/when Windows reaches a working state for this plugin.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

noted

Copy link
Collaborator

@erickgalinkin erickgalinkin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Signed-off-by: Jeffrey Martin <jemartin@nvidia.com>
Signed-off-by: Jeffrey Martin <jemartin@nvidia.com>
Signed-off-by: Jeffrey Martin <jemartin@nvidia.com>
huggingface_hub version 1.0 changes the entry point from `huggingface_cli` to `hf`

Signed-off-by: Jeffrey Martin <jemartin@nvidia.com>
Currently the custom generator used fails to load in windows, allow exception to be raised

Signed-off-by: Jeffrey Martin <jemartin@nvidia.com>
@jmartin-tech jmartin-tech force-pushed the task/transformers-5-support branch from 44e9a86 to b593ba3 Compare February 2, 2026 22:48
Copy link
Collaborator

@leondz leondz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

main q - where/how is custom_generate consumed?

Comment on lines +43 to +47
if sys.platform == "win32" and klassname == "buffs.paraphrase.Fast":
# special case buff not currently supported on Windows
with pytest.raises(GarakException) as exc_info:
list(b.transform(a)) # process yield to see raise
assert "failed" in str(exc_info.value)
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

noted

Signed-off-by: Jeffrey Martin <jemartin@nvidia.com>
@leondz leondz added this to the 0.14.0 milestone Feb 3, 2026
migrate `_load_model` to `_load_unsafe`

Signed-off-by: Jeffrey Martin <jemartin@nvidia.com>
@jmartin-tech jmartin-tech force-pushed the task/transformers-5-support branch from 4a7e63a to eb67619 Compare February 3, 2026 16:54
@jmartin-tech jmartin-tech merged commit a18f126 into NVIDIA:main Feb 3, 2026
15 checks passed
@jmartin-tech jmartin-tech deleted the task/transformers-5-support branch February 3, 2026 17:58
@github-actions github-actions bot locked and limited conversation to collaborators Feb 3, 2026
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants