Skip to content

Remove inference_mode() from platforms.hpu#1691

Merged
jkaniecki merged 1 commit intohabana_mainfrom
dev/jkaniecki/recompilations_fix
Jul 31, 2025
Merged

Remove inference_mode() from platforms.hpu#1691
jkaniecki merged 1 commit intohabana_mainfrom
dev/jkaniecki/recompilations_fix

Conversation

@jkaniecki
Copy link
Copy Markdown

@jkaniecki jkaniecki commented Jul 31, 2025

Inference_mode() is causing recompilations with t.compile - we don't need it as we already put inference_mode on particular functions in model runner. It was introduced by Rebase 0.9.0.1 (#1507) - previously we didn't have such call.

@michalkuligowski
Copy link
Copy Markdown

/run-gaudi-tests

@jkaniecki jkaniecki merged commit 89e6254 into habana_main Jul 31, 2025
57 checks passed
@jkaniecki jkaniecki deleted the dev/jkaniecki/recompilations_fix branch July 31, 2025 13:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants