Reduce recompilations when using merged_prefill#1167

michalkuligowski merged 4 commits into

habana_mainHabanaAI/vllm-fork:habana_mainfrom

dev/madamczyk/fix_merged_prefill_recompilationsHabanaAI/vllm-fork:dev/madamczyk/fix_merged_prefill_recompilationsCopy head branch name to clipboard