undefined symbol: _ZNK2at10TensorBase4nameEv when using torch2.8.0

[Weili17]

Test Scripts:

• examples/01_simple_two_models/start_two_models.sh

Reported Error:

• from kvcached.vmm_ops import kv_tensors_created, map_to_kv_tensors, unmap_from_kv_tensors
• ImportError: kvcached/kvcached/vmm_ops.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZNK2at10TensorBase4nameEv

My ENV:

• vllm 0.11.0
• torch 2.8.0
• kvcached 0.1.2(installed from source)
• CUDA 12.4

[ivanium]

This looks like a pytorch C++ ABI mismatch. I would suggest re-install kvcached via pip install -e . --no-build-isolation --no-cache-dir or if you use uv, then uv pip install -e . --no-build-isolation --no-cache-dir in your current venv.

If that still doesn't work, the last resort is to rebuild vmm_ops manually by python setup.py build_ext --inplace in the project root directory (where kvcached's setup.py locates).