Skip to content

tinfoilsh/confidential-model-router

Repository files navigation

Confidential Inference Router

Tinfoil's confidential inference model router terminates TLS connections (optionally with EHBP), inspects the model name, and directs it to a verified secure inference enclave.

About

Tinfoil Orchestration Server

Topics

Resources

License

Stars

Watchers

Forks

Packages

 
 
 

Contributors 7