[Feature]: Add support for huggingface chat templating

The Feature

Huggingface now has chat templating for a bunch of open source models (including the new mistral ones), I think it's fairly important that we add support for this.

https://huggingface.co/docs/transformers/main/chat_templating

Motivation, pitch

Ensure we give users good results

Twitter / LinkedIn details

No response

also being used by the mistral models currently being used by quivr

[ishaan-jaff]

this is done right @krrishdholakia ?

yes