[Bug]: clean up any bos and eos tokens showing up in messages

What happened?

Relevant log output

repro by using https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1

with litellm

Twitter / LinkedIn details

No response

cc: @StanGirard

[ishaan-jaff]

should we be cleaning out the output by default ? or should the users opt in to this ?

this is now resolved - @ishaan-jaff it was a streaming issue, and caused by a bug with how we were reading an end of stream. Now we don't do a manual cleanup - just stop when stream ends correctly, and that fixes this.