Error calling LLM

[Maxaccurate]

I'm using LM Studio to be the vLLM, but there seems to be some errors. This is the error shown every time:

2026-02-05 11:08:14.445 | INFO | nanobot.agent.loop:_process_message:146 - Processing message from cli:user

🐈 Error calling LLM: litellm.InternalServerError: InternalServerError: OpenAIException - Connection error.

[A11en0]

1

[Airhard]

I ran into the same issue is there a fix for that? I know I use a small gpu but time is not my priority so I wish to use the the Hardware I already own. I read that it is possible to send a parameter with the request to the llm but I do not know how. Could someone please help?

[chengyongru]

Stale: no activity for 42 days; litellm was removed