Implement the /models endpoint for the VLLM provider

[jhrozek]

For some reason, continue in JetBrains needs this otherwise loading the
plugin fails with:

Error: HTTP 404 Not Found from http://127.0.0.1:8000/vllm/models

This may mean that you forgot to add '/v1' to the end of your 'apiBase'
in config.json.
    at customFetch (/snapshot/continue/binary/out/index.js:471442:17)
        at process.processTicksAndRejections
        (node:internal/process/task_queues:95:5)
            at async withExponentialBackoff
            (/snapshot/continue/binary/out/index.js:471175:22)
---> continue restarts here
[info] Starting Continue core...
[2024-12-04T08:52:45] [info] Starting Continue core...

[aponcedeleonch]

I think this is fine. We can also query directly the base_url and it should respond

curl -SsX GET "https://inference.codegate.ai/v1/models" \
     -H "Authorization: Bearer $token" 
     
{"object":"list","data":[{"id":"Qwen/Qwen2.5-Coder-14B-Instruct","object":"model","created":1733303915,"owned_by":"vllm","root":"Qwen/Qwen2.5-Coder-14B-Instruct","parent":null,"max_model_len":32768,"permission":[{"id":"modelperm-0aa1923ad501464fbc2f3ee91f953ed3","object":"model_permission","created":1733303915,"allow_create_engine":false,"allow_sampling":true,"allow_logprobs":true,"allow_search_indices":false,"allow_view":true,"allow_fine_tuning":false,"organization":"*","group":null,"is_blocking":false}]}]}

[jhrozek]

I like your idea more, I will test it out

[aponcedeleonch]

Approved, left one comment. I don't know if querying the base_url for that endpoint actually makes a difference or not