-
Notifications
You must be signed in to change notification settings - Fork 2.3k
[FEATURE] Help user discover their provider/model pair availability #6304
Description
Summary
I am missing an easy way to check in with each of the models listed by kilo models to see which ones are actually available via API for me to use, today, now.
I think of this action as a "roll call", like the one you do in the morning at school (or in prison, eheh) to check for any absence.
I have actually been doing this in the past with a bash for-loop and a lot of opencode run, but that way is painfully slow for obvious reasons - launching the CLI from scratch a several, potentially a hundred times, new sessions, managing timeouts ... and then on top of that, I have to parse the somewhat unstructured output of my survey! In short, there ought to be a built-in way to perform this type of survey/diagnostic on behalf of the user if they need to. The plugin interface does not expose the service necessary to do this, nor does it support adding sub-commands, so a new feature is in order.
Proposed Solution
Add a roll-call sub-command that iterates through configured provider/model pairs and reports their availability status (or make it a sub-sub command like "kilo models test [...]", whatever is best from a discoverability/usability standpoint).
Example use case: "I want need to test a certain prompt against all "gwen" models".
Finally, this is also a good opportunity to measure real-world latency.