Skip to content

[FEATURE] Help user discover their provider/model pair availability #6304

@cbrunnkvist

Description

@cbrunnkvist

Summary

I am missing an easy way to check in with each of the models listed by kilo models to see which ones are actually available via API for me to use, today, now.

I think of this action as a "roll call", like the one you do in the morning at school (or in prison, eheh) to check for any absence.

I have actually been doing this in the past with a bash for-loop and a lot of opencode run, but that way is painfully slow for obvious reasons - launching the CLI from scratch a several, potentially a hundred times, new sessions, managing timeouts ... and then on top of that, I have to parse the somewhat unstructured output of my survey! In short, there ought to be a built-in way to perform this type of survey/diagnostic on behalf of the user if they need to. The plugin interface does not expose the service necessary to do this, nor does it support adding sub-commands, so a new feature is in order.

Proposed Solution

Add a roll-call sub-command that iterates through configured provider/model pairs and reports their availability status (or make it a sub-sub command like "kilo models test [...]", whatever is best from a discoverability/usability standpoint).

Example use case: "I want need to test a certain prompt against all "gwen" models".

Finally, this is also a good opportunity to measure real-world latency.

Metadata

Metadata

Assignees

No one assigned

    Labels

    CLIKilo Code CLIbackendPut on the board of the backend team.enhancementNew feature or requestkilo-auto-fixAuto-generated label by Kilokilo-triagedAuto-generated label by Kilomodel-evaluationproposalA community member proposes an improvement and willing to do a Pull Request, if accepted

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions