Open
Conversation
Sets up the plugin/marketplace plumbing so this repo can distribute agent skills, compatible with the Copilot CLI / Claude Code / VS Code plugin system. Mirrors dotnet/skills conventions. Infrastructure: - marketplace.json registry with two plugins (devflow, general dev) - skill-check.yml: static validation on PRs (skill-validator from dotnet/skills) - skill-evaluation.yml: LLM-based /evaluate gating with permission checks - AGENTS.md: repo-level agent instructions - plugins/CONTRIBUTING.md: contributor guide with evaluation writing guidance - plugins/README.md: marketplace landing page - eng/allowed-external-deps.txt: reference URL allowlist Example skill: - devflow-connect: DevFlow agent connectivity troubleshooting - 4 evaluation scenarios testing platform-specific guidance Closes #51 Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Contributor
There was a problem hiding this comment.
Pull request overview
Adds marketplace/plugin scaffolding so this repo can publish distributable “agent skills” as installable plugins, plus CI to validate and (optionally) evaluate skills.
Changes:
- Introduces marketplace + plugin manifests under
.github/plugin/andplugins/(with an initialdevflow-connectskill). - Adds skill validation (
skill-check) and gated PR evaluation (skill-evaluation) GitHub Actions workflows. - Adds contributor/agent documentation and an external dependency allowlist for skill validation.
Reviewed changes
Copilot reviewed 12 out of 13 changed files in this pull request and generated 3 comments.
Show a summary per file
| File | Description |
|---|---|
tests/dotnet-maui-devflow/devflow-connect/eval.yaml |
Adds evaluation scenarios/assertions for the initial devflow-connect skill. |
README.md |
Documents the new “Agent Skills” marketplace and install commands. |
plugins/README.md |
Adds plugin catalog + install/add-skill guidance. |
plugins/dotnet-maui-devflow/skills/devflow-connect/SKILL.md |
Defines the devflow-connect skill content and workflow. |
plugins/dotnet-maui-devflow/plugin.json |
Declares the DevFlow-focused plugin manifest. |
plugins/dotnet-maui-dev/skills/.gitkeep |
Creates an empty skills folder placeholder for the general MAUI plugin. |
plugins/dotnet-maui-dev/plugin.json |
Declares the general MAUI plugin manifest. |
plugins/CONTRIBUTING.md |
Adds skill authoring + evaluation authoring guidance and checklist. |
eng/allowed-external-deps.txt |
Adds allowlist file for validator-controlled external deps. |
AGENTS.md |
Adds repo instructions for agents + skill authoring/build pointers. |
.github/workflows/skill-evaluation.yml |
Adds gated /evaluate workflow + commit status plumbing and PR reporting. |
.github/workflows/skill-check.yml |
Adds PR/push static validation using skill-validator check. |
.github/plugin/marketplace.json |
Registers the repo marketplace and its plugins. |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
- Use process substitution instead of piped while loop so EVAL_FAILED persists outside the subshell - Handle gh api 404 for non-collaborators gracefully (fall back to 'none') - Deduplicate evaluation by running once per plugin instead of once per skill Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Closes #51
Summary
Sets up the plugin/marketplace plumbing so this repo can distribute agent skills, compatible with the Copilot CLI / Claude Code / VS Code plugin system. Mirrors dotnet/skills conventions.
This PR is infrastructure only. Actual skills (imported from Redth/maui-skillz) will follow in a separate PR once this merges, so the
/evaluateworkflow is available on main for proper pipeline evaluation.What's Included
Marketplace Infrastructure
.github/plugin/marketplace. Registry with two pluginsjsonplugins/dotnet-maui-devflow/plugin. DevFlow plugin manifestjsonplugins/dotnet-maui-dev/plugin. General dev plugin manifest (empty, ready for contributions)jsonCI Workflows
skill-check. Static validation on PRs (downloads skill-validator AOT binary from dotnet/skills)ymlskill-evaluation. LLM-based evaluation gated by/evaluatecomment (write+ permission,issue_commenttrigger runs from default branch)ymlDocumentation
AGENTS. Repo instructions for agentsmdplugins/CONTRIBUTING. Contributor guide with skill format, eval writing guidance, and PR checklistmdplugins/README. Marketplace landing pagemdSecurity
eng/allowed-external-deps. Reference URL allowlisttxt/evaluateExample Skill
devflow- Diagnosing DevFlow agent connectivity (4 eval scenarios)connectPlugin Structure
dotnet-maui-devflowmauiCLI + agent packages)dotnet-maui-devInstallation (once merged)