Strengthen mcp-csharp-publish with prescriptive defaults#939
Closed
leslierichardson95 wants to merge 2 commits into
Closed
Strengthen mcp-csharp-publish with prescriptive defaults#939leslierichardson95 wants to merge 2 commits into
leslierichardson95 wants to merge 2 commits into
Conversation
The cross-family eval (#889) flagged mcp-csharp-publish as inert (STRENGTHEN 0/5, mostly ties) because its guidance was too generic and non-prescriptive, so it rarely changed agent behavior vs. baseline. Add an opinionated 'Default decisions' block and make the previously optional/menu-style choices decisive so the skill produces different, better behavior than an unskilled run: - stdio -> NuGet.org as a .NET tool (dnx) - HTTP -> Azure Container Apps with --min-replicas 0 (scale to zero) - Always publish server.json to the MCP Registry for shared servers - Gate Azure App Service behind explicit user need (VNet, slots, existing plan) Refs #889 Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> Copilot-Session: 6a8ce111-58e5-48a7-9f7f-8de972bdc693
Contributor
Skill Coverage Report
Uncovered:
|
Contributor
There was a problem hiding this comment.
Pull request overview
This PR strengthens the mcp-csharp-publish skill by making it more prescriptive (defaulting key publishing/deployment decisions) so skilled runs diverge meaningfully from baseline and reduce “tie” outcomes in cross-family evals.
Changes:
- Adds a “Default decisions” section that picks common defaults without prompting (NuGet stdio, Container Apps for HTTP, registry publishing, version sync).
- Makes Azure Container Apps the explicit default for HTTP deployment and gates App Service behind specific requirements.
- Reinforces MCP Registry publishing as the default path for shared servers.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
| |----------|---------|-----| | ||
| | stdio distribution | **NuGet.org as a .NET tool** (users run via `dnx`) | The standard way MCP clients consume stdio servers | | ||
| | HTTP hosting | **Azure Container Apps** with `--min-replicas 0` | Serverless, scales to zero — cheapest for bursty MCP traffic | | ||
| | MCP Registry | **Always publish `server.json`** | Discoverability is free and expected for shared servers | |
| @@ -171,7 +186,7 @@ az containerapp create \ | |||
| --env-vars API_KEY=secretref:api-key | |||
Contributor
Author
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
Strengthens the
mcp-csharp-publishskill so it changes agent behavior instead of tying with the no-skill baseline.Why
The cross-family skills-eval (#889) rated
mcp-csharp-publishSTRENGTHEN 0/5 with the diagnosis "mostly ties — too generic/non-prescriptive." The skill listed options (NuGet or Docker, Container Apps or App Service, Registry optional) without deciding, so a skilled run rarely differed from baseline.Changes
dnx)--min-replicas 0(scale to zero)server.jsonto the MCP Registry for shared servers.csproj/server.jsonNo new heavy content — the skill is already token-efficient; this sharpens decisiveness only.
Verification
skill-validator checkruns in CI. Recommend a cross-family eval re-run (-f skills="mcp-csharp-publish" -f executors="opus,gpt" -f runs=5) to confirm the ties convert to wins.Refs #889
Moved from fork branch to the primary dotnet/skills repo; supersedes #935.