SkillValidator Nightly

Automated nightly build from main (2026-06-18).

v1.0.0

What's Changed

• Initial documentation and validation workflow by @timheuer in #1
• Add skill for using file-based programs by @agocke in #20
• Revise validation and reference for file-based apps by @DamianEdwards in #24
• Restructure repo to use src/ layout by @ViktorHofer in #40
• Eval workflow structure by @ViktorHofer in #41
• docs: Add naming guidelines to CONTRIBUTING by @timheuer in #43
• Replace eval pipeline with skill-validator. by @adityamandaleeka in #44
• Use gh pr comment instead of third party dependency. by @adityamandaleeka in #45
• Bump node version to 22. by @adityamandaleeka in #46
• Update skill-validator ref to include CI auth fix by @adityamandaleeka in #47
• Use correct token. by @adityamandaleeka in #48
• Update skill-validator ref with JSON serialization and mkdir fixes by @adityamandaleeka in #49
• Change default runs to 5 for statistical significance by @adityamandaleeka in #50
• Include hidden files for uploading results. by @adityamandaleeka in #55
• Update skill-validator version. by @adityamandaleeka in #56
• Add git remote origin when initializing gh-pages branch. by @adityamandaleeka in #57
• fix: force array output in components.json for dashboard by @adityamandaleeka in #59
• Add dotnet-msbuild component with skills, agents, and tests by @ViktorHofer in #42
• Disable cron for now by @ViktorHofer in #60
• Add dashboard badge by @ViktorHofer in #61
• Enhance README with new plugin and workflow sections by @ViktorHofer in #62
• Reduce quota in evaluation workflow by @ViktorHofer in #65
• Only evaluate changed components in PRs by @ViktorHofer in #66
• Add judge model input to evaluation workflow by @ViktorHofer in #67
• Add parallel runs support to skill-validator by @ViktorHofer in #68
• Enhance CONTRIBUTING.md with skill test guidelines by @ViktorHofer in #70
• Add copy_test_files support and clean up test metadata by @ViktorHofer in #69
• Re-enable cron and set to every two hours by @ViktorHofer in #71
• Add .NET P/Invoke skill by @AaronRobinsonMSFT in #54
• PInvoke skill test IGNORE THIS by @adityamandaleeka in #58
• Added C# MCP Server development skills by @leslierichardson95 in #36
• Revert "Added C# MCP Server development skills" by @leslierichardson95 in #74
• Scope PR evaluation to only changed skills by @adityamandaleeka in #76
• [Infra] Add verbose logging for work directory in runAgent by @ViktorHofer in #93
• [Infra] Add run label to distinguish output by @ViktorHofer in #94
• [Infra] feat: add support for parallel scenarios in skill evaluation by @ViktorHofer in #84
• [Infra] Updates to eval pipeline and instructions by @ViktorHofer in #82
• [Infra] Improve evaluation workflow by @ViktorHofer in #97
• [Infra] Add tokens alternation by @JanKrivanek in #96
• [Infra] Fix JSON parse error from invalid LLM escape sequences in pairwise judge by @ViktorHofer in #99
• [Infra] Add activated skills info by @JanKrivanek in #98
• [Infra] Fix benchmark generation: match timestamp dirs instead of run-* by @ViktorHofer in #102
• Fix merge conflict in CONTRIBUTING.md by @ViktorHofer in #101
• Fix extractJson picking up non-JSON brace groups (e.g., C# code) by @ViktorHofer in #100
• Run all evaluations when infrastructure files change by @JanKrivanek in #104
• Fix empty benches arrays in benchmark data generation by @ViktorHofer in #108
• Refine parameter description in generate-benchmark-data.ps1 and add s… by @ViktorHofer in #110
• Add --verdict-warn-only option to skill-validator for non-fatal skill failures by @ViktorHofer in #111
• [Infra] Indicate not activated skills in dashboard by @JanKrivanek in #105
• Add tests for binlog-failure-analysis skill by @JanKrivanek in #107
• Add test for binlog creation skill by @JanKrivanek in #109
• Remove nuget-restore-failure skills and test by @ViktorHofer in #113
• Port skill-validator from TypeScript to .NET C# by @ViktorHofer in #106
• Clean up MSBuild component: remove deleted skill references, update workflows by @ViktorHofer in #115
• Clean up dotnet-msbuild: unify lock files, compact skill, add .gitattributes by @ViktorHofer in #116
• [Infra] Increase + Capture timeouts (C#) by @JanKrivanek in #117
• [Infra] Add timeout info to dashboard by @JanKrivanek in #119
• Document workflow trigger commands in agentic-workflows README by @ViktorHofer in #118
• [Infra] Fix MCP discovery by @JanKrivanek in #120
• Improve binlog failure analysis skill by @JanKrivanek in #121
• Add .NET performance analysis skill and optimizing agent by @artl93 in #6
• Add build perf baseline eval tests by @JanKrivanek in #128
• Add build organization skill eval by @JanKrivanek in #123
• Increase timeout for evaluation job to 60 minutes by @ViktorHofer in #129
• Add dump-collect skill for modern .NET by @steveisok in #103
• Fix quotes in RunArguments for SkillValidator by @elinor-fung in #134
• Fix typo in README.md by @333fred in #132
• Remove shell tool restrictions from agentic workflows by @ViktorHofer in #136
• Support skill negative tests by @JanKrivanek in #139
• Fix running SkillValidator on Windows locally by @ViktorHofer in #138
• [Infra] Add PoC of overfitting judging by @JanKrivanek in #140
• Add optimizing-ef-core-queries skill (+8.7% eval, near-miss) by @mrsharm in #90
• Thread.Abort migration skill by @danmoseley in #126
• Restructure repository: rename src/ to plugins/, reorganize tests and workflows by @ViktorHofer in #143
• Move src/dotnet content into plugins/ and tests/ by @ViktorHofer in #144
• Add microbenchmarking skill by @caaavik-msft in #63
• Add CODEOWNERS file with per-skill ownership by @ViktorHofer in #148
• Reset plugin verisons to 0.1.0 by @ViktorHofer in #145
• Update contributing guidelines by @jaredpar in #151
• Add CLR activation debugging skill by @marklio in #152
• Nullable reference migration skill by @danmoseley in #39
• Add android-tombstone-symbolication skill by @steveisok in #130
• Move android-tombstone-symbolication skill and tests from src/dotnet … by @jeffschwMSFT in #157
• GHA to validate ownership by @jaredpar in #158
• Remove skills that violate guidelines by @jaredpar in #162
• [Infra] Add devops agentic workflow by @JanKrivanek in #141
• Add missing CODEOWNERS entries for new skills by @AaronRobinsonMSFT in #161
• Clarify that when-to-use guidance belongs in description frontmatter by @danmoseley in #165
• [Infra] Fix devops aw by @JanKrivanek in #167
• Add dotnet-trace-collect skill for .NET performance diagnostics by @brianrob in #124
• Remove noisy tombstone eval scenarios and fix activation flag by @steveisok in #171
• Add skill for AOT-compatibility by @agocke in https://github.co...