Skip to content

yaniv-golan/skill-creator-plus

Repository files navigation

Skill Creator Plus

Skill Creator Plus

Install in Claude Desktop

License: MIT Claude Code Plugin

The skill that builds skills. Write a draft, run evals against a baseline, review results in an interactive viewer, improve, and repeat — until your skill actually works. Based on Anthropic's official skill-creator plugin, with bug fixes and best practices baked in.

Official skill-creator skill-creator-plus
Best practices guide 620+ line Anthropic patterns reference
Script vs. Instruct guidance Decision framework for when to bundle scripts vs. use instructions
Cross-host portability Validates full agentskills.io spec + Claude-specific fields
Claude Code runtime docs v2.1.116 listing budget, collapse mode, truncation thresholds, live-reload behavior
Eval viewer in Cowork Silent fail on submit Copyable JSON textarea (fixed)
Description optimizer Requires separate ANTHROPIC_API_KEY; drifts toward 1,024-char bloat Uses your existing claude session; length-aware selection + plateau early-stop
Benchmarking script Silent empty results Fixed directory handling
Skill type taxonomy 3 broad categories 3 + 9 Anthropic internal types
Pre-packaging checklist Official checklist built in

Why This Over the Built-in?

Anthropic ships a skill-creator plugin. It's good, but several parts are broken or missing:

  • Best practices guide included — 620+ lines of patterns, structural templates, troubleshooting guide, and checklists extracted from Anthropic's Complete Guide to Building Skills for Claude and Thariq's Lessons from Building Claude Code Skills. Includes a "Script vs. Instruct" decision framework for when to bundle pre-made scripts vs. keep logic as instructions — covering context window efficiency, reliability, and auditability. The built-in doesn't ship any of this.
  • Cross-host portability — skills produced here validate against the full agentskills.io cross-host spec so they run on Claude, Gemini CLI, Cursor, OpenCode, and other hosts. Claude-specific fields (when_to_use, model, paths, hooks, etc.) are supported but flagged as optional extensions, never load-bearing.
  • Claude Code runtime docs — documents v2.1.116 mechanics most skill authors hit the hard way: the ~8 KB total listing budget, the ~20-char collapse threshold that silently breaks every skill when any one gets too long, per-entry 1,536-char truncation, gitignore-syntax paths: matching (the docs say "glob" — they're wrong), and chokidar depth-2 live-reload.
  • Eval viewer actually works in Cowork — the built-in silently fails: you write feedback, click "Submit All Reviews", it says "saved" — but nothing reaches Claude. This version reliably shows copyable JSON you can paste back.
  • Description optimizer doesn't bloat or crash — the built-in calls the Anthropic SDK directly, requiring a separate ANTHROPIC_API_KEY most users don't have, and drifts toward 1,024-char descriptions that trigger the listing-collapse failure mode. This version uses claude -p (just works with your existing session), plus length-aware tie-break-shortest selection, plateau early-stop, and a tunable target length so descriptions stay tight.
  • Benchmarking script fixed — the built-in's aggregation script silently produces empty results due to undocumented directory structure requirements. Fixed and tested.

See the CHANGELOG for the full list of fixes.

Quick Start

Install (Claude Code):

claude plugin marketplace add https://github.com/yaniv-golan/skill-creator-plus
claude plugin install skill-creator-plus@skill-creator-plus-marketplace

Then just ask:

/skill-creator-plus Create a skill that reviews pull requests for security issues

The skill takes it from there — intent capture, drafting, test cases, evaluation, and iteration.

Note: If you also have Anthropic's built-in skill-creator installed, Claude may pick that one instead. Either uninstall the built-in, or use /skill-creator-plus to invoke this version explicitly.

How It Works

1. Create

Captures your intent through structured questions, researches existing patterns, then writes a SKILL.md with metadata, instructions, and test cases.

2. Evaluate

Spawns parallel runs (with-skill and baseline) on test prompts. While runs execute, drafts quantitative assertions. Grades results via the grader agent and shows them in an interactive browser-based viewer.

3. Improve

Analyzes evaluation results, identifies weaknesses, and rewrites the skill. Each iteration is benchmarked against the previous version.

4. Compare

For rigorous validation, runs blind A/B comparison: the comparator agent scores two outputs without knowing which skill produced them, then the analyzer agent unblinds and explains the differences.

5. Optimize Description

Generates trigger/non-trigger test queries, runs an optimization loop with train/test split, and selects the best-performing description.

Installation

Claude Desktop

Install in Claude Desktop

— or install manually —

  1. Click Customize in the sidebar
  2. Click Browse Plugins
  3. Go to the Personal tab and click +
  4. Choose Add marketplace
  5. Type yaniv-golan/skill-creator-plus and click Sync

Claude Code (CLI)

From your terminal:

claude plugin marketplace add https://github.com/yaniv-golan/skill-creator-plus
claude plugin install skill-creator-plus@skill-creator-plus-marketplace

Or from within a Claude Code session:

/plugin marketplace add yaniv-golan/skill-creator-plus
/plugin install skill-creator-plus@skill-creator-plus-marketplace

Claude.ai (Web)

  1. Download skill-creator-plus.zip
  2. Click Customize in the sidebar
  3. Go to Skills and click +
  4. Choose Upload a skill and upload the zip file

Usage Examples

/skill-creator-plus Create a skill that reviews pull requests for security issues
/skill-creator-plus Run evals on my skill and show me the results
/skill-creator-plus Optimize my skill's description for better triggering
/skill-creator-plus Do a blind A/B comparison between the old and new version of my skill

Badge

If you built a skill using Skill Creator Plus, add this badge to your README:

Built with Skill Creator Plus

[![Built with Skill Creator Plus](https://img.shields.io/badge/Built_with-Skill_Creator_Plus-4ecdc4?style=flat-square)](https://github.com/yaniv-golan/skill-creator-plus)

License

MIT — see LICENSE. Built on Anthropic's skill-creator (Apache 2.0) — see NOTICE.

About

Based on Anthropic's skill-creator — with bug fixes, working Cowork support, and official best practices baked in. Claude skill for creating, testing, and improving other Claude skills.

Topics

Resources

License

Stars

Watchers

Forks

Packages

 
 
 

Contributors