nicsuzor/eval
archived/skills/eval/SKILL.md
Agent session quality assessment — merged into /qa as Agent Session Evaluation mode
testing
Updated Apr 9, 2026
$ install --global
skillsauthnpx skillsauth add nicsuzor/academicops evalInstall this skill globally with one command. Works with Claude Code, Cursor, and Windsurf.
Security Scan Results
3 of 9 scanners reported clean
Some scanners were skipped, did not run, or reported a non-clean status. Review each row below.
3
Scanners Passed
9
Scanners in report
Clean
TrivyContainer and dependency vulnerability scanner
95%
Clean
SemgrepStatic code analysis for vulnerabilities
95%
Clean
mcp-scan (Snyk)Model Context Protocol security validation
95%
Skipped
Snyk (dep)Open source security scanning
50%
Skipped
Socket.devSupply chain security analysis
50%
Skipped
VirusTotalMulti-engine malware detection
50%
Skipped
CrowdStrikeAdvanced threat intelligence
50%
Skipped
OSV-ScannerOpen Source Vulnerability database check
50%
Skipped
OWASP Dep-Check
50%
Last scanned: Apr 9, 2026, 2:26 AM36.8s3 files scanned
SKILL.md
- name:
- eval
- type:
- skill
- category:
- analysis
- description:
- Agent session quality assessment — merged into /qa as Agent Session Evaluation mode
- modifies_files:
- true
- needs_task:
- false
- mode:
- execution
- allowed-tools:
- Bash,Read,Write,Glob,Grep,Agent
- version:
- 3.0.0
/eval — Agent Session Evaluation
This skill is merged into /qa. Use the Agent Session Evaluation mode there.
See: [[../../skills/qa/SKILL.md]]
All evaluation logic, quality dimensions, and the session extraction script are documented in /qa.
The dimensions reference and extraction script remain at their current paths:
- Quality dimensions: [[references/dimensions.md]]
- Session extractor:
skills/eval/scripts/prepare_evaluation.py
Related Skills
nicsuzor/program
tools
VerifiedTrustedCommunity
Program / portfolio supervision — the autonomous top loop above /supervisor. "Ready the release" → discover and decompose the constituent epics → run /supervisor on each → surface only escalations + merge-ready PRs. Stateless tick driven by /loop; all cross-tick state lives in the program task body.
SKILL.mdUpdated May 30, 2026
nicsuzor/cowork-sync
development
VerifiedTrustedCommunity
Mirror PKB tasks onto the Cowork native task list at claim time and sync completion back to PKB. Cowork-only; ships only in the cowork build of aops-core.
SKILL.mdUpdated May 29, 2026
nicsuzor/craft
testing
VerifiedTrustedCommunity
Instruction quality gate — reviews agent instructions (task bodies, workflow steps, skill procedures, self-test protocols) for shallow-execution vulnerabilities before deployment. Two modes: author (pre-hoc review) and audit (trace a failure back to the instruction gap). The bar is excellence, not compliance.
SKILL.mdUpdated May 24, 2026
nicsuzor/design-rubric
content-media
VerifiedTrustedCommunity
Design-stage fitness rubric — persona immersion, scenario design, dimensions that define what excellence looks like for the people a feature serves. Two modes — author (produce a rubric for a new spec) and critique (red-team an existing spec). Output lives on the spec, not in the verification brief. Owned by pauli.
SKILL.mdUpdated May 18, 2026