aufrank/tool-quality-audit
skills/tool-quality-audit/SKILL.md
Audit tool integrations for deterministic behavior, error contracts, and logging before agents depend on them. Use when adding or updating tools or MCP servers.
tools
Updated Apr 3, 2026
$ install --global
skillsauthnpx skillsauth add aufrank/agent-skills tool-quality-auditInstall this skill globally with one command. Works with Claude Code, Cursor, and Windsurf.
Security Scan Results
3 of 9 scanners reported clean
Some scanners were skipped, did not run, or reported a non-clean status. Review each row below.
3
Scanners Passed
9
Scanners in report
Clean
TrivyContainer and dependency vulnerability scanner
95%
Clean
SemgrepStatic code analysis for vulnerabilities
95%
Clean
mcp-scan (Snyk)Model Context Protocol security validation
95%
Skipped
Snyk (dep)Open source security scanning
50%
Skipped
Socket.devSupply chain security analysis
50%
Skipped
VirusTotalMulti-engine malware detection
50%
Skipped
CrowdStrikeAdvanced threat intelligence
50%
Skipped
OSV-ScannerOpen Source Vulnerability database check
50%
Skipped
OWASP Dep-Check
50%
Last scanned: Apr 20, 2026, 3:20 PM1.7s1 file scanned
SKILL.md
- name:
- tool-quality-audit
- description:
- Audit tool integrations for deterministic behavior, error contracts, and logging before agents depend on them. Use when adding or updating tools or MCP servers.
- short-description:
- Tool contract checks and smoke tests
- audience:
- tool-authors
- stability:
- draft
- tags:
- [tools, validation, mcp]
Tool Quality Audit
Overview
Evaluate a tool’s reliability with a checklist and small smoke tests. Emphasize deterministic outputs, clear errors, and stable schemas.
Quick start
- Fill
templates/tool_audit.json. - Run smoke tests manually or via your harness.
- Record findings in
results.json.
Core Guidance
- Prefer deterministic checks before LLM-based grading.
- Verify error contracts (consistent codes/messages).
- Validate schemas are stable and documented.
- Record latency and failure modes.
Resources
references/tool-audit-checklist.md: Reliability and contract checklist.templates/tool_audit.json: Audit scaffold for a tool.
Validation
- Ensure audit file is filled and failures are actionable.
Related Skills
aufrank/running-dag-pipelines
tools
VerifiedTrustedCommunity
Build and execute modular DAG workflows for long-context processing using slice/map/reduce/recurse/compact/filter operators. Use for one-shot batch jobs, standalone map-reduce pipelines, or when the context-dag plugin is not installed. Trigger when input exceeds the model's context window, when reproducible logged pipelines are needed, or when multi-level recursive processing is required. If context-dag is installed, the plugin's bundled dag_runner.py provides the same capability with persistent artifact storage.
SKILL.mdUpdated May 7, 2026
aufrank/austin-frank-voice
documentation
VerifiedTrustedCommunity
Write in Austin Frank's voice and style. Use this skill whenever generating text that should sound like Austin — strategy docs, charters, proposals, business cases, vision documents, staffing requests, stakeholder updates, cover letters, mission statements, org design documents, or any professional prose where the user wants Austin's distinctive voice. Also use when the user asks to review, edit, or improve a draft for voice consistency, or when they reference "my style", "my voice", "write like me", or "Austin's style".
SKILL.mdUpdated May 7, 2026
aufrank/working-with-notion-programmatically
tools
VerifiedTrustedCommunity
Use mcpc to interact with the Notion MCP server: connect sessions, search workspace content, fetch pages/databases, and run helper scripts for common Notion actions.
SKILL.mdUpdated Apr 3, 2026
aufrank/workflow-or-agent-decider
tools
VerifiedTrustedCommunity
Decide between a scripted workflow and an autonomous agent harness, then scaffold the chosen path. Use when scoping new agentic systems or tool integrations.
SKILL.mdUpdated Apr 3, 2026