jamie-bitflight/comprehensive-test-review
plugins/python3-development/skills/comprehensive-test-review/SKILL.md
Use when reviewing pytest test suites for coverage, isolation, mock usage, naming conventions, or completeness. Activates on requests like "review test coverage", "audit test quality", or "check tests for completeness". Performs thorough checklist-driven review for test isolation, mock correctness, AAA pattern adherence, and naming standards.
$ install --global
skillsauthnpx skillsauth add jamie-bitflight/claude_skills comprehensive-test-reviewInstall this skill globally with one command. Works with Claude Code, Cursor, and Windsurf.
Security Scan Results
3 of 9 scanners reported clean
Some scanners were skipped, did not run, or reported a non-clean status. Review each row below.
3
Scanners Passed
9
Scanners in report
Clean
TrivyContainer and dependency vulnerability scanner
95%
Clean
SemgrepStatic code analysis for vulnerabilities
95%
Clean
mcp-scan (Snyk)Model Context Protocol security validation
95%
Skipped
Snyk (dep)Open source security scanning
50%
Skipped
Socket.devSupply chain security analysis
50%
Skipped
VirusTotalMulti-engine malware detection
50%
Skipped
CrowdStrikeAdvanced threat intelligence
50%
Skipped
OSV-ScannerOpen Source Vulnerability database check
50%
Skipped
OWASP Dep-Check
50%
Last scanned: Apr 28, 2026, 2:17 PM207.3s1 file scanned
SKILL.md
- name:
- comprehensive-test-review
- description:
- Use when reviewing pytest test suites for coverage, isolation, mock usage, naming conventions, or completeness. Activates on requests like "review test coverage", "audit test quality", or "check tests for completeness". Performs thorough checklist-driven review for test isolation, mock correctness, AAA pattern adherence, and naming standards.
- argument-hint:
- <test_file_or_directory>
- user-invocable:
- true
Comprehensive Test Review
Perform thorough test review for the specified test files or directories.
When to Use
- Reviewing test coverage before a release
- Auditing test quality after major refactoring
- Checking tests for completeness and best practices
- Identifying gaps in test suites
Testing Standards
Consult ../python3-development/references/python3-standards.md when auditing against shared testing and quality rules. The checklist below summarizes this skill’s focus; it does not replace the full standards document.
Coverage Requirements:
- [ ] Minimum 80% line and branch coverage
- [ ] Critical paths have 95%+ coverage
- [ ] All public functions have at least one test
- [ ] Edge cases are explicitly tested
Test Quality:
- [ ] Tests follow AAA (Arrange-Act-Assert) pattern
- [ ] Test names describe behavior, not implementation
- [ ] Each test verifies one logical unit
- [ ] Tests are isolated and independent
Mocking Standards:
- [ ] Uses pytest-mock (MockerFixture), NOT unittest.mock
- [ ] Mocks are scoped appropriately
- [ ] No over-mocking of implementation details
- [ ] External dependencies are properly stubbed
Type Safety:
- [ ] All fixtures have complete type hints
- [ ] Test functions have
-> Nonereturn type - [ ] Using Python 3.11+ syntax (
str | None, notOptional[str])
Additional Examination Points
Beyond the standard checklist:
- Test Isolation: No shared state between tests
- Mock Appropriateness: Mocking only external dependencies
- Execution Time: Identifying slow tests for optimization
- Flaky Patterns: Tests dependent on timing, order, or external state
- Naming Clarity: Test names that explain intent and expected behavior
Analysis Process
- Gather test files in specified path
- Run coverage analysis with
uv run pytest --cov - Check each test against the standard checklist
- Identify gaps in coverage and quality
- Generate recommendations prioritized by impact
Output Format
Provide findings in this structure:
## Test Review Summary
### Coverage Analysis
- Overall: X%
- Critical modules: Y%
- Gaps identified: [list]
### Quality Issues
**HIGH Priority:**
- [Issue with location and fix]
**MEDIUM Priority:**
- [Issue with recommendation]
**LOW Priority:**
- [Minor improvements]
### Recommendations
1. [Prioritized action items]
Related Skills
- python3-test-design: Test architecture planning
- python-pytest-architect: Test implementation
Related Agent
For implementing test improvements, use the python-pytest-architect agent.
Related Skills
jamie-bitflight/xdg-base-directory
development
VerifiedTrustedCommunity
When an application needs to store config, data, cache, or state files. When designing where user-specific files should live. When code writes to ~/.appname or hardcoded home paths. When implementing cross-platform file storage with platformdirs.
39SKILL.mdUpdated Apr 30, 2026
jamie-bitflight/verification-gate
testing
VerifiedTrustedCommunity
Enforce mandatory pre-action verification checkpoints to prevent pattern-matching from overriding explicit reasoning. Use this skill when about to execute implementation actions (Bash, Write, Edit) to verify hypothesis-action alignment. Blocks execution when hypothesis unverified or action targets different system than hypothesis identified. Critical for preventing cognitive dissonance where correct diagnosis leads to wrong implementation.
39SKILL.mdUpdated Apr 30, 2026
jamie-bitflight/twelve-factor-app
tools
VerifiedTrustedCommunity
Reference guide for the Twelve-Factor App methodology — 15 principles (12 original + 3 modern extensions) for building portable, resilient, cloud-native applications. Use when evaluating application architecture, designing cloud-native services, reviewing codebases for methodology compliance, advising on configuration, scaling, observability, security, and deployment patterns. Incorporates the 2025 open-source community evolution and cloud-native reinterpretations of each factor.
39SKILL.mdUpdated Apr 30, 2026
jamie-bitflight/user-docs-to-ai-skill
tools
VerifiedTrustedCommunity
Converts user-facing documentation (how-to guides, tutorials, API references, examples) in any format — Markdown, PDF, DOCX, PPTX, XLSX, AsciiDoc, RST, HTML, Jupyter notebooks, man pages, TOML/YAML/JSON configs, and plain text — into Claude Code skill directories with SKILL.md plus thematically grouped references/*.md files. Use when given a docs directory or mixed-format documentation to transform into an AI skill. Uses MCP file-reader server for binary formats.
39SKILL.mdUpdated Apr 30, 2026