aztfmod/regression-test-runner
.github/skills/regression-test-runner/SKILL.md
Run the full CI test suite (make test_ci), parse output, and report pass/fail with failure details. Use after code changes to verify nothing is broken. Triggers on: code changes, PR validation, post-build verification.
$ install --global
skillsauthnpx skillsauth add aztfmod/terraform-provider-azurecaf regression-test-runnerInstall this skill globally with one command. Works with Claude Code, Cursor, and Windsurf.
Security Scan Results
3 of 9 scanners reported clean
Some scanners were skipped, did not run, or reported a non-clean status. Review each row below.
3
Scanners Passed
9
Scanners in report
Clean
TrivyContainer and dependency vulnerability scanner
95%
Clean
SemgrepStatic code analysis for vulnerabilities
95%
Clean
mcp-scan (Snyk)Model Context Protocol security validation
95%
Skipped
Snyk (dep)Open source security scanning
50%
Skipped
Socket.devSupply chain security analysis
50%
Skipped
VirusTotalMulti-engine malware detection
50%
Skipped
CrowdStrikeAdvanced threat intelligence
50%
Skipped
OSV-ScannerOpen Source Vulnerability database check
50%
Skipped
OWASP Dep-Check
50%
Last scanned: Apr 3, 2026, 7:18 PM40.7s1 file scanned
SKILL.md
- name:
- regression-test-runner
- description:
- Run the full CI test suite (make test_ci), parse output, and report pass/fail with failure details. Use after code changes to verify nothing is broken. Triggers on: code changes, PR validation, post-build verification.
Regression Test Runner
Procedure
1. Run test suite
make test_ci 2>&1 | tee /tmp/test-ci-output.txt
This runs: unit tests, coverage, resource validation, and matrix testing.
2. Parse results
Check exit code:
- 0: All tests passed
- Non-zero: Failures detected
Extract summary from output:
grep -E "^(ok|FAIL|---)" /tmp/test-ci-output.txt
3. Report
If all tests pass:
✅ Regression tests: PASSED
Packages: <count> passed
Coverage: <percentage>%
If failures detected:
❌ Regression tests: FAILED
Failed packages:
- <package>: <failure summary>
Failure details:
<relevant test output>
Extract the specific test function names and error messages for each failure.
4. Coverage check
Extract coverage percentage:
grep "coverage:" /tmp/test-ci-output.txt | tail -1
Flag if coverage drops below 95%.
5. Cleanup
rm -f /tmp/test-ci-output.txt
Related Skills
aztfmod/test-failure-diagnosis
development
VerifiedTrustedCommunity
Analyze test failure output to identify root cause and suggest fixes. Use when build or test failures occur. Triggers on: test failures, build errors, CI failures.
183SKILL.mdUpdated Apr 3, 2026
aztfmod/terraform-mock-test
development
VerifiedTrustedCommunity
Validate a resource definition end-to-end using terraform test with mock_provider azurerm. Proves the CAF-generated name is accepted by the azurerm provider schema without Azure credentials. Use after provider-build-test succeeds to run the mocked azurerm integration test.
183SKILL.mdUpdated Apr 3, 2026
aztfmod/semver-assessment
documentation
VerifiedTrustedCommunity
Analyze changes since the last release tag and determine the appropriate semantic version bump (patch/minor/major) based on CHANGELOG entries and commit types. Triggers on: release preparation, version planning.
183SKILL.mdUpdated Apr 3, 2026
aztfmod/resource-diff-report
testing
VerifiedTrustedCommunity
Compare two versions of resourceDefinition.json (e.g., branch vs main) and produce a structured change summary. Triggers on: PR review, audit, before/after comparison.
183SKILL.mdUpdated Apr 3, 2026