intent-solutions-io/nixtla-universal-validator
003-skills/.claude/skills/nixtla-universal-validator/SKILL.md
Validate Nixtla skills and plugins with deterministic evidence bundles and strict schema gates. Use when auditing changes or enforcing compliance. Trigger with 'run validation' or 'audit validators'.
$ install --global
skillsauthnpx skillsauth add intent-solutions-io/plugins-nixtla nixtla-universal-validatorInstall this skill globally with one command. Works with Claude Code, Cursor, and Windsurf.
Security Scan Results
3 of 9 scanners reported clean
Some scanners were skipped, did not run, or reported a non-clean status. Review each row below.
3
Scanners Passed
9
Scanners in report
Clean
TrivyContainer and dependency vulnerability scanner
95%
Clean
SemgrepStatic code analysis for vulnerabilities
95%
Clean
mcp-scan (Snyk)Model Context Protocol security validation
95%
Skipped
Snyk (dep)Open source security scanning
50%
Skipped
Socket.devSupply chain security analysis
50%
Skipped
VirusTotalMulti-engine malware detection
50%
Skipped
CrowdStrikeAdvanced threat intelligence
50%
Skipped
OSV-ScannerOpen Source Vulnerability database check
50%
Skipped
OWASP Dep-Check
50%
Last scanned: Apr 5, 2026, 11:14 PM5.5s21 files scanned
SKILL.md
- name:
- nixtla-universal-validator
- description:
- Validate Nixtla skills and plugins with deterministic evidence bundles and strict schema gates. Use when auditing changes or enforcing compliance. Trigger with 'run validation' or 'audit validators'.
- allowed-tools:
- Read,Write,Bash(python:*),Bash(bash:*),Bash(pytest:*)
- version:
- 1.0.0
- author:
- Jeremy Longshore <[email protected]>
- license:
- MIT
Nixtla Universal Validator
Purpose
Produce deterministic, reviewable validation evidence (reports + JSON + logs) for a repo, plugin, or skill.
Overview
This skill combines two layers:
- A multi-phase subagent workflow (for human-readable analysis + reconciliation)
- A deterministic validator runner (for ground-truth logs and machine-readable summaries)
Validation runs as a pipeline with deterministic gates:
- Discover what changed and what should be validated
- Validate schemas/structure (skills + plugins) using canonical repo validators
- Run behavioral checks (tests) when requested
- Reconcile results into a single evidence bundle with pass/fail and next actions
This pattern generalizes beyond Nixtla by swapping the check catalog (a list of commands + expected artifacts).
Prerequisites
- Python 3.11+
- Repo validators available:
004-scripts/validate_skills_v2.py004-scripts/validate-all-plugins.sh
- Optional for plugin validation:
jq
Instructions
Step 1: Create a run directory
Use the built-in runner to create a timestamped evidence bundle under reports/<project>/<timestamp>/.
Step 2: Pick a target scope
Choose one:
- Repo root: validate everything
- A plugin folder:
005-plugins/<plugin> - A skill folder:
.claude/skills/<skill>or003-skills/.claude/skills/<skill>
Step 3: Run the deterministic validator suite
python {baseDir}/scripts/run_validator_suite.py \
--target . \
--project nixtla \
--out reports/nixtla
List built-in profiles:
python {baseDir}/scripts/run_validator_suite.py \
--list-profiles \
--target . \
--project nixtla \
--out reports/nixtla
To validate a single plugin:
python {baseDir}/scripts/run_validator_suite.py \
--target 005-plugins/nixtla-baseline-lab \
--project nixtla-baseline-lab \
--out reports/nixtla-baseline-lab
Step 4: (Optional) Include tests
python {baseDir}/scripts/run_validator_suite.py \
--target . \
--project nixtla \
--out reports/nixtla \
--run-tests
Step 4b: (Optional) Run an enterprise profile
python {baseDir}/scripts/run_validator_suite.py \
--target . \
--project nixtla \
--out reports/nixtla \
--profile enterprise \
--fail-on-warn \
--run-tests
Step 5: (Optional) Use the multi-phase subagent workflow
Run phases in order using the prompts in {baseDir}/agents/ and procedures in {baseDir}/references/.
Each phase must write a report file under the run directory and return strict JSON per the phase contract.
Output
Each run creates a timestamped evidence bundle:
reports/<project>/<timestamp>/summary.jsonreports/<project>/<timestamp>/report.mdreports/<project>/<timestamp>/checks/*.log
Error Handling
-
Error: Validator command not found
Solution: Confirm repo scripts exist and run from the repo root. -
Error: Plugin validation fails due to
jq
Solution: Installjqor run only skill validation. -
Error: Tests fail after schema passes
Solution: Treat this as a behavioral regression; fix tests or code, then re-run.
Examples
Common validations:
# Strict schema/structure gates
python 004-scripts/validate_skills_v2.py --fail-on-warn
bash 004-scripts/validate-all-plugins.sh .
Generate an evidence bundle (profile-driven):
# Generate a single evidence bundle for a PR
python {baseDir}/scripts/run_validator_suite.py \
--target . \
--project pr-1234 \
--out reports/pr-1234 \
--run-tests
Resources
- Subagent orchestration pattern:
000-docs/000a-planned-skills/templates/verification-pipeline/README.md - Canonical skills validator:
004-scripts/validate_skills_v2.py - Canonical plugin validator:
004-scripts/validate-all-plugins.sh - Subagent prompts:
{baseDir}/agents/ - Phase procedures:
{baseDir}/references/
Related Skills
intent-solutions-io/running-load-tests
tools
VerifiedTrustedCommunity
This skill enables Claude to create and execute load tests for performance validation. It is designed to generate load test scripts using tools like k6, JMeter, and Artillery, based on specified test scenarios. Use this skill when the user requests to create a "load test", conduct "performance testing", validate "application performance", or needs a "stress test" to identify breaking points in the application. The skill helps define performance thresholds and provides execution instructions.
9SKILL.mdUpdated Aug 26, 2026
intent-solutions-io/collecting-infrastructure-metrics
testing
VerifiedTrustedCommunity
This skill enables Claude to collect comprehensive infrastructure performance metrics across compute, storage, network, containers, load balancers, and databases. It is triggered when the user requests "collect infrastructure metrics", "monitor server performance", "set up performance dashboards", or needs to analyze system resource utilization. The skill configures metrics collection, sets up aggregation, and helps create infrastructure dashboards for health monitoring and capacity tracking. It supports configuration for Prometheus, Datadog, and CloudWatch.
9SKILL.mdUpdated Aug 26, 2026
intent-solutions-io/monitoring-error-rates
tools
VerifiedTrustedCommunity
This skill enables Claude to monitor and analyze application error rates to improve reliability. It is used when the user needs to track and understand errors occurring in their application, including HTTP errors, application exceptions, database errors, external API errors, background job errors, and client-side errors. Use this skill when the user asks to "monitor errors", "analyze error rates", "track application errors", or requests help with "error monitoring". It sets up comprehensive error tracking and alerting based on defined thresholds.
9SKILL.mdUpdated Aug 26, 2026
intent-solutions-io/setting-up-distributed-tracing
development
VerifiedTrustedCommunity
This skill automates the setup of distributed tracing for microservices. It helps developers implement end-to-end request visibility by configuring context propagation, span creation, trace collection, and analysis. Use this skill when the user requests to set up distributed tracing, implement observability, or troubleshoot performance issues in a microservices architecture. The skill is triggered by phrases such as "setup tracing", "implement distributed tracing", "configure opentelemetry", or "add observability to microservices".
9SKILL.mdUpdated Aug 26, 2026