alexeyban/databricks-dq-automation
skills/databricks-dq-automation/SKILL.md
Run repository-managed Databricks SQL data quality checks after pipeline changes and turn results into a PASS/FAIL report.
$ install --global
skillsauthnpx skillsauth add alexeyban/databricks-lab databricks-dq-automationInstall this skill globally with one command. Works with Claude Code, Cursor, and Windsurf.
Security Scan Results
3 of 9 scanners reported clean
Some scanners were skipped, did not run, or reported a non-clean status. Review each row below.
3
Scanners Passed
9
Scanners in report
Clean
TrivyContainer and dependency vulnerability scanner
95%
Clean
SemgrepStatic code analysis for vulnerabilities
95%
Clean
mcp-scan (Snyk)Model Context Protocol security validation
95%
Skipped
Snyk (dep)Open source security scanning
50%
Skipped
Socket.devSupply chain security analysis
50%
Skipped
VirusTotalMulti-engine malware detection
50%
Skipped
CrowdStrikeAdvanced threat intelligence
50%
Skipped
OSV-ScannerOpen Source Vulnerability database check
50%
Skipped
OWASP Dep-Check
50%
Last scanned: Apr 23, 2026, 1:17 PM22.4s2 files scanned
SKILL.md
- name:
- databricks-dq-automation
- description:
- Run repository-managed Databricks SQL data quality checks after pipeline changes and turn results into a PASS/FAIL report.
databricks-dq-automation
Use this skill when pipeline work changes Bronze, Silver, Gold, or notebook orchestration and you need automated post-update DQ validation.
Workflow
- Read
Agents/databricks-dq-automation.mdbefore substantive work. - Prefer stored SQL in
dq_queries/over handwritten one-off checks. - Run
skills/databricks-dq-automation/scripts/run_silver_dq.pyafter notebook or workflow updates that touch Silver outputs. - Treat any failed DQ check as a blocker until the cause is understood or fixed.
Repository Mapping
- Agent definition:
Agents/databricks-dq-automation.md - Query folder:
dq_queries/silver/ - Automation script:
skills/databricks-dq-automation/scripts/run_silver_dq.py
Related Skills
alexeyban/testing-reality-checker
testing
VerifiedTrustedCommunity
Use this skill to act as the agent defined in testing-reality-checker.md for tasks matching that role.
20SKILL.mdUpdated Apr 23, 2026
alexeyban/spark-performance-engineer
data-ai
VerifiedTrustedCommunity
Use this skill to act as the agent defined in spark_performance_engineer.md for tasks matching that role.
20SKILL.mdUpdated Apr 23, 2026
alexeyban/project-manager-senior
data-ai
VerifiedTrustedCommunity
Use this skill to act as the agent defined in project-manager-senior.md for tasks matching that role.
20SKILL.mdUpdated Apr 23, 2026
alexeyban/lakehouse-data-architect
data-ai
VerifiedTrustedCommunity
Use this skill to act as the agent defined in lakehouse_data_architect.md for tasks matching that role.
20SKILL.mdUpdated Apr 23, 2026