a5c-ai/rubric-design-validation
library/specializations/domains/social-sciences-humanities/education/skills/rubric-design-validation/SKILL.md
Develop clear scoring rubrics with defined criteria, performance levels, and anchor examples ensuring inter-rater reliability
$ install --global
skillsauthnpx skillsauth add a5c-ai/babysitter rubric-design-validationInstall this skill globally with one command. Works with Claude Code, Cursor, and Windsurf.
Security Scan Results
3 of 9 scanners reported clean
Some scanners were skipped, did not run, or reported a non-clean status. Review each row below.
3
Scanners Passed
9
Scanners in report
Clean
TrivyContainer and dependency vulnerability scanner
95%
Clean
SemgrepStatic code analysis for vulnerabilities
95%
Clean
mcp-scan (Snyk)Model Context Protocol security validation
95%
Skipped
Snyk (dep)Open source security scanning
50%
Skipped
Socket.devSupply chain security analysis
50%
Skipped
VirusTotalMulti-engine malware detection
50%
Skipped
CrowdStrikeAdvanced threat intelligence
50%
Skipped
OSV-ScannerOpen Source Vulnerability database check
50%
Skipped
OWASP Dep-Check
50%
Last scanned: Apr 2, 2026, 9:51 AM57.9s1 file scanned
SKILL.md
- name:
- rubric-design-validation
- description:
- Develop clear scoring rubrics with defined criteria, performance levels, and anchor examples ensuring inter-rater reliability
- allowed-tools:
- Read, Grep, Write, Edit, Glob
Rubric Design and Validation
Develop clear scoring rubrics with defined criteria, performance levels, and anchor examples ensuring inter-rater reliability.
Overview
This skill enables the development and validation of scoring rubrics for educational assessment. It encompasses criteria definition, performance level articulation, anchor example selection, and reliability validation to ensure consistent and fair evaluation of student work.
Capabilities
Criteria Development
- Identify essential performance dimensions
- Define observable indicators
- Weight criteria appropriately
- Ensure comprehensiveness
- Avoid overlap between criteria
Performance Level Definition
- Articulate distinct levels
- Write clear descriptors
- Ensure progressive differentiation
- Define score points
- Create level labels
Anchor Examples
- Select representative samples
- Document exemplars for each level
- Annotate scoring rationale
- Create training materials
- Validate with raters
Reliability Validation
- Conduct inter-rater reliability studies
- Calculate agreement statistics
- Identify scoring inconsistencies
- Revise for clarity
- Train and calibrate raters
Usage Guidelines
Rubric Development Process
- Define purpose and use
- Identify assessment criteria
- Describe performance levels
- Draft rubric descriptors
- Select and annotate anchors
- Validate with multiple raters
- Revise based on feedback
Descriptor Writing
- Use concrete, observable language
- Avoid vague qualifiers
- Ensure parallel structure
- Include critical attributes
- Distinguish adjacent levels clearly
Validation Process
- Select diverse raters
- Provide calibration training
- Score common samples
- Calculate reliability statistics
- Revise unclear criteria
Integration Points
Related Processes
- Rubric Development and Validation
- Summative Assessment Development
- Formative Assessment Design
Collaborating Skills
- assessment-item-development
- learning-objectives-writing
- quality-assurance-review
References
- Stevens and Levi rubric design
- Brookhart rubric guidelines
- Inter-rater reliability methods
- Performance assessment standards
Related Skills
a5c-ai/model-card-generator
development
VerifiedTrustedCommunity
Model documentation skill for generating model cards following Google's model card framework.
680SKILL.mdUpdated Apr 28, 2026
a5c-ai/mlflow-experiment-tracker
development
VerifiedTrustedCommunity
MLflow integration skill for experiment tracking, model registry, and artifact management. Enables LLMs to log experiments, compare runs, manage model lifecycle, and retrieve artifacts through the MLflow API.
680SKILL.mdUpdated Apr 28, 2026
a5c-ai/lime-explainer
data-ai
VerifiedTrustedCommunity
LIME-based local explanation skill for individual predictions across tabular, text, and image data.
680SKILL.mdUpdated Apr 28, 2026
a5c-ai/kubeflow-pipeline-executor
devops
VerifiedTrustedCommunity
Kubeflow Pipelines skill for ML workflow orchestration, component management, and Kubernetes-native ML.
680SKILL.mdUpdated Apr 28, 2026