googlecloudplatform/gcp-agent-golden-dataset-builder
ai-ml/dev-signal/.agent/skills/gcp-agent-golden-dataset-builder/SKILL.md
Assists developers in collecting and structuring a library of diverse examples ("Golden Dataset") required for data-driven evaluation, including tool trajectories.
$ install --global
skillsauthnpx skillsauth add googlecloudplatform/devrel-demos gcp-agent-golden-dataset-builderInstall this skill globally with one command. Works with Claude Code, Cursor, and Windsurf.
Security Scan Results
3 of 9 scanners reported clean
Some scanners were skipped, did not run, or reported a non-clean status. Review each row below.
3
Scanners Passed
9
Scanners in report
Clean
TrivyContainer and dependency vulnerability scanner
95%
Clean
SemgrepStatic code analysis for vulnerabilities
95%
Clean
mcp-scan (Snyk)Model Context Protocol security validation
95%
Skipped
Snyk (dep)Open source security scanning
50%
Skipped
Socket.devSupply chain security analysis
50%
Skipped
VirusTotalMulti-engine malware detection
50%
Skipped
CrowdStrikeAdvanced threat intelligence
50%
Skipped
OSV-ScannerOpen Source Vulnerability database check
50%
Skipped
OWASP Dep-Check
50%
Last scanned: Apr 5, 2026, 1:59 PM5.9s2 files scanned
SKILL.md
- name:
- gcp-agent-golden-dataset-builder
- description:
- Assists developers in collecting and structuring a library of diverse examples ("Golden Dataset") required for data-driven evaluation, including tool trajectories.
gcp-agent-golden-dataset-builder
This skill helps you build the foundation for data-driven agent development: the Golden Dataset. Grounded in evaluation_blog.md, it focuses on verifying not just the final answer, but the "Thinking Process" (Reasoning Trace).
Usage
Ask Antigravity to:
- "Build a golden dataset with tool trajectories"
- "Structure my evaluation data for tool call validation"
- "Create a template for my Course Creator agent evaluation"
Dataset Pattern
A production-ready dataset uses the .jsonl format and includes:
prompt: The user input.reference: The ground truth answer (for semantic ResponseMatch).reference_trajectory: A list of expected tool calls. This allows the evaluator to check if the agent used the right tools in the right order.
Example Structure
Refer to examples/trajectory_dataset.jsonl for the implementation. Note the use of tool_name and tool_input in the trajectory.
Related Skills
googlecloudplatform/gcp-agent-sdp-template-factory
devops
VerifiedTrustedCommunity
Standardizes the creation of Sensitive Data Protection (DLP) templates for PII and credential redaction.
260SKILL.mdUpdated Apr 5, 2026
googlecloudplatform/gcp-agent-safety-gatekeeper
development
VerifiedTrustedCommunity
Implements the "Defense-in-Depth" integration pattern in Python (intercepting prompts, parsing filter results).
260SKILL.mdUpdated Apr 5, 2026
googlecloudplatform/gcp-agent-model-armor-shield
testing
VerifiedTrustedCommunity
Configures Model Armor security policies (Prompt Injection, Jailbreak, RAI filters).
260SKILL.mdUpdated Apr 5, 2026
googlecloudplatform/gcp-agent-eval-metric-configurator
tools
VerifiedTrustedCommunity
Provides templates for configuring Vertex AI Gen AI Evaluation metrics like GROUNDING, TOOL_USE_QUALITY, and ResponseMatch for specific agent domains.
260SKILL.mdUpdated Apr 5, 2026