antinomyhq/test-reasoning
.forge/skills/test-reasoning/SKILL.md
Validate that reasoning parameters are correctly serialized and sent to provider APIs. Use when the user asks to test reasoning serialization, run reasoning tests, verify reasoning config fields, or check that ReasoningConfig maps correctly to provider-specific JSON (OpenRouter, Anthropic, GitHub Copilot, Codex).
$ install --global
skillsauthnpx skillsauth add antinomyhq/forgecode test-reasoningInstall this skill globally with one command. Works with Claude Code, Cursor, and Windsurf.
Security Scan Results
3 of 9 scanners reported clean
Some scanners were skipped, did not run, or reported a non-clean status. Review each row below.
3
Scanners Passed
9
Scanners in report
Clean
TrivyContainer and dependency vulnerability scanner
95%
Clean
SemgrepStatic code analysis for vulnerabilities
95%
Clean
mcp-scan (Snyk)Model Context Protocol security validation
95%
Skipped
Snyk (dep)Open source security scanning
50%
Skipped
Socket.devSupply chain security analysis
50%
Skipped
VirusTotalMulti-engine malware detection
50%
Skipped
CrowdStrikeAdvanced threat intelligence
50%
Skipped
OSV-ScannerOpen Source Vulnerability database check
50%
Skipped
OWASP Dep-Check
50%
Last scanned: Apr 4, 2026, 4:17 AM4.0s2 files scanned
SKILL.md
- name:
- test-reasoning
- description:
- Validate that reasoning parameters are correctly serialized and sent to provider APIs. Use when the user asks to test reasoning serialization, run reasoning tests, verify reasoning config fields, or check that ReasoningConfig maps correctly to provider-specific JSON (OpenRouter, Anthropic, GitHub Copilot, Codex).
Test Reasoning Serialization
Validates that ReasoningConfig fields are correctly serialized into provider-specific JSON
for OpenRouter, Anthropic, GitHub Copilot, and Codex.
Quick Start
Run all tests with the bundled script:
./scripts/test-reasoning.sh
The script builds forge in debug mode, runs each provider/model combination, captures the
outgoing HTTP request body via FORGE_DEBUG_REQUESTS, and asserts the correct JSON fields.
Running a Single Test Manually
FORGE_DEBUG_REQUESTS="forge.request.json" \
FORGE_SESSION__PROVIDER_ID=<provider_id> \
FORGE_SESSION__MODEL_ID=<model_id> \
FORGE_REASONING__EFFORT=<effort> \
target/debug/forge -p "Hello!"
Then inspect .forge/forge.request.json for the expected fields.
Test Coverage
| Provider | Model | Config fields | Expected JSON field |
| ---------------- | ---------------------------- | ------------------------------------------------- | --------------------------------- |
| open_router | openai/o4-mini | effort: none\|minimal\|low\|medium\|high\|xhigh | reasoning.effort |
| open_router | openai/o4-mini | max_tokens: 4000 | reasoning.max_tokens |
| open_router | openai/o4-mini | effort: high + exclude: true | reasoning.effort + .exclude |
| open_router | openai/o4-mini | enabled: true | reasoning.enabled |
| open_router | anthropic/claude-opus-4-5 | max_tokens: 4000 | reasoning.max_tokens |
| open_router | moonshotai/kimi-k2 | max_tokens: 4000 | reasoning.max_tokens |
| open_router | moonshotai/kimi-k2 | effort: high | reasoning.effort |
| open_router | minimax/minimax-m2 | max_tokens: 4000 | reasoning.max_tokens |
| open_router | minimax/minimax-m2 | effort: high | reasoning.effort |
| anthropic | claude-opus-4-6 | effort: low\|medium\|high\|max | output_config.effort |
| anthropic | claude-3-7-sonnet-20250219 | enabled: true + max_tokens: 8000 | thinking.type + budget_tokens |
| github_copilot | o4-mini | effort: none\|minimal\|low\|medium\|high\|xhigh | reasoning_effort (top-level) |
| codex | gpt-5.1-codex | effort: none\|minimal\|low\|medium\|high\|xhigh | reasoning.effort + .summary |
| codex | gpt-5.1-codex | effort: medium + exclude: true | reasoning.summary = "concise" |
| all providers | one model each | effort: invalid | non-zero exit, no request written |
Tests for unconfigured providers are skipped automatically. Invalid-effort tests run regardless of credentials — the rejection happens at config parse time before any provider interaction.
References
- OpenAI Reasoning guide
- OpenAI Chat Completions API reference
- Anthropic Extended Thinking
- OpenRouter Reasoning Tokens
Related Skills
antinomyhq/github-pr-description
tools
VerifiedTrustedCommunity
Generate and create pull request descriptions automatically using GitHub CLI. Use when the user asks to create a PR, generate a PR description, make a pull request, or submit changes for review. Analyzes git diff and commit history to create comprehensive, meaningful PR descriptions that explain what changed, why it matters, and how to test it.
5,784SKILL.mdUpdated Apr 4, 2026
antinomyhq/execute-plan
development
VerifiedTrustedCommunity
Execute structured task plans with status tracking. Use when the user provides a plan file path in the format `plans/{current-date}-{task-name}-{version}.md` or explicitly asks you to execute a plan file.
5,784SKILL.mdUpdated Apr 4, 2026
antinomyhq/create-skill
tools
VerifiedTrustedCommunity
Guide for creating effective skills. This skill should be used when users want to create a new skill (or update an existing skill) that extends your capabilities with specialized knowledge, workflows, or tool integrations.
5,784SKILL.mdUpdated Apr 4, 2026
antinomyhq/test-skill
testing
VerifiedTrustedCommunity
A test skill with resources
5,784SKILL.mdUpdated Apr 4, 2026