ADu2021/astroreason-bench-evaluating-unified-agentic
skills/skillxiv-v0.0.2-claude-opus-4.6/astroreason-bench-evaluating-unified-agentic/SKILL.md
Recent advances in agentic Large Language Models (LLMs) have positioned them as generalist planners capable of reasoning and acting across diverse tasks. However, existing agent benchmarks largely focus on symbolic or weakly grounded environments, leaving their performance in physics-constrained real-world domains underexplored. We introduce AstroReason-Bench, a comprehensive benchmark for evaluating agentic planning in Space Planning Problems (SPP), a family of high-stakes problems with heterog...
$ install --global
skillsauthnpx skillsauth add ADu2021/skillXiv astroreason-bench-evaluating-unified-agenticInstall this skill globally with one command. Works with Claude Code, Cursor, and Windsurf.
Security Scan Results
3 of 9 scanners reported clean
Some scanners were skipped, did not run, or reported a non-clean status. Review each row below.
3
Scanners Passed
9
Scanners in report
Clean
TrivyContainer and dependency vulnerability scanner
95%
Clean
SemgrepStatic code analysis for vulnerabilities
95%
Clean
mcp-scan (Snyk)Model Context Protocol security validation
95%
Skipped
Snyk (dep)Open source security scanning
50%
Skipped
Socket.devSupply chain security analysis
50%
Skipped
VirusTotalMulti-engine malware detection
50%
Skipped
CrowdStrikeAdvanced threat intelligence
50%
Skipped
OSV-ScannerOpen Source Vulnerability database check
50%
Skipped
OWASP Dep-Check
50%
Last scanned: Apr 24, 2026, 8:55 PM1.7s1 file scanned
SKILL.md
- name:
- astroreason-bench-evaluating-unified-agentic
- title:
- AstroReason-Bench: Evaluating Unified Agentic Planning Across Heterogeneous Space Planning Problems
- version:
- 0.0.2
- engine:
- skillxiv-v0.0.2-claude-opus-4.6
- license:
- MIT
- url:
- https://arxiv.org/abs/2601.11354
- keywords:
- [Agent, Planning]
- description:
- Recent advances in agentic Large Language Models (LLMs) have positioned them as generalist planners capable of reasoning and acting across diverse tasks. However, existing agent benchmarks largely focus on symbolic or weakly grounded environments, leaving their performance in physics-constrained real-world domains underexplored. We introduce AstroReason-Bench, a comprehensive benchmark for evaluating agentic planning in Space Planning Problems (SPP), a family of high-stakes problems with heterog...
Problem
AstroReason-Bench addresses key challenges in autonomous agent development. This paper provides solutions for evaluating, building, or improving agent systems.
Key Approach
The paper introduces a novel framework, methodology, or benchmark for astroreason-bench. The core contributions include:
- Systematic framework or benchmark for agent evaluation and development
- Empirical findings on agent performance, efficiency, or capabilities
- Generalizable principles applicable across domains
When to Use
Use this skill when you need to:
- Evaluate or benchmark autonomous agent systems
- Understand best practices in agent design and evaluation
- Learn empirical results on agent performance
- Improve agent efficiency, reasoning, or capabilities
When NOT to Use
- For non-agent-related tasks
- When seeking quick implementation code (see the paper for details)
- For general knowledge unrelated to autonomous agents
Resources
- ArXiv Abstract: https://arxiv.org/abs/2601.11354
- Full PDF: https://arxiv.org/pdf/2601.11354
- HTML Version: https://arxiv.org/html/2601.11354
See the paper for comprehensive methodology, experimental protocols, benchmarks, and implementation details.
Related Skills
ADu2021/flow-map-trajectory-tilting
testing
VerifiedTrustedCommunity
Uses flow maps as look-ahead operators to enable principled reward-guided diffusion by predicting trajectory endpoints at any denoising step. Deploy when applying rewards or preferences to diffusion trajectories with meaningful gradients throughout generation.
2SKILL.mdUpdated Apr 17, 2026
ADu2021/flexible-data-mixture-of-experts
testing
VerifiedTrustedCommunity
Train language models where each expert learns independently on closed datasets, enabling flexible inference with selective data inclusion or exclusion. 41% performance improvement while allowing users to opt out of specific data sources without retraining.
2SKILL.mdUpdated Apr 17, 2026
ADu2021/flexibility-trap-diffusion-reasoning
data-ai
VerifiedTrustedCommunity
Understand how token generation flexibility in diffusion LMs paradoxically constrains reasoning, as models exploit ordering flexibility to avoid uncertain tokens, and apply simplified approaches that preserve parallel decoding benefits. Use when optimizing diffusion-based language models for reasoning tasks.
2SKILL.mdUpdated Apr 17, 2026
ADu2021/flex-continuous-agent-evolution
devops
VerifiedTrustedCommunity
Enable LLM agents to improve continuously during deployment by constructing structured experience libraries through self-reflection on successes and failures—achieving 23% improvement on reasoning without gradient-based parameter updates or external training.
2SKILL.mdUpdated Apr 17, 2026