openai/omniverse-cad-to-simready

CAD to SimReady

When to Use

Use this workflow skill when the user wants an end-to-end pipeline from a source asset to a SimReady asset or package. This skill coordinates existing conversion, authoring, validation, conformance, rendering, and packaging references directly. Do not replace the workflow with a single monolithic runner command.

This skill is documentation-driven and does not ship scripts/run.py. It should not depend on a repository checkout. When a stage needs deterministic execution, run the portable script from that stage reference's installed directory. Shell is declared because this workflow invokes installed stage reference scripts directly; it still must not grow a monolithic runner.

Prerequisites

• Prefer running the preflight reference first for deterministic setup. It installs or verifies local upstream checkouts, writes a cad-to-simready-preflight.json manifest, and exports PHYSICAL_AI_PREFLIGHT_MANIFEST plus PHYSICAL_AI_REQUIRE_PREFLIGHT=1 for downstream references.
• Python 3.12 and uv (per repo README.md).
• NVIDIA_API_KEY from https://build.nvidia.com when local Content Agents deployment will run. Already-running endpoints may instead use explicit endpoint variables plus usage tokens such as NGC_API_KEY, NVCF_API_KEY, or CONTENT_AGENTS_*_TOKEN.
• Docker, NVIDIA Container Toolkit, and an NVIDIA GPU for Content Agents and OVRTX stages.
• Local upstream checkouts under ${PHYSICAL_AI_SKILL_HUB_UPSTREAM_ROOT:-$HOME/.physical-ai-skill-hub/upstreams} when a downstream stage needs upstream scripts or specs.

Minimum Viable Scope

Conversion-only is a valid workflow request. When the user asks only to convert or smoke-test source asset conversion, set property_assignment_intent=skip, do not deploy Content Agents, run convert-to-usd, then run validate-usd-minimum on the generated USD if conversion succeeds.

Do not imply that uv sync installs every source converter runtime. URDF, MuJoCo/MJCF, and the repo Python dependencies are handled by the project environment, but NVIDIA-backed source conversion requires an installed and validated NVIDIA-Omniverse/usd-convert-cad checkout. If that runtime is missing or does not support the source, preserve the blocked conversion report and its install_hint instead of attempting an unrequested local build or substituting another converter.

First Action

For any broad CAD/source-asset to SimReady request, assume property_assignment_intent=run unless the user explicitly asks for conversion-only, validation-only, or no material/physics assignment.

Before invoking converter, validation, Content Agents, OVRTX, packaging, or FET helper scripts, run the preflight reference or verify an existing PHYSICAL_AI_PREFLIGHT_MANIFEST. Treat preflight as the mandatory dependency bootstrap step, not as workflow routing. If the user explicitly asks not to deploy services or asks for conversion-only/validation-only, use --skip-content-agents. When PHYSICAL_AI_REQUIRE_PREFLIGHT=1 is set and a required component is not ready in the manifest, downstream references must block with the preflight guardrail instead of rediscovering upstreams or services directly.

When property_assignment_intent=run, the first operational action after confirming the source path and resolving intent is to verify or deploy Content Agents services. Do this before asset-context inspection, converter dependency checks, conversion, validation, conformance, rendering, packaging, or upstream source builds.

Use healthy existing endpoints when available. If OVRTX, Material, or Physics endpoints are missing or unhealthy, run deploy-content-agents first and do not continue until the shared standalone OVRTX renderer plus independent Material and Physics service containers are healthy and exported through CONTENT_AGENTS_*_BASE_URL. Deploy the Texture Agent too when texture generation is requested.

If required deployment authentication is missing, ask the user for NVIDIA_API_KEY and wait. If a provided endpoint requires usage auth, ask for the appropriate usage token instead. If deployment cannot produce healthy services, report Content Agents readiness as blocked instead of proceeding to conversion.

Instructions

1. Confirm the source asset path exists, resolve output_root, and classify the request as end-to-end, conversion-only, validation-only, or packaging.
2. Resolve property_assignment_intent before running any asset inspection, converter probe, conversion, validation, conformance, rendering, or packaging step.
3. Run preflight for the selected workflow targets, unless a ready PHYSICAL_AI_PREFLIGHT_MANIFEST is already configured. Source the generated env file before running downstream scripts. Treat preflight as dependency setup only: it may use a provided --source-asset, --source-format, or --conversion-tools value to scope dependency checks, but convert-to-usd and the upstream converter references still decide actual conversion support.
4. Verify or deploy Content Agents services first when property_assignment_intent=run; block on missing authentication or unhealthy services instead of continuing.
5. Read references/workflow.md and references/commands.md, then run only the stage references needed for the current request.
6. Run identify-asset-context on the original source asset when web search is available or property assignment will run.
7. Route the source through convert-to-usd, or skip conversion for existing USD input and treat the source path as the current USD path.
8. Run validate-usd-minimum before expensive downstream work. Treat this as a viability gate only: record unit/profile issues such as metersPerUnit != 1.0, but do not run simready-conform-profile, FET001, or any other FET repair before Content Agents assignment when property assignment will run.
9. Run Content Agents material, physics, and optional texture assignment on the converted/minimum-valid USD when requested or required.
10. Run simready-conform-profile on the latest simulation USD path after property assignment and preserve every selected FET repair report.
11. Run validation gates in order: omni-asset-validate, omni-asset-validate-geometry, omni-asset-validate-physics, and simready-validate.
12. Rerun simready-conform-profile when simready-validate reports a repairable requirement, then rerun profile validation on the newest authored USD.
13. Run ovrtx-render-service when preview, thumbnail, or inspection images are requested. When package outputs are requested, run assemble-package-source next to create the clean deliverable/ package source from the final USD and thumbnail, then run nv-core-package-sample and nv-core-package-sample-validation on that deliverable folder only.
14. Emit the consolidated workflow report with the final USD path, all stage reports, validation findings, rerun reasons, and next work.

Use the simready-conform-profile reference only after property assignment when property_assignment_intent=run. It routes feature repair to upstream SimReady Foundation FET skills such as simready-foundation-conform-fet-000-core, simready-foundation-conform-fet-001-minimal, simready-foundation-conform-fet-004-simulate-multi-body-physics, and simready-foundation-conform-fet-005-simulate-grasp-physics from branch main.

If simready-validate reports a repairable requirement after the first conformance pass, feed the structured requirement IDs back into the simready-conform-profile reference before writing the final result. In particular, GSP.001 is owned by upstream simready-foundation-conform-fet-005-simulate-grasp-physics; run that skill when a vision-capable agent can inspect visual evidence or explicit grasp points were provided, otherwise record the FET005 step as blocked by missing vision/points instead of treating it as an optional preview task. For RB.MB.001, route the failure to upstream simready-foundation-conform-fet-004-simulate-multi-body-physics. Do not assume multiple visual prims are multiple rigid bodies; inspect UsdPhysics.RigidBodyAPI applications. When the Physics Agent report shows composed topology optimization or the USD has existing component colliders/part roots and the profile validator reports FET004/RB.MB.001, FET004 should promote those existing components into rigid bodies without creating geometry. Do not mark the gate not applicable until after confirming there are fewer than two reusable body candidates.

Output Format

Emit a consolidated workflow report in Markdown, and include JSON when the workflow writes structured artifacts. The report must include:

• Overall status: passed, blocked, failed, or needs_rerun.
• Request summary: source asset path, detected source format, output root, selected SimReady profile/version, and property assignment intent.
• Ordered stage results: stage reference, input artifact, output USD or USDZ path, report path, status, blocker reason, and rerun reason when applicable.
• Content Agents readiness and property assignment results with service URLs, tokens, and credentials redacted.
• Conformance and validation findings grouped by gate, requirement ID, selected FET repair reference, repair-loop attempt, and final disposition.
• Final artifacts: final reported USD path, render preview path when requested, package root and package validation report when packaging ran, Markdown report path, JSON report path when present, and recommended next work.

Detailed References

Read only the references needed for the current request:

• references/preflight/README.md: deterministic local setup, manifest/env contract, Linux and Windows wrappers, Content Agents deployment opt-out, and guardrail behavior.
• references/workflow.md: inputs, source routing, detailed workflow, validation policy, output report fields, approval points, and next steps.
• references/commands.md: concrete portable script command patterns for each stage.
• references/assemble-package-source/README.md: two-zone package source assembly, canonical root USD naming, thumbnail placement, and self-contained deliverable checks.

Publishing Layout Notes

Use skills/omniverse-cad-to-simready/ as the source of truth for this product repo's skill. The .agents/skills symlink is a compatibility alias for local agentskills.io-style discovery, and .codex/skills and .claude/skills are agent-specific compatibility aliases.

Frontmatter keeps version and tools at top level for agentskills.io runtime compatibility. NVCARPS discoverability fields live under metadata.

The nested references/ tree is intentional. It keeps one public catalog skill while retaining script-bearing atomic stage references, upstream handoff notes, and router documentation under the workflow. Do not flatten those references or promote nested README references to sibling SKILL.md files unless the repo's publishing model changes.

Limitations

• This workflow coordinates existing conversion, property assignment, conformance, validation, rendering, and packaging skills; it does not replace them with a single monolithic runner command.
• Stop at the first failing deployment, conversion, property-assignment, or conformance authoring gate unless the user explicitly asks for best-effort continuation.
• Upstream simready-foundation-conform-fet-005-simulate-grasp-physics needs visual review or explicit grasp points before it can author a meaningful grasp vector.

Troubleshooting

| Symptom | Cause | Fix | |---------|-------|-----| | Downstream reference reports that cad-to-simready preflight has not prepared a component | PHYSICAL_AI_REQUIRE_PREFLIGHT=1 is set, but the manifest is missing or the required runtime/service is not ready | Run preflight/scripts/preflight.py, source the generated env file, or explicitly disable service deployment with --skip-content-agents only when Content Agents are out of scope. | | Workflow stops on GSP.001 and reports the failure as unclassified | Visual evidence or explicit grasp points were not provided to FET005 | Run upstream simready-foundation-conform-fet-005-simulate-grasp-physics only after a vision-capable agent has reviewed the asset, or pass explicit grasp points. Otherwise report the FET005 step as blocked, not failed. | | Validation fails after a meaningful USD artifact already exists | Workflow stopped at the first validation finding | Continue remaining diagnostic gates and mark the result needs_rerun. Do not stop at validation findings once a USD artifact has been produced. | | Property-assignment stage fails with a missing service endpoint | Content Agents service was not deployed before conversion | Run deploy-content-agents first. Do not start asset inspection, conversion, validation, conformance, rendering, or packaging before Content Agents readiness when property assignment will run. | | Material Agent reports that rendering produced 0 images after unit or profile repair | A FET repair, commonly FET001 unit normalization, was applied before Material Agent and changed the USD layering/scene state consumed by the service | Rerun assignment from the converted/minimum-valid USD: Material Agent first, then Physics Agent, then run simready-conform-profile and FET repairs on the latest service-authored USD. | | Material or Physics Agent local optimized path reports Permission denied: '/app/.build-resources/scene_optimizer_core/python' | Local Docker Scene Optimizer bundle permissions prevent the non-root service user from reading the packaged SO runtime | Repair the relevant local container with docker exec --user root content-material-agent-service chmod -R a+rX /app/.build-resources/scene_optimizer_core or docker exec --user root content-physics-agent-service chmod -R a+rX /app/.build-resources/scene_optimizer_core, then rerun the same optimized agent command. Do not treat the no-optimizer fallback as the root cause for instanced/prototype assets. | | RB.MB.001 fails even though the asset has many prims | The profile counts UsdPhysics.RigidBodyAPI prims, not visual or collider prims; Physics Agent may author one root rigid body | Route to upstream simready-foundation-conform-fet-004-simulate-multi-body-physics. First ensure Physics Agent used composed-topology optimization when applicable, then promote existing component colliders/part roots when the active profile reports FET004/RB.MB.001 and no geometry must be invented. |

Hard Rules

• Prefer the preflight manifest for local upstream roots, converter executables, SimReady validation runtime, OVRTX endpoint, and Content Agents service URLs. When PHYSICAL_AI_REQUIRE_PREFLIGHT=1 is set, do not bypass the manifest with direct upstream discovery.
• Do not run asset inspection, converter probes, local upstream builds, conversion, validation, conformance, rendering, or packaging before Content Agents readiness when property assignment will run.
• Use stage-specific installed reference scripts directly. Do not add or call a single omniverse-cad-to-simready runner command.
• For source conversion, delegate to the convert-to-usd reference; do not substitute another converter for CAD or mesh formats.
• For property assignment, use Content Agents references as separate atomic steps: material first, then physics, then texture only when requested.
• When property assignment will run, do not run simready-conform-profile or any FET helper before Content Agents. Validate minimum USD first, then run Content Agents on that converted/minimum-valid USD, then apply FET repairs to the latest service-authored USD.
• When property assignment will run, do not run simready-validate or any SimReady profile validation before Content Agents. The only validation gate allowed before service calls is validate-usd-minimum, which is a basic USD viability check.
• Stop at the first failing deployment, conversion, property-assignment, or conformance authoring gate unless the user explicitly asks for best-effort continuation.
• Do not stop at validation findings after a meaningful USD artifact exists. Continue remaining diagnostic gates and mark the result needs_rerun.
• Do not leave a GSP.001 profile failure as an unclassified final finding. Route it to upstream simready-foundation-conform-fet-005-simulate-grasp-physics; if the current agent cannot inspect renders or no explicit grasp points are available, report a blocked FET005 repair with the visual evidence path or missing input reason.
• Preserve every stage report and pass the concrete output USD path from each report into the next stage.