arthur-ai/test-integration
arthur-observability-sdk/.claude/skills/test-integration/SKILL.md
Run the arthur-observability-sdk integration tests. These build the SDK wheel into a fresh venv and verify OTLP telemetry delivery end-to-end. Use when you want to confirm the installable wheel works correctly.
$ install --global
skillsauthnpx skillsauth add arthur-ai/arthur-engine test-integrationInstall this skill globally with one command. Works with Claude Code, Cursor, and Windsurf.
Security Scan Results
3 of 9 scanners reported clean
Some scanners were skipped, did not run, or reported a non-clean status. Review each row below.
3
Scanners Passed
9
Scanners in report
Clean
TrivyContainer and dependency vulnerability scanner
95%
Clean
SemgrepStatic code analysis for vulnerabilities
95%
Clean
mcp-scan (Snyk)Model Context Protocol security validation
95%
Skipped
Snyk (dep)Open source security scanning
50%
Skipped
Socket.devSupply chain security analysis
50%
Skipped
VirusTotalMulti-engine malware detection
50%
Skipped
CrowdStrikeAdvanced threat intelligence
50%
Skipped
OSV-ScannerOpen Source Vulnerability database check
50%
Skipped
OWASP Dep-Check
50%
Last scanned: Apr 24, 2026, 8:47 PM1.8s1 file scanned
SKILL.md
- name:
- test-integration
- description:
- Run the arthur-observability-sdk integration tests. These build the SDK wheel into a fresh venv and verify OTLP telemetry delivery end-to-end. Use when you want to confirm the installable wheel works correctly.
- allowed-tools:
- Bash, Read
Run Integration Tests
Integration tests (test_install.py) build the real SDK wheel, install it into a fresh venv, and run subprocesses that confirm:
- All expected imports succeed from the installed wheel.
- A real OTLP span is delivered to a mock HTTP collector.
- OpenAI instrumentation emits a span that reaches the collector.
The wheel build is delegated to scripts/build_sdk_wheel.sh, which copies the SDK to a git-free temp directory so uv includes the gitignored python/src/arthur_genai_client/.
Prerequisites
python/src/arthur_genai_client/must exist. If missing, run the generate-client skill first.uvmust be onPATH.
Run all integration tests
From the arthur-observability-sdk/python/ directory:
uv run pytest tests -m integration_tests -v
Run a specific integration test
uv run pytest tests/test_install.py::test_imports_in_fresh_venv -v
uv run pytest tests/test_install.py::test_telemetry_reaches_collector -v
uv run pytest tests/test_install.py::test_openai_instrumentation_sends_span -v
Build the wheel manually (without running tests)
./scripts/build_sdk_wheel.sh # → dist/<wheel>.whl
./scripts/build_sdk_wheel.sh /tmp/out # → /tmp/out/<wheel>.whl
Notes
- Integration tests are marked with
@pytest.mark.integration_tests. - The wheel build copies the SDK to a temp dir with no
.gitancestor so that uv uses filesystem-based file discovery (notgit ls-files). This ensures the gitignoredpython/src/arthur_genai_client/is included in the wheel. - These tests are slower than unit tests (~1–2 min) due to the wheel build and venv creation.
- The mock server in the fixture listens on a random free port for both
POST /v1/traces(OTLP collector) andPOST /v1/chat/completions(fake OpenAI API).
Related Skills
arthur-ai/integrations/claude-code-skills/arthur-onboard/arthur-onboard-verify
tools
VerifiedTrustedCommunity
--- name: arthur-onboard-verify description: Arthur onboarding sub-skill — Step 7: Verify that traces are flowing from the instrumented application to Arthur Engine. Reads credentials from .arthur-engine.env. allowed-tools: Bash, Read --- # Arthur Onboard — Step 7: Verify Instrumentation ## Read State ```bash cat .arthur-engine.env 2>/dev/null || echo "(no state file)" ``` Parse `ARTHUR_ENGINE_URL`, `ARTHUR_API_KEY`, `ARTHUR_TASK_ID`. --- ## Tell the User to Run Their Application Show the
81SKILL.mdUpdated May 28, 2026
arthur-ai/integrations/claude-code-skills/arthur-onboard/arthur-onboard-task
tools
VerifiedTrustedCommunity
--- name: arthur-onboard-task description: Arthur onboarding sub-skill — Step 3: Set up an Arthur Task (create or select). Reads/writes .arthur-engine.env. allowed-tools: Bash, Read, Write, Edit --- # Arthur Onboard — Step 3: Set Up Arthur Task **Goal:** Establish `ARTHUR_TASK_ID` in `.arthur-engine.env`. ## Read State ```bash cat .arthur-engine.env 2>/dev/null || echo "(no state file)" ``` Parse `ARTHUR_ENGINE_URL`, `ARTHUR_API_KEY`, and `ARTHUR_TASK_ID` from the output. **State write hel
81SKILL.mdUpdated May 28, 2026
arthur-ai/integrations/claude-code-skills/arthur-onboard/arthur-onboard-prompts
tools
VerifiedTrustedCommunity
--- name: arthur-onboard-prompts description: Arthur onboarding sub-skill — Step 6: Extract prompts from the target repository and register them with Arthur Engine. Reads credentials from .arthur-engine.env. allowed-tools: Bash, Read, Task --- # Arthur Onboard — Step 6: Extract & Register Prompts ## Read State ```bash cat .arthur-engine.env 2>/dev/null || echo "(no state file)" ``` Parse `ARTHUR_ENGINE_URL`, `ARTHUR_API_KEY`, `ARTHUR_TASK_ID`. --- ## Extract Prompts via Sub-agent Delegate
81SKILL.mdUpdated May 28, 2026
arthur-ai/arthur-onboard-platform
development
VerifiedTrustedCommunity
Onboard an agentic application to the Arthur SaaS Platform (platform.arthur.ai). Guides through authentication, workspace selection, engine deployment, model creation, code instrumentation, trace verification, and eval configuration.
81SKILL.mdUpdated May 28, 2026