dpla/dpla-ingest-status
docs/ai-context/archive/cursor-skills/dpla-ingest-status/SKILL.md
Show all active and completed ingests in one consolidated view. Use when user asks status of the ingests, ingest status, which hubs are running, show active ingests, or ingest progress.
$ install --global
skillsauthnpx skillsauth add dpla/ingestion3 dpla-ingest-statusInstall this skill globally with one command. Works with Claude Code, Cursor, and Windsurf.
Security Scan Results
3 of 9 scanners reported clean
Some scanners were skipped, did not run, or reported a non-clean status. Review each row below.
3
Scanners Passed
9
Scanners in report
Clean
TrivyContainer and dependency vulnerability scanner
95%
Clean
SemgrepStatic code analysis for vulnerabilities
95%
Clean
mcp-scan (Snyk)Model Context Protocol security validation
95%
Skipped
Snyk (dep)Open source security scanning
50%
Skipped
Socket.devSupply chain security analysis
50%
Skipped
VirusTotalMulti-engine malware detection
50%
Skipped
CrowdStrikeAdvanced threat intelligence
50%
Skipped
OSV-ScannerOpen Source Vulnerability database check
50%
Skipped
OWASP Dep-Check
50%
Last scanned: May 26, 2026, 3:36 AM102.5s1 file scanned
SKILL.md
- name:
- dpla-ingest-status
- description:
- Show all active and completed ingests in one consolidated view. Use when user asks status of the ingests, ingest status, which hubs are running, show active ingests, or ingest progress.
dpla-ingest-status
Show ingest status for all hubs (or specific hubs) in one command. Reads logs/status/*.status files — no per-hub log tailing.
When to Use
- "Status of the ingests"
- "Ingest status"
- "Which hubs are running"
- "Show active ingests"
- "Ingest progress"
Primary Action
Run one command:
source .env
./scripts/status/ingest-status.sh
For live updates:
source .env
./scripts/status/ingest-status.sh --watch
Rules
- Do not tail logs per hub, grep ingest.sh, or run monitor-remap.sh per hub.
- Do not assemble status tables manually from log output.
- If "No status files found": Status comes from
logs/status/*.statusandlogs/orchestrator_state.json. Ensure ingests use harvest.sh, ingest.sh, or the orchestrator (all write status). For debugging failures, use the dpla-ingest-debug skill instead.
Options
| Option | Purpose |
|--------|---------|
| (none) | Table view, all hubs |
| --watch | Auto-refresh every 30s |
| --watch 10 | Auto-refresh every 10s |
| -v | Include stage history |
| --json | Raw JSON output |
| --all | Include stale entries (e.g. stuck >72h) |
| hub1 hub2 | Show only specified hubs |
Data sources
Status comes from:
- Orchestrator state —
logs/orchestrator_state.json(latest run's hubs) - Per-hub status files —
logs/status/*.status(written by orchestrator, harvest.sh, ingest.sh, remap.sh)
Stale entries (e.g. a hub stuck in S3 Sync for >72h from a previous run) are excluded by default; use --all to include them. Manual runs (run_id=manual) are always shown.
References
- scripts/SCRIPTS.md — ingest-status.sh usage
- AGENTS.md — agent guide
Related Skills
dpla/dpla-hub-info
data-ai
VerifiedTrustedCommunity
Show key i3.conf config for a hub (provider, harvest.type, harvest.endpoint, schedule, email, setlist). Use when user asks for hub config, harvest type/endpoint, who gets emails, schedule months, or OAI setlist details.
35SKILL.mdUpdated Apr 16, 2026
dpla/dpla-community-webs-ingest
development
VerifiedTrustedCommunity
Run Community Webs ingest. Use when the user says harvest community-webs, run community-webs ingest, export community webs, or process community webs DB.
35SKILL.mdUpdated Apr 15, 2026
dpla/dpla-verify-and-notify
testing
VerifiedTrustedCommunity
Verify ingest outcomes and send failure or status notifications to Slack or [email protected]. Use when the user asks to verify the ingest, check if it succeeded, notify about a failure, or post to tech-alerts.
33SKILL.mdUpdated May 26, 2026
dpla/dpla-staged-report
business
VerifiedTrustedCommunity
Report which hubs have new JSONL staged in S3 for a given month, and optionally post the report to Slack. Use when user asks what hubs are staged/ready for indexing, /ingest staged, or what changed this month in S3.
33SKILL.mdUpdated May 26, 2026