glebis/job-babysitter

Job Babysitter

Purpose

Stop manually polling long-running background jobs. Instead of dozens-to-hundreds of ls -lh / ps checks while guessing at completion, start one background watcher that detects the terminal state via plateau heuristics, then routes a verdict — done, needs-attention, or blocked — with the exact next command.

A night-shift nurse for background jobs: it checks vitals on a schedule and escalates only when something is actually wrong.

When to use

Use when a job will run long enough that babysitting it by hand wastes attention:

• Media encodes / transcodes (ffmpeg, video-transcribe, audio extraction)
• Embedding or vector-DB builds (qmd embed, index builds)
• Batch agent / LLM pipelines run in the background
• Browser / scrape daemons (real-browser, agent-browser) prone to hanging

Do NOT use for jobs that finish in seconds, or where a single Bash call already returns the result.

Core principle: stay thin, lean on the harness

This skill orchestrates Claude Code's own primitives — do not reimplement them:

• Start the watcher with run_in_background: true. When it exits, the harness re-invokes the agent automatically — no manual polling loop needed.
• The watcher (scripts/watch_job.py) owns the deterministic part: poll with backoff, detect plateau, distinguish done from stuck, emit a verdict JSON.
• The skill's value is the per-job-type heuristics, the safe-recovery playbook, and notification routing — all in references/playbook.md.

Workflow

1. Identify the job's signals

Determine what can be watched, in order of reliability:

• PID — the process ID (most reliable completion signal). Get it from the job's launch, pgrep, or ps.
• Output file — a file that grows as the job progresses (e.g. ffmpeg target).
• Log file — a log that gets appended (e.g. an embed progress log).

Read references/playbook.md § "Completion heuristics by job type" to pick flags for the specific job type (ffmpeg, embed, batch, browser).

2. Launch the watcher in the background

Run with run_in_background: true. Always pass --pid when known; add file/log signals as corroboration. Write the verdict to a known path.

scripts/watch_job.py \
  --label "lab05 stream encode" \
  --pid <PID> \
  --output-file /path/to/output.mp4 \
  --plateau-bytes 65536 --plateau-polls 5 --stuck-after 120 \
  --max-wait 7200 \
  --verdict-out /tmp/job-babysitter-<label>.json

The watcher prints a one-line JSON heartbeat per poll (tail it for live progress) and writes the final verdict JSON to --verdict-out on exit.

Tuning lives in the playbook; sensible defaults: --interval 10 (backs off to 60), --plateau-polls 4, --stuck-after 300, --max-wait 7200.

3. On watcher exit, read the verdict and route it

The harness re-invokes the agent when the background watcher finishes. Read the verdict JSON. It has status ∈ {done, needs-attention, blocked}, a reason, suggested_next, elapsed time, and final size.

• done → verify the output is real (see the job-type "Done check" in the playbook, e.g. ffprobe for media, count match for embeds), then proceed with the original task.
• needs-attention → the job plateaued while still alive (possibly wedged). Follow the recovery playbook: diagnose read-only FIRST. Never kill or run destructive recovery (pkill, WAL checkpoint, VACUUM) without asking the user.
• blocked → the watcher gave up after --max-wait. Report honestly: "gave up waiting" ≠ "failed". Offer to re-check or extend the ceiling.

4. Notify per the chosen channel

Default to in-session resume. If the user picked a channel (Telegram, voice/TTS, desktop notification), route per references/playbook.md § "Notification routing". Always include the status emoji, label, elapsed time, and the exact next command.

Guardrails (non-negotiable)

• Never act on a single slow poll. "Stuck" requires plateau AND elapsed past --stuck-after — the watcher already enforces this before returning needs-attention.
• Ask before any destructive recovery — pkill, kill, WAL checkpoint, VACUUM, daemon restart. Diagnose read-only first.
• Report honestly. Distinguish done from "gave up waiting" from "wedged". Never imply a success the watcher did not observe.
• Poll with backoff, not tight loops — the watcher handles this; never wrap it in a manual fast-polling loop.

Resources

• scripts/watch_job.py — background watcher: plateau detection, stuck-vs-done logic, verdict JSON. Stdlib only, Python 3.11+.
• references/playbook.md — per-job-type completion heuristics, the safe-recovery table, and notification routing. Load when picking watcher flags or handling a needs-attention/blocked verdict.