ov-images/skills/ollama/SKILL.md
Standalone Ollama LLM inference server with CUDA GPU support. Runs as a supervisord service on port 11434 with persistent model storage. MUST be invoked before building, deploying, configuring, or troubleshooting the ollama image.
npx skillsauth add overthinkos/overthink-plugins ollamaInstall this skill globally with one command. Works with Claude Code, Cursor, and Windsurf.
3 of 9 scanners reported clean
Some scanners were skipped, did not run, or reported a non-clean status. Review each row below.
GPU-accelerated Ollama LLM inference server.
| Property | Value | |----------|-------| | Base | nvidia | | Layers | agent-forwarding, ollama | | Platforms | linux/amd64 | | Ports | 11434 | | Registry | ghcr.io/overthinkos |
fedora → nvidia (CUDA base)pixi → python → supervisord (transitive)ollama — LLM server, models volume| Port | Service | Protocol | |------|---------|----------| | 11434 | Ollama API | HTTP |
| Name | Path | Purpose | |------|------|---------| | models | ~/.ollama | Model storage |
ov image build ollama
ov config ollama
ov start ollama
ov shell ollama -c "ollama pull llama3"
ov shell ollama -c "ollama run llama3 'Hello'"
ov alias install ollama
# Now: ollama pull llama3 (runs inside the container)
When deployed via ov config ollama, this image automatically provides OLLAMA_HOST=http://ov-ollama:11434 to all other deployed containers via the env_provides mechanism. Use --update-all to propagate to already-deployed services:
ov config ollama --update-all
This means containers like jupyter-ml-notebook automatically discover the Ollama endpoint without manual OLLAMA_HOST configuration.
/ov-layers:ollama — Ollama binary, supervisord service, model volume/ov-layers:cuda — GPU support (via nvidia base)/ov-images:nvidia — parent (GPU without Ollama)/ov-images:openclaw-ollama — OpenClaw gateway + Ollama/ov-images:openclaw-ollama-sway-browser — full stack with desktop/ov-images:jupyter-ml-notebook — Jupyter with Ollama integration notebooks (receives OLLAMA_HOST automatically via env_provides when ollama is deployed)/ov-images:openwebui — Open WebUI (receives OLLAMA_HOST via env_provides, auto-configures as OLLAMA_BASE_URL)/ov-layers:ollama — the Ollama binary layer/ov-layers:notebook-ollama — 6 Jupyter notebooks demonstrating Ollama APIs (requests, OpenAI, ollama lib, Anthropic, HuggingFace, GPU)After ov start:
ov status ollama — container runningov service status ollama — all services RUNNINGcurl -s http://localhost:11434/api/tags — Ollama API respondsMUST be invoked when the task involves the ollama image, LLM model serving, or the standalone Ollama deployment. Invoke this skill BEFORE reading source code or launching Explore agents.
/ov:image — image family umbrella (image: entries in overthink.yml, build/validate/inspect/list)/ov:build — build.yml vocabulary (distros, builders, init-systems)tools
OpenCharly CLI (charly) binary installed into container/VM images for in-container use. Use when working with charly binary deployment inside containers, native D-Bus support, or the full charly toolchain (charly binary + virtualization + gocryptfs + socat).
development
Operator CachyOS workstation profile — a kind:local template + target:local deploy that installs the full dev stack (30 candies) onto a CachyOS host via ShellExecutor. Lives in the overthinkos/cachyos submodule. MUST be invoked before editing or applying the charly-cachyos workstation profile.
tools
Fedora box with the full charly toolchain using shared candies. Rootless-first — runs as uid=1000 with passwordless sudo (no root, no cap_add: ALL). Same candy list as charly-arch. Includes NVIDIA GPU runtime. MUST be invoked before building, deploying, configuring, or troubleshooting the charly-fedora box.
tools
Arch Linux box with the full charly toolchain. Rootless-first — runs as uid=1000 with passwordless sudo (no root, no cap_add: ALL). Composes /charly-coder:charly-mcp so the box is reachable as an MCP gateway on port 18765. NVIDIA GPU runtime composed in. MUST be invoked before building, deploying, configuring, or troubleshooting the charly-arch box.