overthinkos/ollama
ov-layers/skills/ollama/SKILL.md
Ollama LLM server on port 11434 with CUDA GPU support and model persistence. Use when working with Ollama, LLM serving, or local AI model inference.
data-ai
Updated Apr 24, 2026
$ install --global
skillsauthnpx skillsauth add overthinkos/overthink-plugins ollamaInstall this skill globally with one command. Works with Claude Code, Cursor, and Windsurf.
Security Scan Results
3 of 9 scanners reported clean
Some scanners were skipped, did not run, or reported a non-clean status. Review each row below.
3
Scanners Passed
9
Scanners in report
Clean
TrivyContainer and dependency vulnerability scanner
95%
Clean
SemgrepStatic code analysis for vulnerabilities
95%
Clean
mcp-scan (Snyk)Model Context Protocol security validation
95%
Skipped
Snyk (dep)Open source security scanning
50%
Skipped
Socket.devSupply chain security analysis
50%
Skipped
VirusTotalMulti-engine malware detection
50%
Skipped
CrowdStrikeAdvanced threat intelligence
50%
Skipped
OSV-ScannerOpen Source Vulnerability database check
50%
Skipped
OWASP Dep-Check
50%
Last scanned: Apr 24, 2026, 3:01 PM131.4s1 file scanned
SKILL.md
- name:
- ollama
- description:
- |
ollama -- Local LLM inference server
Layer Properties
| Property | Value |
|----------|-------|
| Dependencies | cuda, supervisord |
| Ports | 11434 |
| Volumes | models -> ~/.ollama |
| Aliases | ollama -> ollama |
| Service | ollama (supervisord) |
| Install files | tasks: |
Environment Variables
| Variable | Value |
|----------|-------|
| OLLAMA_HOST | 0.0.0.0 |
| OLLAMA_MODELS | ~/.ollama/models |
Service Environment (injected into other containers)
| Variable | Template Value | Resolved Example |
|----------|---------------|-----------------|
| OLLAMA_HOST | http://{{.ContainerName}}:11434 | http://ov-ollama:11434 |
Pod-aware: same-container consumers receive http://localhost:11434, cross-container consumers receive http://ov-ollama:11434. When ov config ollama runs, OLLAMA_HOST is automatically injected into the global deploy.yml env. Use ov config ollama --update-all to propagate to already-deployed services immediately.
See /ov:layer for env_provides field docs and /ov:config for --update-all.
Usage
# image.yml
ollama:
layers:
- ollama
ov alias install ollama # install host 'ollama' command
ollama run llama3 # uses the alias
Used In Images
/ov-images:ollama/ov-images:openclaw-ollama/ov-images:openclaw-ollama-sway-browser
Cross-Container Integration
The env_provides mechanism makes OLLAMA_HOST available to all containers. The hermes layer auto-detects this variable and configures itself to use local Ollama as its LLM provider (highest priority in the auto-detection chain: OLLAMA_HOST > OLLAMA_API_KEY > OPENROUTER_API_KEY). See /ov-layers:hermes for details on the auto-provider-configuration.
Tests
The layer ships 3 declarative checks embedded in the org.overthinkos.tests
OCI label (see /ov:test for the full schema):
- Build-scope (run under
ov image test):ollama-binary—/usr/bin/ollamaexists
- Deploy-scope (run under
ov testagainst a live service; uses${HOST_PORT:11434}/${CONTAINER_IP}so deploy-time port remapping works unchanged):ollama-tags-api—GET http://${CONTAINER_IP}:${HOST_PORT:11434}/api/tagsreturns 200ollama-version—ollama --versionstdout matches^ollama version
Related Layers
/ov-layers:cuda-- CUDA toolkit dependency/ov-layers:supervisord-- process manager dependency/ov-layers:openclaw-- AI gateway that can use Ollama as backend/ov-layers:hermes-- AI agent that auto-detectsOLLAMA_HOSTfor local Ollama provider
Related Commands
/ov:config— Deploy with quadlet (secrets, volumes, env_provides injection)/ov:start— Start the Ollama service/ov:service— Manage Ollama service inside container
When to Use This Skill
Use when the user asks about:
- Ollama setup or model management
- LLM serving or inference
- Port 11434 configuration
- Ollama model storage volume
- The
ollamahost alias
Related Skills
overthinkos/charly
tools
VerifiedTrustedCommunity
OpenCharly CLI (charly) binary installed into container/VM images for in-container use. Use when working with charly binary deployment inside containers, native D-Bus support, or the full charly toolchain (charly binary + virtualization + gocryptfs + socat).
SKILL.mdUpdated Jun 10, 2026
overthinkos/charly-cachyos
development
VerifiedTrustedCommunity
Operator CachyOS workstation profile — a kind:local template + target:local deploy that installs the full dev stack (30 candies) onto a CachyOS host via ShellExecutor. Lives in the overthinkos/cachyos submodule. MUST be invoked before editing or applying the charly-cachyos workstation profile.
SKILL.mdUpdated Jun 10, 2026
overthinkos/charly-fedora
tools
VerifiedTrustedCommunity
Fedora box with the full charly toolchain using shared candies. Rootless-first — runs as uid=1000 with passwordless sudo (no root, no cap_add: ALL). Same candy list as charly-arch. Includes NVIDIA GPU runtime. MUST be invoked before building, deploying, configuring, or troubleshooting the charly-fedora box.
SKILL.mdUpdated Jun 10, 2026
overthinkos/charly-arch
tools
VerifiedTrustedCommunity
Arch Linux box with the full charly toolchain. Rootless-first — runs as uid=1000 with passwordless sudo (no root, no cap_add: ALL). Composes /charly-coder:charly-mcp so the box is reachable as an MCP gateway on port 18765. NVIDIA GPU runtime composed in. MUST be invoked before building, deploying, configuring, or troubleshooting the charly-arch box.
SKILL.mdUpdated Jun 10, 2026