overthinkos/ollama-layer
ollama/skills/ollama-layer/SKILL.md
Ollama LLM server on port 11434 with CUDA GPU support and model persistence. Use when working with Ollama, LLM serving, or local AI model inference.
data-ai
Updated Jun 14, 2026
$ install --global
skillsauthnpx skillsauth add overthinkos/overthink-plugins ollama-layerInstall this skill globally with one command. Works with Claude Code, Cursor, and Windsurf.
Security Scan Results
3 of 9 scanners reported clean
Some scanners were skipped, did not run, or reported a non-clean status. Review each row below.
3
Scanners Passed
9
Scanners in report
Clean
TrivyContainer and dependency vulnerability scanner
95%
Clean
SemgrepStatic code analysis for vulnerabilities
95%
Clean
mcp-scan (Snyk)Model Context Protocol security validation
95%
Skipped
Snyk (dep)Open source security scanning
50%
Skipped
Socket.devSupply chain security analysis
50%
Skipped
VirusTotalMulti-engine malware detection
50%
Skipped
CrowdStrikeAdvanced threat intelligence
50%
Skipped
OSV-ScannerOpen Source Vulnerability database check
50%
Skipped
OWASP Dep-Check
50%
Last scanned: Jun 14, 2026, 6:03 AM218.1s1 file scanned
SKILL.md
- name:
- ollama-layer
- description:
- |
ollama -- Local LLM inference server
Candy Properties
| Property | Value |
|----------|-------|
| Dependencies | cuda, supervisord |
| Ports | 11434 |
| Volumes | models -> ~/.ollama |
| Aliases | ollama -> ollama |
| Service | ollama (supervisord) |
| Install files | task: |
Environment Variables
| Variable | Value |
|----------|-------|
| OLLAMA_HOST | 0.0.0.0 |
| OLLAMA_MODELS | ~/.ollama/models |
Service Environment (injected into other containers)
| Variable | Template Value | Resolved Example |
|----------|---------------|-----------------|
| OLLAMA_HOST | http://{{.ContainerName}}:11434 | http://charly-ollama:11434 |
Pod-aware: same-container consumers receive http://localhost:11434, cross-container consumers receive http://charly-ollama:11434. When charly config ollama runs, OLLAMA_HOST is automatically injected into the global charly.yml env. Use charly config ollama --update-all to propagate to already-deployed services immediately.
See /charly-image:layer for env_provide field docs and /charly-core:charly-config for --update-all.
Usage
# charly.yml
ollama:
candy:
- ollama
charly alias install ollama # install host 'ollama' command
ollama run llama3 # uses the alias
Used In Boxes
/charly-ollama:ollama
Cross-Container Integration
The env_provide mechanism makes OLLAMA_HOST available to all containers. The hermes candy auto-detects this variable and configures itself to use local Ollama as its LLM provider (highest priority in the auto-detection chain: OLLAMA_HOST > OLLAMA_API_KEY > OPENROUTER_API_KEY). See /charly-hermes:hermes for details on the auto-provider-configuration.
Tests
The candy ships its acceptance steps in its plan:,
baked into the ai.opencharly.description OCI label (see /charly-check:check
for the full schema). Each step is one inline Op — a probe is a check:
step — and its context: list gates where it runs:
context: [build](run undercharly check box):ollama-binary—/usr/bin/ollamaexists
context: [deploy](run undercharly check liveagainst a live service; uses${HOST_PORT:11434}/${CONTAINER_IP}so deploy-time port remapping works unchanged):ollama-tags-api—GET http://${CONTAINER_IP}:${HOST_PORT:11434}/api/tagsreturns 200ollama-version—ollama --versionstdout matches^ollama version
Related Candies
/charly-distros:cuda-- CUDA toolkit dependency/charly-infrastructure:supervisord-- process manager dependency/charly-openclaw:openclaw-- AI gateway that can use Ollama as backend/charly-hermes:hermes-- AI agent that auto-detectsOLLAMA_HOSTfor local Ollama provider
Related Commands
/charly-core:charly-config— Deploy with quadlet (secrets, volumes, env_provide injection)/charly-core:start— Start the Ollama service/charly-core:service— Manage Ollama service inside container
When to Use This Skill
Use when the user asks about:
- Ollama setup or model management
- LLM serving or inference
- Port 11434 configuration
- Ollama model storage volume
- The
ollamahost alias
Related Skills
overthinkos/plugin
tools
VerifiedTrustedCommunity
Use when authoring or modifying a charly PLUGIN — a candy with a `plugin:` block that contributes Providers (verbs/kinds/deploy-targets/steps/builders/commands), its own CUE schema, builtin (compiled-in) or external (out-of-tree git repo). Covers the unified Provider model, the per-plugin CUE-schema contract (single source → Go params for dev + schema-over-Describe RPC for runtime), the SDK, and the loader.
SKILL.mdUpdated Jun 22, 2026
overthinkos/cue
tools
VerifiedTrustedCommunity
The CUE data-validation / configuration CLI (cue), pinned to v0.16.1. Use when working with the cue candy, installing the cue binary into a box or onto a target:local dev host, or running the offline schema-vendoring pipeline that feeds charly's egress validation.
SKILL.mdUpdated Jun 16, 2026
overthinkos/egress
tools
VerifiedTrustedCommunity
CUE EGRESS validation — validating (and, where it adds value, generating) the config files charly WRITES to a system BEFORE the bytes hit disk. MUST be invoked before working on charly/egress.go, the vendored schemas under candy/plugin-egress/egress-schemas/vendor/, the ValidateEgress / registerVendoredEgressKind path, the offline `task cue:vendor` pipeline, or adding an egress schema for any written artifact (cloud-init, k8s manifests, traefik routes, runtime config, install ledger, systemd/quadlet units, ssh_config, libvirt XML).
SKILL.mdUpdated Jun 16, 2026
overthinkos/check-k8s
tools
VerifiedTrustedCommunity
Kubernetes cluster-probe declarative check verb — the `kube:` check verb (nodes, pods, ingress, storage class, addon health, apply/delete, and arbitrary resource GETs) served out-of-process by the candy/plugin-kube plugin (vendored client-go; no external kubectl required).
SKILL.mdUpdated Jun 14, 2026