overthinkos/llama-cpp
ov-layers/skills/llama-cpp/SKILL.md
llama.cpp prebuilt binaries and GGUF conversion tools. Use when working with llama.cpp, GGUF model conversion, or llama-quantize/llama-cli.
tools
Updated Apr 24, 2026
$ install --global
skillsauthnpx skillsauth add overthinkos/overthink-plugins llama-cppInstall this skill globally with one command. Works with Claude Code, Cursor, and Windsurf.
Security Scan Results
3 of 9 scanners reported clean
Some scanners were skipped, did not run, or reported a non-clean status. Review each row below.
3
Scanners Passed
9
Scanners in report
Clean
TrivyContainer and dependency vulnerability scanner
95%
Clean
SemgrepStatic code analysis for vulnerabilities
95%
Clean
mcp-scan (Snyk)Model Context Protocol security validation
95%
Skipped
Snyk (dep)Open source security scanning
50%
Skipped
Socket.devSupply chain security analysis
50%
Skipped
VirusTotalMulti-engine malware detection
50%
Skipped
CrowdStrikeAdvanced threat intelligence
50%
Skipped
OSV-ScannerOpen Source Vulnerability database check
50%
Skipped
OWASP Dep-Check
50%
Last scanned: Apr 24, 2026, 2:55 PM120.8s1 file scanned
SKILL.md
- name:
- llama-cpp
- description:
- |
llama-cpp -- llama.cpp prebuilt binaries and GGUF tools
Layer Properties
| Property | Value |
|----------|-------|
| Dependencies | None |
| Ports | — |
| Service | — |
| Install files | layer.yml, tasks: |
What It Installs
Downloads the latest llama.cpp release from GitHub into ~/llama.cpp:
Binaries: llama-quantize, llama-cli, shared libraries (lib*.so*)
Python tools: convert_hf_to_gguf.py, gguf-py package (from source tarball)
Environment
| Variable | Value | Purpose |
|----------|-------|---------|
| LLAMA_CPP_PATH | ~/llama.cpp | Location of llama.cpp binaries |
| PATH (appended) | ~/llama.cpp | Makes llama-quantize/llama-cli available |
Design: Tier 1 "Post-install" Layer
This layer has no pixi.toml and no depends. It downloads prebuilt binaries and sets environment variables. It is designed to be composed into environment-owning layers (Tier 2) via the layers: field.
The user-phase tasks run after the pixi environment is established by the parent layer. The gguf Python package (for programmatic GGUF access) is declared in the parent layer's pixi.toml, not here.
Used In Layers
/ov-layers:python-ml— vialayers: [llama-cpp]/ov-layers:jupyter-ml— vialayers: [llama-cpp, unsloth]/ov-layers:unsloth-studio— vialayers: [llama-cpp, unsloth]
Related Layers
/ov-layers:unsloth— Fine-tuning (depends on llama.cpp for GGUF conversion)
Used In Images
/ov-images:python-ml(viapython-mlmetalayer)/ov-images:immich-ml(viapython-mlmetalayer)/ov-images:jupyter-ml(viajupyter-mlmetalayer)/ov-images:jupyter-ml-notebook(viajupyter-mlmetalayer)/ov-images:unsloth-studio(viaunsloth-studiometalayer)
When to Use This Skill
Use when the user asks about:
- llama.cpp binaries inside containers
- GGUF model conversion (convert_hf_to_gguf.py)
- llama-quantize or llama-cli
- The
LLAMA_CPP_PATHenvironment variable
Related
/ov:layer— layer authoring reference (layer.ymlschema, task verbs, service declarations)/ov:test— declarative testing (tests:block,ov image test,ov test)
Related Skills
overthinkos/plugin
tools
VerifiedTrustedCommunity
Use when authoring or modifying a charly PLUGIN — a candy with a `plugin:` block that contributes Providers (verbs/kinds/deploy-targets/steps/builders/commands), its own CUE schema, builtin (compiled-in) or external (out-of-tree git repo). Covers the unified Provider model, the per-plugin CUE-schema contract (single source → Go params for dev + schema-over-Describe RPC for runtime), the SDK, and the loader.
SKILL.mdUpdated Jun 22, 2026
overthinkos/cue
tools
VerifiedTrustedCommunity
The CUE data-validation / configuration CLI (cue), pinned to v0.16.1. Use when working with the cue candy, installing the cue binary into a box or onto a target:local dev host, or running the offline schema-vendoring pipeline that feeds charly's egress validation.
SKILL.mdUpdated Jun 16, 2026
overthinkos/egress
tools
VerifiedTrustedCommunity
CUE EGRESS validation — validating (and, where it adds value, generating) the config files charly WRITES to a system BEFORE the bytes hit disk. MUST be invoked before working on charly/egress.go, the vendored schemas under candy/plugin-egress/egress-schemas/vendor/, the ValidateEgress / registerVendoredEgressKind path, the offline `task cue:vendor` pipeline, or adding an egress schema for any written artifact (cloud-init, k8s manifests, traefik routes, runtime config, install ledger, systemd/quadlet units, ssh_config, libvirt XML).
SKILL.mdUpdated Jun 16, 2026
overthinkos/check-k8s
tools
VerifiedTrustedCommunity
Kubernetes cluster-probe declarative check verb — the `kube:` check verb (nodes, pods, ingress, storage class, addon health, apply/delete, and arbitrary resource GETs) served out-of-process by the candy/plugin-kube plugin (vendored client-go; no external kubectl required).
SKILL.mdUpdated Jun 14, 2026