overthinkos/llama-cpp
ov-layers/skills/llama-cpp/SKILL.md
llama.cpp prebuilt binaries and GGUF conversion tools. Use when working with llama.cpp, GGUF model conversion, or llama-quantize/llama-cli.
tools
Updated Apr 24, 2026
$ install --global
skillsauthnpx skillsauth add overthinkos/overthink-plugins llama-cppInstall this skill globally with one command. Works with Claude Code, Cursor, and Windsurf.
Security Scan Results
3 of 9 scanners reported clean
Some scanners were skipped, did not run, or reported a non-clean status. Review each row below.
3
Scanners Passed
9
Scanners in report
Clean
TrivyContainer and dependency vulnerability scanner
95%
Clean
SemgrepStatic code analysis for vulnerabilities
95%
Clean
mcp-scan (Snyk)Model Context Protocol security validation
95%
Skipped
Snyk (dep)Open source security scanning
50%
Skipped
Socket.devSupply chain security analysis
50%
Skipped
VirusTotalMulti-engine malware detection
50%
Skipped
CrowdStrikeAdvanced threat intelligence
50%
Skipped
OSV-ScannerOpen Source Vulnerability database check
50%
Skipped
OWASP Dep-Check
50%
Last scanned: Apr 24, 2026, 2:55 PM120.8s1 file scanned
SKILL.md
- name:
- llama-cpp
- description:
- |
llama-cpp -- llama.cpp prebuilt binaries and GGUF tools
Layer Properties
| Property | Value |
|----------|-------|
| Dependencies | None |
| Ports | — |
| Service | — |
| Install files | layer.yml, tasks: |
What It Installs
Downloads the latest llama.cpp release from GitHub into ~/llama.cpp:
Binaries: llama-quantize, llama-cli, shared libraries (lib*.so*)
Python tools: convert_hf_to_gguf.py, gguf-py package (from source tarball)
Environment
| Variable | Value | Purpose |
|----------|-------|---------|
| LLAMA_CPP_PATH | ~/llama.cpp | Location of llama.cpp binaries |
| PATH (appended) | ~/llama.cpp | Makes llama-quantize/llama-cli available |
Design: Tier 1 "Post-install" Layer
This layer has no pixi.toml and no depends. It downloads prebuilt binaries and sets environment variables. It is designed to be composed into environment-owning layers (Tier 2) via the layers: field.
The user-phase tasks run after the pixi environment is established by the parent layer. The gguf Python package (for programmatic GGUF access) is declared in the parent layer's pixi.toml, not here.
Used In Layers
/ov-layers:python-ml— vialayers: [llama-cpp]/ov-layers:jupyter-ml— vialayers: [llama-cpp, unsloth]/ov-layers:unsloth-studio— vialayers: [llama-cpp, unsloth]
Related Layers
/ov-layers:unsloth— Fine-tuning (depends on llama.cpp for GGUF conversion)
Used In Images
/ov-images:python-ml(viapython-mlmetalayer)/ov-images:immich-ml(viapython-mlmetalayer)/ov-images:jupyter-ml(viajupyter-mlmetalayer)/ov-images:jupyter-ml-notebook(viajupyter-mlmetalayer)/ov-images:unsloth-studio(viaunsloth-studiometalayer)
When to Use This Skill
Use when the user asks about:
- llama.cpp binaries inside containers
- GGUF model conversion (convert_hf_to_gguf.py)
- llama-quantize or llama-cli
- The
LLAMA_CPP_PATHenvironment variable
Related
/ov:layer— layer authoring reference (layer.ymlschema, task verbs, service declarations)/ov:test— declarative testing (tests:block,ov image test,ov test)
Related Skills
overthinkos/agents
development
VerifiedTrustedCommunity
Claude Code multi-agent support in Overthink — sub-agents, dynamic workflows, and agent teams, and how each drives the existing `ov eval` disposable beds to test and verify. MUST be invoked before authoring or invoking an ov sub-agent / dynamic workflow / agent team, wiring agent-lifecycle hooks, or asking "which primitive should drive the R10 beds?".
SKILL.mdUpdated May 31, 2026
overthinkos/workspace-mount
tools
VerifiedTrustedCommunity
Mounts a virtiofs share tagged `workspace` at /workspace inside a VM guest via a systemd .mount unit. Use when a kind:vm entity shares a host directory into the guest and you need it auto-mounted (and re-mounted at every boot).
SKILL.mdUpdated May 30, 2026
overthinkos/android
development
VerifiedTrustedCommunity
MUST be invoked before any work involving: the `kind: android` schema kind, a `target: android` deploy, the `apk:` layer package format (installing Android apps declaratively), AndroidDeployTarget, an in-pod emulator OR a remote/physical adb-endpoint device, or nested `pod → android` deployment. The first-class Android device + app surface that sits above `ov eval adb`/`appium`.
SKILL.mdUpdated May 26, 2026
overthinkos/git-workflow
tools
VerifiedTrustedCommunity
Use when committing, branching, pushing, merging, tagging, creating PRs, or approving/merging PRs with gh — the feat/-branch, R10-gated, never-force-push landing workflow across the main repo + the plugins submodule + image/<distro> submodules. Covers sync-to-upstream, branch/worktree pruning, the fork+PR path for contributors without write access, and cross-repo @github landing order.
SKILL.mdUpdated May 25, 2026