overthinkos/llama-cpp
ov-jupyter/skills/llama-cpp/SKILL.md
llama.cpp prebuilt binaries and GGUF conversion tools. Use when working with llama.cpp, GGUF model conversion, or llama-quantize/llama-cli.
tools
Updated May 10, 2026
$ install --global
skillsauthnpx skillsauth add overthinkos/overthink-plugins llama-cppInstall this skill globally with one command. Works with Claude Code, Cursor, and Windsurf.
Security Scan Results
3 of 9 scanners reported clean
Some scanners were skipped, did not run, or reported a non-clean status. Review each row below.
3
Scanners Passed
9
Scanners in report
Clean
TrivyContainer and dependency vulnerability scanner
95%
Clean
SemgrepStatic code analysis for vulnerabilities
95%
Clean
mcp-scan (Snyk)Model Context Protocol security validation
95%
Skipped
Snyk (dep)Open source security scanning
50%
Skipped
Socket.devSupply chain security analysis
50%
Skipped
VirusTotalMulti-engine malware detection
50%
Skipped
CrowdStrikeAdvanced threat intelligence
50%
Skipped
OSV-ScannerOpen Source Vulnerability database check
50%
Skipped
OWASP Dep-Check
50%
Last scanned: May 10, 2026, 5:37 AM183.4s1 file scanned
SKILL.md
- name:
- llama-cpp
- description:
- |
llama-cpp -- llama.cpp prebuilt binaries and GGUF tools
Layer Properties
| Property | Value |
|----------|-------|
| Dependencies | None |
| Ports | — |
| Service | — |
| Install files | layer.yml, tasks: |
What It Installs
Downloads the latest llama.cpp release from GitHub into ~/llama.cpp:
Binaries: llama-quantize, llama-cli, shared libraries (lib*.so*)
Python tools: convert_hf_to_gguf.py, gguf-py package (from source tarball)
Environment
| Variable | Value | Purpose |
|----------|-------|---------|
| LLAMA_CPP_PATH | ~/llama.cpp | Location of llama.cpp binaries |
| PATH (appended) | ~/llama.cpp | Makes llama-quantize/llama-cli available |
Design: Tier 1 "Post-install" Layer
This layer has no pixi.toml and no depends. It downloads prebuilt binaries and sets environment variables. It is designed to be composed into environment-owning layers (Tier 2) via the layers: field.
The user-phase tasks run after the pixi environment is established by the parent layer. The gguf Python package (for programmatic GGUF access) is declared in the parent layer's pixi.toml, not here.
Used In Layers
/ov-foundation:python-ml— vialayers: [llama-cpp]/ov-jupyter:jupyter-ml— vialayers: [llama-cpp, unsloth]/ov-jupyter:unsloth-studio— vialayers: [llama-cpp, unsloth]
Related Layers
/ov-jupyter:unsloth— Fine-tuning (depends on llama.cpp for GGUF conversion)
Used In Images
/ov-foundation:python-ml(viapython-mlmetalayer)/ov-immich:immich-ml(viapython-mlmetalayer)/ov-jupyter:jupyter-ml(viajupyter-mlmetalayer)/ov-jupyter:jupyter-ml-notebook(viajupyter-mlmetalayer)/ov-jupyter:unsloth-studio(viaunsloth-studiometalayer)
When to Use This Skill
Use when the user asks about:
- llama.cpp binaries inside containers
- GGUF model conversion (convert_hf_to_gguf.py)
- llama-quantize or llama-cli
- The
LLAMA_CPP_PATHenvironment variable
Related
/ov-build:layer— layer authoring reference (layer.ymlschema, task verbs, service declarations)/ov-build:eval— declarative testing (eval:block,ov eval image,ov eval live)
Related Skills
overthinkos/charly
tools
VerifiedTrustedCommunity
OpenCharly CLI (charly) binary installed into container/VM images for in-container use. Use when working with charly binary deployment inside containers, native D-Bus support, or the full charly toolchain (charly binary + virtualization + gocryptfs + socat).
SKILL.mdUpdated Jun 10, 2026
overthinkos/charly-cachyos
development
VerifiedTrustedCommunity
Operator CachyOS workstation profile — a kind:local template + target:local deploy that installs the full dev stack (30 candies) onto a CachyOS host via ShellExecutor. Lives in the overthinkos/cachyos submodule. MUST be invoked before editing or applying the charly-cachyos workstation profile.
SKILL.mdUpdated Jun 10, 2026
overthinkos/charly-fedora
tools
VerifiedTrustedCommunity
Fedora box with the full charly toolchain using shared candies. Rootless-first — runs as uid=1000 with passwordless sudo (no root, no cap_add: ALL). Same candy list as charly-arch. Includes NVIDIA GPU runtime. MUST be invoked before building, deploying, configuring, or troubleshooting the charly-fedora box.
SKILL.mdUpdated Jun 10, 2026
overthinkos/charly-arch
tools
VerifiedTrustedCommunity
Arch Linux box with the full charly toolchain. Rootless-first — runs as uid=1000 with passwordless sudo (no root, no cap_add: ALL). Composes /charly-coder:charly-mcp so the box is reachable as an MCP gateway on port 18765. NVIDIA GPU runtime composed in. MUST be invoked before building, deploying, configuring, or troubleshooting the charly-arch box.
SKILL.mdUpdated Jun 10, 2026