bobmatnyc/local-llm-ops
toolchains/ai/ops/local-llm-ops/SKILL.md
Local LLM operations with Ollama on Apple Silicon, including setup, model pulls, chat launchers, benchmarks, and diagnostics.
$ install --global
skillsauthnpx skillsauth add bobmatnyc/claude-mpm-skills local-llm-opsInstall this skill globally with one command. Works with Claude Code, Cursor, and Windsurf.
Security Scan Results
3 of 9 scanners reported clean
Some scanners were skipped, did not run, or reported a non-clean status. Review each row below.
3
Scanners Passed
9
Scanners in report
Clean
TrivyContainer and dependency vulnerability scanner
95%
Clean
SemgrepStatic code analysis for vulnerabilities
95%
Clean
mcp-scan (Snyk)Model Context Protocol security validation
95%
Skipped
Snyk (dep)Open source security scanning
50%
Skipped
Socket.devSupply chain security analysis
50%
Skipped
VirusTotalMulti-engine malware detection
50%
Skipped
CrowdStrikeAdvanced threat intelligence
50%
Skipped
OSV-ScannerOpen Source Vulnerability database check
50%
Skipped
OWASP Dep-Check
50%
Last scanned: Apr 16, 2026, 9:08 AM25.0s2 files scanned
SKILL.md
- name:
- local-llm-ops
- description:
- Local LLM operations with Ollama on Apple Silicon, including setup, model pulls, chat launchers, benchmarks, and diagnostics.
- user-invocable:
- false
- disable-model-invocation:
- true
- version:
- 1.0.0
- category:
- toolchain
- author:
- Claude MPM Team
- license:
- MIT
- summary:
- Run local LLMs with Ollama: setup venv, start service, pull models, launch chat, benchmark, and diagnose.
- when_to_use:
- Operating local LLMs on macOS, running Ollama-based chat sessions, or benchmarking models for speed/latency.
- quick_start:
- 1. ./setup_chatbot.sh 2. ./chatllm 3. ollama pull mistral (if no models)
Local LLM Ops (Ollama)
Overview
Your localLLM repo provides a full local LLM toolchain on Apple Silicon: setup scripts, a rich CLI chat launcher, benchmarks, and diagnostics. The operational path is: install Ollama, ensure the service is running, initialize the venv, pull models, then launch chat or benchmarks.
Quick Start
./setup_chatbot.sh
./chatllm
If no models are present:
ollama pull mistral
Setup Checklist
- Install Ollama:
brew install ollama - Start the service:
brew services start ollama - Run setup:
./setup_chatbot.sh - Verify service:
curl http://localhost:11434/api/version
Chat Launchers
./chatllm(primary launcher)./chator./chat.py(alternate launchers)- Aliases:
./install_aliases.shthenllm,llm-code,llm-fast
Task modes:
./chat -t coding -m codellama:70b
./chat -t creative -m llama3.1:70b
./chat -t analytical
Benchmark Workflow
Benchmarks are scripted in scripts/run_benchmarks.sh:
./scripts/run_benchmarks.sh
This runs bench_ollama.py with:
benchmarks/prompts.yamlbenchmarks/models.yaml- Multiple runs and max token limits
Diagnostics
Run the built-in diagnostic script when setup fails:
./diagnose.sh
Common fixes:
- Re-run
./setup_chatbot.sh - Ensure
ollamais in PATH - Pull at least one model:
ollama pull mistral
Operational Notes
- Virtualenv lives in
.venv - Chat configs and sessions live under
~/.localllm/ - Ollama API runs at
http://localhost:11434
Related Skills
toolchains/universal/infrastructure/docker
Related Skills
bobmatnyc/xquik
tools
VerifiedTrustedCommunity
Xquik X data automation API - Use REST or MCP for tweet search, user lookup, follower exports, media downloads, monitors, webhooks, giveaway draws, and confirmation-gated X actions.
59SKILL.mdUpdated Jul 19, 2026
bobmatnyc/linkedin
tools
VerifiedTrustedCommunity
LinkedIn automation via the Linked API CLI - fetch profiles, search people and companies, send messages, manage connections, create posts, react, comment, and run Sales Navigator and custom workflows. Use when the user wants to interact with LinkedIn.
59SKILL.mdUpdated Jul 19, 2026
bobmatnyc/model-context-builder
tools
VerifiedTrustedCommunity
MCP (Model Context Protocol) server build and evaluation guide, including local conventions for tool surfaces, config, and testing
58SKILL.mdUpdated Jul 9, 2026
bobmatnyc/model-context
tools
VerifiedTrustedCommunity
MCP (Model Context Protocol) - Build AI-native servers with tools, resources, and prompts. TypeScript/Python SDKs for Claude Desktop integration.
58SKILL.mdUpdated Jul 9, 2026