8dazo/debug-verify-benchmark
.cursor/skills/debug-verify-benchmark/SKILL.md
Debug, verify, and compare elix-db to industry after each plan step. Use after implementing any plan step or changing vector/store/API logic; run tests, IEx checks, and document efficiency vs Qdrant/Milvus/pgvector.
$ install --global
skillsauthnpx skillsauth add 8dazo/elix-db debug-verify-benchmarkInstall this skill globally with one command. Works with Claude Code, Cursor, and Windsurf.
Security Scan Results
3 of 9 scanners reported clean
Some scanners were skipped, did not run, or reported a non-clean status. Review each row below.
3
Scanners Passed
9
Scanners in report
Clean
TrivyContainer and dependency vulnerability scanner
95%
Clean
SemgrepStatic code analysis for vulnerabilities
95%
Clean
mcp-scan (Snyk)Model Context Protocol security validation
95%
Skipped
Snyk (dep)Open source security scanning
50%
Skipped
Socket.devSupply chain security analysis
50%
Skipped
VirusTotalMulti-engine malware detection
50%
Skipped
CrowdStrikeAdvanced threat intelligence
50%
Skipped
OSV-ScannerOpen Source Vulnerability database check
50%
Skipped
OWASP Dep-Check
50%
Last scanned: Apr 17, 2026, 2:01 AM5.8s1 file scanned
SKILL.md
- name:
- debug-verify-benchmark
- description:
- Debug, verify, and compare elix-db to industry after each plan step. Use after implementing any plan step or changing vector/store/API logic; run tests, IEx checks, and document efficiency vs Qdrant/Milvus/pgvector.
Debug, Verify, and Benchmark
Apply after every plan step or change to vector store, search, or API.
When to Use
- After implementing a step in plan/README.md
- After changing
ElixDbvector/store/API logic - Before marking a step "Done" in the plan
Debug
- Run tests:
mix test - Start IEx:
iex -S mixand exercise the new APIs (create collection, upsert, search, get, delete as applicable). - Add traces if needed:
Logger.debug/2or:sys.tracefor GenServer; fix failures before proceeding.
Verify
- All tests pass; no new compiler warnings.
- For search: add or run tests that check known vectors produce known ordering (e.g. cosine similarity order).
- Acceptance criteria in the step file are checked off.
Industry Comparison
For each step, fill in the Industry comparison table in the step file:
- Correctness: Behavior matches Qdrant/Milvus (collections, points, upsert, search, get, delete).
- Latency: Note expected vs actual; compare to typical Qdrant/Milvus/pgvector numbers (e.g. p99 ms) when metrics exist.
- Throughput: QPS if measured; document concurrency level.
- Recall: For search, recall@k = 1.0 for exact k-NN; document when approximate index is added later.
Document efficiency notes at the bottom of the step: gaps, improvement ideas, and follow-up tasks.
Metrics to Capture
When implementing step 8 or ad-hoc benchmarking:
| Metric | How | Use | |--------|-----|-----| | Latency | Per-operation timing; compute mean, p50, p99 | Compare to industry; track over time | | QPS | Queries per second under fixed concurrency | Throughput vs Qdrant/Milvus | | Recall@k | True k-NN vs returned k; fraction overlap | Search quality when ground truth exists | | Memory/CPU | BEAM process stats | Resource efficiency |
Store results in a simple format (e.g. JSON struct or Markdown table) under docs/benchmarks.md or script output for future comparison.
Related Skills
8dazo/versioned-sample-uses
business
VerifiedTrustedCommunity
When publishing a new elix-db version or making version changes, run versioned sample use cases, collect memory/time/latency, compare to the previous version report, and update reports. Remember this workflow for releases.
3SKILL.mdUpdated Apr 17, 2026
8dazo/vector-db-storage
development
VerifiedTrustedCommunity
Storage backends and indexing for vector databases in Elixir. Use when choosing persistence, implementing exact vs approximate k-NN, or integrating pgvector, file, or ETS for vector storage.
3SKILL.mdUpdated Apr 17, 2026
8dazo/vector-db-elixir
development
VerifiedTrustedCommunity
Design and implement a vector database in Elixir. Use when building embedding storage, similarity search, k-NN retrieval, or when the user mentions vector DB, embeddings, or semantic search in Elixir.
3SKILL.mdUpdated Apr 17, 2026
8dazo/elixir-vector-patterns
data-ai
VerifiedTrustedCommunity
Elixir patterns for vector storage and similarity search. Use when implementing GenServer-based vector store, ETS index, Nx/Scholar distance math, or supervision for a vector DB in Elixir.
3SKILL.mdUpdated Apr 17, 2026