mediar-ai/packages/skills/skills/huggingface-evaluation
packages/skills/skills/huggingface-evaluation/SKILL.md
# Hugging Face Evaluation Add structured evaluation results to model cards with support for README extraction, Artificial Analysis API, and custom evaluations using vLLM/lighteval. ## Prerequisites - uv (Python package manager) - HF_TOKEN environment variable - For Artificial Analysis: AA_API_KEY environment variable ## Instructions ### Workflow: Extract from README ```bash # 1. Check for existing PRs first uv run scripts/evaluation_manager.py get-prs --repo-id "username/model-name" # 2.
$ install --global
skillsauthnpx skillsauth add mediar-ai/skillhubz packages/skills/skills/huggingface-evaluationInstall this skill globally with one command. Works with Claude Code, Cursor, and Windsurf.
Security Scan Results
3 of 9 scanners reported clean
Some scanners were skipped, did not run, or reported a non-clean status. Review each row below.
3
Scanners Passed
9
Scanners in report
Clean
TrivyContainer and dependency vulnerability scanner
95%
Clean
SemgrepStatic code analysis for vulnerabilities
95%
Clean
mcp-scan (Snyk)Model Context Protocol security validation
95%
Skipped
Snyk (dep)Open source security scanning
50%
Skipped
Socket.devSupply chain security analysis
50%
Skipped
VirusTotalMulti-engine malware detection
50%
Skipped
CrowdStrikeAdvanced threat intelligence
50%
Skipped
OSV-ScannerOpen Source Vulnerability database check
50%
Skipped
OWASP Dep-Check
50%
Last scanned: Apr 18, 2026, 6:49 AM49.6s2 files scanned
SKILL.md
Hugging Face Evaluation
Add structured evaluation results to model cards with support for README extraction, Artificial Analysis API, and custom evaluations using vLLM/lighteval.
Prerequisites
- uv (Python package manager)
- HF_TOKEN environment variable
- For Artificial Analysis: AA_API_KEY environment variable
Instructions
Workflow: Extract from README
# 1. Check for existing PRs first
uv run scripts/evaluation_manager.py get-prs --repo-id "username/model-name"
# 2. Inspect tables to find evaluation data
uv run scripts/evaluation_manager.py inspect-tables --repo-id "username/model"
# 3. Extract specific table (prints YAML)
uv run scripts/evaluation_manager.py extract-readme \
--repo-id "username/model" \
--table 1
# 4. Apply changes
uv run scripts/evaluation_manager.py extract-readme \
--repo-id "username/model" \
--table 1 \
--create-pr # or --apply for direct push
Import from Artificial Analysis
AA_API_KEY="your-key" uv run scripts/evaluation_manager.py import-aa \
--creator-slug "anthropic" \
--model-name "claude-sonnet-4" \
--repo-id "username/model-name" \
--create-pr
Run Custom Evaluations
lighteval with vLLM:
uv run scripts/lighteval_vllm_uv.py \
--model meta-llama/Llama-3.2-1B \
--tasks "leaderboard|mmlu|5"
inspect-ai with vLLM:
uv run scripts/inspect_vllm_uv.py \
--model meta-llama/Llama-3.2-1B \
--task mmlu
Via HF Jobs:
hf jobs uv run scripts/lighteval_vllm_uv.py \
--flavor a10g-small \
--secrets HF_TOKEN=$HF_TOKEN \
-- --model meta-llama/Llama-3.2-1B \
--tasks "leaderboard|mmlu|5"
Hardware Recommendations
| Model Size | Hardware | |------------|----------| | < 3B params | t4-small | | 3B - 13B | a10g-small | | 13B - 34B | a10g-large | | 34B+ | a100-large |
Notes
- Always check for existing PRs before creating new ones
- Preview YAML output before applying changes
- vLLM provides 5-10x faster inference than standard methods
Source: huggingface/skills
Related Skills
mediar-ai/valet
tools
VerifiedTrustedCommunity
Use when the user wants to manage Valet agents, channels, connectors, organizations, or environment variables (secrets and plain config) via the valet CLI. Handles creation, deployment, linking, teardown, and all multi-step workflows. Also use when asked to "create an agent", "deploy an agent", "design an agent", "build me an agent that...", "create a connector", "set up a webhook", or anything involving the Valet platform or any request to create and deploy AI agents. Also use when asked to "learn from this session", "capture this workflow", "save this as an agent", "make this repeatable", or when writing SOUL.md files.
8SKILL.mdUpdated Aug 25, 2026
mediar-ai/valet-publish
tools
VerifiedTrustedCommunity
Publish files, folders, and artifacts to the web. Static hosting for HTML sites, images, PDFs, reports, dashboards, and any file type. Use when asked to publish, host, upload, serve, or share work at a live URL. Also use to propose a rendered page when a report, comparison, chart, design document, or status page would work better than terminal text, but do not create or update a remote site until the user asks or agrees. Account publishing gives a permanent, private-by-default URL visible to org members; --anonymous gives a temporary public URL with no account. Use the valet CLI when available and its MCP server when the CLI cannot run. For deploying an AI agent rather than static files, use the `valet` skill instead.
8SKILL.mdUpdated Aug 25, 2026
mediar-ai/packages/skills/skills/faceless-so
testing
VerifiedTrustedCommunity
# Faceless.so Turn a script, prompt, Reddit post, or blog into a Remotion short with TTS, captions, and B-roll, then auto-post to YouTube, TikTok, Instagram, X, Facebook, LinkedIn, and Threads. ## Prerequisites - A Faceless.so account (from $24/mo) at https://faceless.so - Source material: script, prompt, Reddit URL, or blog URL - Destination social accounts to auto-post (YouTube, TikTok, Instagram, X, Facebook, LinkedIn, Threads) ## Instructions 1. Open https://faceless.so and start a new
8SKILL.mdUpdated Aug 25, 2026
mediar-ai/packages/skills/skills/bimi-svg-tiny-p-s-corpus-validator
testing
VerifiedTrustedCommunity
# BIMI SVG Tiny P/S Corpus Validator Use the public makeBIMI SVG Tiny P/S Test Corpus to evaluate an SVG against its evidence-bound fixture rules and to report the result clearly. ## Inputs Accept either an SVG file, an SVG URL, or raw SVG markup. If the source cannot be retrieved or parsed as XML, stop and report that limitation. ## Authoritative corpus 1. Retrieve the current manifest from `https://makebimi.com/public/test-corpus/v1/manifest.json`. 2. Record `schema_version`, `corpus_vers
8SKILL.mdUpdated Aug 25, 2026