mediar-ai/packages/skills/skills/huggingface-cli

HuggingFace CLI

Execute Hugging Face Hub operations using the hf CLI for downloading models/datasets, uploading files, managing repositories, cache, and cloud compute.

Prerequisites

• HuggingFace CLI installed: pip install huggingface_hub
• HF account and token for authenticated operations
• hf auth login completed

Instructions

1. Authentication

   hf auth login                    # Interactive login
   hf auth login --token $HF_TOKEN  # Non-interactive
   hf auth whoami                   # Check current user
   

2. Download models and datasets

   hf download <repo_id>                           # Full repo to cache
   hf download <repo_id> --local-dir ./models      # To local directory
   hf download <repo_id> --include "*.safetensors" # Filter by pattern
   hf download <repo_id> --repo-type dataset       # Dataset
   

3. Upload files

   hf upload <repo_id> . .                         # Current dir to root
   hf upload <repo_id> ./models /weights           # Folder to path
   hf upload <repo_id> . . --repo-type dataset     # Dataset
   hf upload <repo_id> . . --create-pr             # Create PR
   

4. Repository management

   hf repo create <name>                           # Create model repo
   hf repo create <name> --repo-type dataset       # Create dataset
   hf repo create <name> --private                 # Private repo
   hf repo delete <repo_id>                        # Delete repo
   hf repo tag create <repo_id> v1.0               # Create tag
   

5. Cache management

   hf cache ls                      # List cached repos
   hf cache rm model/gpt2           # Remove cached repo
   hf cache prune                   # Remove detached revisions
   

6. Browse Hub

   hf models ls                                    # List trending models
   hf models ls --search "llama" --limit 20       # Search models
   hf datasets ls                                  # List datasets
   hf spaces ls                                    # List spaces
   

7. Cloud compute (Jobs)

   hf jobs run python:3.12 python script.py       # Run on CPU
   hf jobs run --flavor a10g-small <image> <cmd>  # Run on GPU
   hf jobs ps                                      # List jobs
   hf jobs logs <job_id>                          # View logs
   

Error Handling

• If authentication fails, run hf auth login again
• For permission errors, check token scope
• For large uploads, use hf upload-large-folder

Notes

• Key options: --repo-type (model/dataset/space), --revision, --quiet
• GPU flavors: cpu-basic, t4-small, a10g-small, a100-large, h100
• Use --quiet for scripts to get only paths/URLs

Source: huggingface/skills