JosiahSiegel/datasets-models-sources

Datasets, Models, and Sources

Overview

Use this skill for Kaggle datasets, models, source attachments, and kagglehub workflows. Separate transfer/download tasks from notebook lifecycle tasks: kagglehub is useful for data and model artifacts, but Kaggle CLI remains the notebook push/pull/status/delete tool.

Tool Selection

| Need | Prefer | |---|---| | Create/edit/push/delete notebook | Kaggle CLI or Python API | | Check notebook status/logs/files | Kaggle CLI or Python API | | Download notebook outputs | Kaggle CLI or kagglehub.notebook_output_download | | Download/load/upload datasets | kagglehub dataset functions or Kaggle CLI | | Download/upload models | kagglehub model functions | | Download competition data | kagglehub competition_download or Kaggle CLI | | Manage metadata/source arrays | kernel-metadata.json plus Kaggle CLI push |

kagglehub Capabilities

kagglehub supports dataset_download, dataset_load, dataset_upload, model_download, model_upload, competition_download, and notebook_output_download. It does not create, edit, push, delete, or administer Kaggle notebooks, and it does not manage kernel-metadata.json or notebook run status. Route those operations to notebook-lifecycle and kernel-metadata.

Source Attachments

Use dataset_sources, competition_sources, kernel_sources, and model_sources in kernel-metadata.json for Kaggle-hosted notebook dependencies. Prefer explicit Kaggle resource identifiers and remove unused sources to reduce ambiguity, mount clutter, and rule-compliance risk.

Dataset and Model Hygiene

• Confirm licenses and competition rules before using external datasets or pretrained models.
• Avoid uploading secrets, private labels, cached tokens, or unredacted logs as dataset/model artifacts.
• Version artifacts intentionally so notebook runs can be reproduced.
• Document expected mounted paths under /kaggle/input and output paths under /kaggle/working.
• Validate checksums or file counts for large downloads when reproducibility matters.

Common Patterns

For competition notebooks, attach competition data through metadata and write submissions to /kaggle/working. For reusable training outputs, download notebook outputs or upload model artifacts with kagglehub after checking license/rule constraints. For local experimentation, use kagglehub downloads to populate local cache while keeping notebook code path-compatible with /kaggle/input.

Safety and Limitations

Require confirmation before overwriting uploaded dataset/model versions or making private assets public. Do not claim kagglehub can push notebooks, change kernel metadata, inspect run logs, or delete kernels. Use Kaggle Secrets guidance for sensitive credentials rather than packaging them into datasets, models, or notebooks.

Sources

• kagglehub repository: https://github.com/Kaggle/kagglehub
• Kaggle kernels CLI: https://github.com/Kaggle/kaggle-api/blob/main/docs/kernels.md
• Kaggle API docs: https://www.kaggle.com/docs/api