aidotnet/csv-pipeline
resources/skills/csv-pipeline/SKILL.md
Process, transform, analyze, and report on CSV and JSON data files. Use when the user needs to filter rows, join datasets, compute aggregates, convert formats, deduplicate, or generate summary reports from tabular data. Works with any CSV, TSV, or JSON Lines file.
$ install --global
skillsauthnpx skillsauth add aidotnet/opencowork csv-pipelineInstall this skill globally with one command. Works with Claude Code, Cursor, and Windsurf.
Security Scan Results
3 of 9 scanners reported clean
Some scanners were skipped, did not run, or reported a non-clean status. Review each row below.
3
Scanners Passed
9
Scanners in report
Clean
TrivyContainer and dependency vulnerability scanner
95%
Clean
SemgrepStatic code analysis for vulnerabilities
95%
Clean
mcp-scan (Snyk)Model Context Protocol security validation
95%
Skipped
Snyk (dep)Open source security scanning
50%
Skipped
Socket.devSupply chain security analysis
50%
Skipped
VirusTotalMulti-engine malware detection
70%
Skipped
CrowdStrikeAdvanced threat intelligence
50%
Skipped
OSV-ScannerOpen Source Vulnerability database check
50%
Skipped
OWASP Dep-Check
50%
Last scanned: Apr 4, 2026, 12:36 AM213.4s1 file scanned
SKILL.md
- name:
- csv-pipeline
- description:
- Process, transform, analyze, and report on CSV and JSON data files. Use when the user needs to filter rows, join datasets, compute aggregates, convert formats, deduplicate, or generate summary reports from tabular data. Works with any CSV, TSV, or JSON Lines file.
- compatibility:
- Requires Python 3. No external dependencies beyond Python standard library (csv, json modules).
CSV Data Pipeline
Process tabular data (CSV, TSV, JSON, JSON Lines) using standard command-line tools and Python. No external dependencies required beyond Python 3.
When to use this skill
- User provides a CSV/TSV/JSON file and asks to analyze, transform, or report on it
- Joining, filtering, grouping, or aggregating tabular data
- Converting between formats (CSV to JSON, JSON to CSV, etc.)
- Deduplicating, sorting, or cleaning messy data
- Generating summary statistics or reports
- ETL workflows: extract from one format, transform, load into another
Scripts overview
| Script | Purpose | Dependencies |
| ------------- | ----------------------------------- | ---------------------- |
| csv_tool.py | All-in-one CSV/JSON processing tool | Python 3 (stdlib only) |
Steps
1. Ensure Python 3 is available
python --version
CRITICAL — Error Recovery: If any script below fails with an error, check that Python 3 is available and re-run the exact same command.
2. Inspect a data file
python scripts/csv_tool.py inspect "DATA_FILE"
Shows row count, column names, and non-empty value counts per column.
3. Filter rows
python scripts/csv_tool.py filter "DATA_FILE" --column COLUMN_NAME --op OPERATOR --value VALUE --output "OUTPUT_FILE"
Operators: eq, neq, gt, gte, lt, lte, contains, startswith, endswith
4. Sort data
python scripts/csv_tool.py sort "DATA_FILE" --column COLUMN_NAME --order asc --output "OUTPUT_FILE"
Options: --numeric for numeric sorting, --order desc for descending.
5. Deduplicate
python scripts/csv_tool.py dedup "DATA_FILE" --columns "col1,col2" --output "OUTPUT_FILE"
Remove duplicates by specified columns (or all columns if omitted).
6. Aggregate / Group By
python scripts/csv_tool.py aggregate "DATA_FILE" --group-by COLUMN --agg-column VALUE_COL --func sum --output "OUTPUT_FILE"
Functions: sum, avg, count, min, max
7. Join two datasets
python scripts/csv_tool.py join "LEFT_FILE" "RIGHT_FILE" --on KEY_COLUMN --how inner --output "OUTPUT_FILE"
Join types: inner, left
8. Convert formats
python scripts/csv_tool.py convert "DATA_FILE" --to json --output "OUTPUT_FILE"
Supported conversions: csv, json, jsonl (JSON Lines), tsv
9. Generate summary report
python scripts/csv_tool.py report "DATA_FILE" --group-by CATEGORY_COL --value-column VALUE_COL --output "report.md"
Generates a Markdown summary table with count, sum, avg, min, max per group.
10. Clean data
python scripts/csv_tool.py clean "DATA_FILE" --output "CLEAN_FILE"
Strips whitespace, normalizes empty values (N/A, null, None → empty), normalizes booleans.
Decision guide
- Quick look →
inspectto understand the data - Filter/sort/dedup → use the corresponding subcommand
- Summarize →
aggregatefor raw data,reportfor Markdown output - Combine files →
jointwo datasets on a shared key - Change format →
convertbetween CSV/JSON/TSV
Edge cases
- Large files (100MB+): The tool processes data in streaming fashion where possible
- Encoding issues: Files are read as UTF-8 by default. For BOM files, use UTF-8-SIG
- Quoted fields: Python's csv module handles RFC 4180 quoting automatically
- Mixed types: Numeric operations attempt float conversion, falling back to 0
Scripts
- csv_tool.py — All-in-one CSV/JSON data processing tool
Related Skills
aidotnet/product-design
tools
VerifiedTrustedCommunity
Product Design workflow plugin for OpenCowork. Use when the user mentions Product Design or asks to design, redesign, audit, research, prototype, clone a URL, turn an image or screenshot into code, generate UI directions, manage saved product design context, or share a runnable prototype.
480SKILL.mdUpdated Jun 13, 2026
aidotnet/resources/skills/post-to-x
tools
VerifiedTrustedCommunity
Post tweets to X.com (Twitter) using the system browser's login state
448SKILL.mdUpdated Mar 27, 2026
aidotnet/docx
development
VerifiedTrustedCommunity
Comprehensive document creation, editing, and analysis with support for tracked changes, comments, formatting preservation, and text extraction. When GLM needs to work with professional documents (.docx files) for: (1) Creating new documents, (2) Modifying or editing content, (3) Working with tracked changes, (4) Adding comments, or any other document tasks
448SKILL.mdUpdated Mar 27, 2026
aidotnet/xlsx
development
VerifiedTrustedCommunity
Comprehensive spreadsheet creation, editing, and analysis with support for formulas, formatting, data analysis, and visualization. When GLM needs to work with spreadsheets (.xlsx, .xlsm, .csv, .tsv, etc) for: (1) Creating new spreadsheets with formulas and formatting, (2) Reading or analyzing data, (3) Modify existing spreadsheets while preserving formulas, (4) Data analysis and visualization in spreadsheets, or (5) Recalculating formulas
284SKILL.mdUpdated Mar 27, 2026