parquetlens

A fast, interactive TUI for viewing Parquet files. Like csvlens but for Parquet.

!parquetlens

Install

``bash
npm install -g parquetlens
`

Or run directly with npx:

`bash
npx parquetlens data.parquet
`

Usage

`bash
parquetlens [options]
`

Options:

- --limit - Number of rows to show (default: 20)
- --columns - Comma-separated column list
- --sql - Run SQL query (uses data as table name, requires @parquetlens/sql)
- --schema - Print schema only
- --no-schema - Skip schema output
- --json - Output rows as JSON lines
- --tui - Open interactive viewer (default)
- --plain / --no-tui - Disable interactive viewer

Examples:

`bash


View local file

parquetlens data.parquet

View with column selection

parquetlens data.parquet --columns city,state

Fetch from URL (e.g., Hugging Face datasets)

parquetlens https://huggingface.co/datasets/cfahlgren1/hub-stats/resolve/main/daily_papers.parquet

Hugging Face shortcut

parquetlens hf://datasets/cfahlgren1/hub-stats/daily_papers.parquet

Pipe from stdin

parquetlens - < data.parquet

Plain output (no TUI)

parquetlens data.parquet --plain --limit 100

SQL query (requires optional @parquetlens/sql)

parquetlens data.parquet --sql "SELECT city, COUNT(*) FROM data GROUP BY city"
`

TUI Controls

| Key | Action |
| --------------- | ----------------------- |
| j/k or arrows | Scroll rows |
| h/l | Jump columns |
| PgUp/PgDn | Page scroll |
| Mouse wheel | Scroll |
| Click cell | Open detail panel |
| s or Enter | Toggle detail panel |
| e | Show error detail |
| y | Copy error to clipboard |
| x or Esc | Close panel (or quit) |
| q | Quit |

Features

- Fast: Uses a lightweight Parquet reader with HTTP range requests
- Interactive TUI: Full-screen terminal UI with mouse support
- URL Support: Read parquet files from URLs (including hf://`)
- Column Types: Shows Parquet schema types in headers
- Cell Detail: Click any cell to see full content
- Streaming: Reads only the rows you need

License

MIT