n8n-nodes-parquet


An n8n community node for reading and writing Apache Parquet files with multi-cloud storage support.

n8n is a fair-code licensed workflow automation platform.

Features

- ✅ Read, Write & Merge Parquet Files: Full support for Apache Parquet format
- ✅ Multi-Cloud Storage: Azure Blob, AWS S3, Google Cloud Storage, S3-compatible (MinIO, Cloudflare R2)
- ✅ Local Files & URLs: Read from filesystem or HTTP(S) endpoints
- ✅ Wildcard Merge: Non-recursive wildcard expansion, sorted deterministically
- ✅ Schema Merge Modes: strict, union, intersection (flat schemas only)
- ✅ Smart Schema Detection: Automatic schema inference with nested/complex type support
- ✅ Manual Schema Override: Define custom schemas when needed
- ✅ Streaming Support: Memory-efficient processing for large files
- ✅ Multiple Compression: SNAPPY, GZIP, UNCOMPRESSED (BROTLI not supported due to n8n compatibility)
- ✅ Column Filtering: Read specific columns only
- ✅ Progress Logging: Track processing of large datasets
- ✅ Type Promotion: Intelligent handling of mixed types
- ✅ n8n Compatible: Pure JavaScript implementation, no native modules

Installation

$3

1. Go to Settings > Community Nodes in your n8n instance
2. Click Install and enter: n8n-nodes-parquet
3. Click Install and agree to the risks
4. Restart n8n if required

Usage

$3

- Operation: Read
- Select storage type (Local File / URL / Azure / S3 / GCS)
- Optional: Batch size, column filter, max rows, metadata

$3

- Operation: Write
- Select destination storage
- Schema mode: Auto or Manual
- Compression: SNAPPY (default), GZIP, UNCOMPRESSED

$3

- Operation: Merge
- Add one or more sources (supports wildcards like data-*.parquet)
- Choose output storage and output path
- Optional: Mismatch handling (failFast or collect)
- Optional: Schema merge mode (strict, union, intersection)
- Note: Union/Intersection currently supports flat schemas only
- Optional: Type conflict handling (error, coerce, null)

Credentials

All cloud credentials are available in the node UI. Select only the ones you need for the chosen storage backends.

Changelog

$3

- Merge schema modes: strict, union, intersection
- Union/Intersection supports flat schemas only (warning shown in UI)
- Read output fills missing columns with null
- Merge UI improvements and schema mismatch handling

$3

- Type conflict handling for merge: error, coerce, null
- Fixed: Correct deployment to both n8n custom and nodes directories

---

Made for the n8n community