Extraload

Extraload is an ETL (EXtract, TRAnsform, LOAD) framework for Node.js. In plain English, it's a tool for taking data from one or more sources, performing any needed manipulations, and storing the transformed data somewhere else.

Common use cases

- Importing data from XML or CSV files into a database
- Migrating data from one database to another (for example, when switching forum software)
- Updating Solr or Lucene indexes

Goals

- ETL scripts should be easily understood. By using pure JavaScript instead of an amalgamation of other languages with XML, understanding a script becomes much easier.
- Scripts should be fast. They are.
- Supporting different data sources and databases should be easy. Extraload drivers are usually thin wrappers around pre-existing Node.js modules, making it quick and easy to support something new.

Installation

- npm install extraload
- Install any dependencies needed for the drivers you're using. Find these on the reference pages below.

API Reference

- Writing a script
- Creating a driver
- Core module: extraload
- Drivers:
- CSV: csv-stream
- MySQL: mysql
- XML: xml-stream
- XPath: xpath