npm install humane-pipelinehumane-pipeline is a tool for managing pipeline of data source to transformations to destination(s). You can use it to read data from various sources, modify and enhance data through various transformations, add additional data through external data mapper, and finally write data to various destinations (one or many). Pipeline can also be forked into branches for multiple type of transformations and destinations.
It is fully free and open source. The license is LGPL 3.0, meaning you are pretty much free to use it in most ways.
It is part of a bigger ecosystem of humane-discovery platform, but is installable, runnable independent of that.
npm install -g humane-pipeline
- file
- directory watch
- file pattern watch
- file tail watch
- sql
- sql incremental watch
- filter
- pick
- pickBy
- omit
- omitBy
- reduce
- groupBy
- keys
- values
- map
- extMap
- log
- json
- jsonArray
- csvToJson
- jsonToCsv
- file - text file or json file