DynamoDB Data Transformation Tool
npm install dynamo-data-transform
Dynamo Data Transform is an easy to use data transformation tool for DynamoDB.
It allows performing powerful data transformations using simple Javascript commands, without the risk of breaking your database.
Available as a Serverless plugin, npm package and even as an interactive CLI, Dynamo Data Transform saves you time and keeps you safe with features like dry-running a data transformation and even rolling back your last trasnformation if needed.
Features
- Seemless data transformations management.
- Support for multiple stages.
- History of executed data transformations.
- Dry run option for each command (by suppling --dry flag, the data will be printed instead of stored).
- Safe & Secure preparation data
- Store preparation data in a private s3 bucket. Prepare data for your data transformation
- Quick Start
- Serverless plugin
- Standalone npm package
- Interactive CLI
- Creating your first data transformation
- Usage and command-line options
- What happens behind the scenes
- Examples
- The data transformation process
bash
npm install dynamo-data-transform --save-dev
`
- Add the tool to your serverless.yml
Run:
`bash
npx serverless plugin install -n dynamo-data-transform
`
Or add manually to your serverless.yml:
`YML
plugins:
- dynamo-data-transform
`
- Run
`bash
sls dynamodt --help
`$3
- Install the tool
`bash
npm install -g dynamo-data-transform -s
`
- Run the tool
`bash
dynamodt help
`
Or with the shortcut
`bash
ddt help
`
$3
After installing the npm package, run:
`bash
dynamodt -i
`
!cli gifCreating your first data transformation
1. Intialize data-transformations folder
Serverless (the plugin reads the table names from the serverless.yml file):
`bash
sls dynamodt init --stage
`
Standalone:
`bash
ddt init --tableNames
`Open the generated data transformation file 'v1_script-name.js' file and implement the following functions:
- transformUp: Executed when running
dynamodt up
- transformDown: Executed when running dynamodt down -t