Commit graph

4 commits

Author SHA1 Message Date
Harlow Ward
71556ee7f7 Remove namespace from RedisCheckpoint
The interface for checkpoint added another dependence to inject into the
Pipeline. With this removed we can use the checkpoint directly from the
pipeline.
2014-12-21 01:08:44 -08:00
Harlow Ward
8e8ee5af73 Use golint to update Golang styles
* Update comments and return statements
* Adjust usage of Kinesis library (upgraded local source)
2014-12-10 15:38:19 -08:00
Harlow Ward
f921eca908 Add support for JSONPaths in Redshift Load
By specifying a `jsonpaths` parameter to an S3 file containing ordinal
attribute position we can store free-form JSON in S3 and then reference
the col order from the COPY command.

http://docs.aws.amazon.com/redshift/latest/dg/r_COPY_command_examples.html
2014-11-15 13:49:37 -08:00
Harlow Ward
06b40e6ed8 Base pipeline components
* Create base Interfaces for Pipeline
* Add first base implementations for Pipeline
* Add initial test for core functionality
2014-11-14 20:45:34 -08:00