f0e6461cb6
The previous pipeline model required a lot of setup and abstracted away the processing of records. By passing a HandlerFunc to the consumer we keep the business logic of processing of records closer to the use of the consumer. * Add refactoring note and SHA to README
12 lines
222 B
INI
12 lines
222 B
INI
[pipeline]
|
|
name = s3Pipeline
|
|
[s3]
|
|
bucketName = kinesis.test
|
|
[kinesis]
|
|
bufferSize = 100
|
|
shardCount = 2
|
|
streamName = userStream
|
|
[redshift]
|
|
tableName = kinesis_pipeline_test
|
|
format = json
|
|
copyMandatory = true
|