Major changes: * Remove intermediate batching of kinesis records * Call the callback func with each record * Use functional options for config https://dave.cheney.net/2014/10/17/functional-options-for-friendly-apis Minor changes: * update README messaging about Kinesis -> Firehose functionality * remove unused buffer and emitter code |
||
|---|---|---|
| .. | ||
| main.go | ||
| README.md | ||
Producer
A prepopulated file with JSON users is available on S3 for seeing the stream:
https://s3.amazonaws.com/kinesis.test/users.txt
Environment Variables
Export the required environment vars for connecting to the Kinesis stream:
export AWS_ACCESS_KEY=
export AWS_REGION_NAME=
export AWS_SECRET_KEY=
Running the code
$ curl https://s3.amazonaws.com/kinesis.test/users.txt > /tmp/users.txt
$ go run main.go -s streamName