kinesis-consumer/examples/producer/README.md

# Producer

A prepopulated file with JSON users is available on S3 for seeing the stream.

### Environment Variables

Export the required environment vars for connecting to the Kinesis stream:

```
export AWS_PROFILE=
export AWS_REGION=
```

### Running the code

    $ go run main.go --stream streamName
Simplify the consumer experience (#35) Major changes: * Remove intermediate batching of kinesis records * Call the callback func with each record * Use functional options for config https://dave.cheney.net/2014/10/17/functional-options-for-friendly-apis Minor changes: * update README messaging about Kinesis -> Firehose functionality * remove unused buffer and emitter code 2017-11-20 16:21:40 +00:00			`# Producer`
Add sample pipeline * Reduce the size of main README in favor of adding functioning examples * Add S3 Pipeline exmaple * Add example of seeing the stream 2015-05-23 22:22:58 +00:00
Example data is in repo, no need to download 2019-04-07 23:33:47 +00:00			`A prepopulated file with JSON users is available on S3 for seeing the stream.`
Add sample pipeline * Reduce the size of main README in favor of adding functioning examples * Add S3 Pipeline exmaple * Add example of seeing the stream 2015-05-23 22:22:58 +00:00
			`### Environment Variables`

			`Export the required environment vars for connecting to the Kinesis stream:`

			```
Use shard broker to monitor and process new shards (#85) * Use shard broker to start processing new shards The addition of a shard broker will allow the consumer to be notified when new shards are added to the stream so it can consume them. Fixes: https://github.com/harlow/kinesis-consumer/issues/36 2019-04-10 05:03:12 +00:00			`export AWS_PROFILE=`
adjust channel ownership for group 2019-06-03 00:46:28 +00:00			`export AWS_REGION=`
Add sample pipeline * Reduce the size of main README in favor of adding functioning examples * Add S3 Pipeline exmaple * Add example of seeing the stream 2015-05-23 22:22:58 +00:00			```

			`### Running the code`

Add logs for start scan and checkpoints 2017-11-23 01:52:41 +00:00			`$ go run main.go --stream streamName`