Amazon Kinesis Client for Go
Find a file
Taylor Sutton 6b2d1f8a56 Add zlib decompression to batch consumer.
This has become relevant as zlib is the compression method supported
by the Kinesis plugin for Fluent Bit.
2020-11-11 09:12:05 -05:00
.circleci Upgrade go to v1.13 2019-10-18 09:45:22 -07:00
.github add codeowners 2020-07-20 18:11:27 +00:00
batchconsumer Add zlib decompression to batch consumer. 2020-11-11 09:12:05 -05:00
cmd Merge pull request #33 from wwwjfy/fix-shutdown-requested 2018-12-11 16:28:37 -08:00
decode Add decoding of JSON logs in Fluent format. 2020-08-17 15:02:59 -07:00
kcl Merge pull request #33 from wwwjfy/fix-shutdown-requested 2018-12-11 16:28:37 -08:00
splitter glue log group format 2020-08-11 16:42:59 -07:00
.gitignore Added vendor to .gitignore 2017-05-22 22:57:34 +00:00
batchconsumer.properties Implemented new consumer interface as well as example consumer: 'batchconsumer' 2017-07-18 02:03:15 +00:00
consumer.properties initial commit 2017-02-08 20:23:00 +00:00
golang.mk upgrade kayvee-go to 6.24.0 2020-08-14 16:30:08 -07:00
Gopkg.lock upgrade kayvee-go to 6.24.0 2020-08-14 16:30:08 -07:00
Gopkg.toml upgrade kayvee-go to 6.24.0 2020-08-14 16:30:08 -07:00
Makefile update to repo1 link for jars 2020-04-06 13:31:10 -07:00
README.md initial commit 2017-02-08 20:23:00 +00:00

amazon-kinesis-client-go

A port of amazon-kinesis-client-python to Go.

Running the Consumer

Edit the file consumer.properties to point at a Kinesis stream that has some data. Build the consumer binary:

make build

Then run:

make run

This will download the jar files necessary to run the KCL, and then launch the KCL communicating with the consumer binary.