Amazon Kinesis Client for Go
Find a file
Taylor Sutton f8e9c34641 Refactor zlib decompression into the splitter package
Being in the batchconsumer package means it will work for anything
using KCL, but lambdas that subscribe to these log streams do not use
batchconsumer at all; instead they invoke the splitter package
directly. As such, if we want this functionality to be available to
lambda log consumers, it can't be in batchconsumer.

There are no functionality changes here, just moving code from an
unexported method in one place to an exported function in another
place. The tests also get moved along with it.
2020-11-12 11:37:13 -05:00
.circleci Upgrade go to v1.13 2019-10-18 09:45:22 -07:00
.github add codeowners 2020-07-20 18:11:27 +00:00
batchconsumer Refactor zlib decompression into the splitter package 2020-11-12 11:37:13 -05:00
cmd Merge pull request #33 from wwwjfy/fix-shutdown-requested 2018-12-11 16:28:37 -08:00
decode Add decoding of JSON logs in Fluent format. 2020-08-17 15:02:59 -07:00
kcl Merge pull request #33 from wwwjfy/fix-shutdown-requested 2018-12-11 16:28:37 -08:00
splitter Refactor zlib decompression into the splitter package 2020-11-12 11:37:13 -05:00
.gitignore Added vendor to .gitignore 2017-05-22 22:57:34 +00:00
batchconsumer.properties Implemented new consumer interface as well as example consumer: 'batchconsumer' 2017-07-18 02:03:15 +00:00
consumer.properties initial commit 2017-02-08 20:23:00 +00:00
golang.mk upgrade kayvee-go to 6.24.0 2020-08-14 16:30:08 -07:00
Gopkg.lock upgrade kayvee-go to 6.24.0 2020-08-14 16:30:08 -07:00
Gopkg.toml upgrade kayvee-go to 6.24.0 2020-08-14 16:30:08 -07:00
Makefile update to repo1 link for jars 2020-04-06 13:31:10 -07:00
README.md initial commit 2017-02-08 20:23:00 +00:00

amazon-kinesis-client-go

A port of amazon-kinesis-client-python to Go.

Running the Consumer

Edit the file consumer.properties to point at a Kinesis stream that has some data. Build the consumer binary:

make build

Then run:

make run

This will download the jar files necessary to run the KCL, and then launch the KCL communicating with the consumer binary.