luciano/vmware-go-kcl-v2
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
vmware-go-kcl is a vmware originated open-source project for AWS Kinesis Client Library in Go. It has been widely used by many external companies and internally by Carbon Black. vmware-go-kcl-v2 is its companion project by utilizing AWS Go SDK V2 which introduces lots of breaking changes. To keep the repo clean, it is better to have a separated repo vmware-go-kcl-v2 with better golang project structure improvement.
24 commits 18 branches 1 tag 598 KiB
Go 97%
Shell 2.3%
Makefile 0.7%
Find a file
Tao Jiang e2a945d824 KCL: Stuck on processing after kinesis shard splitting 
The processing Kinesis gets stuck after splitting shard. The
reason is that the app doesn't do mandatory checkpoint.

KCL document states:
// When the value of {@link ShutdownInput#getShutdownReason()} is
// {@link com.amazonaws.services.kinesis.clientlibrary.lib.worker.ShutdownReason#TERMINATE} it is required that you
// checkpoint. Failure to do so will result in an IllegalArgumentException, and the KCL no longer making progress.

Also, fix shard lease to prevent one host takes more shard than
its configuration allowed.

Jira CNA-1701

Change-Id: Icbdacaf347c7a67b5793647ad05ff93cca629741
2021-12-20 21:15:25 -06:00
clientlibrary KCL: Stuck on processing after kinesis shard splitting 2021-12-20 21:15:25 -06:00
support KCL: remove unused item 2021-12-20 21:15:25 -06:00
vendor Flatten directory structure 2021-12-20 21:15:15 -06:00
.gitignore CKL: Initial version for starting repository 2021-12-20 21:13:11 -06:00
.gitreview CKL: Initial version for starting repository 2021-12-20 21:13:11 -06:00
CODE_OF_CONDUCT.md Add Code of Conduct template 2021-11-30 23:05:17 +08:00
CONTRIBUTING.md Add CONTRIBUTING template 2021-12-20 21:11:09 -06:00
HyperMake Flatten directory structure 2021-12-20 21:15:15 -06:00
README.md CKL: Initial version for starting repository 2021-12-20 21:13:11 -06:00

README.md

vmware-go-kcl-v2

Overview

Try it out

Prerequisites

  • Prereq 1
  • Prereq 2
  • Prereq 3

Build & Run

  1. Step 1
  2. Step 2
  3. Step 3

Documentation

Contributing

The vmware-go-kcl-v2 project team welcomes contributions from the community. Before you start working with vmware-go-kcl-v2, please read our Developer Certificate of Origin. All contributions to this repository must be signed as described on that page. Your signature certifies that you wrote the patch or have the right to pass it on as an open-source patch. For more detailed information, refer to CONTRIBUTING.md.

License

=======

Cascade Kinesis Client Library for GO

The Cascade Kinesis Client Library for GO (Cascade KCL) enables Go developers to easily consume and process data from [Amazon Kinesis][kinesis].

It is a re-implementation on Amazon's Kinesis Client Library in pure Go without using KCL's multi-language support.