luciano/vmware-go-kcl-v2
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
vmware-go-kcl-v2/clientlibrary/worker
History
Tao Jiang e2a945d824 KCL: Stuck on processing after kinesis shard splitting 
The processing Kinesis gets stuck after splitting shard. The
reason is that the app doesn't do mandatory checkpoint.

KCL document states:
// When the value of {@link ShutdownInput#getShutdownReason()} is
// {@link com.amazonaws.services.kinesis.clientlibrary.lib.worker.ShutdownReason#TERMINATE} it is required that you
// checkpoint. Failure to do so will result in an IllegalArgumentException, and the KCL no longer making progress.

Also, fix shard lease to prevent one host takes more shard than
its configuration allowed.

Jira CNA-1701

Change-Id: Icbdacaf347c7a67b5793647ad05ff93cca629741
2021-12-20 21:15:25 -06:00
..
checkpointer.go KCL: Stuck on processing after kinesis shard splitting 2021-12-20 21:15:25 -06:00
record-processor-checkpointer.go KCL: Stuck on processing after kinesis shard splitting 2021-12-20 21:15:25 -06:00
shard-consumer.go KCL: remove panic in shard consumer 2021-12-20 21:15:25 -06:00
worker.go KCL: Stuck on processing after kinesis shard splitting 2021-12-20 21:15:25 -06:00
worker_test.go KCL: Stuck on processing after kinesis shard splitting 2021-12-20 21:15:25 -06:00