This is the core part of KCL by implementing worker. It has exactly the same interface as Amazon's KCL. Internally, it uses code from GoKini in order to get the library functionaly quickly. This is a working version. The test code worker_test.go shows how to use this library. Dynamic resharding feature is out of the scope of M4. Test: 1. A Kinesis stream named "kcl-test" has been created under photon-infra account. 2. Download your AWS Credential from IAM user page. 3. Modify the worker_test.go to fill in your aws credential. 4. hmake test Jira CNA-637 Change-Id: I886d255bab9adaf7a13bca11bfda51bedaacaaed
11 lines
516 B
Go
11 lines
516 B
Go
package interfaces
|
|
|
|
// ExtendedSequenceNumber represents a two-part sequence number for records aggregated by the Kinesis Producer Library.
|
|
//
|
|
// The KPL combines multiple user records into a single Kinesis record. Each user record therefore has an integer
|
|
// sub-sequence number, in addition to the regular sequence number of the Kinesis record. The sub-sequence number
|
|
// is used to checkpoint within an aggregated record.
|
|
type ExtendedSequenceNumber struct {
|
|
SequenceNumber *string
|
|
SubSequenceNumber int64
|
|
}
|