kinesis-consumer/checkpoint/checkpoint.go

package checkpoint

// Checkpoint interface used to allow swappable backends for checkpoining
// consumer progress in the stream.
type Checkpoint interface {
	Get(shardID string) (string, error)
	Set(shardID string, sequenceNumber string) error
}
Simplify the consumer experience (#35) Major changes: * Remove intermediate batching of kinesis records * Call the callback func with each record * Use functional options for config https://dave.cheney.net/2014/10/17/functional-options-for-friendly-apis Minor changes: * update README messaging about Kinesis -> Firehose functionality * remove unused buffer and emitter code 2017-11-20 16:21:40 +00:00			`package checkpoint`
Base pipeline components * Create base Interfaces for Pipeline * Add first base implementations for Pipeline * Add initial test for core functionality 2014-07-25 06:03:41 +00:00
Add DDB as consumer checkpoint option (#37) * Simplify the checkpoint interface * Add DDB backend for checkpoint persistence Implements: https://github.com/harlow/kinesis-consumer/issues/26 2017-11-20 17:37:30 +00:00			`// Checkpoint interface used to allow swappable backends for checkpoining`
			`// consumer progress in the stream.`
Add checkpoint interface for custom checkpoints (#29) To allow other checkpoint backends we extract a checkpoint interface which future checkpoints can implement. * Add checkpoint interface for custom checkpoints * Create RedisCheckpoint to implement checkpoint interface * Swap out hosie redis library for go-redis Minor changes * Allow configuration of Redis endpoint with env var `REDIS_URL` * Replace gvt with govendor 2016-12-04 08:08:06 +00:00			`type Checkpoint interface {`
Add DDB as consumer checkpoint option (#37) * Simplify the checkpoint interface * Add DDB backend for checkpoint persistence Implements: https://github.com/harlow/kinesis-consumer/issues/26 2017-11-20 17:37:30 +00:00			`Get(shardID string) (string, error)`
			`Set(shardID string, sequenceNumber string) error`
Base pipeline components * Create base Interfaces for Pipeline * Add first base implementations for Pipeline * Add initial test for core functionality 2014-07-25 06:03:41 +00:00			`}`