History

Harlow Ward 76158d24ab Introduce ScanFunc signature and remove ScanStatus (#77 ) Major changes: ```go type ScanFunc func(r Record) error ``` Simplify the callback func signature by removing `ScanStatus` * Leverage context for cancellation * Add custom error `SkipCheckpoint` for special cases when we don't want to checkpoint Minor changes: * Use kinesis package constants for shard iterator types * Move optional config to new file See conversation on #75 for more details	2019-04-07 16:29:12 -07:00
..
main.go	Introduce ScanFunc signature and remove ScanStatus (#77 )	2019-04-07 16:29:12 -07:00
README.md	Add postgres checkpoint implementation (#55 )	2018-06-17 19:27:10 -07:00

Introduce ScanFunc signature and remove ScanStatus (#77 )

Major changes:

```go
type ScanFunc func(r *Record) error
```

* Simplify the callback func signature by removing `ScanStatus` 
* Leverage context for cancellation 
* Add custom error `SkipCheckpoint` for special cases when we don't want to checkpoint

Minor changes:

* Use kinesis package constants for shard iterator types
* Move optional config to new file

See conversation on #75 for more details

2019-04-07 16:29:12 -07:00

main.go

Introduce ScanFunc signature and remove ScanStatus (#77 )

2019-04-07 16:29:12 -07:00

README.md

Add postgres checkpoint implementation (#55 )

2018-06-17 19:27:10 -07:00

README.md

Consumer with postgres checkpoint

Read records from the Kinesis stream using postgres as checkpoint

Environment Variables

Export the required environment vars for connecting to the Kinesis stream:

export AWS_ACCESS_KEY=
export AWS_REGION=
export AWS_SECRET_KEY=

Run the consumer

 go run main.go --app appName --stream streamName --table tableName --connection connectionString