By specifying a `jsonpaths` parameter to an S3 file containing ordinal attribute position we can store free-form JSON in S3 and then reference the col order from the COPY command. http://docs.aws.amazon.com/redshift/latest/dg/r_COPY_command_examples.html
10 lines
385 B
Go
10 lines
385 B
Go
package connector
|
|
|
|
// Used by Pipeline.ProcessShard when they want to checkpoint their progress.
|
|
// The Kinesis Connector Library will pass an object implementing this interface to ProcessShard,
|
|
// so they can checkpoint their progress.
|
|
type Checkpoint interface {
|
|
CheckpointExists(shardID string) bool
|
|
SequenceNumber() string
|
|
SetCheckpoint(shardID string, sequenceNumber string)
|
|
}
|