kinesis-consumer

luciano/kinesis-consumer

Fork 0

Commit graph

Select branches

Hide pull requests

hw-group-interface

hw-group-lease

hw-ksis-agg

hw-remove-note

master

opentracing_examples

#1

#10

#100

#102

#103

#104

#105

#106

#11

#110

#113

#118

#119

#12

#121

#122

#122

#123

#124

#126

#126

#127

#129

#129

#13

#13

#130

#132

#134

#135

#137

#139

#14

#141

#144

#146

#146

#148

#15

#150

#153

#155

#156

#157

#159

#160

#161

#162

#163

#164

#168

#17

#170

#170

#171

#2

#21

#24

#25

#27

#29

#3

#30

#31

#31

#32

#34

#34

#35

#37

#38

#4

#40

#44

#44

#46

#47

#48

#49

#5

#50

#51

#52

#53

#54

#55

#56

#58

#59

#6

#60

#61

#61

#62

#62

#63

#64

#65

#66

#68

#69

#7

#72

#72

#73

#77

#8

#81

#82

#83

#85

#87

#88

#89

#9

#90

#91

#95

#96

#99

v0.1.0

v0.2.0

v0.3.0

v0.3.1

v0.3.2

v0.3.3

v0.3.4

v0.3.5

v0.3.6

d542fa996f Use AWS SDK and concurrency Harlow Ward 2016-01-09 09:46:28 -0800
0d5e9b7b02 Use AWS SDK for S3 Emitter Harlow Ward 2015-08-16 17:52:10 -0700
18173842fb Use AWS SDK Harlow Ward 2015-08-15 22:20:34 -0700
8277ffc6be Use GoKit logger interface directly Harlow Ward 2015-05-26 18:50:34 -0700
3d9e6e2485 Add Redshift Pipeline example Harlow Ward 2015-05-25 23:18:14 -0700
e17988cfc9 Update Logging instructions Harlow Ward 2015-05-25 23:09:59 -0700
cd54569c61 Use go-kit Log interface Harlow Ward 2015-05-25 21:51:53 -0700
9371fb938c Logging and DB connection reuse dan 2015-05-23 13:13:55 -0700
a27a13f405 Update README.md Harlow Ward 2015-05-23 16:18:10 -0700
9a30e97f10 Add link to exmaples directory Harlow Ward 2015-05-23 16:10:08 -0700
25e390e8b4 Add sample pipeline Harlow Ward 2015-05-23 15:22:58 -0700
fdd39482bb Add Installation sub-header to Usage Harlow Ward 2015-05-23 13:57:52 -0700
b9a489b940 Update header size. Remove note Harlow Ward 2015-05-23 13:56:03 -0700
6ca2abb7f8 User Log package for default logger Harlow Ward 2015-05-23 11:40:04 -0700
e52fcb4f8c Checkpoint after filtered messages in the pipeline dan 2015-04-07 11:19:10 -0700
b38102eec7 Silence log warnings during test run Harlow Ward 2015-05-23 12:48:31 -0700
95fe49e7e0 Add specs for AWS Backoff dan 2015-05-06 09:18:15 -0700
8c660f79fb Add Retries to Redshift Basic Emitter dan 2015-05-06 09:14:00 -0700
f4de27dc13 Add recoverability in the Pipeline dan 2015-04-03 15:33:34 -0700
7dbc78c656 Merge 6e75180bda into 9077d288d2 Harlow Ward 2015-05-23 17:25:29 +0000
9077d288d2 Rename License file and add Contributing sections Harlow Ward 2015-05-23 08:52:08 -0700
6e75180bda Rename License file and add Contributing sections Harlow Ward 2015-05-23 08:52:08 -0700
bde3e96ad9 Add Discard Logger Harlow Ward 2015-05-22 23:38:06 -0700
ff1cff0293 Add default logger dan 2015-05-15 12:32:45 -0700
ebcea0a451 replace the logger and ezoic/go-kinesis dan 2015-05-15 13:21:19 -0700
05330c6a9d Merge branch 'hw-updates' into ez-recover-errors dan 2015-05-15 13:15:20 -0700
b045031df8 add default logger to remove panics caused by initialization dan 2015-05-15 12:32:45 -0700
efa20e0ff6 Merge branch 'master' into hw-logger-interface dan 2015-05-15 12:03:07 -0700
e6a0af7ffd move aws backoff to its own file, and use it for redshift basic emitter dan 2015-05-06 09:18:15 -0700
e42dd7f73d move aws backoff to its own file, and use it for redshift basic emitter dan 2015-05-06 09:14:00 -0700
2a285c52d5 add mysql checkpoint to kinesis-connectors dan 2015-05-06 08:44:14 -0700
82d10ab78d Simplify example (no Redshift cluster required) Harlow Ward 2015-05-03 16:00:27 -0700
cd71fd41bc Add Logger interface Harlow Ward 2015-05-03 15:36:07 -0700
e5af96fb54 handle more errors dan 2015-04-21 15:14:24 -0700
5cf67a3c85 Add MIT License Harlow Ward 2015-04-10 09:32:30 -0700
46e5d62884 handle more kinesis recoverable errors dan 2015-04-08 09:54:20 -0700
a028ee862f add more recoverable errors dan 2015-04-07 14:40:34 -0700
969ba18824 if there are no records available, keep going until the nextiterator returns nothing dan 2015-04-07 13:42:50 -0700
2ff748a2d4 checkpoint after filtered messages in the pipeline dan 2015-04-07 11:19:10 -0700
0dce2a6045 debug for errors that are killing the pipeline dan 2015-04-07 10:42:07 -0700
f1af849e81 handle recoverable error properly dan 2015-04-07 08:53:06 -0700
6f8ff3f11d use a prefix for files generated on s3 dan 2015-04-06 14:52:04 -0700
9ed761edc6 re-use the database connection to redshift dan 2015-04-06 14:51:46 -0700
e3efa383c1 change dependency on log4go to different folder dan 2015-04-06 11:38:20 -0700
18163c1599 change the l4g.Critical, os.Exit combo to log.Fatal, because l4g defers output so the critical logs are not being seen dan 2015-04-04 10:24:23 -0700
852cf2a7d2 more log4go additions dan 2015-04-03 23:17:19 -0700
d746c2529a more log4go additions dan 2015-04-03 23:14:08 -0700
b89c69d86b more log4go additions dan 2015-04-03 23:09:33 -0700
02a9d5d173 use log4go output dan 2015-04-03 23:05:49 -0700
5301dfe963 fix the recoverable error logic to prevent crash dan 2015-04-03 22:48:38 -0700
6502115563 add recoverability in the pipeline, especially for throughput errors dan 2015-04-03 15:38:04 -0700
797b575ad1 add recoverability in the pipeline, especially for throughput errors dan 2015-04-03 15:33:34 -0700
c5c7dd49c9 add / between bucket and filename in copy statement dan 2015-03-29 12:22:29 -0700
71556ee7f7 Remove namespace from RedisCheckpoint Harlow Ward 2014-12-21 01:08:44 -0800
da7a1dd87a Update README.md Harlow Ward 2014-12-20 19:46:38 -0800
1bce60bae6 Update example with Redshift Manifest Pipeline Harlow Ward 2014-12-20 19:45:34 -0800
b7f4cfc841 Remove custom config functions Harlow Ward 2014-12-20 19:40:25 -0800
3d290c4512 Shorten the CreateStream function name Harlow Ward 2014-12-20 18:55:13 -0800
05920cc5d3 Update development notice Harlow Ward 2014-12-18 18:26:59 -0800
236a6eefd0 Add tags to gitignore Harlow Ward 2014-12-13 13:25:36 -0800
4366c364d0 Remove unused DeleteStream function Harlow Ward 2014-12-10 22:04:28 -0800
106f0d66bb Add Redshift Manifest functionality Harlow Ward 2014-12-07 13:51:07 -0800
8e8ee5af73 Use golint to update Golang styles Harlow Ward 2014-12-10 15:38:19 -0800
b4f0539fb4 Add Redshift Manifest functionality Harlow Ward 2014-12-07 13:51:07 -0800
02a7c648a3 Update link for AWS attribution Harlow Ward 2014-11-15 18:10:19 -0800
a9a625aa79 Update example usage in README Harlow Ward 2014-11-15 17:32:41 -0800
4d00c430cf Sort exported fields alphabetically Harlow Ward 2014-11-15 17:19:08 -0800
7c631ba8c0 Add StringToString transformer Harlow Ward 2014-11-15 17:00:37 -0800
59f488e6c7 Add line-break after exported fields Harlow Ward 2014-11-15 16:25:27 -0800
5095681ad0 Group exported fields Harlow Ward 2014-11-15 16:15:18 -0800
b98adcf659 Rename Model to Record Harlow Ward 2014-11-15 15:54:54 -0800
ad57271712 Documentation for Redis Checkpoint Harlow Ward 2014-11-15 14:04:52 -0800
1b045f6107 Bump sleep time to 10s Harlow Ward 2014-11-15 13:51:55 -0800
f921eca908 Add support for JSONPaths in Redshift Load Harlow Ward 2014-11-15 13:44:46 -0800
06b40e6ed8 Base pipeline components Harlow Ward 2014-07-24 23:03:41 -0700
e8f39cdf29 Add sample app usage Harlow Ward 2014-08-03 20:18:17 -0700
4e909185d1 Add Record Processor Harlow Ward 2014-07-29 23:09:57 -0700
70c3b1bd79 Broke apart generic files into directories Harlow Ward 2014-07-29 19:15:44 -0700
b086b64d7b Add Emitters Harlow Ward 2014-07-29 18:45:58 -0700
f7d1202fe0 Use ID over Id from Golang best practices Harlow Ward 2014-07-28 16:33:42 -0700
57dc74bd48 Add checkpoint interface Harlow Ward 2014-07-27 20:31:51 -0700
0ba88d49bc Add example applications Harlow Ward 2014-07-27 19:38:53 -0700
b5625c98a1 Message buffer Harlow Ward 2014-07-24 23:03:41 -0700
0fe80b708b Initial commit Harlow Ward 2014-07-24 23:03:41 -0700