amazon-kinesis-client-go

luciano/amazon-kinesis-client-go

Fork 0

Commit graph

Select branches

Hide pull requests

INFRA-3186-circleci-2

INFRA-3363

INFRANG-5293

INFRANG-6623-update-golang-makefile

INFRANG-6876

go1.21-update

kvrds

master

remove-strings

update

update-jar-link

#1

#10

#11

#12

#13

#14

#15

#16

#17

#18

#19

#2

#20

#20

#21

#22

#23

#24

#25

#26

#27

#28

#29

#3

#30

#31

#32

#33

#34

#35

#36

#37

#38

#39

#4

#40

#41

#42

#43

#44

#45

#46

#47

#48

#49

#5

#50

#51

#52

#53

#54

#55

#56

#57

#58

#59

#6

#60

#61

#62

#63

#64

#65

#66

#67

#68

#69

#69

#7

#70

#70

#71

#72

#73

#73

#8

#9

v1.0.0

33d58bc6e0

Merge pull request #32 from Clever/SYNC-859 Nate 2018-10-11 15:40:18 -0700
dd22f519be update golang.mk Nate Brennand 2018-10-11 12:39:00 -0700
42fba675bb

Merge pull request #31 from Clever/fix-type-o Xavi 2018-10-05 15:38:04 -0700
c4712bd220

Fixed type-o: guage -> gauge Xavi 2018-10-05 15:31:48 -0700
dbc3002d02

Merge pull request #30 from Clever/INFRA-3186-circleci-2 Xavi 2018-08-17 15:44:57 -0700
31eeb34fdc [INFRA-3186] autotranslate CircleCI 1.0 -> 2.0 INFRA-3186-circleci-2 Brianna Veenstra 2018-08-17 15:21:41 -0700
92ce9be607

Merge pull request #29 from Clever/initialize-method Xavi 2018-08-09 16:48:43 -0700
e5850f1464 Added Initialize method to sender Xavi Ramirez 2018-08-09 16:43:30 -0700
df698f34aa Updated golang.mk to v0.3.8 Xavi Ramirez 2018-08-09 16:32:10 -0700
e377f46b69

Merge pull request #28 from Clever/go1.10 renato 2018-05-23 16:33:11 -0700
167c524fb2 golang upgrade Renato 2018-05-18 15:54:07 -0700
6e45fa518b

Merge pull request #27 from Clever/more-reserve-fields Xavi 2018-05-10 17:09:07 -0700
8f2ad09efa Added timestamp, hostname, and rawlog to list of reserved fields Xavi Ramirez 2018-05-10 23:56:32 +0000
74634a6bf0 Added decoder_msg_type field to logs parsed by syslog Xavi Ramirez 2018-05-10 23:56:14 +0000
3ded2fcd2d

Merge pull request #26 from Clever/INFRA-2824 Rafael 2018-03-13 09:55:55 -0700
ad2ef687bb fix lambda -> rsyslog message conversion to always have a task ID Rafael Garcia 2018-03-13 16:48:41 +0000
4858074bb7

Merge pull request #25 from Clever/IL-200-remove-self-reference Nathan Leiby 2018-02-16 14:42:40 -0800
267b28a032 Remove self-references in Gopkg.toml Nathan Leiby 2018-02-16 14:24:35 -0800
44a89a1685

Merge pull request #24 from Clever/IL-200-remove-self-reference Nathan Leiby 2018-02-16 14:17:23 -0800
b0196cf7b0 Remove self-references in Gopkg.toml Nathan Leiby 2018-02-16 13:14:07 -0800
bfe2ac0f6d

Merge pull request #23 from Clever/INFRA-2764 Rafael 2018-01-25 15:15:10 -0800
c255bf87f3 add test for default case Rafael Garcia 2018-01-25 15:13:11 +0000
10750e802b handle logs coming in from lambda functions Rafael Garcia 2018-01-25 01:23:03 +0000
7d863db172

Merge pull request #22 from Clever/SYNC-114-go-1.9-upgrade Nate 2017-11-09 08:48:35 -0800
2a4e6fcc71 upgrade to 1.9 and convert to dep Nate Brennand 2017-11-08 09:46:29 -0800
ebf2e2dc98

Merge pull request #21 from Clever/only-send-failed-log-lines-to-file Rafael 2017-11-03 11:05:31 -0700
7b18d1bab4 write failed log message to file Rafael Garcia 2017-11-03 18:03:39 +0000
945ed317c2 remove logger as parameter Rafael Garcia 2017-11-03 17:48:50 +0000
221743b3e2 write errors to stderr Rafael Garcia 2017-11-02 21:49:13 +0000
94aacdf833 Merge pull request #19 from Clever/rm-params-from-decoder Xavi 2017-09-26 14:53:56 -0700
2b763d7b15 remove some strings remove-strings Rafael Garcia 2017-09-25 16:22:55 +0000
2ecbc081cd Removed stringifyNested, renameESReservedFields, and minimumTimestamp params from decoder. minimumTimestamp isn't needed anymore. stringifyNested and renameESReservedFields are very specific to the elasticsearch consumer and will be moved to the elasticsearch consumer. Xavi Ramirez 2017-09-21 19:51:48 +0000
8d871591de Merge pull request #18 from Clever/fix-shutdown Xavi 2017-09-21 10:58:25 -0700
81fbb957c4 Merge pull request #17 from Clever/INFRA-2521-update-log-stream-parsing Nathan Leiby 2017-09-20 14:30:23 -0700
b07ad4c1c2 Cleaned up shutdown code Xavi Ramirez 2017-09-20 21:28:43 +0000
efa90d4481 splitter: update log stream parsing Nathan Leiby 2017-09-20 14:18:35 -0700
7f2afe9d8f Send nil showdown signal immediately Xavi Ramirez 2017-09-20 04:58:40 +0000
32d4d33f00 Merge pull request #16 from Clever/always-log-counter-stats mohit 2017-09-13 12:24:01 -0700
22495acfe4 derpfix: s/black/blank mohit 2017-09-13 19:22:58 +0000
5b91cd80da DefaultCounters to log 0 for counter stats mohit 2017-09-12 04:33:05 +0000
b3d971e3ba Merge pull request #15 from Clever/typo-fix mohit 2017-09-11 13:41:02 -0700
8b44537934 fix typo in error log mohit 2017-09-11 20:22:34 +0000
a559c33272 Merge pull request #14 from Clever/increase-default-read-rate Xavi 2017-08-22 11:43:05 -0700
f581bb4f6e Increased default read rate. Xavi Ramirez 2017-08-22 18:37:47 +0000
7f39898b70 Merge pull request #13 from Clever/fix-checkpoint-with-archive-consumer Xavi 2017-08-20 16:47:49 -0700
09ea3282af Standardized error reporting Xavi Ramirez 2017-08-20 23:42:27 +0000
8f7cbf9952 Fixed case checkpoints would only occur on shutdown. The archive consumer fell victim of this bug. Xavi Ramirez 2017-08-20 23:41:28 +0000
59a1fb7c1d Merge pull request #12 from Clever/fix-readline-edge-case Xavi 2017-08-20 11:35:12 -0700
22915133fe Fixed edge case where the beginnings of messages would sometimes get chopped off as a result of creating a new buffered reader each time we'd read a line. Xavi Ramirez 2017-08-20 03:26:32 +0000
d63effaddd Merge pull request #11 from Clever/properly-handle-shutdowns Xavi 2017-08-18 11:50:28 -0700
b385278e04 More properly handle errors from KCL Xavi Ramirez 2017-08-18 01:42:36 +0000
0a3335173a Merge pull request #10 from Clever/INFRA-2263-rename-type Nathan Leiby 2017-08-17 16:25:01 -0700
d1473f894a decode: s/type/decoder_msg_type Nathan Leiby 2017-08-17 14:36:53 -0700
4b4af77ba2 Merge pull request #9 from Clever/INFRA-2405-new-consumer-interface Xavi 2017-08-16 14:54:27 -0700
e2f55b6d98 Updated syslogparser library and added unit tests Xavi Ramirez 2017-08-16 20:58:30 +0000
035cc7fd83 Merge pull request #8 from Clever/INFRA-2263-kvroutes-bugfix Nathan Leiby 2017-08-15 12:11:49 -0700
1bebeb5aa5 decode: json decodes dimensions as array of interface Nathan Leiby 2017-08-15 11:46:59 -0700
375e4d1147 Merge pull request #7 from Clever/splitter-dont-filter-by-env Nathan Leiby 2017-08-10 14:34:16 -0700
6039f69d86 (lint) go vet fixes Nathan Leiby 2017-08-10 14:28:13 -0700
5b8a86212d remove DeployEnv (no longer needed) Nathan Leiby 2017-08-10 14:26:27 -0700
0c02e93821 splitter: don't filter by env Nathan Leiby 2017-08-10 14:22:58 -0700
16814bd597 Merge pull request #6 from Clever/INFRA-2405-new-consumer-interface Xavi 2017-08-10 13:56:04 -0700
55aeecddd7 Renamed IsEmpty to IsNil on SequencePair Xavi Ramirez 2017-08-10 20:16:41 +0000
45fad863d0 Made config object that's specific to BatcherManager Xavi Ramirez 2017-08-10 20:11:24 +0000
3a04dad4bf Send single value instead of full config object to CheckpointManager Xavi Ramirez 2017-08-10 20:01:07 +0000
6102f9c752 Added comment to why a channel is taking a channel. Xavi Ramirez 2017-08-10 19:56:17 +0000
68a16cfe6a Added an external go routine to ensure stale batches get flushed Xavi Ramirez 2017-08-10 19:47:08 +0000
27cce44140 Made constructors of private structs private Xavi Ramirez 2017-08-10 19:21:46 +0000
1632c81fc7 Use errors.New instead of fmt.Errorf Xavi Ramirez 2017-08-10 19:20:55 +0000
dd9da85055 Fixed type-o Xavi Ramirez 2017-08-10 19:15:53 +0000
b7743c9ea7 Added a more coherent shutdown pathway Xavi Ramirez 2017-08-08 19:09:31 +0000
1be812a887 Added less hacky way of downloading jars Xavi Ramirez 2017-08-07 19:22:10 +0000
de04a27799 Return NonKayveeError if log contians invalid or empty json Xavi Ramirez 2017-08-07 05:58:15 +0000
eb230b94f7 Added stats to base kinesis client Xavi Ramirez 2017-08-07 03:05:41 +0000
5c373fa7d8 Fixed unit tests Xavi Ramirez 2017-08-07 00:54:29 +0000
4809cdb4e6 Another refactor to simply and likely speed up code. New code allows checkpoint and readline messages to be interleaved. Xavi Ramirez 2017-08-06 10:58:46 +0000
1bff01ff4f Removed unused params and properties Xavi Ramirez 2017-08-06 05:44:51 +0000
734b46274f Better coordinated checkpoints and readlines. Checkpoint function now returns all errors. Xavi Ramirez 2017-08-06 05:02:55 +0000
b19c9297d8 Adjusted some locks Xavi Ramirez 2017-08-06 03:46:58 +0000
c814742afa Another refactor Xavi Ramirez 2017-08-06 02:59:28 +0000
c5f75d6554 Fixed another race-condition. Ensure line is completely processed before allowing a checkpoint. Xavi Ramirez 2017-08-06 01:52:11 +0000
6a30e0eb8a Huge refactor. Batchers no longer run in their own go-routines, which allowed us to a lot of concurrency and simplify model. Xavi Ramirez 2017-08-04 09:36:42 +0000
ba951ff0da Refactor to fix dead locks and race conditions. Xavi Ramirez 2017-08-03 21:22:52 +0000
29f68f77eb Removed redundant retry logic Xavi Ramirez 2017-08-03 18:35:19 +0000
c6fe4cef37 Renamed variable from seq to pair Xavi Ramirez 2017-08-03 18:33:43 +0000
6e9457cbcf Better propogated shutdown signal Xavi Ramirez 2017-08-03 07:55:57 +0000
873544ae78 Run benchmarks when building Xavi Ramirez 2017-08-02 19:54:06 +0000
266d7d620d Fixed bug in decoder package Xavi Ramirez 2017-08-02 19:47:14 +0000
7a7716e824 Increased default read rate limit Xavi Ramirez 2017-08-02 19:46:13 +0000
04042290f5 Moved SequencePair to kcl package Xavi Ramirez 2017-08-02 19:45:23 +0000
4c6d8453ef Merge pull request #5 from Clever/INFRA-2405-new-consumer-interface Xavi 2017-07-24 13:12:43 -0700
212ec45d88 Added writter unit tests and fixed a slew of concurrency bugs Xavi Ramirez 2017-07-21 01:35:54 +0000
939fc5406f Batcher now returns error if bad config is provided Xavi Ramirez 2017-07-21 01:33:59 +0000
0cb14948a3 KCL more aggressively logs errors Xavi Ramirez 2017-07-21 01:27:17 +0000
ae37b57e61 Added IsEmpty to SequencePair Xavi Ramirez 2017-07-21 01:23:25 +0000
b0f769bfa7 Breaking change to KCL. Created Checkpointer interface to make testing easier. Xavi Ramirez 2017-07-21 01:04:34 +0000
164b9923be Reworded docs to remove references to firehose. Renamed config variables to be clearer. Xavi Ramirez 2017-07-19 19:06:27 +0000
e8f40e607a Added unit test for SequencePair IsLessThan function Xavi Ramirez 2017-07-19 19:00:28 +0000
1b2afcafc0 Renamed methods to be more generic and to remove reference to logs Xavi Ramirez 2017-07-19 00:21:31 +0000
f116c752f5 Added unit test to ensure correct error is returned Xavi Ramirez 2017-07-19 00:20:20 +0000