Commit graph

23 commits

Author SHA1 Message Date
Xavi
23c68b42ff
Merge pull request #33 from wwwjfy/fix-shutdown-requested
Fix shutdown requested
2018-12-11 16:28:37 -08:00
Tony Wang
2f722d9cd2
fix periodic checkpoint not triggered
when initialized, largestPair is empty and IsLessThan always return
false
2018-11-09 15:08:47 +08:00
Tony Wang
06838386db
fix review comments 2018-10-18 15:50:44 +08:00
Tony Wang
e7b75a20ac
handle shutdown requested message
Message type shutdownRequested doesn't have reason, which causes
checkpoint on termination not work.
This commit is to ask KCL daemon to checkpoint on shutdownRequested.
2018-10-14 18:29:17 +08:00
Tony Wang
c86a5da722
remove not in use statements 2018-10-14 17:55:46 +08:00
Xavi Ramirez
e5850f1464 Added Initialize method to sender 2018-08-09 16:43:30 -07:00
Rafael Garcia
945ed317c2 remove logger as parameter 2017-11-03 17:48:50 +00:00
Rafael Garcia
221743b3e2 write errors to stderr 2017-11-02 21:50:46 +00:00
Nathan Leiby
6039f69d86 (lint) go vet fixes 2017-08-10 14:28:13 -07:00
Nathan Leiby
5b8a86212d remove DeployEnv (no longer needed) 2017-08-10 14:26:27 -07:00
Xavi Ramirez
1bff01ff4f Removed unused params and properties 2017-08-07 19:20:56 +00:00
Xavi Ramirez
ba951ff0da Refactor to fix dead locks and race conditions. 2017-08-07 19:20:56 +00:00
Xavi Ramirez
b0f769bfa7 Breaking change to KCL. Created Checkpointer interface to make testing easier. 2017-07-21 01:25:02 +00:00
Xavi Ramirez
164b9923be Reworded docs to remove references to firehose. Renamed config variables to be clearer. 2017-07-21 01:25:02 +00:00
Xavi Ramirez
1b2afcafc0 Renamed methods to be more generic and to remove reference to logs 2017-07-19 00:21:31 +00:00
Xavi Ramirez
8d273d6a1e Fixed and added unit tests 2017-07-18 19:19:40 +00:00
Xavi Ramirez
4c67f39c99 Implemented new consumer interface as well as example consumer: 'batchconsumer' 2017-07-18 02:03:15 +00:00
Xavi Ramirez
458e66e321 Added shutdown method to *Checkerpointer struct 2017-05-22 23:06:56 +00:00
Xavi Ramirez
5f507ab116 Moved retry and error handling logic to Checkpointer class 2017-05-22 23:06:16 +00:00
Xavi Ramirez
17cfe98efa Users of this library can now cache the checkpointer object 2017-05-19 22:01:57 +00:00
Rafael Garcia
bea2abc691 allow for empty checkpoints on shutdown 2017-05-18 00:46:29 +00:00
Nathan Leiby
e6229ce8bb checkpointing fix
- always try checkpoint at least once (previously, a value of 0 retries
  meant it would never checkpoint)
- setup record processor using New(), so we get default checkpointing
  configuration
2017-04-05 13:51:45 -07:00
Rafael Garcia
39e5fa5860 initial commit 2017-02-08 20:23:00 +00:00