Commit graph

  • ee3a6c24e6 Support Prefetching of Records Sahil Palvia 2017-10-17 13:05:43 -0700
  • 7234599e1a Adding initialized boolean to record worker state Nariman Mirzaei 2017-10-17 13:29:48 -0400
  • efef97b802 Updating branch to master (#244) Sahil Palvia 2017-10-17 10:39:57 -0700
  • 9f579fcd0b Merge remote-tracking branch 'upstream/prefetch' into prefetch Sahil Palvia 2017-10-17 10:34:52 -0700
  • f211be88d3 Merge 816b55ffb0 into 9720b1b249 Sahil Palvia 2017-10-17 16:52:51 +0000
  • 816b55ffb0 Merge branch 'master' into prefetch Sahil Palvia 2017-10-17 09:52:48 -0700
  • c978d3c223 Merge remote-tracking branch 'upstream/master' into spurious-update-fix Sahil Palvia 2017-10-16 16:48:30 -0700
  • 622f3c74f9 Merging master to branch (#242) Sahil Palvia 2017-10-16 14:34:25 -0700
  • a78d039e31 Merging changes from master. Sahil Palvia 2017-10-16 14:25:38 -0700
  • 029da69926 Exposes the millisBehindCurrent metric to V1 IRecordProcessor implementations. Juan Botiva 2017-10-13 12:09:46 -0500
  • 2afb0bd00b allow unexpected child shards to be ignored Mike Watters 2017-09-13 14:17:32 -0600
  • 3b89b56df4 Handle custom metric scope (#235) BtXin 2017-10-09 16:32:52 -0700
  • 94930bfacb Addressed comment Wei 2017-10-09 15:50:09 -0700
  • 8055b6379a Addressed comments Wei 2017-10-09 15:17:33 -0700
  • eff10a8253 Addressed Comments Wei 2017-10-06 14:39:18 -0700
  • be34a50f59 Addressed comments Wei 2017-10-06 13:34:57 -0700
  • a2fd07c7b0 Added set metrics to InitializeTask Wei 2017-10-06 13:08:04 -0700
  • e0c4ad2680 Get rid of sysout Wei 2017-10-06 11:36:16 -0700
  • dddcd64bd7 Passed the operation by caller Wei 2017-10-06 10:51:10 -0700
  • 81c13d2a35 Merge remote-tracking branch 'upstream/prefetch' into prefetch Wei 2017-10-05 18:04:37 -0700
  • 4d35210938 Merge pull request #239 from sahilpalvia/prefetch Justin Pfifer 2017-10-05 11:46:37 -0700
  • 0cf34461a7 Updated the documentation. Changed the variable name from maxSize to maxPendingProcessRecordsInput. Sahil Palvia 2017-10-04 12:00:36 -0700
  • 5717bab9b6 Addressing comments from PR. Catching expected exceptions, changing log message for unexcepted exception. Changing threadname. Sahil Palvia 2017-10-04 11:14:55 -0700
  • 80216b9a59 Added shardId to thread name. Added documentation to the methods. Sahil Palvia 2017-10-03 22:57:33 -0700
  • ffdfe82b79 Fixing issue with prefetch thread, where it kept on dying and falling behind. Catching throwable instead of error. Assigning thread name to the prefetch thread. Sahil Palvia 2017-10-03 15:29:38 -0700
  • 192aef6619 Addressed comments Wei 2017-10-03 13:39:29 -0700
  • 2fc4267b83 Merged upstream Wei 2017-10-03 13:17:58 -0700
  • 585fa63508 Merge pull request #234 from sahilpalvia/prefetch Justin Pfifer 2017-10-03 13:05:48 -0700
  • eaac59bff3 Shutdown that throws an exception will be retried. Moore-Oliva 2017-10-02 07:21:39 -0700
  • 6ab1503fe3 emit metric Wei 2017-09-29 14:49:11 -0700
  • abed367da0 Handle Custom Metric Scope Wei 2017-09-28 14:47:31 -0700
  • cd1f944add Making sure to call shutdown on strategy once the cache is interrupted. Sahil Palvia 2017-09-27 21:01:29 -0700
  • 7b76d1d56e Moving the idleMillisBetweenCalls to the cache. Fixed unit and integ tests. Calling StrategyShutdown from within the cache thread. Sahil Palvia 2017-09-27 15:50:23 -0700
  • 50ed982255 Merge remote-tracking branch 'upstream/prefetch' into prefetch Wei 2017-09-27 10:43:09 -0700
  • 060913d49c Merge Release 1.8.5 (#233) Justin Pfifer 2017-09-27 10:31:04 -0700
  • 601108c719 Fix unit test for behavior change of TerminalResult Pfifer, Justin 2017-09-27 10:09:20 -0700
  • cc2e92001a Change the TerminalResult to return an empty GetRecordsResult Pfifer, Justin 2017-09-27 09:58:33 -0700
  • f8425d9283 Merge branch 'master' into prefetch Pfifer, Justin 2017-09-27 08:37:08 -0700
  • c96c8afeac Merge pull request #229 from sahilpalvia/prefetch Justin Pfifer 2017-09-27 08:03:03 -0700
  • e437fa8436 Adding Integ testing for prefetch. Sahil Palvia 2017-09-26 16:24:30 -0700
  • d3b81cb463 Changing default cache size to 8 megs Sahil Palvia 2017-09-26 14:44:35 -0700
  • f96062efe3 Modifying the sane defaults to have 3 advanced calls, 15 megs cache size and 30000 records. Sahil Palvia 2017-09-26 14:41:32 -0700
  • 34dd6f416a Adding idleMillisBetweenCalls config, to slow down the aggressive get calls while prefetching. Sahil Palvia 2017-09-26 14:39:13 -0700
  • 9720b1b249 Release 1.8.5 of the Amazon Kinesis Client for Java (#232) v1.8.5 Justin Pfifer 2017-09-26 14:31:59 -0700
  • 821bcfed3f Updated release notes some more Pfifer, Justin 2017-09-26 14:24:12 -0700
  • 6429d26022 Rewrote the release notes a bit Pfifer, Justin 2017-09-26 14:13:09 -0700
  • a86da56069 Release 1.8.5 of the Amazon Kinesis Client for Java Pfifer, Justin 2017-09-26 13:57:02 -0700
  • 6b25de917b Merge pull request #230 from pfifer/data-fetcher-accept Justin Pfifer 2017-09-26 13:47:57 -0700
  • 4b20556f37 Only advance the shard iterator when we accept a result to return Pfifer, Justin 2017-09-26 12:39:53 -0700
  • b5d5618a94 Updating the config to set the cache type. Sahil Palvia 2017-09-25 11:56:02 -0700
  • 1deae5cd07 Updating the artifact version to the next SNAPSHOT Sahil Palvia 2017-09-25 11:31:40 -0700
  • 86c9f3d5b9 Merge remote-tracking branch 'upstream/master' into prefetch Sahil Palvia 2017-09-25 11:29:38 -0700
  • 6321dcafd7 Merging changes into the branch and updating the tests. Sahil Palvia 2017-09-25 11:25:31 -0700
  • 23c46267cf Merge pull request #228 from pfifer/release-1.8.4 v1.8.4 Justin Pfifer 2017-09-22 16:32:19 -0700
  • c1df703d67 Release 1.8.4 of the Amazon Kinesis Client for Java Pfifer, Justin 2017-09-22 16:23:20 -0700
  • e8039b31ae Merge pull request #227 from pfifer/cancel-fix Justin Pfifer 2017-09-22 16:18:52 -0700
  • cdca7efcf2 Merge remote-tracking branch 'upstream/prefetch' into prefetch Wei 2017-09-22 15:54:01 -0700
  • b1c27bd386 Recreate the completion service instead of reusing them. Pfifer, Justin 2017-09-22 14:45:54 -0700
  • 49b761c5e2 Merging changes (#225) BtXin 2017-09-22 14:20:08 -0700
  • f841ea2cd9 merged chagnes Wei 2017-09-22 14:13:22 -0700
  • 9249f28092 Merging master into prefetch (#223) Sahil Palvia 2017-09-22 13:32:49 -0700
  • 8af4db39c6 Merge remote-tracking branch 'upstream/master' into prefetch Sahil Palvia 2017-09-22 13:29:20 -0700
  • 5558449043 Release 1.8.3 of the Amazon Kinesis Client for Java (#224) v1.8.3 Justin Pfifer 2017-09-22 12:25:52 -0700
  • 7cbecbafec Update Version to 1.8.3 Pfifer, Justin 2017-09-22 12:21:50 -0700
  • 9123fb7aec Release 1.8.3 of the Amazon Kinesis Client for Java Pfifer, Justin 2017-09-22 12:18:00 -0700
  • 38900c51ad Updating branch to be upto date with the master Sahil Palvia 2017-09-22 11:51:21 -0700
  • 4dd9423170 Calling shutdown on the RetrievalStrategy (#222) Sahil Palvia 2017-09-22 11:43:34 -0700
  • 9b804bb91f Updating to next snapshot version and the urls in the release notes. Sahil Palvia 2017-09-22 11:10:06 -0700
  • 312dd94233 Calling shutdown on the RetrievalStrategy, fixing test cases and updating licenses. Sahil Palvia 2017-09-22 10:59:21 -0700
  • 30f99fc34c Integrated the changes Wei 2017-09-21 16:09:26 -0700
  • 211b0d9daa Merge remote-tracking branch 'upstream/prefetch' into prefetch Wei 2017-09-21 14:29:03 -0700
  • e3be69082d Merge db8b8d5abc into fac15f80f8 BtXin 2017-09-21 21:05:38 +0000
  • fac15f80f8 Merge pull request #221 from sahilpalvia/prefetch Justin Pfifer 2017-09-21 13:30:41 -0700
  • 7d24bc54f8 Addressing comments and fixing the failing test. Sahil Palvia 2017-09-21 13:23:22 -0700
  • 48699f4812 Updating the test Sahil Palvia 2017-09-21 11:52:00 -0700
  • ce8dd88846 Added a test case for BlockingGetRecordsCache. Updated the comments on BlockingGetRecords cache. Synchronized the added and removed methods instead of using volatile variables. Sahil Palvia 2017-09-21 11:50:53 -0700
  • db8b8d5abc Merge branch 'prefetch' into prefetch BtXin 2017-09-21 11:32:31 -0700
  • 3404ddfcf4 Adding licenses to files, addressing comments. Throwing IllegalStateException if threadpool is not started. Exposing the start method in the GetRecordsCache interface. Adding new test case for the new behavior. Sahil Palvia 2017-09-21 11:27:49 -0700
  • ba0bdc5fe3 Addressed comments Wei 2017-09-21 11:26:10 -0700
  • aaea26aefc Resolved conflicts Wei 2017-09-21 11:17:11 -0700
  • ed1f9d4dca Merge remote-tracking branch 'upstream/prefetch' into prefetch Sahil Palvia 2017-09-21 11:10:39 -0700
  • 5c57dfe0db added tests and fixed broken tests Wei 2017-09-21 11:02:14 -0700
  • f9701f9651 Merge Release 1.8.2 (#220) Justin Pfifer 2017-09-21 10:23:38 -0700
  • 92c0b43b2a Merge remote-tracking branch 'upstream/prefetch' into prefetch Sahil Palvia 2017-09-20 17:29:19 -0700
  • a3cbfaff31 Changed KinesisDataFetecher.getRecords not to return null back. Added test for KinesisDataFetcher.getRecords. Adding test classes for GetRecordsCache implemetations. Removing the DataFetchingStrategy from the PrefetchGetRecordsCache. Sahil Palvia 2017-09-20 17:28:05 -0700
  • 248605ed91 added fatory methods Wei 2017-09-20 15:34:36 -0700
  • 024d86da76 fixed tests Wei 2017-09-20 14:25:23 -0700
  • 1c07b45166 integrated prefetch with shardconsumer Wei 2017-09-20 10:51:08 -0700
  • 9a82b6bd05 Release 1.8.2 of the Amazon Kinesis Client for Java (#218) v1.8.2 Justin Pfifer 2017-09-20 08:52:36 -0700
  • 51d05516e7 Release 1.8.2 of the Amazon Kinesis Client for Java Pfifer, Justin 2017-09-20 08:44:32 -0700
  • 65effc8fd9 Update to the newest version of AWS Java SDK Pfifer, Justin 2017-09-20 08:43:22 -0700
  • 105b89278d Update release date to the current date. Pfifer, Justin 2017-09-20 08:20:01 -0700
  • c935fbb3a9 Update copyright statement for all files changed, or added in 2017 Pfifer, Justin 2017-09-20 08:17:31 -0700
  • b59caf6c4d Completed release notes for 1.8.2 Pfifer, Justin 2017-09-20 07:54:49 -0700
  • 8f79833463 Merge branch 'master' into release-1.8.2 Pfifer, Justin 2017-09-20 07:32:10 -0700
  • 7270477ff9 More release notes Pfifer, Justin 2017-09-20 07:31:29 -0700
  • 40aaece7c3 Merge pull request #216 from sahilpalvia/prefetch Justin Pfifer 2017-09-19 16:09:13 -0700
  • a8edb70552 Addressing PR comments. Sahil Palvia 2017-09-19 14:48:43 -0700
  • 5172f4f936 Adding null condition to getRecords in the KinesisDataFetcher class. Changing the abstract class back to an interface. Sahil Palvia 2017-09-19 14:25:25 -0700
  • 14ebfb8f0f Adding Blocking cache and spilting into blocking and prefetching cache. Changing the GetRecordsCache interface to abstract class. Sahil Palvia 2017-09-19 13:57:32 -0700