Commit graph

  • b323e7c487 Introducing dedicated shard syncer for each of the streamconfig Ashwin Giridharan 2020-06-07 20:35:25 -0700
  • 700c7a563a Adding unit test case Ashwin Giridharan 2020-06-07 21:17:24 -0700
  • 5089e5015e DDB is considered healthy in UPDATING status Cai41 2020-06-05 15:45:22 -0700
  • b5d0301b31 Adding stream information to Fanout Consumer Registration logs Ashwin Giridharan 2020-06-03 01:08:13 -0700
  • f69398a2b2 Adding dedicated consumerArn support for streams in multistreaming mode Ashwin Giridharan 2020-06-03 00:48:11 -0700
  • 113029e33c
    Update lease sync algorithm to create leases for no more than one level of the shard hierarchy (#41) Micah Jaffe 2020-05-31 10:28:05 -0700
  • f2ba3bcd2f Changes for partial lease table hole detection, missing hash range detection and recovery Ashwin Giridharan 2020-05-29 09:10:14 -0700
  • be1e3cd112
    Update to 2.2.12-SHAPSHOT (#724) Micah Jaffe 2020-05-28 13:47:02 -0700
  • ab1bed30d2 Update to 2.2.12-SHAPSHOT Micah Jaffe 2020-05-28 13:46:19 -0700
  • 9db3a11ffe
    Prepare for 2.2.11 release (#723) v2.2.11 Micah Jaffe 2020-05-27 17:54:18 -0700
  • 1d5099cef4
    Update AWS SDK to version 2.13.25 (#722) Micah Jaffe 2020-05-27 17:51:43 -0700
  • 16ff164914 Prepare for 2.2.11 release Micah Jaffe 2020-05-27 16:42:58 -0700
  • 8ae1e5aacb Update AWS SDK to version 2.13.25 Micah Jaffe 2020-05-27 16:35:13 -0700
  • 67d2b082fd Fixing retry logic Ashwin Giridharan 2020-05-26 11:10:10 -0700
  • 08ca1b61bc Changing test case name Ashwin Giridharan 2020-05-25 13:37:10 -0700
  • 72a6d5e084 Adding more unit test cases and fixing an edge case Ashwin Giridharan 2020-05-25 13:25:43 -0700
  • fc4781e347 Addressed review comments Ashwin Giridharan 2020-05-21 00:57:24 -0700
  • 6b474b7390
    Add configurable max initialization attempts (#39) Micah Jaffe 2020-05-15 14:02:44 -0700
  • 2a9205d03f
    Merge 28d4416953 into 4f927da81c thuandb 2020-05-15 14:20:54 +0100
  • 7324d46294
    Merge pull request #718 from keerthy411/master ychunxue 2020-05-14 13:53:53 -0700
  • 4f927da81c
    Merge pull request #719 from keerthy411/upsv1 ychunxue 2020-05-14 13:49:12 -0700
  • dd72cf96e5 protobuf upgrade Keerthy Muralidharan 2020-05-14 13:45:54 -0700
  • b195cfe4cf reverting version Keerthy Muralidharan 2020-05-14 13:26:15 -0700
  • fdad20aff4
    Add leader-elected periodic shard sync manager as auditor to ShardEndShardSync strategy (#35) Micah Jaffe 2020-05-14 09:04:44 -0700
  • ea8cf661ae proto-buf upgrade Keerthy Muralidharan 2020-05-13 15:42:51 -0700
  • 45e76b0fd5
    Add leader-elected shard sync on application bootstrap (#28) Micah Jaffe 2020-05-07 17:08:53 -0700
  • 52f1be5c67
    Merge pull request #32 from ychunxue/ltr_1_updateLeaseFix ychunxue 2020-05-07 14:58:24 -0700
  • 02ea8cd70f Added TODO for childshards update fix Ashwin Giridharan 2020-05-07 01:36:51 -0700
  • 9115f2000b Logic to auto fill the missing hashranges and lease recovery. Added more unit test cases Ashwin Giridharan 2020-05-07 01:28:56 -0700
  • 80cdf0df6f Update Parent lease fix Chunxue Yang 2020-05-06 21:12:50 -0700
  • 9e97edd273 Reusing code while determining leaskekey Ashwin Giridharan 2020-05-06 11:06:23 -0700
  • a6922d9d7e Hash range hole confidence check Ashwin Giridharan 2020-05-02 03:22:59 -0700
  • eb00229602 Hole detection logic Ashwin Giridharan 2020-05-01 01:28:48 -0700
  • 5cd40e4718 Lease Recovery and Blockoing parent bug fix Ashwin Giridharan 2020-04-30 14:03:39 -0700
  • eb7a60ec62 Fixing a metrics bug Ashwin Giridharan 2020-04-29 15:56:15 -0700
  • d28d26c635 Adding java docs Ashwin Giridharan 2020-05-06 10:41:12 -0700
  • 14915fc01c Throttle error messages when Kinesis provisioned throughput exceeded Kirill Kozlov 2020-05-06 11:56:19 +0200
  • e86b1d1f01 Adding shouldCleanupLeasesForDeletedStreams option to FormerStreamsLeasesDeletionStrategy and introducing OnlyDeletedStreamsLeasesCleanupStrategy. Ashwin Giridharan 2020-05-05 17:34:37 -0700
  • 8e4b8d789b
    Merge pull request #26 from ychunxue/ltr_1_lease_parameter ychunxue 2020-05-05 17:36:24 -0700
  • 760c52d7bc getLeaseKey Chunxue Yang 2020-05-05 17:31:08 -0700
  • 1036006bb4 leaseKey parameter fix and logging change for shutdownTask Chunxue Yang 2020-05-05 15:44:45 -0700
  • c479984fb4 Hashrange persistence changes Ashwin Giridharan 2020-05-05 12:58:16 -0700
  • 550d7af5b1
    Add lease sync strategy for empty lease table (#24) Micah Jaffe 2020-05-04 17:06:57 -0700
  • 43217fedc6 Also consider TableStatus.UPDATING status Cai41 2020-04-22 18:11:51 -0700
  • a73701ff87 Lease I/F changes and drop lease fix Ashwin Giridharan 2020-04-30 17:20:01 -0700
  • c7cd2f1e75 Migrate KinesisProxy to ListShardsWithFilter for empty lease table case Micah Jaffe 2020-04-30 11:07:29 -0700
  • 4ce0591e79 Adding hashkeyRange back Ashwin Giridharan 2020-04-29 15:59:53 -0700
  • 4a323b8f1c Fixing a metrics bug Ashwin Giridharan 2020-04-29 15:56:15 -0700
  • bdec3bd66d Fixing comparison bug and addressing review comments Ashwin Giridharan 2020-04-29 15:23:14 -0700
  • f69e9cf3ba
    Add getResponse override for ShardDetector (#19) (#21) Renju Radhakrishnan 2020-04-28 16:32:29 -0700
  • 07c9529c14 doc comments Ashwin Giridharan 2020-04-28 15:58:50 -0700
  • 4d058ecf51 Persisting hashrange in lease table Ashwin Giridharan 2020-04-28 15:53:22 -0700
  • 038524e0b1 Introducing lease deletion strategy for multistreaming Ashwin Giridharan 2020-04-24 00:01:19 -0700
  • 167ecfb08c Add licensing information Ashwin Giridharan 2020-04-22 00:15:36 -0700
  • 61e500d4fd Adding logging for streanms to be deleted Ashwin Giridharan 2020-04-21 22:17:51 -0700
  • 596e3ee797 Exposing interface method to set the wait time for old stream deletion. Adding license details to new classes Ashwin Giridharan 2020-04-21 21:31:13 -0700
  • 45387bfd74 Adding logic to garbage collect active streams from stale streams list. Ashwin Giridharan 2020-04-17 17:11:04 -0700
  • f51657f6f7 Changes for adding stream as dimension in multistream mode. Changes for deferred cleanup of stale stream leases to free up record processors. Ashwin Giridharan 2020-04-17 10:37:19 -0700
  • b3980da9cd Also consider TableStatus.UPDATING status Cai41 2020-04-22 18:11:51 -0700
  • 3de44dc4eb
    Merge pull request #16 from ychunxue/ltr_1_merge ychunxue 2020-04-22 15:02:46 -0700
  • cde09ca191 Address comments Chunxue Yang 2020-04-22 15:00:10 -0700
  • 93dac82bd6 Fixing unit tests Chunxue Yang 2020-04-22 12:35:23 -0700
  • 9b14b93941 Merging to ltr_1 Chunxue Yang 2020-04-22 11:14:32 -0700
  • 054cd88284 ShardEnd sync persistence change Chunxue Yang 2020-04-15 17:57:38 -0700
  • 15f17700d9
    Merge pull request #15 from jushkem/QueryMultiStream ashwing 2020-04-22 00:42:33 -0700
  • a5f251014e
    Merge pull request #14 from Renjuju/cherry-pick-interface-changes ashwing 2020-04-22 00:41:20 -0700
  • 2973401248 reverting pom changes Joshua Kim 2020-04-21 14:31:07 -0400
  • 9f639b2342 Adding query support for multistream Joshua Kim 2020-04-15 05:24:18 -0400
  • 78a877dc0b
    Merge pull request #11 from ashwing/TwoPhaseCommit Joshua Kim 2020-04-20 16:08:44 -0400
  • a97a617f35 Add DataFetcher and ShardDetector interface changes (#9) Renju Radhakrishnan 2020-04-17 13:20:41 -0700
  • 22fa12abfa Java docs Joshua Kim 2020-04-15 19:29:17 -0400
  • 4782e43c3a PR comments Joshua Kim 2020-04-15 19:26:53 -0400
  • d31758727c Fixing bug Joshua Kim 2020-04-14 04:37:11 -0400
  • 64469f4199 PR feedback Joshua Kim 2020-04-10 05:55:45 -0400
  • 80df8ce439 Cleaning up unused imports Joshua Kim 2020-04-07 06:22:22 -0400
  • a61890ab40 Adding integration test for serializing application info Joshua Kim 2020-04-07 06:16:04 -0400
  • ddaf714a09 Adding application state to lease copy Joshua Kim 2020-04-07 06:15:47 -0400
  • b335246a30 Adding serializer for application state to lease info Joshua Kim 2020-04-07 06:15:18 -0400
  • ae005ce0f8 Adding unit tests Joshua Kim 2020-04-07 04:03:38 -0400
  • 1794874e33 Clean up checkpoint state after successful checkpoint Joshua Kim 2020-04-07 03:45:03 -0400
  • 5355b4b7c5 Moving new parameters to end Joshua Kim 2020-04-07 03:28:58 -0400
  • 26c737cc2a Adding in memory implememtation for pending checkpoint state Joshua Kim 2020-04-07 03:22:56 -0400
  • af0cd5463d Adding arbitrary application state checkpointing for two phase commit. Joshua Kim 2020-03-30 02:35:13 -0400
  • 8873b1346f
    Adjusting default initial window size to 512 KB. (#706) Joshua Kim 2020-04-15 00:38:07 -0400
  • 6f658be557 Adjusting default initial window size to 512 KB. jushkem 2020-03-24 06:55:25 -0400
  • e045b308c7
    Updating version to 2.2.11-SNAPSHOT (#709) Joshua Kim 2020-04-09 20:04:47 -0400
  • b1a3d215d0
    Merge pull request #10 from ychunxue/ltr_base_ShardEnd ychunxue 2020-04-09 10:50:44 -0700
  • 734d4918d0 Addressing minor comments Chunxue Yang 2020-04-09 10:48:19 -0700
  • 6c73be5d92
    Merge pull request #5 from ashwing/ValidateHashRange Joshua Kim 2020-04-09 03:45:38 -0400
  • 0715903456 Addressing comments Chunxue Yang 2020-04-08 16:47:37 -0700
  • c7fe06dab5 PR comments Joshua Kim 2020-04-08 00:31:55 -0400
  • 01db7753f0 Making test cases actually go through validation steps. Joshua Kim 2020-04-08 00:31:49 -0400
  • ea093a4466 Adding stream id to exception Joshua Kim 2020-03-30 19:30:11 -0400
  • 5351c9ddab Adding hash range validation for list shards with filter. Joshua Kim 2020-03-25 15:49:57 -0400
  • cdaef8e630 Updating version to 2.2.11-SNAPSHOT jushkem 2020-04-05 23:05:11 -0400
  • 4b3c717c53 Quick fix Chunxue Yang 2020-04-05 13:36:25 -0700
  • 2f9ce0ce4f ShardEnd Shard Sync Chunxue Yang 2020-03-05 16:44:37 -0800
  • 33cd0f52b2 Merging multstreming dynamic stream syncer, logging changes and periodic lease sync modifications Ashwin Giridharan 2020-04-02 17:07:15 -0700
  • 771bc914eb Added unit test cases and addressed review comments Ashwin Giridharan 2020-03-31 15:40:43 -0700
  • 297b09481c
    Merge pull request #2 from ashwing/EmptyLeaseTable Joshua Kim 2020-03-30 18:48:56 -0400