Commit graph

450 commits

Author SHA1 Message Date
Joshua Kim
01db7753f0 Making test cases actually go through validation steps. 2020-04-08 00:31:49 -04:00
Joshua Kim
ea093a4466 Adding stream id to exception 2020-04-07 21:30:51 -04:00
Joshua Kim
5351c9ddab Adding hash range validation for list shards with filter. 2020-04-07 21:30:51 -04:00
Chunxue Yang
4b3c717c53 Quick fix 2020-04-05 13:36:25 -07:00
Chunxue Yang
2f9ce0ce4f ShardEnd Shard Sync 2020-04-04 16:55:17 -07:00
Ashwin Giridharan
33cd0f52b2 Merging multstreming dynamic stream syncer, logging changes and periodic lease sync modifications 2020-04-02 17:07:15 -07:00
Ashwin Giridharan
771bc914eb Added unit test cases and addressed review comments 2020-03-31 15:40:43 -07:00
Joshua Kim
297b09481c
Merge pull request #2 from ashwing/EmptyLeaseTable
Adding empty lease table sync using ListShards w/ ShardFilter.
2020-03-30 18:48:56 -04:00
Joshua Kim
201a1e1553 java docs 2020-03-30 18:46:47 -04:00
Joshua Kim
82cc362545 --amend 2020-03-30 18:37:30 -04:00
Joshua Kim
f2911f1f0d Moving literals to variable for readability 2020-03-30 18:19:32 -04:00
Joshua Kim
6a0c17745a PR Feedback 2020-03-30 17:50:33 -04:00
Joshua Kim
05f2002596 Fixing unit tests. 2020-03-26 05:25:30 -04:00
Joshua Kim
8609820f20 Adding java docs 2020-03-26 05:16:32 -04:00
Joshua Kim
16cf142b44 Adding unit tests for bootstrapping cases. 2020-03-25 16:49:23 -04:00
Joshua Kim
039dd176f8 Fix existing unit tests. 2020-03-25 16:49:23 -04:00
Joshua Kim
892218d8b5 Adding multistreaming changes 2020-03-25 16:49:23 -04:00
Joshua Kim
30ef7f62b1 TODO to add multistream support to read from lease tables. 2020-03-25 16:49:23 -04:00
Joshua Kim
0052b5799c Multistream support for leases. 2020-03-25 16:49:23 -04:00
Joshua Kim
1ccbe614eb Re-adding multistream tests. 2020-03-25 16:49:23 -04:00
Joshua Kim
e906a835f8 Adding empty lease table sync. 2020-03-25 16:49:23 -04:00
ychunxue
f03a0fc561
Merge pull request #1 from ychunxue/periodic_sync
Implementation of Periodic shard sync manager that supports multi streams
2020-03-25 13:36:12 -07:00
Chunxue Yang
391532da31 Adding comments for metric and Todo works 2020-03-25 12:19:47 -07:00
Chunxue Yang
98d2f946f4 Fix test comment 2020-03-24 10:28:05 -07:00
Chunxue Yang
35be75c347 Addressing comments about unit tests 2020-03-23 18:35:18 -07:00
Ashwin Giridharan
a7ae4d3e24 Minor refactoring 2020-03-23 13:23:59 -07:00
Ashwin Giridharan
a6f767bf96 Shard Syncer and Logging changes 2020-03-23 13:13:49 -07:00
Ashwin Giridharan
c00c943a79 MultiStream Sync and logging changes 2020-03-20 17:19:04 -07:00
Chunxue Yang
bb495e4f60 Adding metric for ShardSyncTaskManager 2020-03-20 11:54:40 -07:00
Chunxue Yang
384fe5266c Address comments 2020-03-19 15:47:27 -07:00
Chunxue Yang
f57a332671 Make periodic shard sync support multi streams 2020-03-18 11:56:20 -07:00
Chunxue Yang
6c4297f5b3 Initial Merge for periodic sync 2020-03-16 17:41:00 -07:00
Ashwin Giridharan
0285789a24 Addressed review comments 2020-03-16 11:31:57 -07:00
Ashwin Giridharan
2e113dbd6c Added Unit Test cases, code comments and other code refactoring 2020-03-16 11:31:57 -07:00
Ashwin Giridharan
255ae932d2 Adding account and stream epoch support. Checkpoint 3 2020-03-16 11:31:57 -07:00
Ashwin Giridharan
8e8f6ed352 Adding account and stream epoch support. Checkpoint 2 2020-03-16 11:31:57 -07:00
Ashwin Giridharan
2b507342d8 Adding account and stream epoch support. Checkpoint 1 2020-03-16 11:31:57 -07:00
Ashwin Giridharan
fedd02c2a5 Fixing fanout cross consumer issue 2020-03-16 11:31:57 -07:00
Ashwin Giridharan
097559eca2 Checkpointing and retrieval fix 2020-03-16 11:31:57 -07:00
Ashwin Giridharan
9ad65ee486 Optional bug fix 2020-03-16 11:31:56 -07:00
Ashwin Giridharan
9fa0cee97e ShardSyncer multistream changes 2020-03-16 11:31:56 -07:00
Ashwin Giridharan
11c0ee7556 Testcase fixes 2020-03-16 11:31:56 -07:00
Ashwin Giridharan
fd0e96a5d1 checkpointing 2020-03-16 11:31:56 -07:00
Ashwin Giridharan
d6e2e0b324 Multistream tracker v1 2020-03-16 11:31:56 -07:00
Ashwin Giridharan
38c64b8624 Fixing doc comment shard structure format for HierarchicalShardSyncerTest 2020-03-16 11:31:56 -07:00
Jegosh John
f625aea63d Fixing scheduler initialization waitWhenLeaseTableEmpty unit test 2020-03-06 11:37:29 -08:00
Jegosh John
3bd9b29a13 Add wait to initialization until hashRange covered, modify wait logic for empty leaseTable check 2020-03-06 10:53:35 -08:00
Jegosh John
8511475868 Minor refactor, addressing feedback 2020-03-03 16:02:00 -08:00
Jegosh John
62e13ff3a1 Introduce PeriodicShardSync with leader election 2020-02-25 10:41:34 -08:00
Joshua Kim
ab572a9378
Update SNAPSHOT version. (#690) 2020-02-18 16:40:11 -08:00