Commit graph

364 commits

Author SHA1 Message Date
Joshua Kim
80df8ce439 Cleaning up unused imports 2020-04-15 19:27:13 -04:00
Joshua Kim
a61890ab40 Adding integration test for serializing application info 2020-04-15 19:27:13 -04:00
Joshua Kim
ddaf714a09 Adding application state to lease copy 2020-04-15 19:27:13 -04:00
Joshua Kim
b335246a30 Adding serializer for application state to lease info 2020-04-15 19:27:13 -04:00
Joshua Kim
ae005ce0f8 Adding unit tests 2020-04-15 19:27:13 -04:00
Joshua Kim
1794874e33 Clean up checkpoint state after successful checkpoint 2020-04-15 19:27:13 -04:00
Joshua Kim
5355b4b7c5 Moving new parameters to end 2020-04-15 19:27:13 -04:00
Joshua Kim
26c737cc2a Adding in memory implememtation for pending checkpoint state 2020-04-15 19:27:13 -04:00
Joshua Kim
af0cd5463d Adding arbitrary application state checkpointing for two phase commit. 2020-04-15 19:27:13 -04:00
ychunxue
b1a3d215d0
Merge pull request #10 from ychunxue/ltr_base_ShardEnd
ShardEnd shard sync with Child Shards
2020-04-09 10:50:44 -07:00
Chunxue Yang
734d4918d0 Addressing minor comments 2020-04-09 10:48:19 -07:00
Joshua Kim
6c73be5d92
Merge pull request #5 from ashwing/ValidateHashRange
Adding hash range validation for empty lease table
2020-04-09 03:45:38 -04:00
Chunxue Yang
0715903456 Addressing comments 2020-04-08 16:47:37 -07:00
Joshua Kim
c7fe06dab5 PR comments 2020-04-08 00:31:55 -04:00
Joshua Kim
01db7753f0 Making test cases actually go through validation steps. 2020-04-08 00:31:49 -04:00
Joshua Kim
ea093a4466 Adding stream id to exception 2020-04-07 21:30:51 -04:00
Joshua Kim
5351c9ddab Adding hash range validation for list shards with filter. 2020-04-07 21:30:51 -04:00
Chunxue Yang
4b3c717c53 Quick fix 2020-04-05 13:36:25 -07:00
Chunxue Yang
2f9ce0ce4f ShardEnd Shard Sync 2020-04-04 16:55:17 -07:00
Ashwin Giridharan
33cd0f52b2 Merging multstreming dynamic stream syncer, logging changes and periodic lease sync modifications 2020-04-02 17:07:15 -07:00
Ashwin Giridharan
771bc914eb Added unit test cases and addressed review comments 2020-03-31 15:40:43 -07:00
Joshua Kim
297b09481c
Merge pull request #2 from ashwing/EmptyLeaseTable
Adding empty lease table sync using ListShards w/ ShardFilter.
2020-03-30 18:48:56 -04:00
Joshua Kim
201a1e1553 java docs 2020-03-30 18:46:47 -04:00
Joshua Kim
82cc362545 --amend 2020-03-30 18:37:30 -04:00
Joshua Kim
f2911f1f0d Moving literals to variable for readability 2020-03-30 18:19:32 -04:00
Joshua Kim
6a0c17745a PR Feedback 2020-03-30 17:50:33 -04:00
Joshua Kim
05f2002596 Fixing unit tests. 2020-03-26 05:25:30 -04:00
Joshua Kim
8609820f20 Adding java docs 2020-03-26 05:16:32 -04:00
Joshua Kim
16cf142b44 Adding unit tests for bootstrapping cases. 2020-03-25 16:49:23 -04:00
Joshua Kim
039dd176f8 Fix existing unit tests. 2020-03-25 16:49:23 -04:00
Joshua Kim
892218d8b5 Adding multistreaming changes 2020-03-25 16:49:23 -04:00
Joshua Kim
30ef7f62b1 TODO to add multistream support to read from lease tables. 2020-03-25 16:49:23 -04:00
Joshua Kim
0052b5799c Multistream support for leases. 2020-03-25 16:49:23 -04:00
Joshua Kim
1ccbe614eb Re-adding multistream tests. 2020-03-25 16:49:23 -04:00
Joshua Kim
e906a835f8 Adding empty lease table sync. 2020-03-25 16:49:23 -04:00
ychunxue
f03a0fc561
Merge pull request #1 from ychunxue/periodic_sync
Implementation of Periodic shard sync manager that supports multi streams
2020-03-25 13:36:12 -07:00
Chunxue Yang
391532da31 Adding comments for metric and Todo works 2020-03-25 12:19:47 -07:00
Chunxue Yang
98d2f946f4 Fix test comment 2020-03-24 10:28:05 -07:00
Chunxue Yang
35be75c347 Addressing comments about unit tests 2020-03-23 18:35:18 -07:00
Ashwin Giridharan
a7ae4d3e24 Minor refactoring 2020-03-23 13:23:59 -07:00
Ashwin Giridharan
a6f767bf96 Shard Syncer and Logging changes 2020-03-23 13:13:49 -07:00
Ashwin Giridharan
c00c943a79 MultiStream Sync and logging changes 2020-03-20 17:19:04 -07:00
Chunxue Yang
bb495e4f60 Adding metric for ShardSyncTaskManager 2020-03-20 11:54:40 -07:00
Chunxue Yang
384fe5266c Address comments 2020-03-19 15:47:27 -07:00
Chunxue Yang
f57a332671 Make periodic shard sync support multi streams 2020-03-18 11:56:20 -07:00
Chunxue Yang
6c4297f5b3 Initial Merge for periodic sync 2020-03-16 17:41:00 -07:00
Ashwin Giridharan
0285789a24 Addressed review comments 2020-03-16 11:31:57 -07:00
Ashwin Giridharan
2e113dbd6c Added Unit Test cases, code comments and other code refactoring 2020-03-16 11:31:57 -07:00
Ashwin Giridharan
255ae932d2 Adding account and stream epoch support. Checkpoint 3 2020-03-16 11:31:57 -07:00
Ashwin Giridharan
8e8f6ed352 Adding account and stream epoch support. Checkpoint 2 2020-03-16 11:31:57 -07:00