Commit graph

380 commits

Author SHA1 Message Date
Ashwin Giridharan
f51657f6f7 Changes for adding stream as dimension in multistream mode. Changes for deferred cleanup of stale stream leases to free up record processors. 2020-04-24 17:02:11 -07:00
ychunxue
3de44dc4eb
Merge pull request #16 from ychunxue/ltr_1_merge
ShardEnd child shard persistence change
2020-04-22 15:02:46 -07:00
Chunxue Yang
cde09ca191 Address comments 2020-04-22 15:00:10 -07:00
Chunxue Yang
93dac82bd6 Fixing unit tests 2020-04-22 12:35:23 -07:00
Chunxue Yang
9b14b93941 Merging to ltr_1 2020-04-22 11:14:32 -07:00
Chunxue Yang
054cd88284 ShardEnd sync persistence change
quick fix

Addressing comments
2020-04-22 11:02:44 -07:00
ashwing
15f17700d9
Merge pull request #15 from jushkem/QueryMultiStream
Adding support to filter out multi streaming leases
2020-04-22 00:42:33 -07:00
ashwing
a5f251014e
Merge pull request #14 from Renjuju/cherry-pick-interface-changes
[Cherry-pick to ltr_1] Add DataFetcher and ShardDetector interface changes (#9)
2020-04-22 00:41:20 -07:00
Joshua Kim
2973401248 reverting pom changes 2020-04-21 14:31:07 -04:00
Joshua Kim
9f639b2342 Adding query support for multistream 2020-04-20 16:09:57 -04:00
Joshua Kim
78a877dc0b
Merge pull request #11 from ashwing/TwoPhaseCommit
Introducing two phase commit with arbitrary application state
2020-04-20 16:08:44 -04:00
Renju Radhakrishnan
a97a617f35 Add DataFetcher and ShardDetector interface changes (#9) 2020-04-17 13:20:41 -07:00
Joshua Kim
22fa12abfa Java docs 2020-04-15 19:29:17 -04:00
Joshua Kim
4782e43c3a PR comments 2020-04-15 19:27:13 -04:00
Joshua Kim
d31758727c Fixing bug 2020-04-15 19:27:13 -04:00
Joshua Kim
64469f4199 PR feedback 2020-04-15 19:27:13 -04:00
Joshua Kim
80df8ce439 Cleaning up unused imports 2020-04-15 19:27:13 -04:00
Joshua Kim
a61890ab40 Adding integration test for serializing application info 2020-04-15 19:27:13 -04:00
Joshua Kim
ddaf714a09 Adding application state to lease copy 2020-04-15 19:27:13 -04:00
Joshua Kim
b335246a30 Adding serializer for application state to lease info 2020-04-15 19:27:13 -04:00
Joshua Kim
ae005ce0f8 Adding unit tests 2020-04-15 19:27:13 -04:00
Joshua Kim
1794874e33 Clean up checkpoint state after successful checkpoint 2020-04-15 19:27:13 -04:00
Joshua Kim
5355b4b7c5 Moving new parameters to end 2020-04-15 19:27:13 -04:00
Joshua Kim
26c737cc2a Adding in memory implememtation for pending checkpoint state 2020-04-15 19:27:13 -04:00
Joshua Kim
af0cd5463d Adding arbitrary application state checkpointing for two phase commit. 2020-04-15 19:27:13 -04:00
ychunxue
b1a3d215d0
Merge pull request #10 from ychunxue/ltr_base_ShardEnd
ShardEnd shard sync with Child Shards
2020-04-09 10:50:44 -07:00
Chunxue Yang
734d4918d0 Addressing minor comments 2020-04-09 10:48:19 -07:00
Joshua Kim
6c73be5d92
Merge pull request #5 from ashwing/ValidateHashRange
Adding hash range validation for empty lease table
2020-04-09 03:45:38 -04:00
Chunxue Yang
0715903456 Addressing comments 2020-04-08 16:47:37 -07:00
Joshua Kim
c7fe06dab5 PR comments 2020-04-08 00:31:55 -04:00
Joshua Kim
01db7753f0 Making test cases actually go through validation steps. 2020-04-08 00:31:49 -04:00
Joshua Kim
ea093a4466 Adding stream id to exception 2020-04-07 21:30:51 -04:00
Joshua Kim
5351c9ddab Adding hash range validation for list shards with filter. 2020-04-07 21:30:51 -04:00
Chunxue Yang
4b3c717c53 Quick fix 2020-04-05 13:36:25 -07:00
Chunxue Yang
2f9ce0ce4f ShardEnd Shard Sync 2020-04-04 16:55:17 -07:00
Ashwin Giridharan
33cd0f52b2 Merging multstreming dynamic stream syncer, logging changes and periodic lease sync modifications 2020-04-02 17:07:15 -07:00
Ashwin Giridharan
771bc914eb Added unit test cases and addressed review comments 2020-03-31 15:40:43 -07:00
Joshua Kim
297b09481c
Merge pull request #2 from ashwing/EmptyLeaseTable
Adding empty lease table sync using ListShards w/ ShardFilter.
2020-03-30 18:48:56 -04:00
Joshua Kim
201a1e1553 java docs 2020-03-30 18:46:47 -04:00
Joshua Kim
82cc362545 --amend 2020-03-30 18:37:30 -04:00
Joshua Kim
f2911f1f0d Moving literals to variable for readability 2020-03-30 18:19:32 -04:00
Joshua Kim
6a0c17745a PR Feedback 2020-03-30 17:50:33 -04:00
Joshua Kim
05f2002596 Fixing unit tests. 2020-03-26 05:25:30 -04:00
Joshua Kim
8609820f20 Adding java docs 2020-03-26 05:16:32 -04:00
Joshua Kim
16cf142b44 Adding unit tests for bootstrapping cases. 2020-03-25 16:49:23 -04:00
Joshua Kim
039dd176f8 Fix existing unit tests. 2020-03-25 16:49:23 -04:00
Joshua Kim
892218d8b5 Adding multistreaming changes 2020-03-25 16:49:23 -04:00
Joshua Kim
30ef7f62b1 TODO to add multistream support to read from lease tables. 2020-03-25 16:49:23 -04:00
Joshua Kim
0052b5799c Multistream support for leases. 2020-03-25 16:49:23 -04:00
Joshua Kim
1ccbe614eb Re-adding multistream tests. 2020-03-25 16:49:23 -04:00