Commit graph

339 commits

Author SHA1 Message Date
Joshua Kim
201a1e1553 java docs 2020-03-30 18:46:47 -04:00
Joshua Kim
82cc362545 --amend 2020-03-30 18:37:30 -04:00
Joshua Kim
f2911f1f0d Moving literals to variable for readability 2020-03-30 18:19:32 -04:00
Joshua Kim
6a0c17745a PR Feedback 2020-03-30 17:50:33 -04:00
Joshua Kim
05f2002596 Fixing unit tests. 2020-03-26 05:25:30 -04:00
Joshua Kim
8609820f20 Adding java docs 2020-03-26 05:16:32 -04:00
Joshua Kim
16cf142b44 Adding unit tests for bootstrapping cases. 2020-03-25 16:49:23 -04:00
Joshua Kim
039dd176f8 Fix existing unit tests. 2020-03-25 16:49:23 -04:00
Joshua Kim
892218d8b5 Adding multistreaming changes 2020-03-25 16:49:23 -04:00
Joshua Kim
30ef7f62b1 TODO to add multistream support to read from lease tables. 2020-03-25 16:49:23 -04:00
Joshua Kim
0052b5799c Multistream support for leases. 2020-03-25 16:49:23 -04:00
Joshua Kim
1ccbe614eb Re-adding multistream tests. 2020-03-25 16:49:23 -04:00
Joshua Kim
e906a835f8 Adding empty lease table sync. 2020-03-25 16:49:23 -04:00
ychunxue
f03a0fc561
Merge pull request #1 from ychunxue/periodic_sync
Implementation of Periodic shard sync manager that supports multi streams
2020-03-25 13:36:12 -07:00
Chunxue Yang
391532da31 Adding comments for metric and Todo works 2020-03-25 12:19:47 -07:00
Chunxue Yang
98d2f946f4 Fix test comment 2020-03-24 10:28:05 -07:00
Chunxue Yang
35be75c347 Addressing comments about unit tests 2020-03-23 18:35:18 -07:00
Chunxue Yang
bb495e4f60 Adding metric for ShardSyncTaskManager 2020-03-20 11:54:40 -07:00
Chunxue Yang
384fe5266c Address comments 2020-03-19 15:47:27 -07:00
Chunxue Yang
f57a332671 Make periodic shard sync support multi streams 2020-03-18 11:56:20 -07:00
Chunxue Yang
6c4297f5b3 Initial Merge for periodic sync 2020-03-16 17:41:00 -07:00
Ashwin Giridharan
0285789a24 Addressed review comments 2020-03-16 11:31:57 -07:00
Ashwin Giridharan
2e113dbd6c Added Unit Test cases, code comments and other code refactoring 2020-03-16 11:31:57 -07:00
Ashwin Giridharan
255ae932d2 Adding account and stream epoch support. Checkpoint 3 2020-03-16 11:31:57 -07:00
Ashwin Giridharan
8e8f6ed352 Adding account and stream epoch support. Checkpoint 2 2020-03-16 11:31:57 -07:00
Ashwin Giridharan
2b507342d8 Adding account and stream epoch support. Checkpoint 1 2020-03-16 11:31:57 -07:00
Ashwin Giridharan
fedd02c2a5 Fixing fanout cross consumer issue 2020-03-16 11:31:57 -07:00
Ashwin Giridharan
097559eca2 Checkpointing and retrieval fix 2020-03-16 11:31:57 -07:00
Ashwin Giridharan
9ad65ee486 Optional bug fix 2020-03-16 11:31:56 -07:00
Ashwin Giridharan
9fa0cee97e ShardSyncer multistream changes 2020-03-16 11:31:56 -07:00
Ashwin Giridharan
11c0ee7556 Testcase fixes 2020-03-16 11:31:56 -07:00
Ashwin Giridharan
fd0e96a5d1 checkpointing 2020-03-16 11:31:56 -07:00
Ashwin Giridharan
d6e2e0b324 Multistream tracker v1 2020-03-16 11:31:56 -07:00
Ashwin Giridharan
38c64b8624 Fixing doc comment shard structure format for HierarchicalShardSyncerTest 2020-03-16 11:31:56 -07:00
Jegosh John
f625aea63d Fixing scheduler initialization waitWhenLeaseTableEmpty unit test 2020-03-06 11:37:29 -08:00
Jegosh John
3bd9b29a13 Add wait to initialization until hashRange covered, modify wait logic for empty leaseTable check 2020-03-06 10:53:35 -08:00
Jegosh John
8511475868 Minor refactor, addressing feedback 2020-03-03 16:02:00 -08:00
Jegosh John
62e13ff3a1 Introduce PeriodicShardSync with leader election 2020-02-25 10:41:34 -08:00
Joshua Kim
ab572a9378
Update SNAPSHOT version. (#690) 2020-02-18 16:40:11 -08:00
Joshua Kim
cff709d044
Preparing for 2.2.9 release. (#688) 2020-02-18 10:15:55 -08:00
Joshua Kim
8aaf2aa11c
Updating AWS SDK version to 2.10.66 (#687) 2020-02-17 16:44:23 -08:00
Joshua Kim
189df4bc90
Adding request id logging to SubscribeToShard response. (#678) 2020-02-17 14:34:20 -08:00
Joshua Kim
b3bcc59697
Update SNAPSHOT version. (#681) 2020-01-28 15:44:39 -08:00
Joshua Kim
9abb56a634
Preparing for KCL v2.2.8 release (#680) 2020-01-28 11:49:55 -08:00
Joshua Kim
66f5204d84
Updating to new version of AWS SDK 2.10.56, changing Netty client defaults. (#679)
* Updating AWS SDK version to 2.10.56

* Changing default netty client to use 60 second ping health check timeout and 10MB initial window size.

* Tuning default request response timeout to 60 seconds.
2020-01-28 11:00:51 -08:00
Cory-Bradshaw
1a2932cc5a
Removing Codebuild Badge
Removing CodeBuild Badge, these webhooks have been removed.
2020-01-16 08:42:22 -08:00
Eric Meisel
3e32ff1906 Fix for #475 2020-01-16 08:37:10 -08:00
ychunxue
8a01abbf43
Merge pull request #668 from josvijay/shard-consumer-test-fix
Ensure the new test task is scheduled beyond millisecond delay to avo…
2019-12-20 09:58:53 -08:00
ychunxue
51ab53c319
Merge pull request #667 from josvijay/skipITs
Ensure IntegrationTests follow pattern of "*IntegrationTest.java"
2019-12-19 15:29:01 -08:00
Vijay
3fba5b31e6 Ensure the new test task is scheduled beyond millisecond delay to avoid incorrect test failure. 2019-12-19 15:19:10 -08:00