luciano/amazon-kinesis-client
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
251 commits 48 branches 124 tags 11 MiB
Commit graph

251 commits

This branch
This branch
All branches
Author SHA1 Message Date
ychunxue
b7468267f4
Merge pull request #72 from ychunxue/periodicShardSyncMetric 
Periodic shard sync metric
 2020-07-31 14:26:07 -07:00
Chunxue Yang
32fc14f535 Rebasing and addressing comments 2020-07-31 13:51:30 -07:00
ychunxue
c5632e38bc
Merge pull request #76 from ychunxue/prematureChildShardCreation 
fix for premature childShard lease creation
 2020-07-28 18:00:18 -07:00
Chunxue Yang
22737c4a5b addressing comments 2020-07-28 17:51:50 -07:00
Chunxue Yang
38cef8963a fixing expectation 2020-07-28 13:43:56 -07:00
Chunxue Yang
6738087a8f updateLeaseWithMetaInfo with expectation 2020-07-28 13:32:04 -07:00
Chunxue Yang
f713017528 LeaseCleanupManager change 2020-07-28 13:11:57 -07:00
Chunxue Yang
c3b41c3b55 refactoring shutdownTask 2020-07-27 18:18:32 -07:00
Chunxue Yang
5f7d4b3bc6 merging and resolving conflicts 2020-07-27 15:19:35 -07:00
Joshua Kim
6f16b168a4
Lease cleanup v1.x (#73) 
* Moving lease cleanup to ShutdownTask.
* Introducing LeaseCleanupManager with relevant configs.
 2020-07-27 16:08:52 -04:00
Chunxue Yang
8a296a5aa3 change the retry logic 2020-07-21 11:08:56 -07:00
Joshua Kim
089c6ab18e
Making isLeaseTableEmpty use one paginated scan call. (#75) 
Co-authored-by: Joshua Kim <kimjos@amazon.com>
 2020-07-16 16:27:25 -04:00
Chunxue Yang
5bf24bda43 fix for premature childShard lease creation 2020-07-15 12:33:53 -07:00
Chunxue Yang
a1eafbb69a Addressing comments 2020-07-10 10:43:29 -07:00
Chunxue Yang
995511afe5 Fixing updateParentShardupdateCurrentLeaseWithChildShards method 2020-07-09 16:03:49 -07:00
Chunxue Yang
849ffea028 Periodic shard sync metrics and config 2020-07-09 12:07:30 -07:00
ychunxue
4fd63989d3
Merge pull request #70 from ychunxue/ltr-v1.x-bugfix 
Bug fix: No longer need full shard sync for shardEnd
 2020-07-09 11:26:24 -07:00
Chunxue Yang
058403f943 addressing comments 2020-07-09 11:20:37 -07:00
Chunxue Yang
36ae2f2428 Bug fix: No longer need full shard sync for shardEnd 2020-07-08 17:45:02 -07:00
Chunxue Yang
5ba87a34ab Merge remote-tracking branch 'ashwin/ltr-v1.x' into periodicShardSyncMetric 2020-07-07 17:17:50 -07:00
ychunxue
53cc7fc347
Merge pull request #67 from ychunxue/ltr1x_latest 
KCL 1.x ShardEnd Shard Sync and Lease table ChildShard persistence
 2020-07-07 13:49:53 -07:00
Chunxue Yang
0a5724c332 KCL 1.x ShardEnd Shard Sync and Lease table ChildShard persistence 2020-07-06 15:10:17 -07:00
Joshua Kim
0760688375
KinesisShardSyncer only create leases for one level of leases (#49) 
Co-authored-by: Joshua Kim <kimjos@amazon.com>
 2020-07-06 14:50:21 -04:00
Chunxue Yang
57f8c120d0 Periodc Shard Sync Metrics and Config 2020-07-02 10:15:44 -07:00
Micah Jaffe
3a88a60a4e
Add periodic hash range auditor, hole detection, and recovery (#43) 
* Add periodic hash range auditor, hole detection, and recovery

* Add unit tests for hash range hole recovery

* Fix max hash range bug

* Address PR feedback

* Fix DDB hash key persistence bug
 2020-06-22 08:45:46 -07:00
Micah Jaffe
6b474b7390
Add configurable max initialization attempts (#39) 
* Add configurable max initialization attempts

* Add maxInitializationAttempts to unit test setup
 2020-05-15 14:02:44 -07:00
Micah Jaffe
fdad20aff4
Add leader-elected periodic shard sync manager as auditor to ShardEndShardSync strategy (#35) 
* Add leader-elected periodic shard sync manager as auditor to ShardEndShardSync strategy

* Address PR feedback and add Builder unit tests
 2020-05-14 09:04:44 -07:00
Micah Jaffe
45e76b0fd5
Add leader-elected shard sync on application bootstrap (#28) 
* Add leader-elected shard sync on application bootstrap

* Add additional testing and address PR feedback

* Remove runShardSync leader election from boostrap case

* Remove random UUID workerId and update unit tests
 2020-05-07 17:08:53 -07:00
Micah Jaffe
550d7af5b1
Add lease sync strategy for empty lease table (#24) 
* Add lease sync strategy for empty lease table

* Fix ShardSyncer unit tests to reflect new empty lease table shard sync logic
 2020-05-04 17:06:57 -07:00
Micah Jaffe
c7cd2f1e75 Migrate KinesisProxy to ListShardsWithFilter for empty lease table case 2020-04-30 13:28:27 -07:00
ychunxue
e1111d487e
Merge pull request #699 from ychunxue/v1.x 
Post Release 1.13.3
 2020-03-02 16:50:54 -08:00
Chunxue Yang
418807668d Fixing Snapshot version 2020-03-02 16:45:48 -08:00
Chunxue Yang
f93d01f183 Post Release 1.13.3 2020-03-02 16:43:12 -08:00
ychunxue
74fc856dab
Merge pull request #698 from ychunxue/v1.x 
Prepare for KCL 1.13.3 release
 2020-03-02 14:17:52 -08:00
Chunxue Yang
3cd1bdccf7 Prepare for KCL 1.13.3 release 2020-03-02 13:50:08 -08:00
ychunxue
e9e64f8511
Merge pull request #694 from ychunxue/v1.x 
Stop passing latest shards to the next ShardSyncTask in ShardSyncTask…
 2020-03-02 10:18:24 -08:00
Chunxue Yang
e95344b13e Adding unit test changes 2020-03-02 09:48:00 -08:00
Chunxue Yang
5760a27962 Stop passing latest shards to the next ShardSyncTask in ShardSyncTaskManager. 2020-02-25 16:18:56 -08:00
ychunxue
de52856b45
Merge pull request #684 from parijatsinha/v1.12_fix 
Refactored shard closure verification performed by ShutdownTask
 2020-02-24 09:58:52 -08:00
parijas
94a6324724 Addressed PR comments 2020-02-11 14:13:19 -08:00
parijas
1d50d766f4 Refactored shard closure verification performed by ShutdownTask 2020-02-03 17:00:32 -08:00
Cory Bradshaw
02c2036d5d Preparing for Release 1.13.2 2020-01-13 09:56:16 -08:00
Cory-Bradshaw
a7079a81e4
Adding backward compatible constructors that use the default DDB Billing Mode (#673) 
Co-authored-by: cobrads <44237866+cobrads@users.noreply.github.com>
 2020-01-09 10:10:06 -08:00
ychunxue
ca15bd4ef5
Merge pull request #671 from ychunxue/v1.x 
Prepare KCL release 1.13.1
 2019-12-30 15:20:15 -08:00
Chunxue Yang
53133fd385 Trim the old release notes in README file 2019-12-30 15:11:39 -08:00
Chunxue Yang
5f50f08dcc Prepare KCL release 1.13.1 2019-12-30 15:01:56 -08:00
ychunxue
e8180c9804
Merge pull request #670 from Cory-Bradshaw/v1.x 
Fixing LeaseManagementIntegrationTest
 2019-12-30 14:46:06 -08:00
Cory Bradshaw
40bc62e1f9 Fixing LeaseManagementIntegrationTest by using mocks to setup assumptions about table existance 2019-12-30 14:27:51 -08:00
ychunxue
bd59461c2c
Merge pull request #659 from parijatsinha/bug-fix 
Ensure ShardSyncTask invocation from ShardSyncTaskManager for pending ShardEnd
 2019-12-26 09:44:37 -08:00
parijas
5b3078f801 Addressed review comments 2019-12-17 11:40:20 -08:00