Ashwin Giridharan
b2a747f3ea
1. Update the checkpoint with non SHARD_END sequence number only if the DDB sequence number is not SHARD_END.
...
2. Verify the shard end checkpointing by directly looking up the ddb lease entry
2021-01-25 23:02:41 -08:00
Ashwin Giridharan
76234d172c
Making LeaseCleanupManager more verbose about lease cleanup failures
2021-01-24 16:10:25 -08:00
Ashwin Giridharan
9cb5020022
1. Fix for updating HashRange directly while creating leases and including HashRange in seralizing and deserializing to/from DDB
...
2. Fix for making LeaseCleanupManager non-singleton to avoid cross-table interference in multiple apps running in same JVM
3. Fixing updateMetaInfo method to not update other lease table fields
4. Preventing shard deletion in LeaseCleanupManager if a valid shard does not have child shards in lease table and in Kinesis Service
5. Adding childshards update support in updateMetaInfo
6. Fixing LeaseCleanupManager to call updateMetaInfo instead of update for childshard update in lease
7. Fixing unit tests to accommodate HashRange changes
2021-01-23 17:58:42 -08:00
ychunxue
6fbfc21ad7
Merge pull request #735 from ashwing/v1.x-ltr-release
...
Merging LTR changes to public KCL 1.x branch. Preparing for KCL 1.14.0 release
2020-08-17 17:06:53 -07:00
Joshua Kim
ff004d75be
Update CHANGELOG.md
2020-08-17 19:58:35 -04:00
Joshua Kim
53174940e8
Update README.md
2020-08-17 19:58:13 -04:00
Joshua Kim
1440eeabbc
Update README.md
2020-08-17 19:57:40 -04:00
Joshua Kim
aaf4604357
Update CHANGELOG.md
2020-08-17 19:56:52 -04:00
Chunxue Yang
142415a213
Fixing the readme and changelog docs
2020-08-17 16:44:59 -07:00
Chunxue Yang
9e353db3db
Updating the SDK version in README and CHANGELOG
2020-08-17 15:49:42 -07:00
Chunxue Yang
dd4e88e621
Updating user agent version
2020-08-17 15:38:55 -07:00
Chunxue Yang
2ae76065a8
Correcting the KCL release version
2020-08-17 15:21:48 -07:00
Chunxue Yang
566a2446c6
SDK version upgrade and KCL version update
2020-08-17 15:03:40 -07:00
Joshua Kim
7b13527d41
More release notes
2020-08-17 15:50:44 -04:00
Joshua Kim
49231cc6c1
Adding release notes
2020-08-17 15:45:41 -04:00
Joshua Kim
700daa7a87
Fixing cache miss bug in list shards
2020-08-17 15:45:41 -04:00
Joshua Kim
a85ef70898
Fixing list shards bug
2020-08-17 15:45:41 -04:00
Joshua Kim
34e9016c01
Deprecating class
2020-08-17 15:45:41 -04:00
Joshua Kim
1f71042d80
Revert "temp pom change"
...
This reverts commit 129eee72da9be4f224f0ec23f08f305fb9564cde.
2020-08-17 15:45:41 -04:00
Joshua Kim
66bcd45d36
Using correct default shard prioritization strategy.
...
* Fixing bug where this was set as default in configuration, but if a
configuraiton is not specified it falls back to parent prioritization.
2020-08-17 15:45:41 -04:00
Chunxue Yang
bb84c17abf
Lease cleanup interval fix
2020-08-17 15:45:41 -04:00
Keerthy Muralidharan
44474a1c05
protobuf upgrade
2020-08-17 15:45:41 -04:00
Cai41
41c08c3b04
Also consider TableStatus.UPDATING status
2020-08-17 15:45:41 -04:00
Joshua Kim
17ecc87d71
temp pom change
2020-08-06 16:08:04 -04:00
ychunxue
226d5113aa
Merge pull request #89 from ychunxue/metricNameChange
...
metric name change for periodicShardSyncManager
2020-08-03 14:13:12 -07:00
Chunxue Yang
0d358b682d
metric name change for periodicShardSyncManager
2020-07-31 16:29:25 -07:00
ychunxue
b7468267f4
Merge pull request #72 from ychunxue/periodicShardSyncMetric
...
Periodic shard sync metric
2020-07-31 14:26:07 -07:00
Chunxue Yang
32fc14f535
Rebasing and addressing comments
2020-07-31 13:51:30 -07:00
ychunxue
c5632e38bc
Merge pull request #76 from ychunxue/prematureChildShardCreation
...
fix for premature childShard lease creation
2020-07-28 18:00:18 -07:00
Chunxue Yang
22737c4a5b
addressing comments
2020-07-28 17:51:50 -07:00
Chunxue Yang
38cef8963a
fixing expectation
2020-07-28 13:43:56 -07:00
Chunxue Yang
6738087a8f
updateLeaseWithMetaInfo with expectation
2020-07-28 13:32:04 -07:00
Chunxue Yang
f713017528
LeaseCleanupManager change
2020-07-28 13:11:57 -07:00
Chunxue Yang
c3b41c3b55
refactoring shutdownTask
2020-07-27 18:18:32 -07:00
Chunxue Yang
5f7d4b3bc6
merging and resolving conflicts
2020-07-27 15:19:35 -07:00
Joshua Kim
6f16b168a4
Lease cleanup v1.x ( #73 )
...
* Moving lease cleanup to ShutdownTask.
* Introducing LeaseCleanupManager with relevant configs.
2020-07-27 16:08:52 -04:00
Chunxue Yang
8a296a5aa3
change the retry logic
2020-07-21 11:08:56 -07:00
Joshua Kim
089c6ab18e
Making isLeaseTableEmpty use one paginated scan call. ( #75 )
...
Co-authored-by: Joshua Kim <kimjos@amazon.com>
2020-07-16 16:27:25 -04:00
Chunxue Yang
5bf24bda43
fix for premature childShard lease creation
2020-07-15 12:33:53 -07:00
Chunxue Yang
a1eafbb69a
Addressing comments
2020-07-10 10:43:29 -07:00
Chunxue Yang
995511afe5
Fixing updateParentShardupdateCurrentLeaseWithChildShards method
2020-07-09 16:03:49 -07:00
Chunxue Yang
849ffea028
Periodic shard sync metrics and config
2020-07-09 12:07:30 -07:00
ychunxue
4fd63989d3
Merge pull request #70 from ychunxue/ltr-v1.x-bugfix
...
Bug fix: No longer need full shard sync for shardEnd
2020-07-09 11:26:24 -07:00
Chunxue Yang
058403f943
addressing comments
2020-07-09 11:20:37 -07:00
Chunxue Yang
36ae2f2428
Bug fix: No longer need full shard sync for shardEnd
2020-07-08 17:45:02 -07:00
Chunxue Yang
5ba87a34ab
Merge remote-tracking branch 'ashwin/ltr-v1.x' into periodicShardSyncMetric
2020-07-07 17:17:50 -07:00
ychunxue
53cc7fc347
Merge pull request #67 from ychunxue/ltr1x_latest
...
KCL 1.x ShardEnd Shard Sync and Lease table ChildShard persistence
2020-07-07 13:49:53 -07:00
Chunxue Yang
0a5724c332
KCL 1.x ShardEnd Shard Sync and Lease table ChildShard persistence
2020-07-06 15:10:17 -07:00
Joshua Kim
0760688375
KinesisShardSyncer only create leases for one level of leases ( #49 )
...
Co-authored-by: Joshua Kim <kimjos@amazon.com>
2020-07-06 14:50:21 -04:00
Chunxue Yang
57f8c120d0
Periodc Shard Sync Metrics and Config
2020-07-02 10:15:44 -07:00
