Commit graph

304 commits

Author SHA1 Message Date
rexcsn
d22fecbb8c
Merge pull request #873 from rexcsn/upgrade
Upgrade AWSSDK to v1.12.128
2021-12-10 17:25:49 -05:00
Rex Chen
b402ad69b2 Upgrade AWSSDK to v1.12.128
Signed-off-by: Rex Chen <shuningc@amazon.com>
2021-12-10 17:03:40 -05:00
rexcsn
142653f918
Merge pull request #872 from rexcsn/v1.x
Update log4j dependency
2021-12-10 16:02:29 -05:00
Rex Chen
269724b8df Update log4j dependency
Signed-off-by: Rex Chen <shuningc@amazon.com>
2021-12-10 14:27:20 -05:00
Avinash Chowdary
d8e29e8cd7
Preparing for 1.14.4 Release (#823)
* Upgraded aws java sdk version

* preparing for release 1.4.4

Co-authored-by: Avinash Ravilla <ravillaa@amazon.com>
2021-06-14 17:36:31 -04:00
Avinash Chowdary
fb1f44f482
Upgraded AWS SDK version to 1.12.3 (#821)
Co-authored-by: Avinash Ravilla <ravillaa@amazon.com>
2021-06-14 16:54:29 -04:00
catalinclapon
cf71e4e4e4
Update the Worker shutdown logic to make sure that the LeaseCleanupManager also terminates all the threads that it has started (#816)
* Update the Worker shutdown logic to make sure that the LeaseCleanupManager also terminates all the threads that it has started

* Minor javadoc fixes
2021-05-13 12:53:52 -07:00
Joshua Kim
b314d56308
Updating to SNAPSHOT version. (#813)
Co-authored-by: Joshua Kim <kimjos@amazon.com>
2021-05-03 18:22:08 -07:00
Joshua Kim
1956e02725
Preparing for 1.14.3 release (#812)
Co-authored-by: Joshua Kim <kimjos@amazon.com>
2021-05-03 15:05:22 -07:00
Joshua Kim
f2b9006a98
Removing cached shard progress, adding guardrails for duplicate shard responses. (#811)
Co-authored-by: Joshua Kim <kimjos@amazon.com>
2021-05-03 13:50:54 -07:00
Joshua Kim
f38dd18ed1
Preparing for 1.14.2 release (#793)
Co-authored-by: Joshua Kim <kimjos@amazon.com>
2021-02-24 14:39:04 -08:00
Joshua Kim
a13ed13702
Fixing bug where ShardFilter parameter for ListShards was being passed in for paginated calls. (#790)
Co-authored-by: Joshua Kim <kimjos@amazon.com>
2021-02-24 13:34:39 -08:00
ashwing
b4f6f8fffb
Merge pull request #782 from awslabs/kcl_1.14.1_release
KCL 1.14.1 Release
2021-01-27 16:15:52 -08:00
Ashwin Giridharan
8ba93e6aee Release notes update 2021-01-27 16:08:41 -08:00
Ashwin Giridharan
4f6f4e5971 KCL 1.14.1 release 2021-01-27 14:53:54 -08:00
ashwing
539550b664
Merge pull request #781 from awslabs/dead_shard_initialize_cycle_fix
Fixing record processor processing deleted leases in cycle
2021-01-27 09:17:40 -08:00
Ashwin Giridharan
9ed1e10fe5 Fixing unit test 2021-01-26 23:21:39 -08:00
Ashwin Giridharan
5142ce9bc5 Fixing exception type 2021-01-26 21:40:22 -08:00
ashwing
b04e93ec0d
Merge pull request #779 from awslabs/shard_end_corruption_issues_1
KCL 1.X - Guardrails to avoid checkpoint corruption during resharding
2021-01-26 15:34:49 -08:00
Ashwin Giridharan
530fd477b1 Fixing record processor processing deleted leases in cycle 2021-01-26 15:18:29 -08:00
ashwing
c935bc4032
Update README.md 2021-01-26 09:26:36 -08:00
Ashwin Giridharan
03e162b770 Improving LeaseCleanupManager's cleanupFailureReason 2021-01-25 23:41:23 -08:00
ashwing
e873c999cd
Merge pull request #776 from awslabs/shard_end_corruption_issues
KCL 1.X Fix for ShardEnd corruption and preventing lease table interference in multi-app JVM
2021-01-25 23:16:24 -08:00
Ashwin Giridharan
b2a747f3ea 1. Update the checkpoint with non SHARD_END sequence number only if the DDB sequence number is not SHARD_END.
2. Verify the shard end checkpointing by directly looking up the ddb lease entry
2021-01-25 23:02:41 -08:00
ashwing
ddfe75bb2d
Bugs in 1.14.0 2021-01-25 17:27:01 -08:00
Ashwin Giridharan
76234d172c Making LeaseCleanupManager more verbose about lease cleanup failures 2021-01-24 16:10:25 -08:00
Ashwin Giridharan
9cb5020022 1. Fix for updating HashRange directly while creating leases and including HashRange in seralizing and deserializing to/from DDB
2. Fix for making LeaseCleanupManager non-singleton to avoid cross-table interference in multiple apps running in same JVM
3. Fixing updateMetaInfo method to not update other lease table fields
4. Preventing shard deletion in LeaseCleanupManager if a valid shard does not have child shards in lease table and in Kinesis Service
5. Adding childshards update support in updateMetaInfo
6. Fixing LeaseCleanupManager to call updateMetaInfo instead of update for childshard update in lease

7. Fixing unit tests to accommodate HashRange changes
2021-01-23 17:58:42 -08:00
ychunxue
6fbfc21ad7
Merge pull request #735 from ashwing/v1.x-ltr-release
Merging LTR changes to public KCL 1.x branch. Preparing for KCL 1.14.0 release
2020-08-17 17:06:53 -07:00
Joshua Kim
ff004d75be
Update CHANGELOG.md 2020-08-17 19:58:35 -04:00
Joshua Kim
53174940e8
Update README.md 2020-08-17 19:58:13 -04:00
Joshua Kim
1440eeabbc
Update README.md 2020-08-17 19:57:40 -04:00
Joshua Kim
aaf4604357
Update CHANGELOG.md 2020-08-17 19:56:52 -04:00
Chunxue Yang
142415a213 Fixing the readme and changelog docs 2020-08-17 16:44:59 -07:00
Chunxue Yang
9e353db3db Updating the SDK version in README and CHANGELOG 2020-08-17 15:49:42 -07:00
Chunxue Yang
dd4e88e621 Updating user agent version 2020-08-17 15:38:55 -07:00
Chunxue Yang
2ae76065a8 Correcting the KCL release version 2020-08-17 15:21:48 -07:00
Chunxue Yang
566a2446c6 SDK version upgrade and KCL version update 2020-08-17 15:03:40 -07:00
Joshua Kim
7b13527d41 More release notes 2020-08-17 15:50:44 -04:00
Joshua Kim
49231cc6c1 Adding release notes 2020-08-17 15:45:41 -04:00
Joshua Kim
700daa7a87 Fixing cache miss bug in list shards 2020-08-17 15:45:41 -04:00
Joshua Kim
a85ef70898 Fixing list shards bug 2020-08-17 15:45:41 -04:00
Joshua Kim
34e9016c01 Deprecating class 2020-08-17 15:45:41 -04:00
Joshua Kim
1f71042d80 Revert "temp pom change"
This reverts commit 129eee72da9be4f224f0ec23f08f305fb9564cde.
2020-08-17 15:45:41 -04:00
Joshua Kim
66bcd45d36 Using correct default shard prioritization strategy.
* Fixing bug where this was set as default in configuration, but if a
configuraiton is not specified it falls back to parent prioritization.
2020-08-17 15:45:41 -04:00
Chunxue Yang
bb84c17abf Lease cleanup interval fix 2020-08-17 15:45:41 -04:00
Keerthy Muralidharan
44474a1c05 protobuf upgrade 2020-08-17 15:45:41 -04:00
Cai41
41c08c3b04 Also consider TableStatus.UPDATING status 2020-08-17 15:45:41 -04:00
Joshua Kim
17ecc87d71 temp pom change 2020-08-06 16:08:04 -04:00
ychunxue
226d5113aa
Merge pull request #89 from ychunxue/metricNameChange
metric name change for periodicShardSyncManager
2020-08-03 14:13:12 -07:00
Chunxue Yang
0d358b682d metric name change for periodicShardSyncManager 2020-07-31 16:29:25 -07:00