luciano/amazon-kinesis-client
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
350 commits 48 branches 124 tags 11 MiB
Commit graph

213 commits

Author SHA1 Message Date
lucienlu-aws
19818ccd61
Preparation for 1.15.2 (#1376) 2024-08-15 10:57:09 -07:00
lucienlu-aws
51ef718fc0
bugfix: debug or trace logging level now properly logs all worker loops (#1371) 
* bugfix: debug or trace logging level now properly logs all worker loops
 2024-07-25 17:01:27 -07:00
Nakul Joshi
acdb964f29 Backport pull #1340 to v1.x 2024-06-07 12:43:01 -07:00
furq-aws
48fab1fe71
Modify RecordProcessorCheckpointer#advancePosition Metrics usage to ensure proper closure (#1224) 2024-02-23 10:22:20 -08:00
vincentvilo-aws
1236d65f78
Preparation for v1.15.1 release (#1252) 
* Updated aws-java-sdk from 1.12.406 to 1.12.647

* Prepare for v1.15.1 release

* update CHANGELOG.md with changes for 1.15.1

* add 1.15.1 changes to README

* include Guava update in changelog

* Update release notes with concise descriptions
 2024-02-05 10:46:41 -08:00
Brendan Lynch
e731486b7f
Updated Guava version, added backoff for ShardSync Integ test, and reintroduced SNAPSHOT version (#1214) 
* Updated guava version to 32.1.1 and added backoff logic for ShardSync Integration test

* Added back snapshot version classifier

---------

Co-authored-by: Brendan Lynch <brenplyn@amazon.com>
 2023-10-11 14:54:49 -07:00
lucienlu-aws
b011206f7b
Preparation for v1.15.0 (#1135) 
* Prepare changes to release v1.15.0
 2023-06-08 14:11:42 -07:00
lucienlu-aws
db30ac956b
Add support for Stream ARNs (#1108) 
Add support for referencing streams by streamARN
 2023-06-07 13:55:51 -07:00
lucienlu-aws
fe1a34f6e5
Prevent HashRangesAreAlwaysComplete test from building invalid hierarchy trees (#1111) 2023-05-17 16:41:28 -07:00
ZeyuLi-AWS
d5324409ee
Updated the dependency to fix vulnerability issue (#1042) 
* updated the aws-java-sdk and google.protobuf version to fix vulnerabilities
 2023-02-16 12:51:48 -08:00
kdsjasonwng
367cede700
Preparation for v1.14.9 (#1012) 2022-12-14 11:07:54 -08:00
gguptp
372f98b21a
Every other change for DynamoDBStreamsKinesis Adapter Compatibility (#995) 
Co-authored-by: Nicholas Gutierrez <nichgu@amazon.com>
 2022-10-06 10:08:50 -07:00
Nicholas Gutierrez
251b331a2e
PeriodicShardSyncManager Changes Needed for DynamoDBStreamsKinesisAdapter Compatibility (#970) 
* Interface and Rename for PeriodicShardSyncManager

* Removed Automatic Indents

* More Auto Indent Fixes
 2022-09-08 17:45:53 -07:00
Yu Zeng
8dceb3f80f Preparing for release 1.4.8 2022-02-24 14:37:15 -08:00
Yu Zeng
4fd7b7aadb
Preparation for v1.14.7 (#884) 
Co-authored-by: Yu Zeng <yuzen@amazon.com>
 2021-12-22 10:47:58 -08:00
Rex Chen
58036d4977 Preparation for v1.14.6 
Signed-off-by: Rex Chen <shuningc@amazon.com>
 2021-12-15 13:18:43 -05:00
Rex Chen
f9648b4d99 Preparation for v1.14.5 
Signed-off-by: Rex Chen <shuningc@amazon.com>
 2021-12-10 17:44:15 -05:00
Avinash Chowdary
d8e29e8cd7
Preparing for 1.14.4 Release (#823) 
* Upgraded aws java sdk version

* preparing for release 1.4.4

Co-authored-by: Avinash Ravilla <ravillaa@amazon.com>
 2021-06-14 17:36:31 -04:00
catalinclapon
cf71e4e4e4
Update the Worker shutdown logic to make sure that the LeaseCleanupManager also terminates all the threads that it has started (#816) 
* Update the Worker shutdown logic to make sure that the LeaseCleanupManager also terminates all the threads that it has started

* Minor javadoc fixes
 2021-05-13 12:53:52 -07:00
Joshua Kim
b314d56308
Updating to SNAPSHOT version. (#813) 
Co-authored-by: Joshua Kim <kimjos@amazon.com>
 2021-05-03 18:22:08 -07:00
Joshua Kim
1956e02725
Preparing for 1.14.3 release (#812) 
Co-authored-by: Joshua Kim <kimjos@amazon.com>
 2021-05-03 15:05:22 -07:00
Joshua Kim
f2b9006a98
Removing cached shard progress, adding guardrails for duplicate shard responses. (#811) 
Co-authored-by: Joshua Kim <kimjos@amazon.com>
 2021-05-03 13:50:54 -07:00
Joshua Kim
f38dd18ed1
Preparing for 1.14.2 release (#793) 
Co-authored-by: Joshua Kim <kimjos@amazon.com>
 2021-02-24 14:39:04 -08:00
Joshua Kim
a13ed13702
Fixing bug where ShardFilter parameter for ListShards was being passed in for paginated calls. (#790) 
Co-authored-by: Joshua Kim <kimjos@amazon.com>
 2021-02-24 13:34:39 -08:00
Ashwin Giridharan
4f6f4e5971 KCL 1.14.1 release 2021-01-27 14:53:54 -08:00
Ashwin Giridharan
9ed1e10fe5 Fixing unit test 2021-01-26 23:21:39 -08:00
Ashwin Giridharan
5142ce9bc5 Fixing exception type 2021-01-26 21:40:22 -08:00
Ashwin Giridharan
530fd477b1 Fixing record processor processing deleted leases in cycle 2021-01-26 15:18:29 -08:00
Ashwin Giridharan
03e162b770 Improving LeaseCleanupManager's cleanupFailureReason 2021-01-25 23:41:23 -08:00
Ashwin Giridharan
b2a747f3ea 1. Update the checkpoint with non SHARD_END sequence number only if the DDB sequence number is not SHARD_END. 
2. Verify the shard end checkpointing by directly looking up the ddb lease entry
 2021-01-25 23:02:41 -08:00
Ashwin Giridharan
76234d172c Making LeaseCleanupManager more verbose about lease cleanup failures 2021-01-24 16:10:25 -08:00
Ashwin Giridharan
9cb5020022 1. Fix for updating HashRange directly while creating leases and including HashRange in seralizing and deserializing to/from DDB 
2. Fix for making LeaseCleanupManager non-singleton to avoid cross-table interference in multiple apps running in same JVM
3. Fixing updateMetaInfo method to not update other lease table fields
4. Preventing shard deletion in LeaseCleanupManager if a valid shard does not have child shards in lease table and in Kinesis Service
5. Adding childshards update support in updateMetaInfo
6. Fixing LeaseCleanupManager to call updateMetaInfo instead of update for childshard update in lease

7. Fixing unit tests to accommodate HashRange changes
 2021-01-23 17:58:42 -08:00
Chunxue Yang
dd4e88e621 Updating user agent version 2020-08-17 15:38:55 -07:00
Joshua Kim
700daa7a87 Fixing cache miss bug in list shards 2020-08-17 15:45:41 -04:00
Joshua Kim
a85ef70898 Fixing list shards bug 2020-08-17 15:45:41 -04:00
Joshua Kim
34e9016c01 Deprecating class 2020-08-17 15:45:41 -04:00
Joshua Kim
66bcd45d36 Using correct default shard prioritization strategy. 
* Fixing bug where this was set as default in configuration, but if a
configuraiton is not specified it falls back to parent prioritization.
 2020-08-17 15:45:41 -04:00
Chunxue Yang
bb84c17abf Lease cleanup interval fix 2020-08-17 15:45:41 -04:00
Cai41
41c08c3b04 Also consider TableStatus.UPDATING status 2020-08-17 15:45:41 -04:00
Chunxue Yang
0d358b682d metric name change for periodicShardSyncManager 2020-07-31 16:29:25 -07:00
Chunxue Yang
32fc14f535 Rebasing and addressing comments 2020-07-31 13:51:30 -07:00
Chunxue Yang
22737c4a5b addressing comments 2020-07-28 17:51:50 -07:00
Chunxue Yang
38cef8963a fixing expectation 2020-07-28 13:43:56 -07:00
Chunxue Yang
6738087a8f updateLeaseWithMetaInfo with expectation 2020-07-28 13:32:04 -07:00
Chunxue Yang
f713017528 LeaseCleanupManager change 2020-07-28 13:11:57 -07:00
Chunxue Yang
c3b41c3b55 refactoring shutdownTask 2020-07-27 18:18:32 -07:00
Chunxue Yang
5f7d4b3bc6 merging and resolving conflicts 2020-07-27 15:19:35 -07:00
Joshua Kim
6f16b168a4
Lease cleanup v1.x (#73) 
* Moving lease cleanup to ShutdownTask.
* Introducing LeaseCleanupManager with relevant configs.
 2020-07-27 16:08:52 -04:00
Chunxue Yang
8a296a5aa3 change the retry logic 2020-07-21 11:08:56 -07:00
Joshua Kim
089c6ab18e
Making isLeaseTableEmpty use one paginated scan call. (#75) 
Co-authored-by: Joshua Kim <kimjos@amazon.com>
 2020-07-16 16:27:25 -04:00