luciano/amazon-kinesis-client
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
629 commits 48 branches 124 tags 11 MiB
Commit graph

629 commits

This branch
This branch
All branches
Author SHA1 Message Date
eha sah
2f17a68b2a Formating and remove unused variable 2025-04-14 16:12:56 -07:00
eha sah
37562aa082 removed backward compatibility code/constructors 2025-04-14 12:21:22 -07:00
eha sah
43063e1dd0 merge master 2025-04-14 11:16:08 -07:00
chenylee-aws
6990fc513f
Update Java doc for internal Api annotation (#1466) 2025-04-14 09:32:16 -07:00
eha sah
f102b0db6a Best practice to deprecate old constructor 2025-04-11 17:03:24 -07:00
eha sah
0d2161e3f8 Best practice to deprecate old constructor 2025-04-11 16:56:13 -07:00
eha sah
94cda6bd79 Best practice to deprecate old constructor 2025-04-11 16:07:17 -07:00
eha sah
443b41690b Code for backward compatibility check 2025-04-11 15:21:10 -07:00
eha sah
af99b4d743 Code for backward compatibility check 2025-04-11 14:34:30 -07:00
eha sah
d01ed3e527 Code for backward compatibility 2025-04-11 14:18:21 -07:00
eha sah
6520d3e739 Change logic to balance tied to LAM run 2025-04-10 13:58:57 -07:00
eha sah
6d8396d3f4 Change logic to balance tied to lease duration 2025-04-10 13:26:16 -07:00
eha sah
90b1282d16 Changed variance based balancing to 3 2025-04-10 10:22:13 -07:00
eha sah
cc0bf011a0 Changed variance based balancing to 12 2025-04-10 09:41:06 -07:00
eha sah
f9465637ae updated logic to count based variance balancing 2025-04-10 09:08:21 -07:00
eha sah
6b19b6e996 Updated test logic to use Supplier to provide time 2025-04-10 08:31:41 -07:00
eha sah
57868a28e1 Updated comment removed one variable for consistency 2025-04-08 19:38:21 -07:00
eha sah
c17118429e remove unwanted RecordProcessor and added new parameter class 2025-04-08 19:34:23 -07:00
eha sah
37513e5f4a remove unwanted SampleApp class 2025-04-08 19:29:48 -07:00
eha sah
6049ef1e53 Make LAM run at configurable interval, tie LeaseDiscoverer with LAM run and tie load balancing with leaseDuration 2025-04-08 19:27:24 -07:00
skyero-aws
133374706c
Dependabot auto merge addition in github workflows (#1459) 
Dependabot auto-merge feature. Auto-merge triggers for dependabot depencency pull requests that are patches and have a cvss level greater than zero.
 2025-04-01 11:02:17 -07:00
Minu Hong
edd7d9b1e5
Update README.md (#1455) 
* Update README.md

Update KCL main readme page to add end-of-support notice for KCL 1.x. Also applied some formatting changes in the KCL versions section.

* Update README.md

Update the readme

* Update README.md
 2025-03-20 17:37:50 -07:00
lucienlu-aws
458ed653bc
Re-add SNAPSHOT to version (#1453) 2025-03-14 11:12:09 -07:00
vincentvilo-aws
9daed2dda9
Update version number in README for 2.x (#1450) 2025-03-13 10:25:41 -07:00
lucienlu-aws
5263b4227c
Prepare for release 3.0.2 (#1447) 2025-03-12 10:22:41 -07:00
ehasah-aws
7b5ebaeb93
Calculate scan segment by table size (#1443) 
* Fixes DDB usage spike issue

* Removed un-necessary exception handling

* made max total segment size 30

* Cached total scan segment

* Reuse listLeasesParallely api to dynamically calculate total segment

* Added unit tests and made getParallelScanTotalSegments synchronous

* Simplified getParallelScanTotalSegments method

* Fall back to previously calculated totalScan

* fixed formating
 2025-03-12 10:10:19 -07:00
dependabot[bot]
e856e7c95e
Bump io.netty:netty-handler in /amazon-kinesis-client (#1439) 
Bumps [io.netty:netty-handler](https://github.com/netty/netty) from 4.1.108.Final to 4.1.118.Final.
- [Commits](https://github.com/netty/netty/compare/netty-4.1.108.Final...netty-4.1.118.Final)

---
updated-dependencies:
- dependency-name: io.netty:netty-handler
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-03-03 15:17:53 -08:00
Abhi Gupta
c9563ab585
Having a way to override the consumerTaskFactory as part of LeaseManagementConfig (#1441) 2025-02-23 22:17:43 -08:00
Abhi Gupta
8deebe4bda
Adding functionality to override the vanilla KCL tasks (#1440) 2025-02-20 20:26:21 -08:00
ivanlkc
68a7a9bf53
Suppress LeaseAssignmentManager excessive WARN logs when there is no issue (#1437) 
This commit fixes https://github.com/awslabs/amazon-kinesis-client/issues/1407. The WARN level log statements should only be executed when a real problem had been detected.
 2025-02-06 17:20:19 -08:00
Minu Hong
ae9a433ebd
Update README.md (#1434) 
To update the notice related to the issue with AWS Java SDK 2.27.x versions.
 2025-01-27 16:42:54 -08:00
Minu Hong
854d99da52
Update README.md (#1428) 
Update the version number in the dependency for KCL 2.x
 2025-01-03 15:11:04 -08:00
dependabot[bot]
d9a238d33d
Bump com.fasterxml.jackson.core:jackson-databind (#1400) 
Bumps [com.fasterxml.jackson.core:jackson-databind](https://github.com/FasterXML/jackson) from 2.10.1 to 2.12.7.1.
- [Commits](https://github.com/FasterXML/jackson/commits)

---
updated-dependencies:
- dependency-name: com.fasterxml.jackson.core:jackson-databind
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-12-30 12:25:55 -08:00
vincentvilo-aws
dcac19e927
update dependabot.yml to track master and v2.x branches (#1416) 2024-12-20 10:02:54 -08:00
lucienlu-aws
9da91cd43c
Update version notice to just recommend to use latest version (#1415) 2024-12-18 11:33:06 -08:00
chenylee-aws
4492e1e206
Update version to 3.0.2-SNAPSHOT (#1404) 2024-11-15 12:02:50 -08:00
chenylee-aws
01d0e5cc55
Preparation for v3.0.1 (#1402) 2024-11-14 16:01:36 -08:00
chenylee-aws
3facf303bf
Fix checkpointOwner copy issue for multistream lease (#1401) 2024-11-14 13:50:22 -08:00
Aravinda Kidambi Srinivasan
b154acf7f5
Address KCLv3 issues from github (#1398) 
* Address KCLv3 issues reported on github
1. Fix transitive dependencies and add a maven plugin to catch these
   at build time
2. Remove the redundant shutdown of the leaseCoordinatorThreadPool
3. Fix typo THROUGHOUT_PUT_KBPS
4. Fix shutdown sequence - make sure
    scheduler shutdown without invoking run works
5. Fix backward compatibility check - Avoid flagging methods as deleted
    if it is marked synchronized. Also mark interfaces introduced in KCLv3 as internal.
 2024-11-12 12:20:16 -08:00
Aravinda Kidambi Srinivasan
004f6d3ea0
Update version to 3.0.1-SNAPSHOT (#1394) 
Change version to 3.0.1-SNAPSHOT
 2024-11-07 14:01:51 -08:00
Aravinda Kidambi Srinivasan
f7e909c979
Update backward compatibility check script (#1393) 
Dont fail the check for major release but print the output
for information/review purposes to know what API changes
have occurred in a major release

Manually tested the changes with some incompatible API changes
between patch release, minor release and major release.
 2024-11-06 14:31:25 -08:00
lucienlu-aws
fbfd74df39
Release v3.0.0 (#1392) 2024-11-05 22:09:59 -08:00
dependabot[bot]
a159fa31fb
Bump com.google.protobuf:protobuf-java in /amazon-kinesis-client (#1383) 
Bumps [com.google.protobuf:protobuf-java](https://github.com/protocolbuffers/protobuf) from 4.27.0 to 4.27.5.
- [Release notes](https://github.com/protocolbuffers/protobuf/releases)
- [Changelog](https://github.com/protocolbuffers/protobuf/blob/main/protobuf_release.bzl)
- [Commits](https://github.com/protocolbuffers/protobuf/commits)

---
updated-dependencies:
- dependency-name: com.google.protobuf:protobuf-java
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-09-30 13:30:44 -07:00
lucienlu-aws
0478575b3d
bugfix: debug or trace logging level now properly logs all worker loops (#1372) 2024-07-26 10:03:46 -07:00
lucienlu-aws
1c0c41c4e8
Add config to enable PITR (#1365) 
* Add config to enable PITR
 2024-07-15 14:15:52 -07:00
nakulj
5878ba8ac6
Add a backwards compatibility check for .proto files (#1362) 2024-07-12 11:18:54 -07:00
nakulj
3b5c59ec04
fix backwards compatibility check (#1361) 2024-07-12 09:46:49 -07:00
nakulj
57dcddf10b
Fix some of the warnings emitted by maven during build (#1363) 
* Set the source encoding in the pom.

This stops the following warning from being emitted in our logs:

```
[WARNING] File encoding has not been set, using platform encoding UTF-8, i.e. build is platform dependent!
```

* Replace deprecated systemProperties.

The recommended replacement is systemPropertyVariables, documented [here](https://maven.apache.org/surefire/maven-surefire-plugin/examples/system-properties.html).
 2024-07-08 15:22:24 -07:00
Nakul Joshi
f507066ea6 *Actually* skip tests while running backwards compatibility test. 2024-07-02 14:00:57 -07:00
Aravinda Kidambi Srinivasan
6cba7f431d
Remove ShutdownNotificationAware and update javadocs (#1358) 
* Deprecate ShutdownNotificationAware and update javadocs

ShutdownNotificationAware is not used by KCL, this PR
marks it as deprecated and updates the javadoc

Co-authored-by: nakulj <nklj@amazon.com>
 2024-07-02 13:28:19 -07:00