luciano/amazon-kinesis-client
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
590 commits 48 branches 124 tags 11 MiB
Commit graph

590 commits

This branch
This branch
All branches
Author SHA1 Message Date
dependabot[bot]
5421d0884c
Bump org.apache.commons:commons-lang3 from 3.14.0 to 3.17.0 
Bumps org.apache.commons:commons-lang3 from 3.14.0 to 3.17.0.

---
updated-dependencies:
- dependency-name: org.apache.commons:commons-lang3
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-12-20 18:03:48 +00:00
vincentvilo-aws
da34720eda
Reintroduce -SNAPSHOT version classifier (#1412) 2024-12-13 14:00:46 -08:00
vincentvilo-aws
c69ccb6a80
Prepare for v2.6.1 (#1411) 2024-12-13 09:34:53 -08:00
dependabot[bot]
a159fa31fb
Bump com.google.protobuf:protobuf-java in /amazon-kinesis-client (#1383) 
Bumps [com.google.protobuf:protobuf-java](https://github.com/protocolbuffers/protobuf) from 4.27.0 to 4.27.5.
- [Release notes](https://github.com/protocolbuffers/protobuf/releases)
- [Changelog](https://github.com/protocolbuffers/protobuf/blob/main/protobuf_release.bzl)
- [Commits](https://github.com/protocolbuffers/protobuf/commits)

---
updated-dependencies:
- dependency-name: com.google.protobuf:protobuf-java
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-09-30 13:30:44 -07:00
lucienlu-aws
0478575b3d
bugfix: debug or trace logging level now properly logs all worker loops (#1372) 2024-07-26 10:03:46 -07:00
lucienlu-aws
1c0c41c4e8
Add config to enable PITR (#1365) 
* Add config to enable PITR
 2024-07-15 14:15:52 -07:00
nakulj
5878ba8ac6
Add a backwards compatibility check for .proto files (#1362) 2024-07-12 11:18:54 -07:00
nakulj
3b5c59ec04
fix backwards compatibility check (#1361) 2024-07-12 09:46:49 -07:00
nakulj
57dcddf10b
Fix some of the warnings emitted by maven during build (#1363) 
* Set the source encoding in the pom.

This stops the following warning from being emitted in our logs:

```
[WARNING] File encoding has not been set, using platform encoding UTF-8, i.e. build is platform dependent!
```

* Replace deprecated systemProperties.

The recommended replacement is systemPropertyVariables, documented [here](https://maven.apache.org/surefire/maven-surefire-plugin/examples/system-properties.html).
 2024-07-08 15:22:24 -07:00
Nakul Joshi
f507066ea6 *Actually* skip tests while running backwards compatibility test. 2024-07-02 14:00:57 -07:00
Aravinda Kidambi Srinivasan
6cba7f431d
Remove ShutdownNotificationAware and update javadocs (#1358) 
* Deprecate ShutdownNotificationAware and update javadocs

ShutdownNotificationAware is not used by KCL, this PR
marks it as deprecated and updates the javadoc

Co-authored-by: nakulj <nklj@amazon.com>
 2024-07-02 13:28:19 -07:00
lucienlu-aws
715690d2c0
bugfix: revert update of in memory lease if DDB lease renewal throws error (#1354) 2024-06-24 10:47:00 -07:00
dependabot[bot]
78fb42ede1 Bump commons-io:commons-io from 2.15.1 to 2.16.1 
Bumps commons-io:commons-io from 2.15.1 to 2.16.1.

---
updated-dependencies:
- dependency-name: commons-io:commons-io
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-06-07 11:06:32 -07:00
dependabot[bot]
b271fed18b Bump awssdk.version from 2.25.11 to 2.25.64 
Bumps `awssdk.version` from 2.25.11 to 2.25.64.

Updates `software.amazon.awssdk:kinesis` from 2.25.11 to 2.25.64

Updates `software.amazon.awssdk:dynamodb` from 2.25.11 to 2.25.64

Updates `software.amazon.awssdk:cloudwatch` from 2.25.11 to 2.25.64

Updates `software.amazon.awssdk:netty-nio-client` from 2.25.11 to 2.25.64

Updates `software.amazon.awssdk:sts` from 2.25.11 to 2.25.64

---
updated-dependencies:
- dependency-name: software.amazon.awssdk:kinesis
  dependency-type: direct:production
  update-type: version-update:semver-patch
- dependency-name: software.amazon.awssdk:dynamodb
  dependency-type: direct:production
  update-type: version-update:semver-patch
- dependency-name: software.amazon.awssdk:cloudwatch
  dependency-type: direct:production
  update-type: version-update:semver-patch
- dependency-name: software.amazon.awssdk:netty-nio-client
  dependency-type: direct:production
  update-type: version-update:semver-patch
- dependency-name: software.amazon.awssdk:sts
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-06-07 11:05:55 -07:00
dependabot[bot]
cbed8c3c6f Bump com.google.protobuf:protobuf-java from 3.21.12 to 4.27.0 
Bumps [com.google.protobuf:protobuf-java](https://github.com/protocolbuffers/protobuf) from 3.21.12 to 4.27.0.
- [Release notes](https://github.com/protocolbuffers/protobuf/releases)
- [Changelog](https://github.com/protocolbuffers/protobuf/blob/main/protobuf_release.bzl)
- [Commits](https://github.com/protocolbuffers/protobuf/commits)

---
updated-dependencies:
- dependency-name: com.google.protobuf:protobuf-java
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-06-04 10:04:19 -07:00
nakulj
e8c3c01b12
Generate wrappers from proto files instead of shipping them directly (#1340) 
* Replace generated code with source .proto files

This change replaces the generated Messages.java file with the source .proto files.
It also includes the pom.xml changes needed to install protoc from Maven Central, and use it to compile the wrapper java code.

* add explanatory comment
 2024-06-03 15:20:07 -07:00
dependabot[bot]
a83b3fbd57 Bump org.apache.maven.plugins:maven-javadoc-plugin from 3.6.3 to 3.7.0 
Bumps [org.apache.maven.plugins:maven-javadoc-plugin](https://github.com/apache/maven-javadoc-plugin) from 3.6.3 to 3.7.0.
- [Release notes](https://github.com/apache/maven-javadoc-plugin/releases)
- [Commits](https://github.com/apache/maven-javadoc-plugin/compare/maven-javadoc-plugin-3.6.3...maven-javadoc-plugin-3.7.0)

---
updated-dependencies:
- dependency-name: org.apache.maven.plugins:maven-javadoc-plugin
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-06-03 09:06:16 -07:00
dependabot[bot]
0005670513 Bump org.apache.maven.plugins:maven-failsafe-plugin from 3.1.2 to 3.2.5 
Bumps [org.apache.maven.plugins:maven-failsafe-plugin](https://github.com/apache/maven-surefire) from 3.1.2 to 3.2.5.
- [Release notes](https://github.com/apache/maven-surefire/releases)
- [Commits](https://github.com/apache/maven-surefire/compare/surefire-3.1.2...surefire-3.2.5)

---
updated-dependencies:
- dependency-name: org.apache.maven.plugins:maven-failsafe-plugin
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-06-03 09:05:50 -07:00
dependabot[bot]
35b150009a Bump org.slf4j:slf4j-api from 2.0.7 to 2.0.13 
Bumps org.slf4j:slf4j-api from 2.0.7 to 2.0.13.

---
updated-dependencies:
- dependency-name: org.slf4j:slf4j-api
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-05-31 13:18:54 -07:00
dependabot[bot]
d3b84dc995 Bump io.reactivex.rxjava3:rxjava from 3.1.6 to 3.1.8 
Bumps [io.reactivex.rxjava3:rxjava](https://github.com/ReactiveX/RxJava) from 3.1.6 to 3.1.8.
- [Release notes](https://github.com/ReactiveX/RxJava/releases)
- [Commits](https://github.com/ReactiveX/RxJava/compare/v3.1.6...v3.1.8)

---
updated-dependencies:
- dependency-name: io.reactivex.rxjava3:rxjava
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-05-31 12:56:25 -07:00
Nakul Joshi
49fa32d68e Update maven compiler plugin to 3.13.0 
This version of the compiler plugin supports the `--release` option as
documented [here](https://maven.apache.org/plugins/maven-compiler-plugin/examples/set-compiler-release.html).
 2024-05-30 09:33:41 -07:00
Nakul Joshi
221db0564d Fix checkstyle violations. 
Follow up to #1332.
- Manually split up a long string literal.
- Disable ArrayTrailingComma, which checkstyle complains about even in
  commented code. In any case it is redundant with PJF.
 2024-05-21 16:35:31 -07:00
Nakul Joshi
adcc89f80d ignore format commit in blame 2024-05-21 01:27:20 -07:00
Nakul Joshi
18fe49eed0 run spotless:apply 2024-05-21 01:27:20 -07:00
Nakul Joshi
409a8f13cd add spotless 2024-05-21 01:27:20 -07:00
Nakul Joshi
c5e4fa2de0 remove commented imports 2024-05-21 01:27:20 -07:00
dependabot[bot]
a8abbea29f Bump org.apache.maven.plugins:maven-surefire-plugin from 3.1.2 to 3.2.5 
Bumps [org.apache.maven.plugins:maven-surefire-plugin](https://github.com/apache/maven-surefire) from 3.1.2 to 3.2.5.
- [Release notes](https://github.com/apache/maven-surefire/releases)
- [Commits](https://github.com/apache/maven-surefire/compare/surefire-3.1.2...surefire-3.2.5)

---
updated-dependencies:
- dependency-name: org.apache.maven.plugins:maven-surefire-plugin
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-05-20 16:21:00 -07:00
dependabot[bot]
2648123a79 Bump org.apache.maven.plugins:maven-checkstyle-plugin 
Bumps [org.apache.maven.plugins:maven-checkstyle-plugin](https://github.com/apache/maven-checkstyle-plugin) from 3.3.0 to 3.3.1.
- [Commits](https://github.com/apache/maven-checkstyle-plugin/compare/maven-checkstyle-plugin-3.3.0...maven-checkstyle-plugin-3.3.1)

---
updated-dependencies:
- dependency-name: org.apache.maven.plugins:maven-checkstyle-plugin
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-05-20 16:19:38 -07:00
vincentvilo-aws
023f6be251
Modify backwards compatibility script to ignore synthetic access methods (#1330) 
* modify backwards compatibility script to ignore synthetic access methods

* ignore synthetic access methods starting at access\$000
 2024-05-20 13:06:24 -07:00
nakulj
71f31e0a11
Remove unnecessary lambda (#1329) 
> Returning a lambda from a helper method or saving it in a constant is unnecessary; prefer to implement the functional interface method directly and use a method reference instead.

https://errorprone.info/bugpattern/UnnecessaryLambda
 2024-05-09 15:22:45 -07:00
Aravinda Kidambi Srinivasan
16e8404dc4
Fix a race condition between ShardConsumer shutdown and initialization (#1319) 
* Fix a race condition between ShardConsumer shutdown and initialization

When Kinesis shards have no data, there can be a race condition where
the shard-end record processing from RecordProcessorThread
interleaves with Scheduler performing initialization.
This leads to ShardConsumer making incorrect state transition
during initialization (moves from PROCESSING -> SHUTTING_DOWN) state
and during shutdown handling it moves from SHUTTING_DOWN -> SHUTDOWN_COMPLETE
without running the ShutdownTask.

This can cause the ShardConsumer to not perform proper shutdown
processing that is required for a child shard processing
to be unblocked. So the child shard could be blocked forever unless the
lease for the parent shard moves to a new worker and that worker does
not run into the race condition.

This patch fixes the race condition as follows:

The intializationComplete invocation is not needed after
needsInitialization has been set to false. Because initializationComplete
is mean to perform initialization in an async manner, but once
its done, the async task is a no-op in happy-path, but it can
perform incorrect state transition during a race condition.
 2024-05-02 14:54:59 -07:00
chenylee-aws
69cf5996c5
Honor lease sync on app bootstrap (#1325) 2024-05-02 14:43:03 -07:00
kcl-release-automation-bot
35fc72b2c8
Add snapshot to version 2.6.1-SNAPSHOT (#1324) 2024-05-01 17:54:42 -07:00
kcl-release-automation-bot
89a90e34e2
Preparation for v2.6.0 (#1323) 2024-05-01 17:48:25 -07:00
lucienlu-aws
ab24b66039
Skip cross account tests if no cross account credentials are provided (#1321) 2024-04-30 16:56:05 -07:00
Brendan Lynch
34fe58c492
Get unassigned leases in leasesToTake (#1320) 
Consider all null leases as a possible lease to take alongside expired leases

---------

Co-authored-by: Brendan Lynch <brenplyn@amazon.com>
 2024-04-30 15:56:31 -07:00
furq-aws
ec34ed1def
Internally construct and use stream ARNs for all streams in multi-stream mode (#1318) 2024-04-30 14:19:58 -07:00
lucienlu-aws
c12cee2a1b
Add additional integration tests for multistream and cross account (#1313) 2024-04-30 11:16:37 -07:00
lucienlu-aws
96be30b3e7
Change agedFailoverTimeMultiplier config to doPriorityLeaseTaking (#1317) 
* Change agedFailoverTimeMultiplier config to doPriorityLeaseTaking
 2024-04-22 10:35:08 -07:00
vincentvilo-aws
7d55b7a77f
Create script to check for backwards compatibility (#1316) 
* create script to check for backwards compatibility

* move scripts directory to .github folder

* add execute permissions to script

* moved the 'continue' call to the find_removed_methods() function

* add function to check if minor release is being performed

* Upgrade version to 2.6.0-SNAPSHOT
 2024-04-19 14:01:04 -07:00
furq-aws
e9990190cc
Update RetrievalFactory implementations to utilize the StreamIdentifier field of StreamConfig (#1291) 2024-04-15 11:14:13 -07:00
vincentvilo-aws
969341130a
move shutdownComplete call to ShardConsumer (#1308) 
* move shutdownComplete call to ShardConsumer
 2024-04-10 14:10:52 -07:00
lucienlu-aws
981899499f
Expose veryOldLeaseDurationMultiplier in LeaseManagementConfig (#1307) 
* Expose veryOldLeaseDurationMultiplier in LeaseManagementConfig as agedFailoverTimeMultiplier
 2024-04-10 11:24:53 -07:00
vincentvilo-aws
7f1f243676
Correcting the behavior of gracefulShutdown (#1302) 
* modify ShutdownTask to call shutdownComplete for graceful shutdown

* add test to verify ShutdownTask succeeds regardless of shutdownNotification

* change access level for finalShutdownLatch to NONE

* remove unused variable in GracefulShutdownCoordinator

* make comment more concise

* move waitForFinalShutdown method into GracefulShutdownCoordinator class

* cleanup call method of GracefulShutdownCoordinator

* modify waitForFinalShutdown to throw InterruptedException
 2024-04-03 12:42:26 -07:00
kcl-release-automation-bot
581d713815
Add snapshot to version 2.5.9-SNAPSHOT (#1303) 2024-04-02 08:09:22 -07:00
chenylee-aws
24774bc2e3
Clean up streams from currentStreamConfigMap (#1273) 2024-04-01 14:53:16 -07:00
kcl-release-automation-bot
bf5ab60f4b
Preparation for v2.5.8 (#1290) 2024-03-27 15:19:20 -07:00
dependabot[bot]
44beda5cb7
Upgrade awssdk.version from 2.25.3 to 2.25.11 (#1278) 
Bumps `awssdk.version` from 2.25.3 to 2.25.11.

Updates `software.amazon.awssdk:kinesis` from 2.25.3 to 2.25.11

Updates `software.amazon.awssdk:dynamodb` from 2.25.3 to 2.25.11

Updates `software.amazon.awssdk:cloudwatch` from 2.25.3 to 2.25.11

Updates `software.amazon.awssdk:netty-nio-client` from 2.25.3 to 2.25.11

Updates `software.amazon.awssdk:sts` from 2.25.3 to 2.25.11

---
updated-dependencies:
- dependency-name: software.amazon.awssdk:kinesis
  dependency-type: direct:production
  update-type: version-update:semver-patch
- dependency-name: software.amazon.awssdk:dynamodb
  dependency-type: direct:production
  update-type: version-update:semver-patch
- dependency-name: software.amazon.awssdk:cloudwatch
  dependency-type: direct:production
  update-type: version-update:semver-patch
- dependency-name: software.amazon.awssdk:netty-nio-client
  dependency-type: direct:production
  update-type: version-update:semver-patch
- dependency-name: software.amazon.awssdk:sts
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-03-27 10:09:21 -07:00
dependabot[bot]
38b8eb5fa2
Upgrade org.apache.maven.plugins:maven-gpg-plugin from 3.1.0 to 3.2.1 (#1279) 
Bumps [org.apache.maven.plugins:maven-gpg-plugin](https://github.com/apache/maven-gpg-plugin) from 3.1.0 to 3.2.1.
- [Release notes](https://github.com/apache/maven-gpg-plugin/releases)
- [Commits](https://github.com/apache/maven-gpg-plugin/compare/maven-gpg-plugin-3.1.0...maven-gpg-plugin-3.2.1)

---
updated-dependencies:
- dependency-name: org.apache.maven.plugins:maven-gpg-plugin
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-03-27 10:08:41 -07:00
dependabot[bot]
c6b5d6872d
Upgrade org.apache.commons:commons-lang3 from 3.12.0 to 3.14.0 (#1280) 
Bumps org.apache.commons:commons-lang3 from 3.12.0 to 3.14.0.

---
updated-dependencies:
- dependency-name: org.apache.commons:commons-lang3
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-03-27 10:07:56 -07:00