commit
72d50e7baf
6 changed files with 24 additions and 7 deletions
11
CHANGELOG.md
11
CHANGELOG.md
|
|
@ -1,7 +1,16 @@
|
||||||
# Changelog
|
# Changelog
|
||||||
|
|
||||||
### Latest Release (2.3.0 - August 17, 2020)
|
### Latest Release 2.3.1 (October 20, 2020)
|
||||||
|
[Milestone#53](https://github.com/awslabs/amazon-kinesis-client/milestone/53)
|
||||||
|
* Introducing support for processing multiple kinesis data streams with the same KCL 2.x for java consumer application
|
||||||
|
* To build a consumer application that can process multiple streams at the same time, you must implement a new
|
||||||
|
interface called MultistreamTracker (https://github.com/awslabs/amazon-kinesis-client/blob/0c5042dadf794fe988438436252a5a8fe70b6b0b/amazon-kinesis-client/src/main/java/software/amazon/kinesis/processor/MultiStreamTracker.java)
|
||||||
|
|
||||||
|
* MultistreamTracker will also publish various metrics around the current active streams being processed, the number
|
||||||
|
of streams which are deleted at this time period or are pending deletion.
|
||||||
|
|
||||||
|
|
||||||
|
### Release 2.3.0 (August 17, 2020)
|
||||||
* [Milestone#52](https://github.com/awslabs/amazon-kinesis-client/milestones/52)
|
* [Milestone#52](https://github.com/awslabs/amazon-kinesis-client/milestones/52)
|
||||||
|
|
||||||
* Behavior of shard synchronization is moving from each worker independently learning about all existing shards to workers only discovering the children of shards that each worker owns. This optimizes memory usage, lease table IOPS usage, and number of calls made to kinesis for streams with high shard counts and/or frequent resharding.
|
* Behavior of shard synchronization is moving from each worker independently learning about all existing shards to workers only discovering the children of shards that each worker owns. This optimizes memory usage, lease table IOPS usage, and number of calls made to kinesis for streams with high shard counts and/or frequent resharding.
|
||||||
|
|
|
||||||
12
README.md
12
README.md
|
|
@ -47,7 +47,7 @@ The recommended way to use the KCL for Java is to consume it from Maven.
|
||||||
<dependency>
|
<dependency>
|
||||||
<groupId>software.amazon.kinesis</groupId>
|
<groupId>software.amazon.kinesis</groupId>
|
||||||
<artifactId>amazon-kinesis-client</artifactId>
|
<artifactId>amazon-kinesis-client</artifactId>
|
||||||
<version>2.3.0</version>
|
<version>2.3.1</version>
|
||||||
</dependency>
|
</dependency>
|
||||||
```
|
```
|
||||||
|
|
||||||
|
|
@ -63,8 +63,16 @@ The recommended way to use the KCL for Java is to consume it from Maven.
|
||||||
|
|
||||||
## Release Notes
|
## Release Notes
|
||||||
|
|
||||||
### Latest Release (2.3.0 - August 17, 2020)
|
### Latest Release 2.3.1 (October 20, 2020)
|
||||||
|
[Milestone#53](https://github.com/awslabs/amazon-kinesis-client/milestone/53)
|
||||||
|
* Introducing support for processing multiple kinesis data streams with the same KCL 2.x for java consumer application
|
||||||
|
* To build a consumer application that can process multiple streams at the same time, you must implement a new
|
||||||
|
interface called MultistreamTracker (https://github.com/awslabs/amazon-kinesis-client/blob/0c5042dadf794fe988438436252a5a8fe70b6b0b/amazon-kinesis-client/src/main/java/software/amazon/kinesis/processor/MultiStreamTracker.java)
|
||||||
|
|
||||||
|
* MultistreamTracker will also publish various metrics around the current active streams being processed, the number
|
||||||
|
of streams which are deleted at this time period or are pending deletion.
|
||||||
|
|
||||||
|
### Release 2.3.0 (August 17, 2020)
|
||||||
* [Milestone#52](https://github.com/awslabs/amazon-kinesis-client/milestones/52)
|
* [Milestone#52](https://github.com/awslabs/amazon-kinesis-client/milestones/52)
|
||||||
|
|
||||||
* Behavior of shard synchronization is moving from each worker independently learning about all existing shards to workers only discovering the children of shards that each worker owns. This optimizes memory usage, lease table IOPS usage, and number of calls made to kinesis for streams with high shard counts and/or frequent resharding.
|
* Behavior of shard synchronization is moving from each worker independently learning about all existing shards to workers only discovering the children of shards that each worker owns. This optimizes memory usage, lease table IOPS usage, and number of calls made to kinesis for streams with high shard counts and/or frequent resharding.
|
||||||
|
|
|
||||||
|
|
@ -21,7 +21,7 @@
|
||||||
<parent>
|
<parent>
|
||||||
<artifactId>amazon-kinesis-client-pom</artifactId>
|
<artifactId>amazon-kinesis-client-pom</artifactId>
|
||||||
<groupId>software.amazon.kinesis</groupId>
|
<groupId>software.amazon.kinesis</groupId>
|
||||||
<version>2.3.0</version>
|
<version>2.3.1</version>
|
||||||
</parent>
|
</parent>
|
||||||
<modelVersion>4.0.0</modelVersion>
|
<modelVersion>4.0.0</modelVersion>
|
||||||
|
|
||||||
|
|
|
||||||
|
|
@ -22,7 +22,7 @@
|
||||||
<parent>
|
<parent>
|
||||||
<groupId>software.amazon.kinesis</groupId>
|
<groupId>software.amazon.kinesis</groupId>
|
||||||
<artifactId>amazon-kinesis-client-pom</artifactId>
|
<artifactId>amazon-kinesis-client-pom</artifactId>
|
||||||
<version>2.3.0</version>
|
<version>2.3.1</version>
|
||||||
</parent>
|
</parent>
|
||||||
|
|
||||||
<artifactId>amazon-kinesis-client</artifactId>
|
<artifactId>amazon-kinesis-client</artifactId>
|
||||||
|
|
|
||||||
|
|
@ -45,7 +45,7 @@ public class RetrievalConfig {
|
||||||
*/
|
*/
|
||||||
public static final String KINESIS_CLIENT_LIB_USER_AGENT = "amazon-kinesis-client-library-java";
|
public static final String KINESIS_CLIENT_LIB_USER_AGENT = "amazon-kinesis-client-library-java";
|
||||||
|
|
||||||
public static final String KINESIS_CLIENT_LIB_USER_AGENT_VERSION = "2.3.0";
|
public static final String KINESIS_CLIENT_LIB_USER_AGENT_VERSION = "2.3.1";
|
||||||
|
|
||||||
/**
|
/**
|
||||||
* Client used to make calls to Kinesis for records retrieval
|
* Client used to make calls to Kinesis for records retrieval
|
||||||
|
|
|
||||||
2
pom.xml
2
pom.xml
|
|
@ -22,7 +22,7 @@
|
||||||
<artifactId>amazon-kinesis-client-pom</artifactId>
|
<artifactId>amazon-kinesis-client-pom</artifactId>
|
||||||
<packaging>pom</packaging>
|
<packaging>pom</packaging>
|
||||||
<name>Amazon Kinesis Client Library</name>
|
<name>Amazon Kinesis Client Library</name>
|
||||||
<version>2.3.0</version>
|
<version>2.3.1</version>
|
||||||
<description>The Amazon Kinesis Client Library for Java enables Java developers to easily consume and process data
|
<description>The Amazon Kinesis Client Library for Java enables Java developers to easily consume and process data
|
||||||
from Amazon Kinesis.
|
from Amazon Kinesis.
|
||||||
</description>
|
</description>
|
||||||
|
|
|
||||||
Loading…
Reference in a new issue