Commit graph

108 commits

Author SHA1 Message Date
ashwing
0ca5b4d6f6 KCL 2.2.4 release (#615) 2019-09-23 07:51:12 -07:00
Micah Jaffe
db94cb60ef
Update SNAPSHOT version to 2.2.4-SNAPSHOT (#605) 2019-09-04 16:37:07 -07:00
ashwing
18a55cf6f3 KCL 2.2.3 release (#604)
* KCL 2.2.3 release

* Added prior related release notes
2019-09-04 12:17:20 -07:00
Ashwin Giridharan
20cce175be Creating snapshot version for 2.2.3 release 2019-08-20 11:52:25 -07:00
ashwing
b8331f76e3 KCL 2.2.2 release (#598)
* KCL 2.2.2 release

* Addressing release notes feedback
2019-08-19 16:27:34 -07:00
Micah Jaffe
b6236d8077 Update version to 2.2.2-SNAPSHOT (#565) 2019-07-05 12:49:53 -07:00
Micah Jaffe
7d8b281d24
Prepare for v2.2.1 (#561)
* Prepare for v2.2.1

* Minor messaging fixes

* Update CHANGELOG.md

* Update README.md

* Update CHANGELOG.md

* Update README.md

* Update CHANGELOG.md

* Update README.md
2019-07-01 11:49:56 -07:00
Cory-Bradshaw
6159b869ed 2.2.1-SNAPSHOT Updated Snapshot versioning (#544)
* 2.2.1-SNAPSHOT Updated Snapshot versioning

* Updated 1.x versioning in README
2019-04-09 12:15:33 -07:00
Cory-Bradshaw
c8f82836b1 Preparation for v2.2.0 (#536) 2019-04-08 11:20:08 -07:00
awslankakamal
6c64055d9b Updating license to Apache License 2.0 (#523) 2019-04-05 15:25:09 -07:00
Cory-Bradshaw
1bfaa90322 Updated versions to 2.1.4-SNAPSHOT (#526) 2019-03-26 11:59:10 -07:00
Justin Pfifer
a629185786 Release 2.1.3 of the Amazon Kinesis Client Library for Java (#519)
Milestone#30: https://github.com/awslabs/amazon-kinesis-client/milestone/30
* Added a message to recommend using `KinesisClientUtil` when an acquire timeout occurs in the `FanOutRecordsPublisher`.
  * PR#514: https://github.com/awslabs/amazon-kinesis-client/pull/514
* Added a sleep between retries while waiting for a newly created stream consumer to become active.
  * PR#506: https://github.com/awslabs/amazon-kinesis-client/issues/506
* Added timeouts on all futures returned from the DynamoDB and Kinesis clients.
  The timeouts can be configured by setting `LeaseManagementConfig#requestTimeout(Duration)` for DynamoDB, and `PollingConfig#kinesisRequestTimeout(Duration)` for Kinesis.
  * PR#518: https://github.com/awslabs/amazon-kinesis-client/pull/518
* Upgraded to SDK version 2.5.10.
  * PR#518: https://github.com/awslabs/amazon-kinesis-client/pull/518
* Artifacts for the Amazon Kinesis Client for Java are now signed by a new GPG key:
  pub   4096R/86368934 2019-02-14 [expires: 2020-02-14]
  uid                  Amazon Kinesis Tools <amazon-kinesis-tools@amazon.com>
2019-03-18 16:28:42 -07:00
Justin Pfifer
6a70e3db31 Added Timeouts for DynamoDB and Kinesis Calls (#518)
* Advance version to 2.1.3-SNAPSHOT

* Added timeouts for Kinesis and DynamoDB calls

Added a timeout to prevent an issue where the Kinesis or DynamoDB call
never completes.

For Kinesis call to GetRecords the timeout defaults to 30 seconds, and can be configured
on the PollingConfig.

For DynamoDB and Kinesis (when calling ListShards) the timeout
defaults to 60 seconds and can be configured on LeaseManagementConfig.
2019-03-18 10:06:59 -07:00
sullis
c3b3846357 Upgrading maven-compiler-plugin to 3.8.0 (#498) 2019-03-06 15:14:50 -08:00
Justin Pfifer
2ea2717ae2 Release 2.1.2 of the Amazon Kinesis Client Library (#504)
https://github.com/awslabs/amazon-kinesis-client/milestone/29
* Fixed handling of the progress detection in the `ShardConsumer` to restart from the last accepted record, instead of the last queued record.
  * https://github.com/awslabs/amazon-kinesis-client/pull/492
* Fixed handling of exceptions when using polling so that it will no longer treat `SdkException`s as an unexpected exception.
  * https://github.com/awslabs/amazon-kinesis-client/pull/497
  * https://github.com/awslabs/amazon-kinesis-client/pull/502
* Fixed a case where lease loss would block the `Scheduler` while waiting for a record processor's `processRecords` method to complete.
  * https://github.com/awslabs/amazon-kinesis-client/pull/501
2019-02-18 15:56:12 -08:00
Justin Pfifer
b2751f09d5
Advance version to 2.1.2-SNAPSHOT (#496) 2019-02-07 07:59:37 -08:00
Sahil Palvia
5ff227c2c2
Release 2.1.1 (#494)
* Updating the versions to 2.1.1
* Updating release notes and CHANGELOG
* Updating the user agent version number
2019-02-06 15:03:56 -08:00
Sahil Palvia
7f5bd73c0b * Upgrading the SDK (#493)
* Changing KCL version to 2.1.1-SNAPSHOT
2019-02-06 11:41:53 -08:00
Sahil Palvia
03c15eb275
Introducing MultiLangDaemon support: (#483)
* Introducing MultiLangDaemon support for Enhanced Fan-Out.
* MultiLangDaemon now supports the following command line options.
  * `--properties-file`: Properties file that the KCL should use to set up the Scheduler.
  * `--log-configuration`: logback.xml that the KCL should use for logging.
* Updated AWS SDK dependency to 2.2.0.
* MultiLangDaemon now uses logback for logging.
2019-01-14 17:35:35 -08:00
Justin Pfifer
a05e22f782
Release 2.0.5 of the Amazon Kinesis Client for Java (#465) 2018-11-12 08:54:04 -08:00
Sahil Palvia
df6d25a201 Updating version to 2.0.5-SNAPSHOT (#450) 2018-10-23 08:09:59 -07:00
Sahil Palvia
eb7b3fd1bb Release 2.0.4 of the Amazon Kinesis Client for Java (#447)
Release 2.0.4 of the Amazon Kinesis Client for Java
2018-10-18 10:32:23 -07:00
Sahil Palvia
0326e217f6
Updating version to 2.0.4-SNAPSHOT (#438) 2018-10-09 11:55:50 -07:00
Justin Pfifer
e972617bfc
Release note for release 2.0.3 (#436)
Added release notes, and changelog for the 2.0.3 changes.

Made the warning clearer that it only affects the 2.0 version of the
Amazon Kinesis Client
2018-10-08 15:51:06 -07:00
Justin Pfifer
e86bf3d7f3
Revert experimental features from master (#431)
Reverted 3 commits:

Revert "Change version number to 2.0.3-experimental"
Revert: 54c171dc2a.

Revert "Experimental support for sequence number validation in the publisher (#401)"
Revert: 592499f7bc.

Revert "Support Validating Records are From to the Expected Shard (#400)"
Revert: 01f5db8049.
2018-10-02 14:50:25 -07:00
Justin Pfifer
54c171dc2a
Change version number to 2.0.3-experimental 2018-09-18 18:38:59 -07:00
Justin Pfifer
c8a3a031f4
Updated to 2.0.3-SNAPSHOT (#397) 2018-09-11 10:41:47 -07:00
Justin Pfifer
a8badc22d0
Release notes for 2.0.2 (#392)
Release notes for 2.0.2, and advance the version
2018-09-04 10:44:30 -07:00
Sahil Palvia
9459cc6a9e Updating README and version information
* Adding information on how to import the project using maven
* Updating project version to 2.0.2-SNAPSHOT
2018-08-21 17:02:42 -07:00
Justin Pfifer
9d6eb6b1a8 Advance version and release notes for 2.0.1 (#377)
* Update release notes for release 2.0.1

* Updated version to 2.0.1

* Added notes for PR #371, and cleaned up formatting

* Reordered release notes, and added additional fixes

Ordered the release notes in ascending order of their issue #

Added release notes for #374 and #375

* Add release notes to the change log
2018-08-21 10:12:45 -07:00
Sahil Palvia
7de822fd9c Fixing issue with ResourceNotFound
* Calling onNext and onComplete if throwable is of the kind ResourceNotFound.
* Adding testing for ResourceNotFound
* Updating version to 2.0.1-SNAPSHOT
2018-08-09 10:25:37 -07:00
Pfifer, Justin
258be9a504 Release 2.0.0 of the Amazon Kinesis Client for Java
* Added support for Enhanced Fan Out.
  Enhanced Fan Out provides for lower end to end latency, and increased number of consumers per stream.
  * Records are now delivered via streaming, reducing end-to-end latency.
  * The Amazon Kinesis Client will automatically register a new consumer if required.
    When registering a new consumer, the Kinesis Client will default to the application name unless configured otherwise.
  * New configuration options are available to configure Enhanced Fan Out.
  * `SubscribeToShard` maintains long lived connections with Kinesis, which in the AWS Java SDK 2.0 is limited by default.
    The `KinesisClientUtil` has been added to assist configuring the `maxConcurrency` of the `KinesisAsyncClient`.
    __WARNING: The Amazon Kinesis Client may see significantly increased latency, unless the `KinesisAsyncClient` is configured to have a `maxConcurrency` high enough to allow all leases plus additional usages of the `KinesisAsyncClient`.__

  | Name            | Default | Description                                                                                                         |
  |-----------------|---------|---------------------------------------------------------------------------------------------------------------------|
  | consumerArn     | Unset   | The ARN for an already created consumer.  If this is set, the Kinesis Client will not attempt to create a consumer. |
  | streamName      | Unset   | The name of the stream that a consumer should be create for if necessary                                            |
  | consumerName    | Unset   | The name of the consumer to create.  If this is not set the applicationName will be used instead.                   |
  | applicationName | Unset   | The name of the application.  This is used as the name of the consumer unless consumerName is set.                  |

* Modular Configuration of the Kinesis Client
  The Kinesis Client has migrated to a modular configuration system, and the `KinesisClientLibConfiguration` class has been removed.
  Configuration has been split into 7 classes.  Default versions of the configuration can be created from the `ConfigsBuilder`.
  Please see the migration guide for more information
  * `CheckpointConfig`
  * `CoordinatorConfig`
  * `LeaseManagementConfig`
  * `LifecycleConfig`
  * `MetricsConfig`
  * `ProcessorConfig`
  * `RetrievalConfig`

* Upgraded to AWS Java SDK 2.0
  The Kinesis Client now uses the AWS Java SDK 2.0.  The dependency on AWS Java SDK 1.11 has been removed.
  All configurations will only accept 2.0 clients.
  * When configuring the `KinesisAsyncClient` the `KinesisClientUtil#createKinesisAsyncClient` can be used to configure the Kinesis Client
  * __If you need support for AWS Java SDK 1.11 you will need to add a direct dependency.__
    __When adding a dependency you must ensure that the 1.11 versions of Jackson dependencies are excluded__
    Please see the migration guide for more information

* MultiLangDaemon is now a separate module
  The MultiLangDaemon has been separated to its own Maven module and is no longer available in `amazon-kinesis-client`.  To include the MultiLangDaemon, add a dependency on `amazon-kinesis-client-multilang`.
2018-08-02 12:19:46 -07:00
Justin Pfifer
f1d60ec1a6 Remove tests that no longer work (#346)
The new version of the SDK no longer returns null on an unknown
region.  There's not much we can do but run with whatever region is configured
2018-06-12 14:29:22 -07:00
Sahil Palvia
be60a5507d Logging fixes for tests (#340)
* Adding log4j dependency for testing. Moving log4j.properties from test/src to test/resources.
2018-05-17 13:27:35 -07:00
Sahil Palvia
86cc068454 Fix for Worker to handle immutable clients (#305) 2018-05-04 10:06:13 -07:00
Justin Pfifer
5d183e0197 Release 1.9.1 of the Amazon Kinesis Client Library for Java (#337)
* Release 1.9.1 of the Amazon Kinesis Client Library for Java

Updated versions, and added release notes.

* Added note about the update of the AWS Java SDK
2018-04-30 13:18:41 -07:00
Sahil Palvia
d7de6df958 Updating to the next version, 1.9.1-SNAPSHOT. (#295) 2018-02-09 10:09:33 -08:00
Sahil Palvia
09ec52bd16 Release 1.9.0 of the Amazon Kinesis Client for Java (#294)
* Added support for ListShards API. This API is used in place of DescribeStream API to provide more throughput during ShardSyncTask. 
  * ListShards supoorts higher call rate, which should reduce instances of throttling when attempting to synchronize the shard list.

* Updated the version of AWS Java SDK to 1.11.272.
  * Version 1.11.272 is now the minimum support versiojn of the SDK.
* Deprecated the following methods, and classes. These methods, and classes will be removed in a future release.
  * Deprecated IKinesisProxy#getStreamInfo.
  * Deprecated IKinesisProxyFactory.
  * Deprecated KinesisProxyFactory.
  * Deprecated certain KinesisProxy constructors.
2018-02-06 10:11:00 -08:00
Sahil Palvia
3ae916c5fc Introduction of Listshards API to replace DescribeStream (#293)
Use ListShards to retrieve shard information for Amazon Kinesis streams.
2018-02-06 07:35:44 -08:00
Justin Pfifer
59d40251c7
Release 1.8.10 of the Amazon Kinesis Client for Java (#288)
* Allow providing a custom IKinesisProxy implementation.
  * PR #274
* Checkpointing on a different thread should no longer emit a warning about NullMetricsScope.
  * PR #284
  * Issue #48
* Upgraded the AWS Java SDK to version 1.11.271
  * PR #287
2018-01-31 08:32:54 -08:00
Justin Pfifer
4309f23032
Upgraded Java SDK Version 1.11.271 (#287) 2018-01-29 11:41:16 -08:00
Sahil Palvia
71124e4055
Updating version to 1.8.10. (#283) 2018-01-16 15:58:26 -08:00
Justin Pfifer
31fd0b5811
Release 1.8.9 of the Amazon Kinesis Client for Java (#282)
* Allow disabling check for the case where a child shard has an open parent shard.
  There is a race condition where it's possible for the a parent shard
  to appear open, while having child shards. This check can now be
  disabled by setting ignoreUnexpectedChildShards in the
  KinesisClientLibConfiguration to true.
  * PR #240
  * Issue #210
* Upgraded the AWS SDK for Java to 1.11.261
  * PR #281
2018-01-15 07:52:28 -08:00
Justin Pfifer
e999c76b77
Upgraded the AWS SDK version to 1.11.261 (#281) 2018-01-12 12:01:18 -08:00
Pfifer, Justin
db72cc15f8 Advance version to 1.8.9-SNAPSHOT 2018-01-04 08:32:50 -08:00
Sahil Palvia
3c705300b5 Adding release notes and updating the KCL version to 1.8.8. (#268) 2017-11-15 10:44:10 -08:00
Sahil Palvia
cbcc898d71 Updating version to 1.8.8-SNAPSHOT. (#258) 2017-10-25 08:09:44 -07:00
Justin Pfifer
821b0cbd0f Release Notes for 1.8.7 of the Amazon Kinesis Client Library for Java (#257)
Don't add a delay for synchronous requests to Kinesis
Removes a delay that had been added for synchronous GetRecords calls to Kinesis
2017-10-24 09:38:49 -07:00
Justin Pfifer
cc7e329e2f Release Note for Release 1.8.6 of the Amazon Kinesis Client for Java (#254) 2017-10-23 12:30:08 -07:00
Justin Pfifer
90d4cb78c5 Update the AWS SDK Version to 1.11.218 (#253) 2017-10-23 10:16:25 -07:00