luciano/amazon-kinesis-client
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
597 commits 48 branches 124 tags 11 MiB
Commit graph

597 commits

This branch
This branch
All branches
Author SHA1 Message Date
Abhit Sawwalakhe
27b166c5aa
Clean up in-memory state of deleted kinesis stream in MultiStreamMode (#1056) 
Co-authored-by: Abhit Sawwalakhe <sawwa@amazon.com>
 2023-03-08 13:39:35 -08:00
stair
43d43653d0
Documentation: added <pre> tags so fixed-format diagrams aren't garbled. (#1058) 
No functional change.
 2023-03-07 15:36:25 -05:00
stair
87dc586e6d
Added more logging in Scheduler w.r.t. StreamConfigs. (#1057) 2023-03-06 17:05:34 -05:00
stair
cd80c93966
Exposed convenience method of ExtendedSequenceNumber#isSentinelCheckpoint() (#1053) 
+ fixed unrelated parameterized log message in `ShardSyncTaskManager`
 2023-02-27 10:15:30 -08:00
stair
d8aa784f17
Removed a .swp file, and updated .gitignore. (#1043) 2023-02-27 10:02:36 -08:00
ZeyuLi-AWS
70cfc7d7ce
Fixed duplication of project version in children pom.xml (#1045) 2023-02-20 15:53:57 -08:00
stair
1c8bd8e71e
Minor optimizations (e.g., calculate-once, put instead of get+put) (#1041) 
and code cleanup (e.g., removed unused imports, updated Javadoc).

No functional change.
 2023-02-13 10:58:02 -08:00
stair
5bfd1ab289
Release Note updates to avoid duplication and bitrot (e.g., 1.x release (#1035) 
notes are not ported forward to 2.x).
 2023-02-13 13:20:54 -05:00
stair
4d94efac8f
Optimization: 9~15% improvement in KinesisDataFetcher wall-time after (#1034) 
converting `AWSExceptionManger` to a static variable.
 2023-02-13 13:16:28 -05:00
pelaezryan
9fb58a22bf
Increased logging verbosity around lease management. Also included additional javadocs for methods (#1040) 
Co-authored-by: Ryan Pelaez <rmpelaez@amazon.com>
 2023-02-13 12:28:54 -05:00
dependabot[bot]
34f19c5a7b
Bump rxjava from 3.1.5 to 3.1.6 (#1032) 
Bumps [rxjava](https://github.com/ReactiveX/RxJava) from 3.1.5 to 3.1.6.
- [Release notes](https://github.com/ReactiveX/RxJava/releases)
- [Commits](https://github.com/ReactiveX/RxJava/compare/v3.1.5...v3.1.6)

---
updated-dependencies:
- dependency-name: io.reactivex.rxjava3:rxjava
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-02-07 12:20:31 -05:00
dependabot[bot]
af71d9e224
Bump awssdk.version from 2.19.2 to 2.19.31 (#1030) 
Bumps `awssdk.version` from 2.19.2 to 2.19.31.

Updates `kinesis` from 2.19.2 to 2.19.31

Updates `dynamodb` from 2.19.2 to 2.19.31

Updates `cloudwatch` from 2.19.2 to 2.19.31

Updates `netty-nio-client` from 2.19.2 to 2.19.31

Updates `sts` from 2.19.2 to 2.19.31

---
updated-dependencies:
- dependency-name: software.amazon.awssdk:kinesis
  dependency-type: direct:production
  update-type: version-update:semver-patch
- dependency-name: software.amazon.awssdk:dynamodb
  dependency-type: direct:production
  update-type: version-update:semver-patch
- dependency-name: software.amazon.awssdk:cloudwatch
  dependency-type: direct:production
  update-type: version-update:semver-patch
- dependency-name: software.amazon.awssdk:netty-nio-client
  dependency-type: direct:production
  update-type: version-update:semver-patch
- dependency-name: software.amazon.awssdk:sts
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-02-07 12:19:15 -05:00
dependabot[bot]
5715e944e2
Bump slf4j-api from 2.0.0 to 2.0.6 (#1029) 
Bumps [slf4j-api](https://github.com/qos-ch/slf4j) from 2.0.0 to 2.0.6.
- [Release notes](https://github.com/qos-ch/slf4j/releases)
- [Commits](https://github.com/qos-ch/slf4j/compare/v_2.0.0...v_2.0.6)

---
updated-dependencies:
- dependency-name: org.slf4j:slf4j-api
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-02-07 12:18:53 -05:00
stair
17b82a0e67
Refactored MultiStreamTracker to provide and enhance OOP for both (#1028) 
single- and multi-stream trackers.

+ converted `Scheduler#currentStreamConfigMap` to `ConcurrentHashMap`
+ eliminated a responsibility from Scheduler (i.e., orphan config generation)
 2023-02-06 23:04:34 -08:00
stair
dd429a2b1c
Removed CHECKSTYLE:OFF toggles which can invite/obscure sub-par code. (#1027) 
+ removed unused `assertHashRangeOfClosedShardIsCovered(...)` method
 2023-01-31 22:39:13 -08:00
JumpeiAnzai
6cb0100163
Fixing log message spacing (#795) 2023-01-31 18:36:12 -05:00
Ben Iofel
0535193394
Fix warning message typos (#956) 
Same as #875
 2023-01-31 18:26:14 -05:00
dependabot[bot]
28cb185e9c
Bump protobuf-java from 3.21.5 to 3.21.12 (#1015) 
Bumps [protobuf-java](https://github.com/protocolbuffers/protobuf) from 3.21.5 to 3.21.12.
- [Release notes](https://github.com/protocolbuffers/protobuf/releases)
- [Changelog](https://github.com/protocolbuffers/protobuf/blob/main/generate_changelog.py)
- [Commits](https://github.com/protocolbuffers/protobuf/compare/v3.21.5...v3.21.12)

---
updated-dependencies:
- dependency-name: com.google.protobuf:protobuf-java
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-01-31 14:47:32 -05:00
Jan Sochor
65c95ed872
Pass isAtShardEnd correctly to processRecords call (#935) 
The default is false otherwise, i.e., the processor is always getting isAtShardEnd=false.
 2023-01-31 12:53:45 -05:00
CF
6146ff9851
Typo in Comment (#740) 
Implemetation -> Implementation
 2023-01-31 12:32:10 -05:00
stair
4411a3dc77
Added logging w.r.t. StreamConfig handling. (#1024) 2023-01-30 17:41:11 -05:00
Chenyuan Lee
0e86089123
Preparation for v2.4.5 (#1021) 2023-01-05 08:25:17 -08:00
Chenyuan Lee
17d0940f5d
Use AFTER_SEQUENCE_NUMBER iterator type for expired iterator request (#1014) 
* Use AFTER_SEQUENCE_NUMBER iterator type for expired iterator request

* Update Java docs and minor refactoring

* Fix Java doc

Co-authored-by: Chenyuan Lee <chenylee@amazon.com>
 2023-01-03 15:10:31 -08:00
Yu Zeng
676bb86b8e Preparation for v2.4.4 (Revise CHANGELOG/README) 2022-12-23 16:13:21 -08:00
Yu Zeng
adb3990481 Correct the KCL version in the main pom 2022-12-23 16:13:21 -08:00
Yu Zeng
780ca178d5 Preparation for v2.4.4 2022-12-23 15:52:58 -08:00
Yu Zeng
b1cc48af50 Upgrade aws sdk to the latest version 2022-12-23 15:52:58 -08:00
Yu Zeng
05ed537572 Preparation for v2.4.3 (revise changelog) 2022-09-06 15:34:32 -07:00
Yu Zeng
3580b082cd Upgrade awssdk to the latest version 2022-09-06 14:50:50 -07:00
Yu Zeng
5ac021e0c6 Upgrade more dependencies 2022-09-06 14:50:50 -07:00
dependabot[bot]
0e14dcfb2c Bump jcommander from 1.81 to 1.82 
Bumps [jcommander](https://github.com/cbeust/jcommander) from 1.81 to 1.82.
- [Release notes](https://github.com/cbeust/jcommander/releases)
- [Changelog](https://github.com/cbeust/jcommander/blob/master/CHANGELOG.md)
- [Commits](https://github.com/cbeust/jcommander/compare/1.81...1.82)

---
updated-dependencies:
- dependency-name: com.beust:jcommander
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-09-06 13:47:59 -07:00
dependabot[bot]
dd1e7aeeec Bump guava from 31.0.1-jre to 31.1-jre 
Bumps [guava](https://github.com/google/guava) from 31.0.1-jre to 31.1-jre.
- [Release notes](https://github.com/google/guava/releases)
- [Commits](https://github.com/google/guava/commits)

---
updated-dependencies:
- dependency-name: com.google.guava:guava
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-09-06 13:46:30 -07:00
dependabot[bot]
c739f39a14 Bump logback-classic from 1.2.9 to 1.4.0 
Bumps [logback-classic](https://github.com/qos-ch/logback) from 1.2.9 to 1.4.0.
- [Release notes](https://github.com/qos-ch/logback/releases)
- [Commits](https://github.com/qos-ch/logback/compare/v_1.2.9...v_1.4.0)

---
updated-dependencies:
- dependency-name: ch.qos.logback:logback-classic
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-09-06 13:42:11 -07:00
dependabot[bot]
6c16b1c371 Bump awssdk.version from 2.17.108 to 2.17.267 
Bumps `awssdk.version` from 2.17.108 to 2.17.267.

Updates `kinesis` from 2.17.108 to 2.17.267

Updates `dynamodb` from 2.17.108 to 2.17.267

Updates `cloudwatch` from 2.17.108 to 2.17.267

Updates `netty-nio-client` from 2.17.108 to 2.17.267

Updates `sts` from 2.17.108 to 2.17.267

---
updated-dependencies:
- dependency-name: software.amazon.awssdk:kinesis
  dependency-type: direct:production
  update-type: version-update:semver-patch
- dependency-name: software.amazon.awssdk:dynamodb
  dependency-type: direct:production
  update-type: version-update:semver-patch
- dependency-name: software.amazon.awssdk:cloudwatch
  dependency-type: direct:production
  update-type: version-update:semver-patch
- dependency-name: software.amazon.awssdk:netty-nio-client
  dependency-type: direct:production
  update-type: version-update:semver-patch
- dependency-name: software.amazon.awssdk:sts
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-09-06 13:40:38 -07:00
Yu Zeng
2ae576a804 Preparation for v2.4.3 2022-09-06 13:25:44 -07:00
Yu Zeng
145c63a761 Upgrade dependencies 2022-09-06 13:17:18 -07:00
Jason Wang
32aaa66a50 Preparation for v2.4.2 
cr: https://code.amazon.com/reviews/CR-74125438
 2022-08-11 12:59:17 -07:00
Steven Shan
6c7d9ed662
Upgrade Lombok to version 1.18.24 (#972) 2022-08-11 11:06:54 -07:00
Adam Tapp
a344ee4d05 Added metric to record when a lease cannot be taken due to a ConditionalCheckFailedException 2022-03-31 09:15:41 -07:00
ava huang
862fabb266
add recommendation for customer (#937) 
Co-authored-by: Ava Huang <xinlyh@amazon.com>
 2022-03-30 18:36:31 -07:00
Yu Zeng
7f5eb9f34b Preparation for v2.4.1 - Fix pom version 2022-03-24 15:11:42 -07:00
Yu Zeng
b312c181e8 Preparation for v2.4.1 2022-03-24 14:35:18 -07:00
Brandon Dahler
1f15a43f03 Upgrade to rxjava3 2022-03-24 13:43:00 -07:00
Ravindranath Kakarla
5fa75ee3df
Preparation for v2.4.0 (#925) 
Co-authored-by: Ravindranath Kakarla <rnath@amazon.com>
 2022-03-02 16:10:46 -08:00
Kexin Hui
0a47137466 Upgrade GSR version to 1.1.9 2022-03-02 11:21:49 -08:00
dependabot[bot]
e722bbaa3e
Bump protobuf-java from 3.19.1 to 3.19.2 in /amazon-kinesis-client (#894) 
Bumps [protobuf-java](https://github.com/protocolbuffers/protobuf) from 3.19.1 to 3.19.2.
- [Release notes](https://github.com/protocolbuffers/protobuf/releases)
- [Changelog](https://github.com/protocolbuffers/protobuf/blob/master/generate_changelog.py)
- [Commits](https://github.com/protocolbuffers/protobuf/compare/v3.19.1...v3.19.2)

---
updated-dependencies:
- dependency-name: com.google.protobuf:protobuf-java
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-02-25 14:30:28 -08:00
Yu Zeng
fda91d9070 Preparing for release 2.3.10 2022-01-04 11:21:06 -08:00
Yu Zeng
a3e51d5595 Update the warning when lease taker failed to fetch the latest state of the lease 2022-01-04 10:34:27 -08:00
Yu Zeng
72aeac3819 Change log level from debug to warn when update stale leases 
Change log level from debug to warn when update stale leases
 2022-01-04 10:34:27 -08:00
Renju Radhakrishnan
a323272a97 Get latest counter before attempting a take to ensure take succeeds 2022-01-04 10:34:27 -08:00