luciano/vmware-go-kcl-v2
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
146 commits 18 branches 1 tag 598 KiB
Commit graph

146 commits

This branch
This branch
All branches
Author SHA1 Message Date
vmwjc
8df326e926
Merge 486651702f into f6e79f1a2d 2024-06-20 04:08:02 +00:00
spentakota
f6e79f1a2d
Merge pull request #53 from YakkovHow/main 
fix: support go 1.21 & upgrade dependencies
 2024-03-04 18:07:06 -08:00
Yakkov Leng
3676eb410a fix: support go 1.21 & upgrade dependencies 
Signed-off-by: Yakkov Leng <yleng@vmware.com>
 2024-03-04 17:56:27 -08:00
John Calixto
486651702f fix: Move getRecords stop condition checking to top of loop 
Added tests to validate coordination of the lease renewal with the
record getting and processing routines. This brought to light the value
of checking the loop's "stop conditions" early in the loop instead of at
the end.

Signed-off-by: John Calixto <jcalixto@vmware.com>
 2023-04-08 12:03:24 -07:00
John Calixto
ec7c0b6f61 chore: Add test for renewLease 
Signed-off-by: John Calixto <jcalixto@vmware.com>
 2023-04-07 17:43:33 -07:00
spentakota
b12921da23
Merge pull request #37 from vmware/spentakota_passContext 
fix: pass in ctx with cancel for renewLease
 2023-04-06 18:09:16 -07:00
Shiva Pentakota
4482696d95 fix: pass in ctx with cancel for renewLease 
Signed-off-by: Shiva Pentakota <spentakota@vmware.com>
 2023-04-06 17:53:46 -07:00
vmwjc
16c5c53a30
Merge pull request #13 from calebstewart/fix/issue-5-empty-kinesisendpoint 
Automatically resolve default KinesisEndpoint
 2023-04-04 14:40:26 -07:00
vmwjc
f97ba4e3b2
Merge pull request #36 from vmware/clean-up-extra-err-check 
chore: Remove extraneous err check
 2023-04-04 14:21:24 -07:00
John Calixto
c1f6b270ab chore: Remove extraneous err check 
After checking the scan result above this line, checking err here no
longer has any effect.

Signed-off-by: John Calixto <jcalixto@vmware.com>
 2023-04-04 14:15:59 -07:00
vmwjc
6120c11333
Merge pull request #10 from mrmonaghan/fix-infinite-worker-loop 
fixing infinite worker loop
 2023-04-04 14:08:59 -07:00
spentakota
8ecb5b40a2
Merge pull request #35 from vmware/spentakota_retLeaseErr 
fix: return err log in case of ErrLeaseNotAcquired
 2023-04-04 11:21:14 -07:00
Shiva Pentakota
86d70940e6 fix: return err log in case of ErrLeaseNotAcquired 
Signed-off-by: Shiva Pentakota <spentakota@vmware.com>
 2023-04-04 11:17:22 -07:00
spentakota
6516287f6d
Merge pull request #34 from vmware/spentakota_asyncLeaseRenewal 
feat: make lease renewal async
 2023-04-03 15:02:28 -07:00
Shiva Pentakota
4aebaf1ae0 feat: make lease renewal async 
Signed-off-by: Shiva Pentakota <spentakota@vmware.com>
 2023-04-03 14:58:04 -07:00
spentakota
5be0422f33
Merge pull request #32 from vmware/spentakota_overdueShutdown 
fix: add shutdown error case for checkpoint function
 2023-03-30 12:51:49 -07:00
Shiva Pentakota
02d4b44ff6 fix: add shutdown and leaseExpired error cases for checkpoint function 
Signed-off-by: Shiva Pentakota <spentakota@vmware.com>
 2023-03-28 11:46:55 -07:00
cmckelvey-vmware
44f1558847
Merge pull request #31 from vmware/dependabot/go_modules/golang.org/x/sys-0.1.0 
Bump golang.org/x/sys from 0.0.0-20211216021012-1d35b9e2eb4e to 0.1.0
 2023-03-28 10:59:31 -06:00
cmckelvey-vmware
982c468bef
Merge pull request #30 from vmware/dependabot/go_modules/github.com/prometheus/client_golang-1.11.1 
Bump github.com/prometheus/client_golang from 1.11.0 to 1.11.1
 2023-03-28 10:58:45 -06:00
dependabot[bot]
09f0889f28
Bump golang.org/x/sys from 0.0.0-20211216021012-1d35b9e2eb4e to 0.1.0 
Bumps [golang.org/x/sys](https://github.com/golang/sys) from 0.0.0-20211216021012-1d35b9e2eb4e to 0.1.0.
- [Release notes](https://github.com/golang/sys/releases)
- [Commits](https://github.com/golang/sys/commits/v0.1.0)

---
updated-dependencies:
- dependency-name: golang.org/x/sys
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-03-28 16:57:32 +00:00
dependabot[bot]
236412324f
Bump github.com/prometheus/client_golang from 1.11.0 to 1.11.1 
Bumps [github.com/prometheus/client_golang](https://github.com/prometheus/client_golang) from 1.11.0 to 1.11.1.
- [Release notes](https://github.com/prometheus/client_golang/releases)
- [Changelog](https://github.com/prometheus/client_golang/blob/main/CHANGELOG.md)
- [Commits](https://github.com/prometheus/client_golang/compare/v1.11.0...v1.11.1)

---
updated-dependencies:
- dependency-name: github.com/prometheus/client_golang
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-03-28 16:56:55 +00:00
spentakota
61a027efef
Merge pull request #29 from vmware/fix-token-bucket-edge-cases 
fix: Check token bucket corner cases correctly.
 2023-03-23 12:46:42 -07:00
John Calixto
987fada9d3 fix: Check token bucket corner cases correctly. 
Signed-off-by: John Calixto <jcalixto@vmware.com>
 2023-03-23 11:23:35 -07:00
spentakota
711b72932a
Merge pull request #27 from vmware/spentakota_AddLogs 
chore: add info logs in sleep case for kinesis backoff errors
 2023-03-22 14:43:58 -07:00
Shiva Pentakota
a7c063b99c chore: add info logs in sleep case for kinesis backoff errors 
Signed-off-by: Shiva Pentakota <spentakota@vmware.com>
 2023-03-22 12:22:26 -07:00
spentakota
bce4dd3f42
Merge pull request #24 from vmware/spentakota_fixNanoBug 
fix: use nanosecond precision in lease comparisons
 2023-02-14 10:30:14 -08:00
Shiva Pentakota
df16ef451c fix: use nanosecond precision in lease comparisons 
Signed-off-by: Shiva Pentakota <spentakota@vmware.com>
 2023-02-13 17:56:11 -08:00
spentakota
fb17ec8bc6
Merge pull request #23 from vmware/spentakota_filNilError 
fix: add check for GetRecords error within callGetRecordsAPI
 2023-02-01 08:10:38 -08:00
Shiva Pentakota
04c5062ace fix: add check for GetRecords error within callGetRecordsAPI 
Signed-off-by: Shiva Pentakota <spentakota@vmware.com>
 2023-02-01 08:00:49 -08:00
spentakota
c43491f922
Merge pull request #22 from vmware/spentakota/changeLogMessage 
chore: log RemoveLeaseOwner errors with debug instead of error
 2023-01-31 10:21:31 -08:00
Shiva Pentakota
f879712f9d chore: log RemoveLeaseOwner errors with debug instead of error 
Signed-off-by: Shiva Pentakota <spentakota@vmware.com>
 2023-01-31 10:18:15 -08:00
spentakota
42881449ce
Merge pull request #21 from vmware/spentakota_callGetRecordsAPI 
fix: Handle ProvisionedThroughputExceededException throttling
 2023-01-24 17:12:39 -08:00
Shiva Pentakota
7d6b1c33d0 fix: add maxBytes per second getRecord check 
Signed-off-by: Shiva Pentakota <spentakota@vmware.com>
 2023-01-24 16:28:22 -08:00
Shiva Pentakota
b5515931d1 fix: add hard cap maxRetries for getRecord errors 
Signed-off-by: Shiva Pentakota <spentakota@vmware.com>
 2023-01-24 14:09:02 -08:00
Shiva Pentakota
66006caf89 fix: add getRecords TPS rate limiting 
Signed-off-by: Shiva Pentakota <spentakota@vmware.com>
 2023-01-24 11:56:29 -08:00
spentakota
981dc2df11
Merge pull request #20 from vmware/jc/testable-getRecords 
Refactor in prep for testing rate limiting improvements
 2023-01-23 18:52:10 -08:00
John Calixto
3be57e8a74 Refactor in prep for testing rate limiting improvements 
Signed-off-by: John Calixto <jcalixto@vmware.com>
 2023-01-23 17:32:27 -08:00
spentakota
5e7aca6ab2
Merge pull request #18 from vmware/spentakota_deleteMetricMillis 
fix: add DeleteMetricMillisBehindLatest for error case
 2023-01-20 13:29:25 -08:00
Shiva Pentakota
599aa06ecd fix: add DeleteMetricMillisBehindLatest for error case 
Signed-off-by: Shiva Pentakota <spentakota@vmware.com>
 2023-01-20 13:23:02 -08:00
spentakota
c5bc6c4ded
Merge pull request #17 from vmware/spentakota/sendLeaseRenewedMetric 
feat: Sending renewed lease metric
 2023-01-12 11:56:21 -08:00
Shiva Pentakota
e1425047a7 feat: Sending renewed lease metric 
Signed-off-by: Shiva Pentakota <spentakota@vmware.com>
 2023-01-12 11:31:16 -08:00
spentakota
4afa8fec3e
Merge pull request #16 from vmware/spentakota_catchNilErrorSyncLeases 
fix: catch DynamoDB Scan error when trying to scan nonexistent table or index
 2022-12-19 08:34:02 -08:00
Shiva Pentakota
09cc5896e9 chore: Adding periods to copyright comment to satisfy gofmt 
Signed-off-by: Shiva Pentakota <spentakota@vmware.com>
 2022-12-16 19:03:29 -05:00
Shiva Pentakota
08b7fd9447 fix: catch DynamoDB Scan error when trying to scan nonexistent table/index in syncLeases() 
Signed-off-by: Shiva Pentakota <spentakota@vmware.com>
 2022-12-16 18:07:22 -05:00
Caleb Stewart
e2a45c53c3 Automatically resolve default KinesisEndpoint 
This commit fixes #5 by returning `aws.EndpointNotFoundError` from the
endpoint resolver when no `KinesisEndpoint` is defined, which will
resolve the default AWS endpoint. This is the same process used by the
DynamoDB checkpointer to resolve the default endpoint.

Signed-off-by: Caleb Stewart <caleb.stewart94@gmail.com>
 2022-10-13 13:37:51 -04:00
Mike Monaghan
aab08b9050 fixing infinite worker loop 
Signed-off-by: Mike Monaghan <mike_monaghan@live.ca>
 2022-09-13 15:31:16 -06:00
Tao Jiang
c862165130
Update README.md 2022-01-06 20:24:58 -06:00
Fabiano Arruda
c19ae1d605
Feature/fabiano commits (#2) 
* use cammel case

Signed-off-by: Fabiano Graças <fabiano.gracas@faro.com>

* fix credential usage

Signed-off-by: Fabiano Graças <fabiano.gracas@faro.com>

* apply lint against MD file

Signed-off-by: Fabiano Graças <fabiano.gracas@faro.com>

* upgrade versions

Signed-off-by: Fabiano Graças <fabiano.gracas@faro.com>

* remove calls to deprecated functions.

Signed-off-by: Fabiano Graças <fabiano.gracas@faro.com>

* fix cammel case usage

Signed-off-by: Fabiano Graças <fabiano.gracas@faro.com>

* since deaggregation package was upgraded to sdk v2 makes sense to use it.

https://github.com/awslabs/kinesis-aggregation/pull/143#issuecomment-953308464
Signed-off-by: Fabiano Graças <fabiano.gracas@faro.com>

* fix format

Signed-off-by: Fabiano Graças <fabiano.gracas@faro.com>

Co-authored-by: Fabiano Graças <fabiano.gracas@faro.com>
 2022-01-06 20:13:32 -06:00
Tao Jiang
c02b7a85d4 Update unit tests 
Signed-off-by: Tao Jiang <taoj@vmware.com>
 2021-12-22 22:16:06 -06:00
Tao Jiang
86cc5a1a64 Update the libray reference path to new repo 
Signed-off-by: Tao Jiang <taoj@vmware.com>
 2021-12-21 13:49:47 -06:00