luciano/amazon-kinesis-client-go
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
137 commits 11 branches 1 tag 8.2 MiB
Commit graph

137 commits

This branch
This branch
All branches
Author SHA1 Message Date
Rafael Garcia
aeb8af04e8 parse fargate logs 2019-02-25 20:52:52 +00:00
Xavi
2b62c6cbb1
Merge pull request #37 from Clever/INFRA-3343-rm-awscli-install-amazon-kinesis-client-go 
Removed unneeded "Install awscli for ECR publish" command
 2019-01-09 14:55:35 -08:00
Xavi Ramirez
df71c27e6f Removed unneeded "Install awscli for ECR publish" command 2019-01-08 18:40:29 -08:00
Xavi
a975ca3c3b
Merge pull request #36 from Clever/add-err-msg 
Added error message for failed log written to file
 2018-12-11 16:43:26 -08:00
Xavi Ramirez
e80ff2239b Added error message for failed log written to file 2018-12-11 16:32:33 -08:00
Xavi
23c68b42ff
Merge pull request #33 from wwwjfy/fix-shutdown-requested 
Fix shutdown requested
 2018-12-11 16:28:37 -08:00
Xavi
7351346041
Merge pull request #35 from wwwjfy/fix-checkpoint 
fix periodic checkpoint not triggered
 2018-12-11 16:23:51 -08:00
Xavi
6bb489ab5b
Merge pull request #34 from wwwjfy/kcl-v2-format 
fix incompatible Record struct in KCL v2
 2018-12-11 16:22:57 -08:00
Tony Wang
2f722d9cd2
fix periodic checkpoint not triggered 
when initialized, largestPair is empty and IsLessThan always return
false
 2018-11-09 15:08:47 +08:00
Tony Wang
c3ff544d00
fix incompatible Record struct in KCL v2 2018-10-18 16:43:58 +08:00
Tony Wang
06838386db
fix review comments 2018-10-18 15:50:44 +08:00
Tony Wang
e7b75a20ac
handle shutdown requested message 
Message type shutdownRequested doesn't have reason, which causes
checkpoint on termination not work.
This commit is to ask KCL daemon to checkpoint on shutdownRequested.
 2018-10-14 18:29:17 +08:00
Tony Wang
c86a5da722
remove not in use statements 2018-10-14 17:55:46 +08:00
Nate
33d58bc6e0
Merge pull request #32 from Clever/SYNC-859 2018-10-11 15:40:18 -07:00
Nate Brennand
dd22f519be update golang.mk 2018-10-11 12:39:00 -07:00
Xavi
42fba675bb
Merge pull request #31 from Clever/fix-type-o 
Fixed type-o: guage -> gauge
 2018-10-05 15:38:04 -07:00
Xavi
c4712bd220
Fixed type-o: guage -> gauge 2018-10-05 15:31:48 -07:00
Xavi
dbc3002d02
Merge pull request #30 from Clever/INFRA-3186-circleci-2 
[INFRA-3186] autotranslate CircleCI 1.0 -> 2.0
 2018-08-17 15:44:57 -07:00
Brianna Veenstra
31eeb34fdc [INFRA-3186] autotranslate CircleCI 1.0 -> 2.0 2018-08-17 15:21:41 -07:00
Xavi
92ce9be607
Merge pull request #29 from Clever/initialize-method 
Added initialize method to sender
 2018-08-09 16:48:43 -07:00
Xavi Ramirez
e5850f1464 Added Initialize method to sender 2018-08-09 16:43:30 -07:00
Xavi Ramirez
df698f34aa Updated golang.mk to v0.3.8 2018-08-09 16:32:10 -07:00
renato
e377f46b69
Merge pull request #28 from Clever/go1.10 2018-05-23 16:33:11 -07:00
Renato
167c524fb2 golang upgrade 2018-05-18 15:54:07 -07:00
Xavi
6e45fa518b
Merge pull request #27 from Clever/more-reserve-fields 
Added timestamp, hostname, and rawlog to list of reserved fields
 2018-05-10 17:09:07 -07:00
Xavi Ramirez
8f2ad09efa Added timestamp, hostname, and rawlog to list of reserved fields 2018-05-10 23:56:32 +00:00
Xavi Ramirez
74634a6bf0 Added decoder_msg_type field to logs parsed by syslog 2018-05-10 23:56:14 +00:00
Rafael
3ded2fcd2d
Merge pull request #26 from Clever/INFRA-2824 
fix lambda -> rsyslog message conversion to always have a task ID
 2018-03-13 09:55:55 -07:00
Rafael Garcia
ad2ef687bb fix lambda -> rsyslog message conversion to always have a task ID 2018-03-13 16:48:41 +00:00
Nathan Leiby
4858074bb7
Merge pull request #25 from Clever/IL-200-remove-self-reference 2018-02-16 14:42:40 -08:00
Nathan Leiby
267b28a032 Remove self-references in Gopkg.toml 
Issue: https://clever.atlassian.net/browse/IL-200

We accidentally introduced self-references into some Gopkg.toml files.
Let's remove them!

More context: https://github.com/golang/dep/issues/1690
 2018-02-16 14:24:35 -08:00
Nathan Leiby
44a89a1685
Merge pull request #24 from Clever/IL-200-remove-self-reference 
Remove self-references in Gopkg.toml
 2018-02-16 14:17:23 -08:00
Nathan Leiby
b0196cf7b0 Remove self-references in Gopkg.toml 
Issue: https://clever.atlassian.net/browse/IL-200

We accidentally introduced self-references into some Gopkg.toml files.
Let's remove them!

More context: https://github.com/golang/dep/issues/1690
 2018-02-16 13:14:07 -08:00
Rafael
bfe2ac0f6d
Merge pull request #23 from Clever/INFRA-2764 
handle logs coming in from lambda functions
 2018-01-25 15:15:10 -08:00
Rafael Garcia
c255bf87f3 add test for default case 2018-01-25 15:13:11 +00:00
Rafael Garcia
10750e802b handle logs coming in from lambda functions 2018-01-25 01:23:03 +00:00
Nate
7d863db172
Merge pull request #22 from Clever/SYNC-114-go-1.9-upgrade 2017-11-09 08:48:35 -08:00
Nate Brennand
2a4e6fcc71 upgrade to 1.9 and convert to dep 2017-11-08 09:46:29 -08:00
Rafael
ebf2e2dc98
Merge pull request #21 from Clever/only-send-failed-log-lines-to-file 
write errors to stderr, failed log lines to file
 2017-11-03 11:05:31 -07:00
Rafael Garcia
7b18d1bab4 write failed log message to file 2017-11-03 18:03:39 +00:00
Rafael Garcia
945ed317c2 remove logger as parameter 2017-11-03 17:48:50 +00:00
Rafael Garcia
221743b3e2 write errors to stderr 2017-11-02 21:50:46 +00:00
Xavi
94aacdf833 Merge pull request #19 from Clever/rm-params-from-decoder 
Removed stringifyNested, renameESReservedFields, and minimumTimestamp params from decoder
 2017-09-26 14:53:56 -07:00
Xavi Ramirez
2ecbc081cd Removed stringifyNested, renameESReservedFields, and minimumTimestamp params from decoder. minimumTimestamp isn't needed anymore. stringifyNested and renameESReservedFields are very specific to the elasticsearch consumer and will be moved to the elasticsearch consumer. 2017-09-21 19:51:48 +00:00
Xavi
8d871591de Merge pull request #18 from Clever/fix-shutdown 
Fix shutdown
 2017-09-21 10:58:25 -07:00
Nathan Leiby
81fbb957c4 Merge pull request #17 from Clever/INFRA-2521-update-log-stream-parsing 
splitter: update log stream parsing
 2017-09-20 14:30:23 -07:00
Xavi Ramirez
b07ad4c1c2 Cleaned up shutdown code 2017-09-20 21:28:43 +00:00
Nathan Leiby
efa90d4481 splitter: update log stream parsing 
AWS changed the format of the log stream for AWS Batch logs. This
reflects that change.

---

http://docs.aws.amazon.com/batch/latest/userguide/job_states.html

Logs for RUNNING jobs are available in CloudWatch Logs; the log group is /aws/batch/job, and the log stream name format is jobDefinitionName/default/ecs_task_id (this format may change in the future).
After a job reaches the RUNNING status, you can programmatically retrieve its log stream name with the DescribeJobs API operation. For more information, see View Log Data Sent to CloudWatch Logs in the Amazon CloudWatch Logs User Guide. By default, these logs are set to never expire, but you can modify the retention period. For more information, see Change Log Data Retention in CloudWatch Logs in the Amazon CloudWatch Logs User Guide.
 2017-09-20 14:18:35 -07:00
Xavi Ramirez
7f2afe9d8f Send nil showdown signal immediately 2017-09-20 04:58:40 +00:00
mohit
32d4d33f00 Merge pull request #16 from Clever/always-log-counter-stats 
DefaultCounters to log 0 for counter stats
 2017-09-13 12:24:01 -07:00