Commit graph

  • 217999854b Only initialize ddb client if none is provided (#106) Patrik Karlström 2020-01-17 19:02:37 +0100
  • e5ac9128d7 Only initialize ddb client if none is provided Patrik Karlström 2020-01-17 10:17:52 +0100
  • fe00c00557 Add scanInterval option 0livd 2020-01-09 10:49:38 +0100
  • f43d735690 add shardID to scan func Mike McCrary 2019-12-18 14:15:37 -0700
  • f85f25c15e Add an in-memory checkpoint to the API (#103) Andrew Shannon Brown 2019-09-08 13:13:04 -0700
  • cc0fc43a95 Rename test package to store Andrew S. Brown 2019-09-08 06:52:28 -0700
  • a74a986cf9 Rename memory to store Andrew S. Brown 2019-09-07 11:58:46 -0700
  • b3aebf5ab9 Add an in-memory checkpoint to the API Andrew S. Brown 2019-09-04 07:22:44 -0700
  • b87510458e
    Fix example command indentation Harlow Ward 2019-09-02 08:13:08 -0700
  • dfb0faaa87 Add missing code-block highlighting Harlow Ward 2019-09-02 08:11:40 -0700
  • b451fc4cc2 Use stdin for example data reader instead of file path Harlow Ward 2019-09-02 08:08:21 -0700
  • e3ee95b282 Fix typo in context cancellation docs Harlow Ward 2019-09-02 07:47:10 -0700
  • 4c2aaf78a2 Add consumer example without checkpointing Harlow Ward 2019-09-02 07:44:26 -0700
  • 3ae979bf82 Move example consumers under cmd directory Harlow Ward 2019-09-02 07:36:14 -0700
  • 1a141cfbaa
    Move notice above the build status Harlow Ward 2019-09-02 07:30:33 -0700
  • 3a98baa012 Update godoc for allgroup description Harlow Ward 2019-09-02 07:26:44 -0700
  • ed40b5d9b4 Default to kinesalite when running example consumers Harlow Ward 2019-09-02 07:25:07 -0700
  • a252eb38c6 Readme and linter fix (#102) Dimas Yudha P 2019-09-01 08:43:26 +0700
  • 3f2c73db80 update readme.md, fix go badges Dimas Yudha P 2019-09-01 05:52:48 +0700
  • 4abf727f7b update readme.md add Go badges Dimas Yudha P 2019-09-01 05:51:54 +0700
  • 9ca79b145c update readme and fix issue found by linter Dimas Yudha P 2019-09-01 05:48:51 +0700
  • 4b7321e731 update readme.md adding goreport Dimas Yudha P 2019-09-01 05:43:33 +0700
  • 71bbc397e2 An attempt to work around a gopkg.in/module error in a dependency (#100) v0.3.3 Matias Morán Losada 2019-08-31 17:19:23 -0300
  • 3df5dd68ff replace go-sqlmock module to new source in tests Matias Moran Losada 2019-08-21 11:32:08 -0300
  • bbab76ce78 An attempt to work around a gopkg.in/module error in a dependency Matias Moran Losada 2019-08-21 10:47:25 -0300
  • 14db23eaf3 Support creating an iterator with an initial timestamp (#99) Andrew Shannon Brown 2019-08-14 09:33:35 -0700
  • 89b383161a Allow cancelling of request Andrew S. Brown 2019-08-09 08:04:36 -0700
  • cdaa98adfd Fix writing to closed channel Andrew S. Brown 2019-07-16 23:13:01 -0700
  • b37eaf7eec Allow setting initial timestamp Andrew S. Brown 2019-07-16 20:18:28 -0700
  • 81a8ac4221 Allow use of existing Redis client for checkpoint store (#96) Patrick Moore 2019-08-05 15:04:27 -0700
  • e8066c5a9c Allow use of existing Redis client for checkpoint store Patrick Moore 2019-08-05 14:42:53 -0700
  • 35c48ef1c9
    Only retry expired shard iterator errors (#95) Harlow Ward 2019-07-30 19:48:20 -0700
  • 1df9189517 use map for lookup of retriable errors Harlow Ward 2019-07-30 16:44:01 -0700
  • 49b9bfa4e7 Only retry expired shard iterator errors Harlow Ward 2019-07-29 20:31:02 -0700
  • 5da0865ac1 Add WithGroup option Harlow Ward 2019-07-28 21:34:54 -0700
  • a9c97d3b93 Update examples to use Store interface Harlow Ward 2019-07-28 21:33:19 -0700
  • d2cf65fa7a Update Redis library version Harlow Ward 2019-07-28 21:27:28 -0700
  • 00b5f64fa7 Clean up storage w/ store for consistency Harlow Ward 2019-07-28 21:20:29 -0700
  • c72f561abd
    Replace Checkpoint with Store interface (#90) Harlow Ward 2019-07-28 21:18:40 -0700
  • 80009ef620 rename checkpoint dir to store Harlow Ward 2019-07-28 21:13:48 -0700
  • c12e801990 give example of setting storage Harlow Ward 2019-07-28 11:21:08 -0700
  • 70e2468665 Update readme w/ storage Harlow Ward 2019-07-28 11:17:27 -0700
  • 8b19674b4a fix rebase errors Harlow Ward 2019-07-28 11:09:43 -0700
  • c690ce2822 Fix WithStorage option Harlow Ward 2019-05-25 12:30:48 -0700
  • 2ffea4027d Fix updated func name in tests Harlow Ward 2019-05-25 12:06:38 -0700
  • 03afda196f Introduce Storage interface Harlow Ward 2019-05-24 19:43:36 -0700
  • d05d6c2d5e Update comments for exported functions Harlow Ward 2019-07-28 10:54:01 -0700
  • 7018c0c47e
    Introduce Group interface and AllGroup (#91) Harlow Ward 2019-06-09 13:42:25 -0700
  • 0328cba5c9 adjust channel ownership for group hw-group-interface Harlow Ward 2019-06-02 17:46:28 -0700
  • 4fd29c54ff rever the no-op checkpoint Harlow Ward 2019-06-02 17:29:22 -0700
  • 2ab5ec4031 revert examples Harlow Ward 2019-06-02 17:26:24 -0700
  • bd42663013 Introduce Group interface and AllGroup Harlow Ward 2019-05-24 19:43:36 -0700
  • 9cd2e57ba4
    Add note about development on Consumer Groups Harlow Ward 2019-05-28 19:52:32 -0700
  • 8f0fb899b7 addressed PR comments, moved some things around to new storage package, separated out lease and moved to storage, created storage.go. kperry 2019-05-27 11:46:44 -0500
  • 32fcced2d3 remove comments kperry 2019-05-23 08:36:32 -0500
  • e8444db852 remove comments kperry 2019-05-22 09:25:46 -0500
  • e2dca428f7 Added some tests kperry 2019-05-21 17:38:07 -0500
  • f3eb53a703 Added condition expressions to ddb for updates and puts. rearranged some of the code in consumergroup to accomodate conditional expressions. Moved the LeaseUpdate from consumergroup to ddb.go - it is only needed by ddb.go, and it is ddb.go specific. Added some comments. kperry 2019-05-20 14:47:55 -0500
  • b47b611696 Initial commit with consumer groups. Still a lot of cleanup and testing to do. kperry 2019-05-19 20:51:40 -0500
  • 8493100b85 Switch to go modules (#88) v0.3.2 keperry 2019-05-06 18:05:39 -0500
  • 225a178e07 Switch to go modules kperry 2019-05-06 17:02:48 -0500
  • b48acfa5d4 Add Mysql support for checkpointing (#87) James Greenhill 2019-04-12 22:15:49 -0700
  • 08fd79b3ae Add Mysql support for checkpoint storage, port tests, and add example for running against mysql James Greenhill 2019-04-12 14:01:36 -0700
  • f7f98a4bc6 Default the consumer library to read from latest Harlow Ward 2019-04-09 22:10:07 -0700
  • 97fe4e66ff
    Use shard broker to monitor and process new shards (#85) Harlow Ward 2019-04-09 22:03:12 -0700
  • 121cbc26f0 add logger to the broker Harlow Ward 2019-04-09 09:33:49 -0700
  • 3e9760ef2f spelling Harlow Ward 2019-04-08 21:27:08 -0700
  • ef4daf97d1 change examples to use AWS_PROFILE Harlow Ward 2019-04-08 21:24:09 -0700
  • 85b200f768 clean up broker Harlow Ward 2019-04-08 20:41:41 -0700
  • 2c5b50ddf8 add comment to broker Harlow Ward 2019-04-08 20:33:39 -0700
  • 27b6049460 note about scan func Harlow Ward 2019-04-08 19:50:11 -0700
  • 9d4caa05dd don't access counter directly Harlow Ward 2019-04-08 19:43:40 -0700
  • d176afa7ec protect counter race condition Harlow Ward 2019-04-08 19:34:47 -0700
  • dbab92f317 Adjust the scan shard tests Harlow Ward 2019-04-08 11:16:09 -0700
  • 7e72723168 Use shard broker to start processing new shards Harlow Ward 2019-01-03 22:46:13 -0800
  • c4f363a517 Example data is in repo, no need to download Harlow Ward 2019-04-07 16:33:47 -0700
  • 76158d24ab
    Introduce ScanFunc signature and remove ScanStatus (#77) Harlow Ward 2019-04-07 16:29:12 -0700
  • 24de74fd14
    Fix the CI and Doc links Harlow Ward 2019-02-18 11:10:02 -0800
  • b1d49ff58e Fix build images Harlow Ward 2019-02-18 11:09:02 -0800
  • db9668152a remove unreachable code Harlow Ward 2019-02-18 10:37:38 -0800
  • 27f13ed3fc fix merge conflict Harlow Ward 2019-02-18 10:30:37 -0800
  • 4bc414e216 wip Harlow Ward 2019-01-03 19:34:24 -0800
  • 5112f448ac Leverage context cancellation for stopping scan Harlow Ward 2018-12-30 21:54:33 -0800
  • 7d5601fbde Control flow with custom errors types Harlow Ward 2018-12-29 20:54:39 -0800
  • 8fd7675ea4
    Add TravisCI setup (#83) Harlow Ward 2019-02-18 11:05:01 -0800
  • ada1da49da only build master and PRs Harlow Ward 2019-02-18 11:02:36 -0800
  • 0aa351ed6a add travis and docs badges Harlow Ward 2019-02-18 10:59:14 -0800
  • 080b741d7c remove comments Harlow Ward 2019-02-18 10:54:19 -0800
  • 49105f903c repo doesn't have vendor directory Harlow Ward 2019-02-18 10:51:48 -0800
  • cac2958a25 add redis service Harlow Ward 2019-02-18 10:49:28 -0800
  • 63a417a85f remove linting script Harlow Ward 2019-02-18 10:44:59 -0800
  • 0b34ebda08 Add TravisCI setup Harlow Ward 2019-02-18 10:43:15 -0800
  • 245d1bd6b5 change cancel place (#82) v0.3.1 Emanuel Ramos 2019-02-18 15:59:20 +0000
  • 2037463c62 Fix getShardID does not return more than 100 shards (#81) lordfarhan40 2019-02-15 10:15:32 +0530
  • 0a81fa2a35 Using ListShards instead of DescribeStream Farhan 2019-02-12 22:56:03 +0530
  • 249baa2c72 using constants for sharditeratortype instead of string literals Farhan 2019-02-03 13:28:57 +0530
  • 2f0c13ed72 Fix getShardIds Farhan 2019-02-03 13:27:58 +0530
  • 0a132b1b53 change cancel place Emanuel Ramos 2019-01-04 14:52:40 +0000
  • 2f58b136fe Add dummy users data for producing onto stream Harlow Ward 2018-12-30 07:28:18 -0800
  • 4f374e4425 Update example to use new AWS Session Harlow Ward 2018-12-29 10:45:26 -0800