event-shuttle

command module
v0.0.0-...-0f5cdac Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: May 4, 2015 License: MIT Imports: 22 Imported by: 0

README

event-shuttle

goal: unix system service that collects events and reliably delivers them to kafka, relieving other services on the same system from having to do so.

journals events through bolt-db so that in the event of an kafka outage, events can still be accepted, and will be delivered when kafka becomes available.

  • listens on 127.0.0.1:3887, rest-api is POST /:topic -d message
  • journals events to bolt db.
  • discovers brokers via netflix exhibitor, or a seed broker list.
  • delivers events to kafka.
 event-shuttle --help
Usage of event-shuttle:
  -brokers="": comma seperated list of ip:port to use as seed brokers
  -db="events.db": name of the boltdb database file
  -debug=false: start a pprof http server on 6060
  -exhibitor=false: use EXHIBITOR_URL from env to lookup seed brokers
  -port="3887": port on which to listen for events

using a broker list

event-shuttle -brokers 1.2.3.4:9092,1.2.3.5:9092

using netflix exhibitor to find brokers

EXHIBITOR_URL=<some httpsUrl with creds> event-shuttle -exhibitor=true

Documentation

The Go Gopher

There is no documentation for this package.

Directories

Path Synopsis
Godeps
_workspace/src/code.google.com/p/snappy-go/snappy
Package snappy implements the snappy block-based compression format.
Package snappy implements the snappy block-based compression format.
_workspace/src/github.com/Shopify/sarama
Package sarama provides client libraries for the Kafka 0.8 protocol.
Package sarama provides client libraries for the Kafka 0.8 protocol.
_workspace/src/github.com/bmizerany/pat
Package pat implements a simple URL pattern muxer
Package pat implements a simple URL pattern muxer
_workspace/src/github.com/boltdb/bolt
Package bolt implements a low-level key/value store in pure Go.
Package bolt implements a low-level key/value store in pure Go.
_workspace/src/github.com/kr/pretty
Package pretty provides pretty-printing for Go values.
Package pretty provides pretty-printing for Go values.
_workspace/src/github.com/kr/text
Package text provides rudimentary functions for manipulating text in paragraphs.
Package text provides rudimentary functions for manipulating text in paragraphs.
_workspace/src/github.com/kr/text/colwriter
Package colwriter provides a write filter that formats input lines in multiple columns.
Package colwriter provides a write filter that formats input lines in multiple columns.
_workspace/src/github.com/kr/text/mc
Command mc prints in multiple columns.
Command mc prints in multiple columns.
_workspace/src/github.com/sclasen/sarama
Package sarama provides client libraries for the Kafka 0.8 protocol.
Package sarama provides client libraries for the Kafka 0.8 protocol.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL