go-kafka

command module
v0.0.0-...-c4b8a4c Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Apr 21, 2015 License: Apache-2.0 Imports: 8 Imported by: 0

README

go-kafka

Quick up and running using Go for Apache Kafka

Use Vagrant to get up and running.

  1. Install Vagrant http://www.vagrantup.com/
  2. Install Virtual Box https://www.virtualbox.org/

In the main kafka folder

  1. vagrant up
  2. vagrant ssh brokerOne
  3. cd /vagrant
  4. sudo ./test.sh

once this is done

  • Zookeeper will be running 192.168.86.5
  • Broker 1 on 192.168.86.10
  • All the tests in github.com/stealthly/go-kafka/test/* should pass

You can access the brokers and zookeeper by their IP from your local without having to go into vm.

e.g.

bin/kafka-console-producer.sh --broker-list 192.168.86.10:9092 --topic get this from the random topic created in test

bin/kafka-console-consumer.sh --zookeeper 192.168.86.5:2181 --topic get this from the random topic created in test --from-beginning

Scala Go ping-pong client

If there is an API break, godep provides facilities for building and running the provided dependency snapshot (godep save). To leverage this, simply prepend all go commands with godep to run them inside a sandbox. Example:

# Run Go ping-pong client
godep go run scala_go_kafka.go go-topic scala-topic

Documentation

The Go Gopher

There is no documentation for this package.

Directories

Path Synopsis
Godeps
_workspace/src/code.google.com/p/go-uuid/uuid
The uuid package generates and inspects UUIDs.
The uuid package generates and inspects UUIDs.
_workspace/src/code.google.com/p/snappy-go/snappy
Package snappy implements the snappy block-based compression format.
Package snappy implements the snappy block-based compression format.
_workspace/src/github.com/Shopify/sarama
Package sarama provides client libraries for the Kafka 0.8 protocol.
Package sarama provides client libraries for the Kafka 0.8 protocol.
_workspace/src/github.com/cihub/seelog
Package seelog implements logging functionality with flexible dispatching, filtering, and formatting.
Package seelog implements logging functionality with flexible dispatching, filtering, and formatting.
_workspace/src/github.com/eapache/go-resiliency/breaker
Package breaker implements the circuit-breaker resiliency pattern for Go.
Package breaker implements the circuit-breaker resiliency pattern for Go.
_workspace/src/github.com/rcrowley/go-metrics
Go port of Coda Hale's Metrics library <https://github.com/rcrowley/go-metrics> Coda Hale's original work: <https://github.com/codahale/metrics>
Go port of Coda Hale's Metrics library <https://github.com/rcrowley/go-metrics> Coda Hale's original work: <https://github.com/codahale/metrics>
Metrics output to StatHat.
_workspace/src/github.com/stealthly/go_kafka_client
Package go_kafka_client provides a high-level Kafka consumer implementation and introduces different approach than Java/Scala high-level consumer.
Package go_kafka_client provides a high-level Kafka consumer implementation and introduces different approach than Java/Scala high-level consumer.
_workspace/src/github.com/stealthly/go_kafka_client/syslog/syslog_proto
Package syslog_proto is a generated protocol buffer package.
Package syslog_proto is a generated protocol buffer package.
package producer provides simplified usage of Kafka producers build on top of https://github.com/Shopify/sarama
package producer provides simplified usage of Kafka producers build on top of https://github.com/Shopify/sarama

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL