kafka

Documentation

Index

• func MurmurHasher() hash.Hash32
• func NewConsumer(from string, brokers []string, consumerGroup string) *cluster.Consumer
• func NewJVMCompatiblePartitioner(topic string) sarama.Partitioner
• func NewProducer(brokers []string, hasher, compressionType string) sarama.AsyncProducer

Functions

func MurmurHasher

func MurmurHasher() hash.Hash32

MurmurHasher creates murmur2 hasher implementing hash.Hash32 interface. The implementation is not full and does not support streaming. It only implements the interface to comply with sarama.NewCustomHashPartitioner signature. But Sarama only uses Write method once, when writing keys and values of the message, so streaming support is not necessary.

func NewConsumer

func NewConsumer(from string, brokers []string, consumerGroup string) *cluster.Consumer

NewConsumer configures and returns a cluster-consumer

func NewJVMCompatiblePartitioner

func NewJVMCompatiblePartitioner(topic string) sarama.Partitioner

NewJVMCompatiblePartitioner creates a Sarama partitioner that uses the same hashing algorithm as JVM Kafka clients.

func NewProducer

func NewProducer(brokers []string, hasher, compressionType string) sarama.AsyncProducer

NewProducer configures and returns an async producer