kafkautil

README

kafkautil

This repo holds several utilities that can be useful if you use Go and Goka for stream processing with Apache Kafka on Confluent Platform.

Documentation

Index

• func MurmurHasher() hash.Hash32
• func NewJVMCompatiblePartitioner(topic string) sarama.Partitioner
• type CodecWrapper
  • func NewCodecWrapper(rc schemaRegisterer) CodecWrapper

Functions

func MurmurHasher

func MurmurHasher() hash.Hash32

MurmurHasher creates murmur2 hasher implementing hash.Hash32 interface. The implementation is not full and does not support streaming. It only implements the interface to comply with sarama.NewCustomHashPartitioner signature. But Sarama only uses Write method once, when writing keys and values of the message, so streaming support is not necessary.

func NewJVMCompatiblePartitioner

func NewJVMCompatiblePartitioner(topic string) sarama.Partitioner

NewJVMCompatiblePartitioner creates a Sarama partitioner that uses the same hashing algorithm as JVM Kafka clients.

Types

type CodecWrapper

type CodecWrapper interface {
	WrapCodec(c goka.Codec, subject string) goka.Codec
}

CodecWrapper wraps Avro goka.Codec to be compatible with Confluent Schema registry wire format.

func NewCodecWrapper

func NewCodecWrapper(rc schemaRegisterer) CodecWrapper

NewCodecWrapper creates new CodecWrapper using provided Schema Registry client.