kfk

README

相关术语：

Broker

Kafka集群包含一个或多个服务器，这种服务器被称为broker

Topic

每条发布到Kafka集群的消息都有一个类别，这个类别被称为Topic。（物理上不同Topic的消息分开存储，逻辑上一个Topic的消息虽然保存于一个或多个broker上但用户只需指定消息的Topic即可生产或消费数据而不必关心数据存于何处）

Partition

Partition是物理上的概念，每个Topic包含一个或多个Partition.

Producer

负责发布消息到Kafka broker

Consumer

消息消费者，向Kafka broker读取消息的客户端。

Consumer Group

每个Consumer属于一个特定的Consumer Group（可为每个Consumer指定group name，若不指定group name则属于默认的group）。

golang连接kafka有三种client认证方式：

1、无认证
2、TLS认证
3、SASL/PLAIN认证, (其他SASL/SCRAM, SASL/GSSAPI都不支持)

go-client

https://github.com/Shopify/sarama

server https://github.com/apache/kafka

Documentation

Index

• type KafkaAsyncProducer
  • func NewAsyncProducer(config *KafkaConfig) (*KafkaAsyncProducer, error)
  • func (p *KafkaAsyncProducer) Send()
• type KafkaConfig
• type KafkaSyncProducer
  • func NewKafkaProducer(config *KafkaConfig) (*KafkaSyncProducer, error)
  • func (p *KafkaSyncProducer) Send(topic, msg string)

Types

type KafkaAsyncProducer

type KafkaAsyncProducer struct {
	// contains filtered or unexported fields
}

KafkaAsyncProducer async producer

func NewAsyncProducer

func NewAsyncProducer(config *KafkaConfig) (*KafkaAsyncProducer, error)

func (*KafkaAsyncProducer) Send

func (p *KafkaAsyncProducer) Send()

type KafkaConfig

type KafkaConfig struct {
	Brokers       []string
	RetryMax      int
	ReturnSuccess bool
}

type KafkaSyncProducer

type KafkaSyncProducer struct {
	// contains filtered or unexported fields
}

KafkaSyncProducer sync producer

func NewKafkaProducer

func NewKafkaProducer(config *KafkaConfig) (*KafkaSyncProducer, error)

func (*KafkaSyncProducer) Send

func (p *KafkaSyncProducer) Send(topic, msg string)