sticky

Documentation

Overview

Package sticky provides sticky partitioning strategy for Kafka, with a complete overhaul to be faster, more understandable, and optimal.

For some points on how Java's strategy is flawed, see https://github.com/IBM/sarama/pull/1416/files/b29086bdaae0da7ce71eae3f854d50685fd6b631#r315005878

Index

• type GroupMember
• type Plan
  • func Balance(members []GroupMember, topics map[string]int32) Plan

Types

type GroupMember

type GroupMember struct {
	ID          string
	Topics      []string
	UserData    []byte
	Owned       []kmsg.ConsumerMemberMetadataOwnedPartition
	Generation  int32
	Cooperative bool
}

GroupMember is a Kafka group member.

type Plan

type Plan map[string]map[string][]int32

Plan is the plan this package came up with (member => topic => partitions).

func Balance

func Balance(members []GroupMember, topics map[string]int32) Plan

Balance performs sticky partitioning for the given group members and topics, returning the determined plan.