dedupe

Documentation

Overview

Package dedupe implements in-process event deduplication.

Index

• type Deduplicator
• type Item
  • func (i Item) Key() string

Types

type Deduplicator

type Deduplicator interface {
	// IsUnique checks if an event is unique AND adds it to the deduplication index.
	// TODO: deprecate or rename IsUnique
	IsUnique(ctx context.Context, namespace string, ev event.Event) (bool, error)
	// CheckUnique checks if an item is unique.
	CheckUnique(ctx context.Context, item Item) (bool, error)
	// Set adds the item(s) to the deduplicator
	Set(ctx context.Context, events ...Item) error
}

Deduplicator checks if an event is unique.

type Item

type Item struct {
	Namespace string
	ID        string
	Source    string
}

func (Item) Key

func (i Item) Key() string