deaggregator

README

Temporary Deaggregator

Upgrading to aws-sdk-go-v2 was blocked on a PR to introduce a new Deaggregator: https://github.com/awslabs/kinesis-aggregation/pull/143/files

Once that PR is merged I'll remove this code and pull in the awslabs/kinesis-aggregation repo.

Documentation

Overview

Copyright Amazon.com, Inc. or its affiliates. All Rights Reserved. SPDX-License-Identifier: Apache-2.0

Index

• Constants
• Variables
• func DeaggregateRecords(records []*types.Record) ([]*types.Record, error)

Constants

const (
	KplMagicLen = 4  // Length of magic header for KPL Aggregate Record checking.
	DigestSize  = 16 // MD5 Message size for protobuf.
)

Variables

var KplMagicHeader = fmt.Sprintf("%q", []byte("\xf3\x89\x9a\xc2"))

Magic File Header for a KPL Aggregated Record

Functions

func DeaggregateRecords

func DeaggregateRecords(records []*types.Record) ([]*types.Record, error)

DeaggregateRecords takes an array of Kinesis records and expands any Protobuf records within that array, returning an array of all records