sharding

Documentation

Index

• Constants
• func NewSharder(roots []ipld.Link, blocks iterable.Iterator[block.Block], options ...Option) (iterable.Iterator[io.Reader], error)
• func NewSharderFromCAR(reader io.Reader) (iterable.Iterator[io.Reader], error)
• type Option
  • func WithShardSize(size int) Option

Constants

const ShardSize = 133_169_152

https://observablehq.com/@gozala/w3up-shard-size

Functions

func NewSharder

func NewSharder(roots []ipld.Link, blocks iterable.Iterator[block.Block], options ...Option) (iterable.Iterator[io.Reader], error)

func NewSharderFromCAR

func NewSharderFromCAR(reader io.Reader) (iterable.Iterator[io.Reader], error)

Types

type Option

type Option func(cfg *sharderConfig) error

Option is an option configuring a sharder.

func WithShardSize

func WithShardSize(size int) Option

WithShardSize configures the size of the shards - default 133,169,152 bytes.