par

Documentation

Index

• func Map[T, O any, WorkerState any](iter iter.Seq[T], f func(T, *WorkerState) O) iter.Seq[O]
• func MapOpt[T, O any, WorkerState any](opts MapOpts, iter iter.Seq[T], f func(T, *WorkerState) O) iter.Seq[O]
• type MapOpts

Functions

func Map

func Map[T, O any, WorkerState any](
	iter iter.Seq[T],
	f func(T, *WorkerState) O,
) iter.Seq[O]

Runs the map function parallelized over the values in the input iterator. It does batching to reduce scheduler and channel overhead. Inspired by Rust's rayon's par_iter. It does not do dynamic chunk sizing (yet). You must completely consume the output iterator.

func MapOpt

func MapOpt[T, O any, WorkerState any](
	opts MapOpts,
	iter iter.Seq[T],
	f func(T, *WorkerState) O,
) iter.Seq[O]

Runs the map function parallelized over the values in the input iterator. It does batching to reduce scheduler and channel overhead. Inspired by Rust's rayon's par_iter. It does not do dynamic chunk sizing (yet). You must completely consume the output iterator.

Types

type MapOpts

type MapOpts struct {
	// How many items to group up to submit to workers at a time.
	BatchSize int
	// Just feed the input directly into the output, no workers.
	Sequential bool
}