tensormpi

README

tensormpi: Message Passing Interface

The tensormpi package has methods to support use of MPI with tensor and table data structures, using the mpi package for Go mpi wrappers.

As documented in the mpi package, You must set the mpi or mpich build tag to actually have it build using the mpi library. The default is to build a dummy version that has 1 proc of rank 0 always, and nop versions of all the methods.

The code here is not build tag conditionalized, but is harmless for the default 1 processor case.

Supported functionality:

• GatherTensorRows, GatherTableRows: Gathering table.Table and tensor.Tensor data across processors.

• RandCheck checks that the current random number generated across different processors is the same, which is often needed.

• AllocN allocates n items to process across mpi processors.

Documentation

Overview

Package tensormpi has methods to support use of MPI with tensor and table data structures.

Index

• func AllocN(n int) (st, end int, err error)
• func GatherTableRows(dest, src *table.Table, comm *mpi.Comm)
• func GatherTensorRows(dest, src tensor.Tensor, comm *mpi.Comm) error
• func GatherTensorRowsString(dest, src *tensor.String, comm *mpi.Comm) error
• func RandCheck(comm *mpi.Comm) error
• func ReduceTable(dest, src *table.Table, comm *mpi.Comm, op mpi.Op)
• func ReduceTensor(dest, src tensor.Tensor, comm *mpi.Comm, op mpi.Op) error

Functions

func AllocN

func AllocN(n int) (st, end int, err error)

Alloc allocates n items to current mpi proc based on WorldSize and WorldRank. Returns start and end (exclusive) range for current proc.

func GatherTableRows

func GatherTableRows(dest, src *table.Table, comm *mpi.Comm)

GatherTableRows does an MPI AllGather on given src table data, gathering into dest. dest will have np * src.Rows Rows, filled with each processor's data, in order. dest must be a clone of src: if not same number of cols, will be configured from src.

func GatherTensorRows

func GatherTensorRows(dest, src tensor.Tensor, comm *mpi.Comm) error

GatherTensorRows does an MPI AllGather on given src tensor data, gathering into dest, using a row-based tensor organization (as in an table.Table). dest will have np * src.Rows Rows, filled with each processor's data, in order. dest must have same overall shape as src at start, but rows will be enforced.

func GatherTensorRowsString

func GatherTensorRowsString(dest, src *tensor.String, comm *mpi.Comm) error

GatherTensorRowsString does an MPI AllGather on given String src tensor data, gathering into dest, using a row-based tensor organization (as in an table.Table). dest will have np * src.Rows Rows, filled with each processor's data, in order. dest must have same overall shape as src at start, but rows will be enforced.

func RandCheck

func RandCheck(comm *mpi.Comm) error

RandCheck checks that the current random numbers generated across each MPI processor are identical.

func ReduceTable

func ReduceTable(dest, src *table.Table, comm *mpi.Comm, op mpi.Op)

ReduceTable does an MPI AllReduce on given src table data using given operation, gathering into dest. each processor must have the same table organization -- the tensor values are just aggregated directly across processors. dest will be a clone of src if not the same (cos & rows), does nothing for strings.

func ReduceTensor

func ReduceTensor(dest, src tensor.Tensor, comm *mpi.Comm, op mpi.Op) error

ReduceTensor does an MPI AllReduce on given src tensor data, using given operation, gathering into dest. dest must have same overall shape as src -- will be enforced. IMPORTANT: src and dest must be different slices! each processor must have the same shape and organization for this to make sense. does nothing for strings.