README ¶
TensorFlow in Go
Construct and execute TensorFlow graphs in Go.
WARNING: The API defined in this package is not stable and can change without notice. The same goes for the awkward package path (
github.com/tensorflow/tensorflow/tensorflow/go
).
Quickstart
Refer to Installing TensorFlow for Go
Building the TensorFlow C library from source
If the "Quickstart" instructions above do not work (perhaps the release archives are not available for your operating system or architecture, or you're using a different version of CUDA/cuDNN), then the TensorFlow C library must be built from source.
Prerequisites
-
Environment to build TensorFlow from source code (Linux or OS X). If you don't need GPU support, then try the following:
sudo apt-get install python swig python-numpy # Linux brew install swig # OS X with homebrew
Build
-
Download the source code
go get -d github.com/tensorflow/tensorflow/tensorflow/go
-
Build the TensorFlow C library:
cd ${GOPATH}/src/github.com/tensorflow/tensorflow ./configure bazel build --config opt //tensorflow:libtensorflow.so
This can take a while (tens of minutes, more if also building for GPU).
-
Make
libtensorflow.so
available to the linker. This can be done by either:a. Copying it to a system location, e.g.,
sudo cp ${GOPATH}/src/github.com/tensorflow/tensorflow/bazel-bin/tensorflow/libtensorflow.so /usr/local/lib
OR
b. Setting environment variables:
export LIBRARY_PATH=${GOPATH}/src/github.com/tensorflow/tensorflow/bazel-bin/tensorflow # Linux export LD_LIBRARY_PATH=${GOPATH}/src/github.com/tensorflow/tensorflow/bazel-bin/tensorflow # OS X export DYLD_LIBRARY_PATH=${GOPATH}/src/github.com/tensorflow/tensorflow/bazel-bin/tensorflow
-
Build and test:
go test github.com/tensorflow/tensorflow/tensorflow/go
Generate wrapper functions for ops
Go functions corresponding to TensorFlow operations are generated in op/wrappers.go
. To regenerate them:
Prerequisites:
- Protocol buffer compiler (protoc) 3.x
- The TensorFlow repository under GOPATH
go generate github.com/tensorflow/tensorflow/tensorflow/go/op
Support
Use stackoverflow and/or Github issues.
Contributions
Contributions are welcome. If making any signification changes, probably best to discuss on a Github issue before investing too much time. Github pull requests are used for contributions.
Documentation ¶
Overview ¶
Package tensorflow is a Go binding to TensorFlow.
The API is subject to change and may break at any time.
TensorFlow (www.tensorflow.org) is an open source software library for numerical computation using data flow graphs. This package provides functionality to build and execute such graphs and depends on TensorFlow being available. For installation instructions see https://www.tensorflow.org/code/tensorflow/go/README.md
Index ¶
Examples ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
Types ¶
type DataType ¶
type DataType C.TF_DataType
DataType holds the type for a scalar value. E.g., one slot in a tensor.
const ( Float DataType = C.TF_FLOAT Double DataType = C.TF_DOUBLE Int32 DataType = C.TF_INT32 Uint32 DataType = C.TF_UINT32 Uint8 DataType = C.TF_UINT8 Int16 DataType = C.TF_INT16 Int8 DataType = C.TF_INT8 String DataType = C.TF_STRING Complex64 DataType = C.TF_COMPLEX64 Complex DataType = C.TF_COMPLEX Int64 DataType = C.TF_INT64 Uint64 DataType = C.TF_UINT64 Bool DataType = C.TF_BOOL Qint8 DataType = C.TF_QINT8 Quint8 DataType = C.TF_QUINT8 Qint32 DataType = C.TF_QINT32 Bfloat16 DataType = C.TF_BFLOAT16 Qint16 DataType = C.TF_QINT16 Quint16 DataType = C.TF_QUINT16 Uint16 DataType = C.TF_UINT16 Complex128 DataType = C.TF_COMPLEX128 Half DataType = C.TF_HALF )
Types of scalar values in the TensorFlow type system.
type Device ¶ added in v1.6.0
Device structure contains information about a device associated with a session, as returned by ListDevices()
type Graph ¶
type Graph struct {
// contains filtered or unexported fields
}
Graph represents a computation graph. Graphs may be shared between sessions.
func (*Graph) AddOperation ¶ added in v0.12.0
AddOperation adds an operation to g.
func (*Graph) Import ¶ added in v0.12.0
Import imports the nodes and edges from a serialized representation of another Graph into g.
Names of imported nodes will be prefixed with prefix.
func (*Graph) Operation ¶ added in v0.12.0
Operation returns the Operation named name in the Graph, or nil if no such operation is present.
func (*Graph) Operations ¶ added in v1.5.0
Operations returns a list of all operations in the graph
type Input ¶ added in v0.12.0
type Input interface {
// contains filtered or unexported methods
}
Input is the interface for specifying inputs to an operation being added to a Graph.
Operations can have multiple inputs, each of which could be either a tensor produced by another operation (an Output object), or a list of tensors produced by other operations (an OutputList). Thus, this interface is implemented by both Output and OutputList.
See OpSpec.Input for more information.
type OpSpec ¶ added in v0.12.0
type OpSpec struct { // Type of the operation (e.g., "Add", "MatMul"). Type string // Name by which the added operation will be referred to in the Graph. // If omitted, defaults to Type. Name string // Inputs to this operation, which in turn must be outputs // of other operations already added to the Graph. // // An operation may have multiple inputs with individual inputs being // either a single tensor produced by another operation or a list of // tensors produced by multiple operations. For example, the "Concat" // operation takes two inputs: (1) the dimension along which to // concatenate and (2) a list of tensors to concatenate. Thus, for // Concat, len(Input) must be 2, with the first element being an Output // and the second being an OutputList. Input []Input // Map from attribute name to its value that will be attached to this // operation. Attrs map[string]interface{} // Operations that must be executed before executing the operation // being added. ControlDependencies []*Operation }
OpSpec is the specification of an Operation to be added to a Graph (using Graph.AddOperation).
type Operation ¶
type Operation struct {
// contains filtered or unexported fields
}
Operation that has been added to the graph.
func (*Operation) NumOutputs ¶ added in v0.12.0
NumOutputs returns the number of outputs of op.
func (*Operation) OutputListSize ¶ added in v0.12.0
OutputListSize returns the size of the list of Outputs that is produced by a named output of op.
An Operation has multiple named outputs, each of which produces either a single tensor or a list of tensors. This method returns the size of the list of tensors for a specific output of the operation, identified by its name.
type Output ¶
type Output struct { // Op is the Operation that produces this Output. Op *Operation // Index specifies the index of the output within the Operation. Index int }
Output represents one of the outputs of an operation in the graph. Has a DataType (and eventually a Shape). May be passed as an input argument to a function for adding operations to a graph, or to a Session's Run() method to fetch that output as a tensor.
type OutputList ¶ added in v0.12.0
type OutputList []Output
OutputList represents a list of Outputs that can be provided as input to another operation.
type PartialRun ¶ added in v1.1.0
type PartialRun struct {
// contains filtered or unexported fields
}
PartialRun enables incremental evaluation of graphs.
PartialRun allows the caller to pause the evaluation of a graph, run arbitrary code that depends on the intermediate computation of the graph, and then resume graph execution. The results of the arbitrary code can be fed into the graph when resuming execution. In contrast, Session.Run executes the graph to compute the requested fetches using the provided feeds and discards all intermediate state (e.g., value of intermediate tensors) when it returns.
For example, consider a graph for unsupervised training of a neural network model. PartialRun can be used to pause execution after the forward pass of the network, let the caller actuate the output (e.g., play a game, actuate a robot etc.), determine the error/loss and then feed this calculated loss when resuming the backward pass of the graph.
Example ¶
Output: 3 10
type SavedModel ¶ added in v1.1.0
SavedModel represents the contents of loaded SavedModel. TODO(jhseu): Add and document metagraphdef when we pregenerate protobufs.
func LoadSavedModel ¶ added in v1.1.0
func LoadSavedModel(exportDir string, tags []string, options *SessionOptions) (*SavedModel, error)
LoadSavedModel creates a new SavedModel from a model previously exported to a directory on disk.
Exported models contain a set of graphs and, optionally, variable values. Tags in the model identify a single graph. LoadSavedModel initializes a session with the identified graph and with variables initialized to from the checkpoints on disk.
The tensorflow package currently does not have the ability to export a model to a directory from Go. This function thus currently targets loading models exported in other languages, such as using tf.saved_model.builder in Python. See: https://www.tensorflow.org/code/tensorflow/python/saved_model/
type Session ¶
type Session struct {
// contains filtered or unexported fields
}
Session drives a TensorFlow graph computation.
When a Session is created with a given target, a new Session object is bound to the universe of resources specified by that target. Those resources are available to this session to perform computation described in the GraphDef. After creating the session with a graph, the caller uses the Run() API to perform the computation and potentially fetch outputs as Tensors. A Session allows concurrent calls to Run().
func NewSession ¶
func NewSession(graph *Graph, options *SessionOptions) (*Session, error)
NewSession creates a new execution session with the associated graph. options may be nil to use the default options.
func (*Session) Close ¶
Close a session. This contacts any other processes associated with this session, if applicable. Blocks until all previous calls to Run have returned.
func (*Session) ListDevices ¶ added in v1.6.0
Return list of devices associated with a Session
func (*Session) NewPartialRun ¶ added in v1.1.0
func (s *Session) NewPartialRun(feeds, fetches []Output, targets []*Operation) (*PartialRun, error)
NewPartialRun sets up the graph for incremental evaluation.
All values of feeds, fetches and targets that may be provided to Run calls on the returned PartialRun need to be provided to NewPartialRun.
See documentation for the PartialRun type.
func (*Session) Run ¶
func (s *Session) Run(feeds map[Output]*Tensor, fetches []Output, targets []*Operation) ([]*Tensor, error)
Run the graph with the associated session starting with the supplied feeds to compute the value of the requested fetches. Runs, but does not return Tensors for operations specified in targets.
On success, returns the fetched Tensors in the same order as supplied in the fetches argument. If fetches is set to nil, the returned Tensor fetches is empty.
type SessionOptions ¶
type SessionOptions struct { // Target indicates the TensorFlow runtime to connect to. // // If 'target' is empty or unspecified, the local TensorFlow runtime // implementation will be used. Otherwise, the TensorFlow engine // defined by 'target' will be used to perform all computations. // // "target" can be either a single entry or a comma separated list // of entries. Each entry is a resolvable address of one of the // following formats: // local // ip:port // host:port // ... other system-specific formats to identify tasks and jobs ... // // NOTE: at the moment 'local' maps to an in-process service-based // runtime. // // Upon creation, a single session affines itself to one of the // remote processes, with possible load balancing choices when the // "target" resolves to a list of possible processes. // // If the session disconnects from the remote process during its // lifetime, session calls may fail immediately. Target string // Config is a binary-serialized representation of the // tensorflow.ConfigProto protocol message // (https://www.tensorflow.org/code/tensorflow/core/protobuf/config.proto). Config []byte }
SessionOptions contains configuration information for a session.
type Shape ¶ added in v1.1.0
type Shape struct {
// contains filtered or unexported fields
}
Shape represents the (possibly partially known) shape of a tensor that will be produced by an operation.
The zero-value of a Shape represents a shape with an unknown number of dimensions.
func MakeShape ¶ added in v1.1.0
MakeShape returns a Shape with the provided size of each dimension.
A value of -1 implies that the size of the corresponding dimension is not known.
func ScalarShape ¶ added in v1.1.0
func ScalarShape() Shape
ScalarShape returns a Shape representing a scalar.
func (Shape) IsFullySpecified ¶ added in v1.1.0
IsFullySpecified returns true iff the size of all the dimensions of s are known.
func (Shape) NumDimensions ¶ added in v1.1.0
NumDimensions returns the number of dimensions represented by s, or -1 if unknown.
type Tensor ¶
type Tensor struct {
// contains filtered or unexported fields
}
Tensor holds a multi-dimensional array of elements of a single data type.
func NewTensor ¶
NewTensor converts from a Go value to a Tensor. Valid values are scalars, slices, and arrays. Every element of a slice must have the same length so that the resulting Tensor has a valid shape.
func ReadTensor ¶ added in v1.0.0
ReadTensor constructs a Tensor with the provided type and shape from the serialized tensor contents in r.
See also WriteContentsTo.
func (*Tensor) Value ¶
func (t *Tensor) Value() interface{}
Value converts the Tensor to a Go value. For now, not all Tensor types are supported, and this function may panic if it encounters an unsupported DataType.
The type of the output depends on the Tensor type and dimensions. For example: Tensor(int64, 0): int64 Tensor(float64, 3): [][][]float64
func (*Tensor) WriteContentsTo ¶ added in v1.0.0
WriteContentsTo writes the serialized contents of t to w.
Returns the number of bytes written. See ReadTensor for reconstructing a Tensor from the serialized form.
WARNING: WriteContentsTo is not comprehensive and will fail if t.DataType() is non-numeric (e.g., String). See https://github.com/tensorflow/tensorflow/issues/6003.
Source Files ¶
Directories ¶
Path | Synopsis |
---|---|
Command genop generates a Go source file with functions for TensorFlow ops.
|
Command genop generates a Go source file with functions for TensorFlow ops. |
Package op defines functions for adding TensorFlow operations to a Graph.
|
Package op defines functions for adding TensorFlow operations to a Graph. |