yarpc

README

yarpc-go

A transport and encoding agnostic RPC framework.

Installation

go get -u go.uber.org/yarpc

If using Glide, at least glide version 0.12 is required to install:

$ glide --version
glide version 0.12.2

$ glide get 'go.uber.org/yarpc#~0.5'

Development Status: Alpha

Ready for adventurous users and early adopters, but there will likely be a few breaking changes and features required before releasing version 1.0.

Documentation

Overview

Package yarpc provides the YARPC service framework.

Index

• Constants
• func CanonicalizeHeaderKey(k string) string
• func InjectClients(src transport.ClientConfigProvider, dest interface{})
• func IsBadRequestError(err error) bool
• func IsTimeoutError(err error) bool
• func IsUnexpectedError(err error) bool
• func OnewayInboundMiddleware(mw ...middleware.OnewayInbound) middleware.OnewayInbound
• func OnewayOutboundMiddleware(mw ...middleware.OnewayOutbound) middleware.OnewayOutbound
• func RegisterClientBuilder(f interface{}) (forget func())
• func UnaryInboundMiddleware(mw ...middleware.UnaryInbound) middleware.UnaryInbound
• func UnaryOutboundMiddleware(mw ...middleware.UnaryOutbound) middleware.UnaryOutbound
• type Ack
• type Call
  • func CallFromContext(ctx context.Context) *Call
  • func (c *Call) Caller() string
  • func (c *Call) Encoding() transport.Encoding
  • func (c *Call) Header(k string) string
  • func (c *Call) HeaderNames() []string
  • func (c *Call) Procedure() string
  • func (c *Call) RoutingDelegate() string
  • func (c *Call) RoutingKey() string
  • func (c *Call) Service() string
  • func (c *Call) ShardKey() string
  • func (c *Call) WriteResponseHeader(k, v string) error
• type CallOption
  • func ResponseHeaders(h *map[string]string) CallOption
  • func WithHeader(k, v string) CallOption
  • func WithRoutingDelegate(rd string) CallOption
  • func WithRoutingKey(rk string) CallOption
  • func WithShardKey(sk string) CallOption
• type Config
• type Dispatcher
  • func NewDispatcher(cfg Config) *Dispatcher
  • func (d *Dispatcher) ClientConfig(service string) transport.ClientConfig
  • func (d *Dispatcher) Inbounds() Inbounds
  • func (d *Dispatcher) Register(rs []transport.Procedure)
  • func (d *Dispatcher) Start() error
  • func (d *Dispatcher) Stop() error
• type InboundMiddleware
• type Inbounds
• type MapRouter
  • func NewMapRouter(defaultService string) MapRouter
  • func (m MapRouter) Choose(ctx context.Context, req *transport.Request) (transport.HandlerSpec, error)
  • func (m MapRouter) Procedures() []transport.Procedure
  • func (m MapRouter) Register(rs []transport.Procedure)
• type OutboundMiddleware
• type Outbounds

Examples

• Dispatcher (Minimal)
• Dispatcher.Register (JSON)
• Dispatcher.Register (Raw)

Constants

const Version = "1.0.0-rc4"

Version is the current version of YARPC.

Functions

func CanonicalizeHeaderKey

func CanonicalizeHeaderKey(k string) string

CanonicalizeHeaderKey canonicalizes the given header key to the same form used by the headers map returned by ResponseHeaders.

var headers map[string]string
res, err := client.Call(ctx, "hello", requestBody, ResponseHeaders(&headers))
email, ok := headers[CanonicalizeHeaderKey("User-Email-Address")]

func InjectClients

func InjectClients(src transport.ClientConfigProvider, dest interface{})

InjectClients injects clients from a Dispatcher into the given struct. dest must be a pointer to a struct with zero or more exported fields which hold YARPC client types. This includes json.Client, raw.Client, and any generated Thrift service client. Fields with nil values and a `service` tag will be populated with clients using that service`s ClientConfig.

Given,

type Handler struct {
	KeyValueClient keyvalueclient.Interface `service:"keyvalue"`
	UserClient json.Client `service:"users"`
	TagClient tagclient.Interface  // no tag; will be left unchanged
}

The call,

var h Handler
yarpc.InjectClients(dispatcher, &h)

Is equivalent to,

var h Handler
h.KeyValueClient = keyvalueclient.New(dispatcher.ClientConfig("keyvalue"))
h.UserClient = json.New(dispatcher.ClientConfig("users"))

Builder functions for different client types may be registered using the RegisterClientBuilder function.

This function panics if a field with an unknown type and nil value has the `service` tag.

func IsBadRequestError

func IsBadRequestError(err error) bool

IsBadRequestError returns true on an error returned by RPC clients if the request was rejected by YARPC because it was invalid.

res, err := client.Call(...)
if yarpc.IsBadRequestError(err) {
	fmt.Println("invalid request:", err)
}

func IsTimeoutError

func IsTimeoutError(err error) bool

IsTimeoutError return true on an error returned by RPC clients if the given error is a TimeoutError.

res, err := client.Call(...)
if yarpc.IsTimeoutError(err) {
	fmt.Println("request timed out:", err)
}

func IsUnexpectedError

func IsUnexpectedError(err error) bool

IsUnexpectedError returns true on an error returned by RPC clients if the server panicked or failed with an unhandled error.

res, err := client.Call(...)
if yarpc.IsUnexpectedError(err) {
	fmt.Println("internal server error:", err)
}

func OnewayInboundMiddleware

func OnewayInboundMiddleware(mw ...middleware.OnewayInbound) middleware.OnewayInbound

OnewayInboundMiddleware combines the given collection of unary inbound middleware in-order into a single OnewayInbound middleware.

func OnewayOutboundMiddleware

func OnewayOutboundMiddleware(mw ...middleware.OnewayOutbound) middleware.OnewayOutbound

OnewayOutboundMiddleware combines the given collection of unary outbound middleware in-order into a single OnewayOutbound middleware.

func RegisterClientBuilder

func RegisterClientBuilder(f interface{}) (forget func())

RegisterClientBuilder registers a builder function for a specific client type.

Functions must have the signature,

func(transport.ClientConfig) T

Where T is the type of the client. T MUST be an interface.

This function panics if a client for the given type has already been registered.

After a builder function for a client type is registered, these objects can be instantiated automatically using InjectClients.

A function to unregister the builder function is returned. Note that the function will clear whatever the corresponding type's builder function is at the time it is called, regardless of whether the value matches what was passed to this function or not.

func UnaryInboundMiddleware

func UnaryInboundMiddleware(mw ...middleware.UnaryInbound) middleware.UnaryInbound

UnaryInboundMiddleware combines the given collection of unary inbound middleware in-order into a single UnaryInbound middleware.

func UnaryOutboundMiddleware

func UnaryOutboundMiddleware(mw ...middleware.UnaryOutbound) middleware.UnaryOutbound

UnaryOutboundMiddleware combines the given collection of unary outbound middleware in-order into a single UnaryOutbound middleware.

Types

type Ack

type Ack interface {
	fmt.Stringer
}

Ack represents an acknowledgement from a oneway request.

type Call

type Call encoding.Call

Call provides information about the current request inside handlers. An instance of Call for the current request can be obtained by calling CallFromContext on the request context.

func Get(ctx context.Context, req *GetRequest) (*GetResponse, error) {
	call := yarpc.CallFromContext(ctx)
	fmt.Println("Received request from", call.Caller())
	if err := call.WriteResponseHeader("hello", "world"); err != nil {
		return nil, err
	}
	return response, nil
}

func CallFromContext

func CallFromContext(ctx context.Context) *Call

CallFromContext retrieves information about the current incoming request from the given context. Returns nil if the context is not a valid request context.

The object is valid only as long as the request is ongoing.

func (*Call) Caller

func (c *Call) Caller() string

Caller returns the name of the service making this request.

func (*Call) Encoding

func (c *Call) Encoding() transport.Encoding

Encoding returns the encoding for this request.

func (*Call) Header

func (c *Call) Header(k string) string

Header returns the value of the given request header provided with the request.

func (*Call) HeaderNames

func (c *Call) HeaderNames() []string

HeaderNames returns a sorted list of the names of user defined headers provided with this request.

func (*Call) Procedure

func (c *Call) Procedure() string

Procedure returns the name of the procedure being called.

func (*Call) RoutingDelegate

func (c *Call) RoutingDelegate() string

RoutingDelegate returns the routing delegate for this request.

func (*Call) RoutingKey

func (c *Call) RoutingKey() string

RoutingKey returns the routing key for this request.

func (*Call) Service

func (c *Call) Service() string

Service returns the name of the service being called.

func (*Call) ShardKey

func (c *Call) ShardKey() string

ShardKey returns the shard key for this request.

func (*Call) WriteResponseHeader

func (c *Call) WriteResponseHeader(k, v string) error

WriteResponseHeader writes headers to the response of this call.

type CallOption

type CallOption encoding.CallOption

CallOption defines options that may be passed in at call sites to other services.

These may be used to add or alter the request.

func ResponseHeaders

func ResponseHeaders(h *map[string]string) CallOption

ResponseHeaders specifies that headers received in response to this request should replace the given map.

Header keys in the map are normalized using the CanonicalizeHeaderKey function.

var resHeaders map[string]string
resBody, err := client.SetValue(ctx, key, value, yarpc.ResponseHeaders(&resHeaders))
value, ok := resHeaders[yarpc.CanonicalizeHeaderKey("foo")]

Note that the map is replaced completely. Entries it had before making the call will not be available afterwards.

headers := map[string]string{"hello": "world"}
resBody, err := client.SetValue(ctx, key, value, yarpc.ResponseHeaders(&headers))
_, ok := headers["hello"]
fmt.Println(ok)  // false

func WithHeader

func WithHeader(k, v string) CallOption

WithHeader adds a new header to the request. Header keys are case insensitive.

_, err := client.GetValue(ctx, reqBody, yarpc.WithHeader("Token", "10"))
// ==> {"token": "10"}

If multiple entries have the same normalized header name, newer entries override older ones.

func WithRoutingDelegate

func WithRoutingDelegate(rd string) CallOption

WithRoutingDelegate sets the routing delegate for the request.

func WithRoutingKey

func WithRoutingKey(rk string) CallOption

WithRoutingKey sets the routing key for the request.

func WithShardKey

func WithShardKey(sk string) CallOption

WithShardKey sets the shard key for the request.

type Config

type Config struct {
	// Name of the service. This is the name used by other services when
	// making requests to this service.
	Name string

	// Inbounds define how this service receives incoming requests from other
	// services.
	//
	// This may be nil if this service does not receive any requests.
	Inbounds Inbounds

	// Outbounds defines how this service makes requests to other services.
	//
	// This may be nil if this service does not send any requests.
	Outbounds Outbounds

	// Inbound and Outbound Middleware that will be applied to all incoming
	// and outgoing requests respectively.
	//
	// These may be nil if there is no middleware to apply.
	InboundMiddleware  InboundMiddleware
	OutboundMiddleware OutboundMiddleware

	// Tracer is deprecated. The dispatcher does nothing with this propery.
	Tracer opentracing.Tracer
}

Config specifies the parameters of a new Dispatcher constructed via NewDispatcher.

type Dispatcher

type Dispatcher struct {
	// contains filtered or unexported fields
}

Dispatcher encapsulates a YARPC application. It acts as the entry point to send and receive YARPC requests in a transport and encoding agnostic way.

Example (Minimal)

package main

import (
	"log"

	"go.uber.org/yarpc"
)

func main() {
	dispatcher := yarpc.NewDispatcher(yarpc.Config{Name: "myFancyService"})
	if err := dispatcher.Start(); err != nil {
		log.Fatal(err)
	}
	defer dispatcher.Stop()
}

func NewDispatcher

func NewDispatcher(cfg Config) *Dispatcher

NewDispatcher builds a new Dispatcher using the specified Config. At minimum, a service name must be specified.

Invalid configurations or errors in constructing the Dispatcher will cause panics.

func (*Dispatcher) ClientConfig

func (d *Dispatcher) ClientConfig(service string) transport.ClientConfig

ClientConfig provides the configuration needed to talk to the given service. This configuration may be directly passed into encoding-specific RPC clients.

keyvalueClient := json.New(dispatcher.ClientConfig("keyvalue"))

This function panics if the service name is not known.

func (*Dispatcher) Inbounds

func (d *Dispatcher) Inbounds() Inbounds

Inbounds returns a copy of the list of inbounds for this RPC object.

The Inbounds will be returned in the same order that was used in the configuration.

func (*Dispatcher) Register

func (d *Dispatcher) Register(rs []transport.Procedure)

Register registers zero or more procedures with this dispatcher. Incoming requests to these procedures will be routed to the handlers specified in the given Procedures.

Example (JSON)

package main

import (
	"context"
	"fmt"

	"go.uber.org/yarpc"
	"go.uber.org/yarpc/encoding/json"
)

// global dispatcher used in the registration examples
var dispatcher = yarpc.NewDispatcher(yarpc.Config{Name: "service"})

func main() {
	handler := func(ctx context.Context, key string) (string, error) {
		fmt.Println("key", key)
		return "value", nil
	}

	dispatcher.Register(json.Procedure("get", handler))
}

Example (Raw)

package main

import (
	"context"

	"go.uber.org/yarpc"
	"go.uber.org/yarpc/encoding/raw"
)

// global dispatcher used in the registration examples
var dispatcher = yarpc.NewDispatcher(yarpc.Config{Name: "service"})

func main() {
	handler := func(ctx context.Context, data []byte) ([]byte, error) {
		return data, nil
	}

	dispatcher.Register(raw.Procedure("echo", handler))
}

func (*Dispatcher) Start

func (d *Dispatcher) Start() error

Start starts the Dispatcher, allowing it to accept and processing new incoming requests.

This starts all inbounds and outbounds configured on this Dispatcher.

This function returns immediately after everything has been started. Servers should add a `select {}` to block to process all incoming requests.

if err := dispatcher.Start(); err != nil {
	log.Fatal(err)
}
defer dispatcher.Stop()

select {}

func (*Dispatcher) Stop

func (d *Dispatcher) Stop() error

Stop stops the Dispatcher.

This stops all outbounds and inbounds owned by this Dispatcher.

This function returns after everything has been stopped.

type InboundMiddleware

type InboundMiddleware struct {
	Unary  middleware.UnaryInbound
	Oneway middleware.OnewayInbound
}

InboundMiddleware contains the different types of inbound middlewares.

type Inbounds

type Inbounds []transport.Inbound

Inbounds contains a list of inbound transports. Each inbound transport specifies a source through which incoming requests are received.

type MapRouter

type MapRouter struct {
	// contains filtered or unexported fields
}

MapRouter is a Router that maintains a map of the registered procedures.

func NewMapRouter

func NewMapRouter(defaultService string) MapRouter

NewMapRouter builds a new MapRouter that uses the given name as the default service name.

func (MapRouter) Choose

func (m MapRouter) Choose(ctx context.Context, req *transport.Request) (transport.HandlerSpec, error)

Choose retrives the HandlerSpec for the service and procedure noted on the transport request, or returns an error.

func (MapRouter) Procedures

func (m MapRouter) Procedures() []transport.Procedure

Procedures returns a list procedures that have been registered so far.

func (MapRouter) Register

func (m MapRouter) Register(rs []transport.Procedure)

Register registers the procedure with the MapRouter.

type OutboundMiddleware

type OutboundMiddleware struct {
	Unary  middleware.UnaryOutbound
	Oneway middleware.OnewayOutbound
}

OutboundMiddleware contains the different types of outbound middlewares.

type Outbounds

type Outbounds map[string]transport.Outbounds

Outbounds provides access to outbounds for a remote service. Outbounds define how requests are sent from this service to the remote service.