r2

package
v1.20210103.1 Latest Latest
Warning

This package is not in the latest version of its module.

 Go to latest Published: Jan 3, 2021 License: MIT Imports: 19 Imported by: 3

Documentation

Overview

Package r2 is a rewrite of the sdk http request package that eschews fluent apis in favor of the options pattern.

The request returned by `r2.New()` i.e. `*r2.Request` holds everything required to send the request, including the http client reference, and a transport reference. If neither are specified, defaults are used (http.DefaultClient for the client, etc.)

To send a request, simply: 

resp, err := r2.New("http://example.com/").Do()
if err != nil {
	// handle error
}
defer resp.Body.Close()
body, err := ioutil.ReadAll(resp.Body)
// ...

You can specify additional options as a variadic list of `Opt...` functions: 

resp, err := r2.New("http://example.com",
	r2.OptPost(),
	r2.OptHeaderValue("X-Foo", "example-string"),
).Do()

There are convenience methods on the request type that help with things like decoding types as json: 

meta, err := r2.New("http://example.com",
	r2.OptPost(),
	r2.OptHeaderValue("X-Foo", "example-string"),
).JSON(&myObj)

Note that in the above, the JSON method also returns a closed version of the response for metadata purposes.

You can also fire and forget the request with the `.Discard()` method: 

meta, err := r2.New("http://example.com",
	r2.OptPost(),
	r2.OptHeaderValue("X-Foo", "example-string"),
).Discard()

Index

Constants

View Source 
const (
	// MethodGet is a method.
	MethodGet = webutil.MethodGet
	// MethodPost is a method.
	MethodPost = webutil.MethodPost
	// MethodPut is a method.
	MethodPut = webutil.MethodPut
	// MethodPatch is a method.
	MethodPatch = webutil.MethodPatch
	// MethodDelete is a method.
	MethodDelete = webutil.MethodDelete
	// MethodOptions is a method.
	MethodOptions = webutil.MethodOptions
)
View Source 
const (
	// ContentTypeApplicationJSON is a content type header value.
	ContentTypeApplicationJSON = webutil.ContentTypeApplicationJSON
	// ContentTypeApplicationXML is a content type header value.
	ContentTypeApplicationXML = webutil.ContentTypeApplicationXML
	// ContentTypeApplicationFormEncoded is a content type header value.
	ContentTypeApplicationFormEncoded = webutil.ContentTypeApplicationFormEncoded
	// ContentTypeApplicationOctetStream is a content type header value.
	ContentTypeApplicationOctetStream = webutil.ContentTypeApplicationOctetStream
)
View Source 
const (
	// ErrRequestUnset is an error returned from options if they are called on a r2.Request that has not
	// been created by r2.New(), and as a result the underlying request is uninitialized.
	ErrRequestUnset ex.Class = "r2; cannot modify request, underlying request unset. please use r2.New()"
	// ErrInvalidTransport is an error returned from options if they are called on a request that has had
	// the transport set to something other than an *http.Transport; this precludes using http.Transport
	// specific options like tls.Config mutators.
	ErrInvalidTransport ex.Class = "r2; cannot modify transport, is not *http.Transport"
	// ErrNoContentJSON is returns from sending requests when a no-content status is returned.
	ErrNoContentJSON ex.Class = "server returned an http 204 for a request expecting json"
	// ErrNoContentXML is returns from sending requests when a no-content status is returned.
	ErrNoContentXML ex.Class = "server returned an http 204 for a request expecting xml"
	// ErrInvalidMethod is an error that is returned from `r2.Request.Do()` if a method
	// is specified on the request that violates the valid charset for HTTP methods.
	ErrInvalidMethod ex.Class = "r2; invalid http method"
)

Error Constants

View Source 
const (
	// Flag is a logger event flag.
	Flag = "http.client.request"
	// FlagResponse is a logger event flag.
	FlagResponse = "http.client.response"
)
View Source 
const (
	// ConnectionKeepAlive is a connection header value.
	ConnectionKeepAlive = webutil.ConnectionKeepAlive
)
View Source 
const (
	// TestURL can be used in tests for the URL passed to r2.New(...)
	//
	// The URL itself sets `https` as the scheme, `test.invalid` as the host,
	// `/test` as the path, and `query=value` as the querystring.
	//
	// Note: .invalid is a top level special domain that will _never_ be assigned
	// to a real registrant, it is always reserved for testing.
	// See: https://www.iana.org/domains/reserved
	TestURL = webutil.TestURL
)

Variables

View Source 
var (
	// HeaderConnection is a http header.
	HeaderConnection = webutil.HeaderConnection
	// HeaderContentType is a http header.
	HeaderContentType = webutil.HeaderContentType
)

Functions

func EnsureHTTPTransport 

func EnsureHTTPTransport(r *Request) (*http.Transport, error)

EnsureHTTPTransport ensures the http client's transport is set and that it is an *http.Transport.

It will return an error `ErrInvalidTransport` if it is set to something other than *http.Transport.

func ErrIsTooManyRedirects 

func ErrIsTooManyRedirects(err error) bool

ErrIsTooManyRedirects returns if the error is too many redirects.

func NewEventFilter 

func NewEventFilter(filter func(context.Context, Event) (Event, bool)) logger.Filter

NewEventFilter returns a new r2 event filter.

func NewEventListener 

func NewEventListener(listener func(context.Context, Event)) logger.Listener

NewEventListener returns a new r2 event listener.

Types

type DialOption 

type DialOption = webutil.DialOption

DialOption is an option for the net dialer.

func OptDialKeepAlive 

func OptDialKeepAlive(d time.Duration) DialOption

OptDialKeepAlive sets the dial keep alive duration. Only use this if you know what you're doing, the defaults are typically sufficient.

func OptDialTimeout 

func OptDialTimeout(d time.Duration) DialOption

OptDialTimeout sets the dial timeout.

type Event 

type Event struct {
	Flag string
	// The request metadata.
	Request *http.Request
	// The response metadata (excluding the body).
	Response *http.Response
	// The response body.
	Body []byte
	// Elapsed is the time elapsed.
	Elapsed time.Duration
}

Event is a response to outgoing requests.

func NewEvent 

func NewEvent(flag string, options ...EventOption) Event

NewEvent returns a new event.

func (Event) Decompose 

func (e Event) Decompose() map[string]interface{}

Decompose implements logger.JSONWritable.

func (Event) GetFlag 

func (e Event) GetFlag() string

GetFlag implements logger.Event.

func (Event) WriteText 

func (e Event) WriteText(tf logger.TextFormatter, wr io.Writer)

WriteText writes the event to a text writer.

type EventJSONSchema 

type EventJSONSchema struct {
	Req struct {
		StartTime time.Time           `json:"startTime"`
		Method    string              `json:"method"`
		URL       string              `json:"url"`
		Headers   map[string][]string `json:"headers"`
	} `json:"req"`
	Res struct {
		CompleteTime  time.Time           `json:"completeTime"`
		StatusCode    int                 `json:"statusCode"`
		ContentLength int                 `json:"contentLength"`
		Headers       map[string][]string `json:"headers"`
	} `json:"res"`
	Body string `json:"body"`
}

EventJSONSchema is the json schema of the logger event.

type EventOption 

type EventOption func(e *Event)

EventOption is an event option.

func OptEventBody 

func OptEventBody(body []byte) EventOption

OptEventBody sets the body.

func OptEventElapsed 

func OptEventElapsed(elapsed time.Duration) EventOption

OptEventElapsed sets the elapsed time.

func OptEventRequest 

func OptEventRequest(req *http.Request) EventOption

OptEventRequest sets the response.

func OptEventResponse 

func OptEventResponse(res *http.Response) EventOption

OptEventResponse sets the response.

type LogOption 

type LogOption func(*LogOptions)

LogOption are mutators for log options.

type LogOptions 

type LogOptions struct {
	RequestSanitizationDefaults []sanitize.RequestOption
}

LogOptions are options that govern the logging of requests.

type OnRequestListener 

type OnRequestListener func(*http.Request) error

OnRequestListener is an a listener for on request events.

type OnResponseListener 

type OnResponseListener func(*http.Request, *http.Response, time.Time, error) error

OnResponseListener is an on response listener.

The time.Time is given as the start time of the request in the UTC timezone. To compute the elapsed time you would subtract from the current time in UTC i.e. `time.Now().UTC().Sub(startTime)`.

type Option 

type Option func(*Request) error

Option is a modifier for a request.

func OptBasicAuth 

func OptBasicAuth(username, password string) Option

OptBasicAuth is an option that sets the http basic auth.

func OptBody 

func OptBody(contents io.ReadCloser) Option

OptBody sets the post body on the request.

func OptBodyBytes 

func OptBodyBytes(contents []byte) Option

OptBodyBytes sets the post body on the request from a byte array.

func OptClient 

func OptClient(client *http.Client) Option

OptClient sets the underlying client on the request.

It is specifically useful to prevent churning allocations on sending repeated requests.

func OptCloser 

func OptCloser(action func() error) Option

OptCloser sets the request closer.

It is typically used to clean up or trigger other actions.

func OptContext 

func OptContext(ctx context.Context) Option

OptContext sets the request context.

func OptCookie 

func OptCookie(cookie *http.Cookie) Option

OptCookie adds a cookie.

func OptCookieValue 

func OptCookieValue(name, value string) Option

OptCookieValue adds a cookie with a given name and value.

func OptDelete 

func OptDelete() Option

OptDelete sets the request method.

func OptDial 

func OptDial(opts ...DialOption) Option

OptDial sets dial options for a request, these must be done all at once.

func OptDisableKeepAlives 

func OptDisableKeepAlives(disableKeepAlives bool) Option

OptDisableKeepAlives disables keep alives.

func OptGet 

func OptGet() Option

OptGet sets the request method.

func OptHTTPClientTrace added in v1.20210103.1 

func OptHTTPClientTrace(ht *webutil.HTTPTrace) Option

OptHTTPClientTrace sets the outgoing httptrace.ClientTrace context.

func OptHeader 

func OptHeader(headers http.Header) Option

OptHeader sets the request headers.

func OptHeaderValue 

func OptHeaderValue(key, value string) Option

OptHeaderValue adds or sets a header value.

func OptHost 

func OptHost(host string) Option

OptHost sets the url host.

func OptJSONBody 

func OptJSONBody(obj interface{}) Option

OptJSONBody sets the post body on the request.

func OptLog 

func OptLog(log logger.Log) Option

OptLog adds OnRequest and OnResponse listeners to log that a call was made.

func OptLogRequest 

func OptLogRequest(log logger.Log) Option

OptLogRequest adds OnRequest and OnResponse listeners to log that a call was made.

func OptLogResponse 

func OptLogResponse(log logger.Triggerable) Option

OptLogResponse adds an OnResponse listener to log the response of a call.

func OptLogResponseWithBody 

func OptLogResponseWithBody(log logger.Triggerable) Option

OptLogResponseWithBody adds an OnResponse listener to log the response of a call. It reads the contents of the response fully before emitting the event. Do not use this if the size of the responses can be large.

func OptLogWithBody 

func OptLogWithBody(log logger.Log) Option

OptLogWithBody adds OnRequest and OnResponse listeners to log that a call was made. It will also display the body of the response.

func OptMaxRedirects 

func OptMaxRedirects(maxRedirects int) Option

OptMaxRedirects tells the http client to only follow a given number of redirects, overriding the standard library default of 10. Use the companion helper `ErrIsTooManyRedirects` to test if the returned error from a call indicates the redirect limit was reached.

func OptMethod 

func OptMethod(method string) Option

OptMethod sets the request method.

func OptNoFollow 

func OptNoFollow() Option

OptNoFollow tells the http client to not follow redirects returned by the remote server.

func OptOnRequest 

func OptOnRequest(listener OnRequestListener) Option

OptOnRequest sets an on request listener.

func OptOnResponse 

func OptOnResponse(listener OnResponseListener) Option

OptOnResponse adds an on response listener. If an OnResponse listener has already been addded, it will be merged with the existing listener.

func OptPatch 

func OptPatch() Option

OptPatch sets the request method.

func OptPath 

func OptPath(path string) Option

OptPath sets the url path.

func OptPathf 

func OptPathf(format string, args ...interface{}) Option

OptPathf sets the url path based on a format and arguments.

func OptPort 

func OptPort(port int32) Option

OptPort sets a custom port for the request url.

func OptPost 

func OptPost() Option

OptPost sets the request method.

func OptPostForm 

func OptPostForm(postForm url.Values) Option

OptPostForm sets the request post form and the content type.

func OptPostFormValue 

func OptPostFormValue(key, value string) Option

OptPostFormValue sets a request post form value.

func OptPut 

func OptPut() Option

OptPut sets the request method.

func OptQuery 

func OptQuery(query url.Values) Option

OptQuery sets the full querystring.

func OptQueryValue 

func OptQueryValue(key, value string) Option

OptQueryValue adds or sets a query value.

func OptResponseHeaderTimeout 

func OptResponseHeaderTimeout(d time.Duration) Option

OptResponseHeaderTimeout sets the client transport ResponseHeaderTimeout.

func OptScheme 

func OptScheme(scheme string) Option

OptScheme sets the url scheme.

func OptTLSClientCert 

func OptTLSClientCert(cert, key []byte) Option

OptTLSClientCert adds a client cert and key to the request.

func OptTLSClientCertFilePair 

func OptTLSClientCertFilePair(certFile, keyFile string) Option

OptTLSClientCertFilePair adds a client cert and key to the request.

func OptTLSClientConfig 

func OptTLSClientConfig(cfg *tls.Config) Option

OptTLSClientConfig sets the tls config for the request. It will create a client, and a transport if unset.

func OptTLSHandshakeTimeout 

func OptTLSHandshakeTimeout(d time.Duration) Option

OptTLSHandshakeTimeout sets the client transport TLSHandshakeTimeout.

func OptTLSRootCAs 

func OptTLSRootCAs(pool *x509.CertPool) Option

OptTLSRootCAs sets the client tls root ca pool.

func OptTLSSkipVerify 

func OptTLSSkipVerify(skipVerify bool) Option

OptTLSSkipVerify sets if we should skip verification.

func OptTimeout 

func OptTimeout(d time.Duration) Option

OptTimeout sets the client timeout.

func OptTracer 

func OptTracer(tracer Tracer) Option

OptTracer sets the optional trace handler.

func OptTransport 

func OptTransport(transport http.RoundTripper) Option

OptTransport sets the client transport for a request.

func OptURL 

func OptURL(rawURL string) Option

OptURL sets the url of a request.

func OptUserAgent 

func OptUserAgent(userAgent string) Option

OptUserAgent sets the user agent header on a request. It will initialize the request headers map if it's unset. It will overwrite any existing user agent header.

func OptXMLBody 

func OptXMLBody(obj interface{}) Option

OptXMLBody sets the post body on the request.

func RequestOption 

func RequestOption(opt func(*http.Request) error) Option

RequestOption translates a webutil.RequestOption to a r2.Option.

type Request 

type Request struct {
	Request *http.Request
	// Err is an error set on construction.
	// It is checked before sending the request, and will be returned from any of the
	// methods that execute the request.
	// It is typically set in `New(string,...Option)`.
	Err error
	// Client is the underlying http client used to make the requests.
	Client *http.Client
	// Closer is an optional step to run as part of the Close() function.
	Closer func() error
	// Tracer is used to report span contexts to a distributed tracing collector.
	Tracer Tracer
	// OnRequest is an array of request lifecycle hooks used for logging.
	OnRequest []OnRequestListener
	// OnResponse is an array of response lifecycle hooks used for logging.
	OnResponse []OnResponseListener
}

Request is a combination of the http.Request options and the underlying client.

func New 

func New(remoteURL string, options ...Option) *Request

New returns a new request. The default method is GET.

func (Request) Bytes 

func (r Request) Bytes() (contents []byte, res *http.Response, err error)

Bytes reads the response and returns it as a byte array, along with the response metadata..

func (*Request) Close 

func (r *Request) Close() error

Close closes the request if there is a closer specified.

func (Request) CopyTo 

func (r Request) CopyTo(dst io.Writer) (count int64, err error)

CopyTo copies the response body to a given writer.

func (Request) Discard 

func (r Request) Discard() (res *http.Response, err error)

Discard reads the response fully and discards all data it reads, and returns the response metadata.

func (Request) Do 

func (r Request) Do() (*http.Response, error)

Do executes the request.

func (Request) JSON 

func (r Request) JSON(dst interface{}) (res *http.Response, err error)

JSON reads the response as json into a given object and returns the response metadata.

func (*Request) WithContext 

func (r *Request) WithContext(ctx context.Context) *Request

WithContext implements the `WithContext` method for the underlying request.

It is preserved here because the pointer indirects are non-trivial.

func (Request) XML 

func (r Request) XML(dst interface{}) (res *http.Response, err error)

XML reads the response as xml into a given object and returns the response metadata.

type TraceFinisher 

type TraceFinisher interface {
	Finish(*http.Request, *http.Response, time.Time, error)
}

TraceFinisher is a finisher for traces.

type Tracer 

type Tracer interface {
	Start(*http.Request) TraceFinisher
}

Tracer is a tracer for requests.

Source Files

View all Source files

Directories

Path Synopsis
Package r2test provides helpers for writing tests involving calls with sdk/r2.
 Package r2test provides helpers for writing tests involving calls with sdk/r2.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL
go.dev uses cookies from Google to deliver and enhance the quality of its services and to analyze traffic. Learn more.