s3client

Documentation

Overview

s3 client implements a simple client with upload struct as JSON record the JSON is '\n' terminated and is added in a path format base on a timestamp that is compatible with Athena database partitioned tables

Index

• type Client
  • func New(region string, bucket string, folder string, access string, secret string) (*Client, error)
  • func (c *Client) PathFromTimestamp(prefix string, timestamp time.Time) (string, error)
  • func (c *Client) Upload(path string, data interface{}) error

Types

type Client

type Client struct {
	// contains filtered or unexported fields
}

func New

func New(region string, bucket string, folder string, access string, secret string) (*Client, error)

New creates an S3 client

folder is optional root folder, if present "<folder>/" is prepended to upload path

func (*Client) PathFromTimestamp

func (c *Client) PathFromTimestamp(prefix string, timestamp time.Time) (string, error)

PathFromTimestamp create a path with a root folder compatible to Athena table with timestamp partitioning

func (*Client) Upload

func (c *Client) Upload(path string, data interface{}) error

Upload a json record to a path in the bucket