download

Documentation

Index

• Constants
• Variables
• type Downloader
  • func New(logger log.Logger, httpClient *http.Client) *Downloader
  • func (dl *Downloader) GetFiles(ctx context.Context, dir string, namesAndSources map[string]string) (Files, error)
• type Files
  • func (fs Files) Close() error

Constants

const (
	HashKey = "hash:sha256"
)

Variables

var (
	HTTPClient = &http.Client{
		Timeout: 45 * time.Second,
	}
)

Types

type Downloader

type Downloader struct {
	HTTP   *http.Client
	Logger log.Logger
}

Downloader will download and cache DPL files in a temp directory.

If HTTP is nil then http.DefaultClient will be used (which has NO timeouts).

See: https://www.treasury.gov/resource-center/sanctions/SDN-List/Pages/sdn_data.aspx

func New

func New(logger log.Logger, httpClient *http.Client) *Downloader

func (*Downloader) GetFiles

func (dl *Downloader) GetFiles(ctx context.Context, dir string, namesAndSources map[string]string) (Files, error)

GetFiles will initiate download of all provided files, return an io.ReadCloser to their content

initialDir is an optional filepath to look for files in before attempting to download.

Callers are expected to call the io.Closer interface method when they are done with the file

type Files

type Files map[string]io.ReadCloser

func (Files) Close

func (fs Files) Close() error