download

Documentation

Index

• Variables
• type Downloader
  • func New(logger log.Logger, httpClient *http.Client) *Downloader
  • func (dl *Downloader) GetFiles(dir string, namesAndSources map[string]string) (map[string]io.ReadCloser, error)

Variables

var (
	HTTPClient = &http.Client{
		Timeout: 45 * time.Second,
	}
)

Types

type Downloader

type Downloader struct {
	HTTP   *http.Client
	Logger log.Logger
}

Downloader will download and cache DPL files in a temp directory.

If HTTP is nil then http.DefaultClient will be used (which has NO timeouts).

See: https://www.treasury.gov/resource-center/sanctions/SDN-List/Pages/sdn_data.aspx

func New

func New(logger log.Logger, httpClient *http.Client) *Downloader

func (*Downloader) GetFiles

func (dl *Downloader) GetFiles(dir string, namesAndSources map[string]string) (map[string]io.ReadCloser, error)

GetFiles will initiate download of all provided files, return an io.ReadCloser to their content

initialDir is an optional filepath to look for files in before attempting to download.

Callers are expected to call the io.Closer interface method when they are done with the file