download

Documentation

Index

• Variables
• func Download(args []string) error
• func GetURLsFile(urlsFilePath string) (urlsList []string, err error)
• func GetURLsListFile(currentPath string, fileLocation string) (urlsFilePath string, err error)

Variables

var ArgHelp = `
  [urls]
        all flagless arguments will be used as download urls.`

ArgHelp is the suffix text that will be displayed after the argument list in the module help

var Args = flag.NewFlagSet("download", flag.ExitOnError)

Args is a flagset that needs to be exported so that it can be written to the main program help

var Usage = `` /* 480-byte string literal not displayed */

Usage text that will be displayed as command line help text when using the `help download` command

Functions

func Download

func Download(args []string) error

Download function downloads the files included in the urls_list.txt file. The argument can be a local file or a url to an S3 folder

func GetURLsFile

func GetURLsFile(urlsFilePath string) (urlsList []string, err error)

GetURLsFile reads the urls_list.txt file and returns the urls of the files in a list

func GetURLsListFile

func GetURLsListFile(currentPath string, fileLocation string) (urlsFilePath string, err error)

GetURLsListFile is returning the path to the urls_list.txt by handling the URL or path provided by the user. In case of a URL, the file is downloaded in the current path