webscraper

Documentation

Index

• func AddProto(href string, proto string) string
• func HasHTTP(href string) bool
• type DownloadLink
  • func GetHighlightClassTokensN(resp *http.Response, n int) ([]DownloadLink, error)
  • func (dl DownloadLink) FileName() string
  • func (dl DownloadLink) Href() string
  • func (dl DownloadLink) Sha256() string

Functions

func AddProto

func AddProto(href string, proto string) string

AddProto will add the corresponding start of the url

func HasHTTP

func HasHTTP(href string) bool

HasHTTP Make sure the url begins in http**

Types

type DownloadLink

type DownloadLink struct {
	// contains filtered or unexported fields
}

DownloadLink is the type to aggregate the download data

func GetHighlightClassTokensN

func GetHighlightClassTokensN(resp *http.Response, n int) ([]DownloadLink, error)

GetHighlightClassTokensN will return up to the first N of all the highligth class tokens in the http.Response along with the SHA value that is on the table

func (DownloadLink) FileName

func (dl DownloadLink) FileName() string

FileName returns the filename value of the download link

func (DownloadLink) Href

func (dl DownloadLink) Href() string

Href returns the href value of the download link

func (DownloadLink) Sha256

func (dl DownloadLink) Sha256() string

Sha256 returns the Sha256 value of the download link