imgurfetch

README

Imgurfetch

Download images from album by album URL.

imgurfetch -h

Usage of imgurfetch:
imgurfetch [arguments] <url> [path(default: .)]
  -g	group images by resolution
  -r duration
    	rate limit(how often requests could happen)
  -w int
    	number of workers (default 10)

Test and build

make all

Will build binary file into $BINARY_FOLDER(defaut:./bin )

Documentation

Index

• type Album
  • func AlbumMeta(host, id string) (data Album, err error)
• type Image
• type ImageWorker
  • func NewWorker(host string, in <-chan Image, done chan<- struct{}, path string, grByRes bool, ...) *ImageWorker
  • func (w *ImageWorker) Run(ctx context.Context)

Types

type Album

type Album struct {
	Data struct {
		Images []Image `json:"images"`
	} `json:"data"`
}

Album - information about images in the album.

func AlbumMeta

func AlbumMeta(host, id string) (data Album, err error)

AlbumMeta downloads information about images in the album by album ID.

type Image

type Image struct {
	Hash   string `json:"hash"`
	Title  string `json:"title"`
	Width  int    `json:"width"`
	Height int    `json:"height"`
	Ext    string `json:"ext"`
}

Image - information about image.

type ImageWorker

type ImageWorker struct {
	// contains filtered or unexported fields
}

ImageWorker - contains information about how to download images and where to store them. Worker receives tasks from "in" channel. when task is done it send signal to "done" channel. Before each task it asks limiter to get permission for execution.

func NewWorker

func NewWorker(host string, in <-chan Image, done chan<- struct{}, path string, grByRes bool, l *rate.Limiter, hc *http.Client) *ImageWorker

NewWorker create new worker instance. If grByRes is true, it will create sub directory WxH.

func (*ImageWorker) Run

func (w *ImageWorker) Run(ctx context.Context)

Run loop which waits tasks in "in" channel until ctx signals done. Before executing tasks it asks limiter for permission.