requester

README

golang-requester

Golang HTTP GET requester with channels and goroutines

Usage

$ go run main.go --help
$ go run main.go -w 20 -u https://google.com -r 50

• -r: max number of requests
• -u: url you want to fetch
• -w: number of workers

Problems with max open files (to much sockets opened)

ulimit -n 1000000

GO MAX PROCESSORS (by deault is 1)

Is necessary?

export GOMAXPROCS=2