Imports
- github.com/jessevdk/go-flags
- github.com/logrusorgru/aurora/v3
- github.com/mattn/go-colorable
- github.com/mattn/go-isatty
- github.com/oxffaa/gopher-parse-sitemap
- github.com/temoto/robotstxt
- github.com/valyala/fasthttp
- github.com/valyala/fasthttp/fasthttpproxy
- github.com/yhat/scrape
- go.uber.org/ratelimit
- golang.org/x/net/html
- golang.org/x/net/html/atom