Imports
- github.com/3n3a/robotstxt-parser
- github.com/3n3a/securitytxt-parser
- github.com/antchfx/htmlquery
- github.com/imroc/req/v3
- github.com/oschwald/geoip2-golang
- github.com/oxffaa/gopher-parse-sitemap
- github.com/sirupsen/logrus
- golang.org/x/sync/errgroup