SiteRippers

README

SiteRippers

A collection of Golang scripts to do entire rips of sites centralized in a single repo.

Download

https://github.com/nektro/SiteRippers/releases/latest

Usage

Usage of ./SiteRippers:
      --as string           site alias
      --concurrency int     Maximum number of tasks to run at once. Exactly how tasks are used varies slightly. (default 10)
      --job-workers int     Maximum number of tasks to initialize in parallel the the background. (default 5)
      --list                Pass this to list all supported domains.
      --mbpp-bar-gradient   Enabling this will make the bar gradient from red/yellow/green.
      --no-domain-dir       Makes output dir --save-dir/ instead of --save-dir/--site/.
      --save-dir string     Path to folder to save downloaded data to. (default "./data/")
      --site string         Domain of site to rip. None passed means rip all.

License

MIT