BatParamFetcher

README

BatParamFetcher

BatParamFetcher swoops into action, retrieving URLs from the Wayback Machine for a league of domains. With its keen eye for detail, it scrubs the URLs clean by replacing query parameters with placeholders, ensuring they're ready for their next adventure. Finally, it saves these polished URLs to files, ready to take flight into the world wide web.

Installation

To install BatParamFetcher, you can use go install:

go install github.com/MrBrooks89/BatParamFetcher@latest

This will download and install the latest version of BatParamFetcher to your Go bin directory.

Usage

Use the following command to run BatParamFetcher:

BatParamFetcher -l path/to/domain-list.txt

Optional flags:

-h: Show usage information.
-l: Path to a file containing a list of domains (required).
-o: Path to the output directory for the cleaned URLs (default is results).

Example:

BatParamFetcher -l domains.txt -o output

BatParamFetcher will fetch URLs from the Wayback Machine for each domain, clean the URLs, and save the cleaned URLs to files in the specified output directory.

Please note that BatParamFetcher is intended for educational and testing purposes only. Use it responsibly and with permission.

License

This project is licensed under the MIT License.