iatd

README

Internet Archive Torrent Downloader (IATD)

Internet Archive Torrent Downloader (IATD) is a command-line tool designed to automate the download of torrent files from archive.org collections. Given a list of identifiers, IATD will concurrently download the torrent files.

IATD is useful for researchers, archivists, or anyone who needs to bulk download torrent files from archive.org collections.

Features

• Concurrent downloading with configurable number of workers.
• Skips already existing torrent files to avoid duplicate downloads. (Only checks file name, not contents)
• Logs all failed downloads in failed_downloads.log (Currently not configurable)

Installation

[!IMPORTANT] You will need Golang installed.

1. Clone the repository:

   git clone https://github.com/yourusername/iatd.git
   cd iatd
   

2. Build the project:

   go build .
   

OR:

Install with go install:

go install github.com/yourusername/iatd

OR:

Download a build from the releases

Usage

1. Prepare a CSV file (e.g., search.csv) with the following format:

   identifier
   winampskins_Sunico
   winampskin_05PROAmp
   winampskin_08_Meaningless_Shallow
   ...
   

   [!TIP] You can get this by using Advanced Search and selecting "CSV format"

2. Run the downloader:

   ./iatd -csv search.csv -workers 10
   

   Optional flags:

   • -csv: Path to the CSV file containing the archive.org identifiers. Default is search.csv.
   • -workers: Number of concurrent workers. Default is 10.

All torrent files will be downloaded to torrents/, this is currently not configurable.