iatd

command module
v1.0.0 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Jul 25, 2024 License: MIT Imports: 10 Imported by: 0

README

Internet Archive Torrent Downloader (IATD)

Internet Archive Torrent Downloader (IATD) is a command-line tool designed to automate the download of torrent files from archive.org collections. Given a list of identifiers, IATD will concurrently download the torrent files.

IATD is useful for researchers, archivists, or anyone who needs to bulk download torrent files from archive.org collections.

Features

  • Concurrent downloading with configurable number of workers.
  • Skips already existing torrent files to avoid duplicate downloads. (Only checks file name, not contents)
  • Logs all failed downloads in failed_downloads.log (Currently not configurable)

Installation

[!IMPORTANT] You will need Golang installed.

  1. Clone the repository:

    git clone https://github.com/yourusername/iatd.git
    cd iatd
    
  2. Build the project:

    go build .
    

OR:

Install with go install:

go install github.com/yourusername/iatd

OR:

Download a build from the releases

Usage

  1. Prepare a CSV file (e.g., search.csv) with the following format:

    identifier
    winampskins_Sunico
    winampskin_05PROAmp
    winampskin_08_Meaningless_Shallow
    ...
    

    [!TIP] You can get this by using Advanced Search and selecting "CSV format"

  2. Run the downloader:

    ./iatd -csv search.csv -workers 10
    

    Optional flags:

    • -csv: Path to the CSV file containing the archive.org identifiers. Default is search.csv.
    • -workers: Number of concurrent workers. Default is 10.

All torrent files will be downloaded to torrents/, this is currently not configurable.

Documentation

The Go Gopher

There is no documentation for this package.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL