crawl1

command
v0.0.0-...-590cb2f Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Oct 6, 2020 License: MIT Imports: 4 Imported by: 0

Documentation

Overview

Crawl1 crawls web links starting with the command-line arguments.

This version quickly exhausts available file descriptors due to excessive concurrent calls to links.Extract.

Also, it never terminates because the worklist is never closed.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL