crawl1

command
v0.0.0-...-5daf3a2 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Apr 25, 2020 License: MIT Imports: 4 Imported by: 0

Documentation

Overview

Crawl1 crawls web links starting with the command-line arguments.

This version quickly exhausts available file descriptors due to excessive concurrent calls to links.Extract.

Also, it never terminates because the worklist is never closed.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL