go-crawler

module

v0.0.18 Latest Latest Go to latest Published: Nov 3, 2023 License: None detected not legal advice

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Path	Synopsis
cmd
multi_spider
test_browser_spider
test_compress_spider
test_decode_spider
test_error_spider
test_file_spider
test_from_extra_spider
test_from_request_spider
test_item_spider
test_method_spider
test_must_ok_spider
test_ok_spider
test_parse_spider
test_request
test_scheduler_spider
test_spider
zhihu_spider
internal
items
loggers
middlewares
mock_servers
pipelines
spiders/test_browser_spider
spiders/test_compress_spider
spiders/test_decode_spider
spiders/test_error_spider
spiders/test_file_spider
spiders/test_from_extra_spider
spiders/test_from_request_spider
spiders/test_item_spider
spiders/test_method_spider
spiders/test_must_ok_spider
spiders/test_new_request_spider
spiders/test_ok_spider
spiders/test_parse_spider
spiders/test_scheduler_spider
spiders/test_spider
utils
pkg
api
app
cli
config
context
crawler
db
device
dns_cache
downloader
exporter
filters
http_client
http_client/browser
items
loggers
media
middlewares
mock_servers
pipelines
request
response
scheduler
scheduler/kafka
scheduler/memory
scheduler/redis
signals
spider
statistics
statistics/node
statistics/record
statistics/schedule
statistics/spider
statistics/task
stats
utils
static
tools
mitm
tls
web_server