cUrls

README

cUrls

cUrls is a simple tool crawl urls from domain using colly library.

Installation

First, install golang

Then, clone from soure code and install:

git clone https://github.com/ductnn/cUrls.git
cd cUrls
go get

Usage

Run command:

go run curls.go > sub.txt
# Enter domain you want to crawl.
# Example
http://httpbin.org/

Check results in file sub.txt:

Visiting http://httpbin.org/
Link found: "\n        \n            \n            \n            \n        \n    " -> https://github.com/requests/httpbin
Link found: "the developer - Website" -> https://kennethreitz.org
Link found: "Send email to the developer" -> mailto:me@kennethreitz.org
Link found: "Flasgger" -> https://github.com/rochacbruno/flasgger
Link found: "HTML form" -> /forms/post

So done !!! =))))

Show your support

Give a ⭐ if you like this application ❤️

Contribution

Contributions are more than welcome in this project!

License

The MIT License (MIT). Please see LICENSE for more information.