scraper

command module
v0.0.0-...-f960072 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Jun 21, 2019 License: MIT Imports: 3 Imported by: 0

README

Scraper

A scheduled scraper written in Go

Usage

  • Add a new task

    • Note: The time is in seconds
    curl -X POST localhost:4000/api/v1/scraper -d '{"URL": "https://theverge.com", "Time": 10}'
    
  • Get all results

    curl localhost:4000/api/v1/results
    
  • Get a result

    curl localhost:4000/api/v1/result/{id}
    

Documentation

The Go Gopher

There is no documentation for this package.

Directories

Path Synopsis
pkg
title
Based on: https://siongui.github.io/2016/05/10/go-get-html-title-via-net-html/
Based on: https://siongui.github.io/2016/05/10/go-get-html-title-via-net-html/

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL