fetch

README

golibri/fetch

Get and normalize textual content from URLs. Does a few things that go's stdlib doesn't:

• normalize URLs before executing a request (missing http://, beginning with //, ...)
• normalize response buffer to a valid UTF-8 string (ToDo)

installation

go get github.com/golibri/fetch

usage

page, err := fetch.Get("http://blog.golang.org/go1.5")
normalized_url := page.Url
content_string := page.Body

license

LGPLv3. (You can use it in commercial projects as you like, but improvements/bugfixes must flow back to this lib.)

Documentation

Overview

GET the HTML content of a URL as an UTF-8 string

Index

• type Page
  • func Get(url string) (Page, error)

Types

type Page

type Page struct {
	Url  string
	Body string
}

contains normalized url and the response body string

func Get

func Get(url string) (Page, error)

Perform a HTTP GET request, return struct with UTF-8 body