xurls

README

xurls

Extract urls from plain text using regular expressions.

go get github.com/mvdan/xurls

Example usage:

import "github.com/mvdan/xurls"

func main() {
        xurls.Relaxed.FindString("Do gophers live in golang.org?")
        // "golang.org"
        xurls.Relaxed.FindAllString("foo.com is http://foo.com/.", -1)
        // ["foo.com", "http://foo.com/"]
        xurls.Strict.FindAllString("foo.com is http://foo.com/.", -1)
        // ["http://foo.com/"]
}

This is not a URL validation library.

Command-line utilities

xurls

Reads text and prints one url per line.

go get github.com/mvdan/xurls/cmd/xurls

$ echo "Do gophers live in http://golang.org?" | xurls
http://golang.org

Documentation

Index

• Variables
• func StrictMatching(schemeExp string) (*regexp.Regexp, error)

Variables

var (
	// Relaxed matches all the urls it can find
	Relaxed = regexp.MustCompile(relaxed)
	// Strict only matches urls with a scheme to avoid false positives
	Strict = regexp.MustCompile(strict)
)

var PseudoTLDs = []string{
	`bit`,
	`exit`,
	`gnu`,
	`i2p`,
	`local`,
	`onion`,
	`zkey`,
}

PseudoTLDs is a sorted list of some widely used unofficial TLDs

Sources:

• https://en.wikipedia.org/wiki/Pseudo-top-level_domain
• https://en.wikipedia.org/wiki/Category:Pseudo-top-level_domains
• https://tools.ietf.org/html/draft-grothoff-iesg-special-use-p2p-names-00

var TLDs = []string{}/* 1246 elements not displayed */

TLDs is a sorted list of all public top-level domains

Sources:

• https://data.iana.org/TLD/tlds-alpha-by-domain.txt
• https://publicsuffix.org/list/effective_tld_names.dat

Functions

func StrictMatching

func StrictMatching(schemeExp string) (*regexp.Regexp, error)

StrictMatching produces a regexp that matches urls like Strict but matching a specified scheme regular expression