sitemap

Documentation

Overview

Package sitemap is an internal package of the tool Crawl, responsible for parsing XML sitemaps and indexes.

Index

• func Fetch(url string) ([]string, error)
• func FetchIndex(url string) ([]string, error)
• func Parse(in io.Reader) ([]string, error)
• func ParseIndex(in io.Reader) ([]string, error)

Functions

func Fetch

func Fetch(url string) ([]string, error)

Fetch is like Parse, but it also retrieves its data from the given URL.

func FetchIndex

func FetchIndex(url string) ([]string, error)

FetchIndex is like ParseIndex, but it also retrieves its data from the given URL.

func Parse

func Parse(in io.Reader) ([]string, error)

Parse interprets in as a sitemap. It returns the URLs in that sitemap if successful.

func ParseIndex

func ParseIndex(in io.Reader) ([]string, error)

ParseIndex interprets in as a sitemap index. It returns the sitemap URLs in the index if successful.