scraper

Documentation

Index

• type FeedMeta
• type Result
• type Scraper
  • func New(c *client.Client) (Scraper, error)

Types

type FeedMeta

type FeedMeta struct {
	Title       string
	Description string
	Author      string
	URL         string
	Items       []string
}

FeedMeta contains metadata about a feed

type Result

type Result struct {
	URL  string
	Name string
}

Result contains a single feed element

type Scraper

type Scraper interface {
	DiscoverFeed(ctx context.Context, u *url.URL) (*FeedMeta, error)
	ScrapeFeed(ctx context.Context, u *url.URL) ([]Result, error)
}

Scraper defines the methods used when interacting with a feed

func New

func New(c *client.Client) (Scraper, error)

New returns a new scraper instance