decoder

Documentation

Overview

Package decoder implements a simple decoder for wiki pages.

Index

• type Decoder
  • func New(r io.Reader) (*Decoder, error)
  • func (d *Decoder) Err() error
  • func (d *Decoder) Next() bool
  • func (d *Decoder) Scan(v any) error
• type Page

Types

type Decoder

type Decoder struct {
	// contains filtered or unexported fields
}

Decoder is an XML decoder tailored to the Wikipedia dataset.

func New

func New(r io.Reader) (*Decoder, error)

New instanciates a new Decoder.

It fail if it cannot find the mediawiki and siteinfo elements from the dataset.

func (*Decoder) Err

func (d *Decoder) Err() error

Err returns any error encountered by Next.

func (*Decoder) Next

func (d *Decoder) Next() bool

Next moves to the next element.

func (*Decoder) Scan

func (d *Decoder) Scan(v any) error

Scan scans an element.

type Page

type Page struct {
	ID        int64     `xml:"-"`
	UpdatedAt time.Time `xml:"revision>timestamp"`
	Title     string    `xml:"title"`
	Text      string    `xml:"revision>text"`
}

Page represents a page from Wikipedia.