ferret

README

Ferret

Try it! Docs CLI Test runner Web worker

What is it?

ferret is a web scraping system. It aims to simplify data extraction from the web for UI testing, machine learning, analytics and more.
ferret allows users to focus on the data. It abstracts away the technical details and complexity of underlying technologies using its own declarative language. It is extremely portable, extensible, and fast.

Read the introductory blog post about Ferret here!

Features

• Declarative language
• Support of both static and dynamic web pages
• Embeddable
• Extensible

Documentation is available at our website.

Different languages

• Ferret for python. Pyfer

Documentation

Index

• type Instance
  • func New(setters ...Option) *Instance
  • func (i *Instance) Compile(query string) (*runtime.Program, error)
  • func (i *Instance) Drivers() *drivers.Container
  • func (i *Instance) Exec(ctx context.Context, query string, opts ...runtime.Option) ([]byte, error)
  • func (i *Instance) Functions() core.Namespace
  • func (i *Instance) MustCompile(query string) *runtime.Program
  • func (i *Instance) MustExec(ctx context.Context, query string, opts ...runtime.Option) []byte
  • func (i *Instance) MustRun(ctx context.Context, program *runtime.Program, opts ...runtime.Option) []byte
  • func (i *Instance) Run(ctx context.Context, program *runtime.Program, opts ...runtime.Option) ([]byte, error)
• type Option
  • func WithoutStdlib() Option
• type Options
  • func NewOptions(setters []Option) *Options

Types

type Instance

type Instance struct {
	// contains filtered or unexported fields
}

func New

func New(setters ...Option) *Instance

func (*Instance) Compile

func (i *Instance) Compile(query string) (*runtime.Program, error)

func (*Instance) Drivers

func (i *Instance) Drivers() *drivers.Container

func (*Instance) Exec

func (i *Instance) Exec(ctx context.Context, query string, opts ...runtime.Option) ([]byte, error)

func (*Instance) Functions

func (i *Instance) Functions() core.Namespace

func (*Instance) MustCompile

func (i *Instance) MustCompile(query string) *runtime.Program

func (*Instance) MustExec

func (i *Instance) MustExec(ctx context.Context, query string, opts ...runtime.Option) []byte

func (*Instance) MustRun

func (i *Instance) MustRun(ctx context.Context, program *runtime.Program, opts ...runtime.Option) []byte

func (*Instance) Run

func (i *Instance) Run(ctx context.Context, program *runtime.Program, opts ...runtime.Option) ([]byte, error)

type Option

type Option func(opts *Options)

func WithoutStdlib

func WithoutStdlib() Option

type Options

type Options struct {
	// contains filtered or unexported fields
}

func NewOptions

func NewOptions(setters []Option) *Options