proxypool

Documentation

Overview

Package proxypool offers a proxy ranking model.

Index

• func InitProxyPool(urls string, test string, timeout time.Duration) (pp map[string]*ProxyPool)
• type Proxy
  • func NewProxies(urls []string) []*Proxy
  • func NewProxy(s string) (*Proxy, error)
  • func (p *Proxy) Check(target *url.URL, timeout time.Duration) error
  • func (p *Proxy) Dup() *Proxy
• type ProxyPool
  • func (pp *ProxyPool) GetProxy(i int) (p *Proxy)
  • func (pp *ProxyPool) Sort()
  • func (pp *ProxyPool) Update()
  • func (pp *ProxyPool) UpdateProxy(p *Proxy, d time.Duration)

Functions

func InitProxyPool

func InitProxyPool(urls string, test string, timeout time.Duration) (pp map[string]*ProxyPool)

InitProxyPool initializes a ProxyPool from configured URLs.

Types

type Proxy

type Proxy struct {
	Ewma *ewma.EWMA
	URL  *url.URL
	// contains filtered or unexported fields
}

Proxy stores the upstream proxy(socks/http, h3) settings.

func NewProxies

func NewProxies(urls []string) []*Proxy

NewProxies generates Proxies form URL strings.

func NewProxy

func NewProxy(s string) (*Proxy, error)

NewProxy generates a Proxy form a URL string.

func (*Proxy) Check

func (p *Proxy) Check(target *url.URL, timeout time.Duration) error

Check the avalability of a Proxy.

func (*Proxy) Dup

func (p *Proxy) Dup() *Proxy

Dup duplicates a Proxy struct.

type ProxyPool

type ProxyPool struct {
	sync.RWMutex
	Proxies       []*Proxy
	Checker       string
	ProxyProbeURL *url.URL
	Timeout       time.Duration
}

ProxyPool struct.

func (*ProxyPool) GetProxy

func (pp *ProxyPool) GetProxy(i int) (p *Proxy)

GetProxy gets a proxy by index mapping.

func (*ProxyPool) Sort

func (pp *ProxyPool) Sort()

Sort the proxies in pool.

func (*ProxyPool) Update

func (pp *ProxyPool) Update()

Update and sort the EWMA of proxies in the pool.

func (*ProxyPool) UpdateProxy

func (pp *ProxyPool) UpdateProxy(p *Proxy, d time.Duration)

UpdateProxy updates EWMA of the specified proxy.