stats

Documentation

Overview

Package stats provides a simple way to track and manipulate statistics related to web crawling.

Index

• type Stats
  • func (s *Stats) GetMatchedLinks() int
  • func (s *Stats) GetNotMatchedLinks() int
  • func (s *Stats) GetTotalPages() int
  • func (s *Stats) IncrementMatchedLinks()
  • func (s *Stats) IncrementNotMatchedLinks()
  • func (s *Stats) IncrementTotalLinks()
  • func (s *Stats) IncrementTotalPages()
  • func (s *Stats) Report() map[string]interface{}

Types

type Stats

type Stats struct {
	TotalLinks      int
	MatchedLinks    int
	NotMatchedLinks int
	TotalPages      int
	Links           []string
	// contains filtered or unexported fields
}

Stats holds counters for various metrics related to web crawling.

func (*Stats) GetMatchedLinks

func (s *Stats) GetMatchedLinks() int

GetMatchedLinks retrieves the total number of not matched links.

func (*Stats) GetNotMatchedLinks

func (s *Stats) GetNotMatchedLinks() int

GetNotMatchedLinks retrieves the total number of not matched links.

func (*Stats) GetTotalPages

func (s *Stats) GetTotalPages() int

GetTotalPages retrieves the total number of pages crawled.

func (*Stats) IncrementMatchedLinks

func (s *Stats) IncrementMatchedLinks()

IncrementMatchedLinks increases the MatchedLinks counter by one.

func (*Stats) IncrementNotMatchedLinks

func (s *Stats) IncrementNotMatchedLinks()

IncrementNotMatchedLinks increases the NotMatchedLinks counter by one.

func (*Stats) IncrementTotalLinks

func (s *Stats) IncrementTotalLinks()

IncrementTotalLinks increases the TotalLinks counter by one.

func (*Stats) IncrementTotalPages

func (s *Stats) IncrementTotalPages()

IncrementTotalPages increases the TotalPages counter by one.

func (*Stats) Report

func (s *Stats) Report() map[string]interface{}