Why Go
- Case Studies
  
  Common problems companies solve with Go
- Use Cases
  
  Stories about how and why companies use Go
- Security Policy
  
  How Go can help keep you secure by default
Learn
Docs
- Effective Go
  
  Tips for writing clear, performant, and idiomatic Go code
- Go User Manual
  
  A complete introduction to building software with Go
- Standard library
  
  Reference documentation for Go's standard library
- Release Notes
  
  Learn what's new in each Go release
Packages
Community
- Recorded Talks
  
  Videos from prior events
- Meetups
  
  Meet other local Go developers
- Conferences
  
  Learn and network with Go developers from around the world
- Go blog
  
  The Go project's official blog.
- Go project
  
  Get help and stay informed from Go
- Get connected

logservice

package

Go to main page

Versions in this module

v0

v0.4.0

Aug 31, 2023

v0.3.2

Apr 13, 2023

v0.3.1

Apr 4, 2023

v0.3.0

Mar 13, 2023

Changes in this version

+ const TableCrawlLog

+ const TablePageLog

+ const TableResource

+ type Resource struct

+ ContentType string

+ DiscoveryPath string

+ Error *ErrorUDT

+ FromCache bool

+ Method string

+ PageId string

+ Referrer string

+ Renderable bool

+ ResourceType string

+ StatusCode int32

+ Uri string

+ WarcId string

v0.2.0

Oct 28, 2022

v0.1.7

Sep 29, 2021

v0.1.7-alpha.1

Sep 28, 2021

v0.1.6

May 4, 2021

Changes in this version

+ const Namespace

+ var PageLinks = promauto.NewCounterVec(prometheus.CounterOpts{ ... }, []string{ ... })

+ var PageOutlinks = promauto.NewSummary(prometheus.SummaryOpts{ ... })

+ var PageRequests = promauto.NewCounter(prometheus.CounterOpts{ ... })

+ var PageResources = promauto.NewSummary(prometheus.SummaryOpts{ ... })

+ var PageResourcesCacheHit = promauto.NewSummary(prometheus.SummaryOpts{ ... })

+ var PageResourcesCacheMiss = promauto.NewSummary(prometheus.SummaryOpts{ ... })

+ var UriFetchTimeSeconds = promauto.NewSummary(prometheus.SummaryOpts{ ... })

+ var UriMimeType = promauto.NewCounterVec(prometheus.CounterOpts{ ... }, []string{ ... })

+ var UriRecordType = promauto.NewCounterVec(prometheus.CounterOpts{ ... }, []string{ ... })

+ var UriRequests = promauto.NewCounter(prometheus.CounterOpts{ ... })

+ var UriRequestsFailed = promauto.NewCounter(prometheus.CounterOpts{ ... })

+ var UriSizeBytes = promauto.NewSummary(prometheus.SummaryOpts{ ... })

+ var UriStatusCode = promauto.NewCounterVec(prometheus.CounterOpts{ ... }, []string{ ... })

+ func CollectCrawlLog(crawlLog *logV1.CrawlLog)

+ func CollectPageLog(pageLog *logV1.PageLog)

+ type CrawlLog struct

+ BlockDigest string

+ CollectionFinalName string

+ ContentType string

+ DiscoveryPath string

+ Error *ErrorUDT

+ ExecutionId string

+ FetchTimeMs int64

+ FetchTimeStamp time.Time

+ IpAddress string

+ JobExecutionId string

+ Method string

+ PayloadDigest string

+ RecordType string

+ Referrer string

+ RequestedUri string

+ ResponseUri string

+ Retries int32

+ Size int64

+ StatusCode int32

+ StorageRef string

+ TimeStamp time.Time

+ WarcId string

+ WarcRefersTo string

+ type ErrorUDT struct

+ Code int32

+ Detail string

+ Msg string

+ type LogServer struct

+ func New(session gocqlx.Session, readPoolSize int, writePoolSize int) *LogServer

+ func (l *LogServer) Close()

+ func (l *LogServer) ListCrawlLogs(req *logV1.CrawlLogListRequest, stream logV1.Log_ListCrawlLogsServer) error

+ func (l *LogServer) ListPageLogs(req *logV1.PageLogListRequest, stream logV1.Log_ListPageLogsServer) error

+ func (l *LogServer) WriteCrawlLog(stream logV1.Log_WriteCrawlLogServer) error

+ func (l *LogServer) WritePageLog(stream logV1.Log_WritePageLogServer) error

+ type PageLog struct

+ CollectionFinalName string

+ ExecutionId string

+ JobExecutionId string

+ Method string

+ Outlink []string

+ Referrer string

+ Resource []*ResourceUDT

+ Uri string

+ WarcId string

+ type Pool struct

+ func NewPool(size int, new func() *gocqlx.Queryx) *Pool

+ func (p *Pool) Borrow() *gocqlx.Queryx

+ func (p *Pool) Drain()

+ func (p *Pool) Return(c *gocqlx.Queryx)

+ type ResourceUDT struct

+ ContentType string

+ DiscoveryPath string

+ Error *ErrorUDT

+ FromCache bool

+ Method string

+ Referrer string

+ Renderable bool

+ ResourceType string

+ StatusCode int32

+ Uri string

+ WarcId string