parser

Documentation

Index

• Constants
• func DetectParamInfo(adjacentNumberGroups *info.MonotonicPageInfoGroups, docURL string, ...) *info.PageParamInfo
• type DetectionState
• type PageCandidate
• type PageCandidatesMap

Constants

const (
	MaxPagingDocs = 100
)

Functions

func DetectParamInfo

func DetectParamInfo(adjacentNumberGroups *info.MonotonicPageInfoGroups, docURL string, logger logutil.Logger) *info.PageParamInfo

DetectParamInfo creates a PageParamInfo based on outlinks and numeric text around them. Always return PageParamInfo (never nil). If no page parameter is detected or determined to be best, its ParamType is Unset.

Types

type DetectionState

type DetectionState struct {
	// contains filtered or unexported fields
}

DetectionState keeps track of the detection state: - best PageParamInfo detected so far - if multiple page patterns have been found.

type PageCandidate

type PageCandidate struct {
	// contains filtered or unexported fields
}

type PageCandidatesMap

type PageCandidatesMap map[string]PageCandidate

PageCandidatesMap stores a map of URL pattern to its associated list of PageLinkInfo's.