Documentation
¶
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
func GoQueryLinksFilter ¶
func GoQueryLinksFilter() crawler.FilterFunc
func RegexpLinksFilter ¶
func RegexpLinksFilter() crawler.FilterFunc
Do not need to implement streaming capabilities in RegExp filter, because it does not worth it, it's not performant.
func StreamingFSMLinksFilter ¶
func StreamingFSMLinksFilter(chunkSize int) crawler.FilterFunc
FIXME Strange behaviour on larger chunks FIXME Strange behaviour on smaller chunks
func StreamingGoHTMLLinksFilter ¶
func StreamingGoHTMLLinksFilter() crawler.FilterFunc
func StreamingScannerLinksFilter ¶
func StreamingScannerLinksFilter() crawler.FilterFunc
Not going to finish it, but it's performance is reasonable, but memory consumption is near to zero
Types ¶
This section is empty.
Source Files
Click to show internal directories.
Click to hide internal directories.