Directories ¶
Path | Synopsis |
---|---|
Package scraper implements a web scraper as a library
|
Package scraper implements a web scraper as a library |
getter
Package getter defines an interface that is used to request results by URL
|
Package getter defines an interface that is used to request results by URL |
getter/mockgetter
Package mockgetter defines a getter.Interface that returns mock results for use in tests
|
Package mockgetter defines a getter.Interface that returns mock results for use in tests |
getter/webgetter
Package webgetter defines a getter.Interface that gets real results by HTTP
|
Package webgetter defines a getter.Interface that gets real results by HTTP |
logger
Package logger defines an interface that is used to log events and metrics during execution
|
Package logger defines an interface that is used to log events and metrics during execution |
logger/consolelogger
Package consolelogger defines a logger.Interface that emits logs to a writer (usually the console)
|
Package consolelogger defines a logger.Interface that emits logs to a writer (usually the console) |
logger/mocklogger
Package mocklogger defines a logger.Interface that stores a string representation of each logged event for testing
|
Package mocklogger defines a logger.Interface that stores a string representation of each logged event for testing |
parser
Package parser defines an interface used to parse HTML and extract links
|
Package parser defines an interface used to parse HTML and extract links |
parser/htmlparser
Package htmlparser defines a parser.Interface that parses HTML and returns the urls from anchor href attributes
|
Package htmlparser defines a parser.Interface that parses HTML and returns the urls from anchor href attributes |
parser/mockparser
Package mockparser defines a parser.Interface that returns dummy urls for a given input, and is used in tests
|
Package mockparser defines a parser.Interface that returns dummy urls for a given input, and is used in tests |
queuer
Package queuer defines an interface used to queue and execute an action on items
|
Package queuer defines an interface used to queue and execute an action on items |
queuer/concurrentqueuer
Package concurrentqueuer defines a queuer.Interface that runs several workers concurrently on a queue
|
Package concurrentqueuer defines a queuer.Interface that runs several workers concurrently on a queue |
Click to show internal directories.
Click to hide internal directories.