Imports
- code.google.com/p/go.net/html
- code.google.com/p/go.net/html/charset
- code.google.com/p/go.net/publicsuffix
- code.google.com/p/log4go
- github.com/PuerkitoBio/purell
- github.com/iParadigms/walker/dnscache
- github.com/iParadigms/walker/mimetools
- github.com/stretchr/testify/mock
- github.com/temoto/robotstxt.go
- gopkg.in/yaml.v2