Imports github.com/temoto/robotstxt-go github.com/garyburd/redigo/redis gopkg.in/fatih/set.v0 code.google.com/p/go.net/websocket code.google.com/p/go.net/html Standard library imports fmt io io/ioutil log net/http net/url os path strings sync time encoding/xml