collectlinks

Documentation

Overview

Package collectlinks does extraordinarily simple operation of parsing a given piece of html and providing you with all the hyperlinks hrefs it finds.

Index

• Constants
• Variables
• func All(httpBody io.Reader) []string
• func CollectMailsAsync(in chan http.Response) chan string
• func CollectNamesAndPhonesAsync(in chan http.Response) chan string
• func CollectNamesAsync(in chan http.Response) chan string
• func CollectPhonesAsync(in chan http.Response) chan string
• func FetchPagesAsync(searchWord string, location string, pages string) chan http.Response
• func Names(httpBody io.Reader) []string
• func SetSearchSite(searchSite string) error
• type Record
  • func NamesAndPhones(httpBody io.Reader) []Record
  • func (r Record) String() string

Constants

const (
	SleepDuration = 1

	//XO ΧρυσοςΟδηγος
	XO = iota
	//VR Vrisko.gr
	VR
)

Variables

var SearchSite int

SearchSite The site you want goldenRuffian to search

Functions

func All

func All(httpBody io.Reader) []string

All takes a reader object (like the one returned from http.Get()) It returns a slice of strings representing the "href" attributes from anchor links found in the provided html. It does not close the reader passed to it.

func CollectMailsAsync

func CollectMailsAsync(in chan http.Response) chan string

CollectMailsAsync searches the pages provided in the channel for mails

func CollectNamesAndPhonesAsync

func CollectNamesAndPhonesAsync(in chan http.Response) chan string

CollectNamesAsync searches the pages provided in the channel for names

func CollectNamesAsync

func CollectNamesAsync(in chan http.Response) chan string

CollectNamesAsync searches the pages provided in the channel for names

func CollectPhonesAsync

func CollectPhonesAsync(in chan http.Response) chan string

CollectMailsAsync searches the pages provided in the channel for telephones

func FetchPagesAsync

func FetchPagesAsync(searchWord string, location string, pages string) chan http.Response

FetchPagesAsync fetches html page based on what, where and page number and puts them in a channel

func Names

func Names(httpBody io.Reader) []string

func SetSearchSite

func SetSearchSite(searchSite string) error

SetSearchSite set the website you want to search

Types

type Record

type Record struct {
	Name       string
	Telephones []string
}

Record is the data structure that contains the data extracted from pages TODO: Move this out of here

func NamesAndPhones

func NamesAndPhones(httpBody io.Reader) []Record

func (Record) String

func (r Record) String() string