scraper

Documentation

Index

• type PostCommentScraper
  • func New(config *client.ScraperConfig, awsServiceAddress string, ...) *PostCommentScraper

Types

type PostCommentScraper

type PostCommentScraper struct {
	*worker.Worker
	// contains filtered or unexported fields
}

PostCommentScraper scrapes the comments under post

func New

func New(config *client.ScraperConfig, awsServiceAddress string, postIDQReader *kafka.Reader, commentsInfoQWriter *kafka.Writer, errQWriter *kafka.Writer, commentLimit int) *PostCommentScraper

New returns an initialized PostCommentScraper