crawl

package
v0.0.0-...-13e68c6 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Aug 28, 2024 License: MIT Imports: 15 Imported by: 0

Documentation

Index

Constants

This section is empty.

Variables

View Source
var MAX_BODY_SIZE int64 = 1024 * 1024 * 10

Functions

func ScrapeCDP

func ScrapeCDP(url string) (string, error)

func ScrapeCDPImages

func ScrapeCDPImages(url string) ([]llm.InlineData, error)

func ScrapeCDPImagesPDF

func ScrapeCDPImagesPDF(url string) ([]llm.InlineData, error)

func ScrapeHTTP

func ScrapeHTTP(client *http.Client, url string) (string, error)

Types

This section is empty.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL