documentloader

Documentation

Index

• type Text
  • func NewText(r io.Reader) *Text
  • func (l *Text) Load(ctx context.Context) ([]schema.Document, error)
  • func (l *Text) LoadAndSplit(ctx context.Context, splitter schema.TextSplitter) ([]schema.Document, error)

Types

type Text

type Text struct {
	// contains filtered or unexported fields
}

func NewText

func NewText(r io.Reader) *Text

NewText creates a new Text document loader with the given reader.

func (*Text) Load

func (l *Text) Load(ctx context.Context) ([]schema.Document, error)

Load reads the content from the reader and returns it as a single document.

func (*Text) LoadAndSplit

func (l *Text) LoadAndSplit(ctx context.Context, splitter schema.TextSplitter) ([]schema.Document, error)

LoadAndSplit reads the content from the reader and splits it into multiple documents using the provided splitter.