Why Go
- Case Studies
  
  Common problems companies solve with Go
- Use Cases
  
  Stories about how and why companies use Go
- Security Policy
  
  How Go can help keep you secure by default
Learn
Docs
- Effective Go
  
  Tips for writing clear, performant, and idiomatic Go code
- Go User Manual
  
  A complete introduction to building software with Go
- Standard library
  
  Reference documentation for Go's standard library
- Release Notes
  
  Learn what's new in each Go release
Packages
Community
- Recorded Talks
  
  Videos from prior events
- Meetups
  
  Meet other local Go developers
- Conferences
  
  Learn and network with Go developers from around the world
- Go blog
  
  The Go project's official blog.
- Go project
  
  Get help and stay informed from Go
- Get connected

text_splitter

package

v0.0.0-...-66bbac4 Latest Latest Go to latest Published: Sep 21, 2023 License: GPL-3.0 Imports: 2 Imported by: 0

Details

Valid go.mod file
Redistributable license
Tagged version
Stable version
Learn more about best practices

Repository

github.com/kamushadenes/chloe

Documentation ¶

Index ¶

func CharacterTextSplitter(text string, maxChunkSize int, separator string, lengthFunc LengthFunc) []string
func LatexTextSplitter(text string, maxChunkSize int, lengthFunc LengthFunc) []string
func MarkdownTextSplitter(text string, maxChunkSize int, lengthFunc LengthFunc) []string
func NaiveSentenceTextSplitter(text string, maxChunkSize int, lengthFunc LengthFunc) []string
func RecursiveCharacterTextSplitter(text string, maxChunkSize int, separators []string, lengthFunc LengthFunc) []string
type LengthFunc

Constants ¶

This section is empty.

Variables ¶

This section is empty.

Functions ¶

func CharacterTextSplitter ¶

func CharacterTextSplitter(text string, maxChunkSize int, separator string, lengthFunc LengthFunc) []string

func LatexTextSplitter ¶

func LatexTextSplitter(text string, maxChunkSize int, lengthFunc LengthFunc) []string

func MarkdownTextSplitter ¶

func MarkdownTextSplitter(text string, maxChunkSize int, lengthFunc LengthFunc) []string

func NaiveSentenceTextSplitter ¶

func NaiveSentenceTextSplitter(text string, maxChunkSize int, lengthFunc LengthFunc) []string

func RecursiveCharacterTextSplitter ¶

func RecursiveCharacterTextSplitter(text string, maxChunkSize int, separators []string, lengthFunc LengthFunc) []string

Types ¶

type LengthFunc ¶

type LengthFunc func(string) int

Source Files ¶

View all Source files