Why Go
- Case Studies
  
  Common problems companies solve with Go
- Use Cases
  
  Stories about how and why companies use Go
- Security Policy
  
  How Go can help keep you secure by default
Learn
Docs
- Effective Go
  
  Tips for writing clear, performant, and idiomatic Go code
- Go User Manual
  
  A complete introduction to building software with Go
- Standard library
  
  Reference documentation for Go's standard library
- Release Notes
  
  Learn what's new in each Go release
Packages
Community
- Recorded Talks
  
  Videos from prior events
- Meetups
  
  Meet other local Go developers
- Conferences
  
  Learn and network with Go developers from around the world
- Go blog
  
  The Go project's official blog.
- Go project
  
  Get help and stay informed from Go
- Get connected

bart

package

Go to main page

Versions in this module

v0

v0.1.2

Oct 17, 2022

v0.1.1

Sep 25, 2022

Changes in this version

+ type BPETokenizer struct

+ BosTokenID int

+ DecoderStartTokenID int

+ EosTokenID int

+ ExtraSpecialTokenIDs map[int]string

+ PadTokenID int

+ func (m *BPETokenizer) Detokenize(tokenIds []int, stripPaddingTokens bool) string

+ func (m *BPETokenizer) Tokenize(text string) ([]int, error)

+ type SentencePieceTokenizer struct

+ BosTokenID int

+ DecoderStartTokenID int

+ EosTokenID int

+ PadTokenID int

+ func (m *SentencePieceTokenizer) Detokenize(tokenIds []int, stripPaddingTokens bool) string

+ func (m *SentencePieceTokenizer) Tokenize(text string) ([]int, error)

+ type Text2Text struct

+ Model *bart.ModelForConditionalGeneration

+ Tokenizer Tokenizer

+ func LoadText2Text(modelPath string) (*Text2Text, error)

+ func (m *Text2Text) Close() error

+ func (m *Text2Text) Generate(ctx context.Context, text string, opts *text2text.Options) (text2text.Response, error)

+ type Tokenizer interface

+ Detokenize func(tokenIds []int, stripPaddingTokens bool) string

+ Tokenize func(text string) ([]int, error)

v0.1.0

Sep 18, 2022