Directories
¶
| Path | Synopsis |
|---|---|
|
Package charlm provides an implementation of a character-level language model that uses a recurrent neural network as its backbone.
|
Package charlm provides an implementation of a character-level language model that uses a recurrent neural network as its backbone. |
|
Package contextualstringembeddings provides an implementation of the "Contextual String Embeddings" of words (Akbik et al., 2018).
|
Package contextualstringembeddings provides an implementation of the "Contextual String Embeddings" of words (Akbik et al., 2018). |
|
Package evolvingembeddings provides a word embedding model that evolves by dynamically aggregating contextual embeddings over time during inference.
|
Package evolvingembeddings provides a word embedding model that evolves by dynamically aggregating contextual embeddings over time during inference. |
|
Package sequencelabeler provides an implementation of a sequence labeling architecture composed by Embeddings -> BiRNN -> Scorer -> CRF.
|
Package sequencelabeler provides an implementation of a sequence labeling architecture composed by Embeddings -> BiRNN -> Scorer -> CRF. |
|
Package stackedembeddings provides convenient types to stack multiple word embedding representations by concatenating them.
|
Package stackedembeddings provides convenient types to stack multiple word embedding representations by concatenating them. |
|
Package tokenizers is an interim solution while developing `gotokenizers` (https://github.com/nlpodyssey/gotokenizers).
|
Package tokenizers is an interim solution while developing `gotokenizers` (https://github.com/nlpodyssey/gotokenizers). |
|
basetokenizer
Package basetokenizer provides an implementation of a very simple tokenizer that splits by white-spaces (and alike) and punctuation symbols.
|
Package basetokenizer provides an implementation of a very simple tokenizer that splits by white-spaces (and alike) and punctuation symbols. |
|
sentencepiece/internal/sentencepiece
Package sentencepiece implements the SentencePiece encoder (Kudo and Richardson, 2018).
|
Package sentencepiece implements the SentencePiece encoder (Kudo and Richardson, 2018). |
|
transformers
|
|
|
bart
Package bart implements the transformer model introduced by Mike et al., 2019.
|
Package bart implements the transformer model introduced by Mike et al., 2019. |
|
bert
Package bert provides an implementation of BERT model (Bidirectional Encoder Representations from Transformers).
|
Package bert provides an implementation of BERT model (Bidirectional Encoder Representations from Transformers). |
|
generation
Package generation implements a generation search algorithm for conditional generation.
|
Package generation implements a generation search algorithm for conditional generation. |
Click to show internal directories.
Click to hide internal directories.