SentencePiece¶
Description¶
Unsupervised text tokenizer for Neural Network-based text generation.
More information¶
- Homepage: https://github.com/google/sentencepiece
Availability¶
| Module | Manneback | Lemaitre4 |
|---|---|---|
| SentencePiece/0.2.0-GCC-12.3.0 | √ |
Unsupervised text tokenizer for Neural Network-based text generation.
| Module | Manneback | Lemaitre4 |
|---|---|---|
| SentencePiece/0.2.0-GCC-12.3.0 | √ |