Binary package “sentencepiece” in ubuntu noble
Unsupervised text tokenizer and detokenizer
SentencePiece is an unsupervised text tokenizer/
designed for Neural Network-based text generation systems where the
vocabulary size is predetermined prior to the neural model training.
Source package
Published versions
- sentencepiece 0.1.99-3 in amd64 (Release)
- sentencepiece 0.2.0-1build1 in amd64 (Proposed)
- sentencepiece 0.2.0-1build1 in amd64 (Release)
- sentencepiece 0.1.99-3 in arm64 (Release)
- sentencepiece 0.2.0-1build1 in arm64 (Proposed)
- sentencepiece 0.2.0-1build1 in arm64 (Release)
- sentencepiece 0.1.99-3 in armhf (Release)
- sentencepiece 0.2.0-1build1 in armhf (Proposed)
- sentencepiece 0.2.0-1build1 in armhf (Release)
- sentencepiece 0.1.99-3 in ppc64el (Release)
- sentencepiece 0.2.0-1build1 in ppc64el (Proposed)
- sentencepiece 0.2.0-1build1 in ppc64el (Release)
- sentencepiece 0.1.99-3 in riscv64 (Release)
- sentencepiece 0.2.0-1build1 in riscv64 (Proposed)
- sentencepiece 0.2.0-1build1 in riscv64 (Release)
- sentencepiece 0.1.99-3 in s390x (Release)
- sentencepiece 0.2.0-1build1 in s390x (Proposed)
- sentencepiece 0.2.0-1build1 in s390x (Release)