SentencePiece outperforms BPE and WordPiece for Dzongkha tokenization

SentencePiece yielded more compact token sequences, fewer fragmented words and comparable processing time versus BPE and WordPiece for Dzongkha tokenization. getnews.me/sentencepiece-outperform... #dzongkha #tokenization #sentencepiece