#токенизация
-
Byte language models: long sequences as a resource, not a burden
Researchers in Shanghai show that a plain Transformer can learn directly from raw bytes without a tokenizer — and, as parameters scale, overtake subword models.