minbpe vs turboBPE: Two ways to think about tokenizer training

minbpe is where you learn BPE. turboBPE is where you actually train with it. Here is what separates them and why it matters.

Raccontata dadev.to