About a year ago, I was learning PyTorch. I was learning about model training, transformers,...
About a year ago, I was learning PyTorch.
I was learning about model training, transformers, language models, tokenization, architectures, and all the other things that come with building models.
And honestly?
There were a LOT of parameters.
d_model
Honestly, Tensorless was not supposed to become this big. I was learning PyTorch. I wanted to...
I trained my own transformer model from the ground up — no HuggingFace, no shortcuts. Here's the full...
Every time a PyTorch model refuses to learn, the debugging process looks the same: Stare at the...
Tokenization → embeddings → causal Transformer → LM head → softmax → loss → backpropagation. No...
For the last few months I've been building Tlamatini, an open-source local-first AI developer...
Introduction When learning machine learning, it is easy to rely on powerful frameworks such as...
