Hello, I'm Shrijith Venkatramana, and I'm building LiveReview — a blast-radius aware AI code review built for your business-critical systems. Star us to help devs discover the project, give it a try, and share your feedback to help improve the product.
There is a strange fact about training a large language model:
A model with hundreds of billions of parameters is trained by repeatedly nudging a point in an unimaginably high-dimensional space downhill.
That sentence sounds almost absurd.
Imagine a landscape where every coordinate is a model weight. With 70 billion parameters, your "position" is a vector with 70 billion coordinates. The training objective assigns one scalar value to that position. Gradient descent looks at the local slope and says:
