Thinking Machines Lab just released Inkling, their first model trained from scratch, weights are open, fine-tunable on Tinker. The lab pitches it as a base for customization.
What is Inkling?
Inkling is a Mixture-of-Experts transformer with 975B total parameters and 41B active. It supports a context window of up to 1M tokens. Pretraining covered 45 trillion tokens of text, images, audio, and video. Inputs accept text, images, and audio; output is UTF-8 text only.
The research team also previewed Inkling-Small, a 276B-parameter MoE with 12B active parameters. It matches or exceeds its larger sibling on many benchmarks, and its weights arrive once testing finishes. Because customization/finetuning is the key differentiator, the architecture matters here very much.
Inside The Architecture
