Many companies want to understand power utilization to feel good about the AI they will come to rely on. To help organizations, the data center industry must agree upon using a new metric, one that should bridge the worlds of power use and AI compute work output.
This is why I think tokens per watt should come to the forefront.
Usefulness of tokens per watt
You may ask, “What are tokens?” Simply put, tokens are the language that AI models speak. Text, images, audio clips and videos are broken into logical and descriptive pieces that all AI models can process.
Tokens per watt can put a different lens on the topic by showing that, while power use is increasing, the work output is advancing at a much greater speed
