Meta releases open-source Muse Glimmer model with 30B parameters
Meta Platforms Inc. today released Muse Glimmer, an open-source language model that can run on personal computers.
The company also published a lengthy essay penned by Chief Executive Officer Mark Zuckerberg. The document discusses the risks of artificial intelligence, open-source model regulations and several related topics.
Muse Glimmer features 30 billion parameters, which means that it would normally require about 55 gigabytes of RAM. Meta’s engineers shrunk its footprint to under 20 gigabytes using various optimization methods. As a result, it can run on personal computers and Macs with a single consumer-grade graphics card.
One of the optimization methods Meta used is called quantization. It compressed each of the model’s weights, the configuration settings that determine how it processes data, into four bits. The company determined that the quantization introduced “minimal to no degradation on agentic tasks.”
