Aether-7B-5Attn: VIDRAFT's Fully Open-Source MoE Foundation Model with Five Heterogeneous Attention Mechanisms
TL;DR: Korean AI startup VIDRAFT has released Aether-7B-5Attn on Hugging Face — a fully open-source Mixture-of-Experts foundation model with 6.59B total parameters that integrates five distinct attention mechanisms arranged in a novel Latin-square layer structure. It ships under Apache 2.0 with full training data recipes, code, hyperparameters, logs, intermediate checkpoints, and evaluation code, making it one of the most transparently documented open releases to date.
What it is
Aether-7B-5Attn is a foundation language model developed by VIDRAFT (비드래프트), a Seoul-based Pre-AGI AI deep-tech company. The model is published on Hugging Face under the Apache 2.0 license and is part of VIDRAFT's broader four-layer integrated AGI system, which includes the Darwin model family, the AETHER architecture, the PROMETHEUS world model, and the HEPHAESTUS embedded AI stack.
Key release artifacts that are all publicly available:
