ByteDance study finds that asking LMMs questions beats making it transcribe text for long document training

ByteDance Seed shows that a 7B model can answer questions on long, image-heavy documents more reliably than much larger models, even when documents are four times longer than anything it saw during training. Instead of transcribing pages, the model learns by answering questions and finding the right passages on its own.

Raccontata dathe-decoder.com