Storia in 1 fonti

I Added Three Rules to Gemma 4. The MoE Searched. The Dense Model Refused.

I ran Gemma 4 26B (MoE, 4B active) and Gemma 4 31B (dense) against GPT-4o and GPT-4o mini on a real Arabic e-commerce chatbot. Then I added three Gemma-only prompt rules. The MoE variant opened the catalog. The dense variant stopped reading it. Same prompt, two architectures, opposite failures.

Raccontata da

dev.to

sabato 16 maggio 2026·dev.to
I Added Three Rules to Gemma 4. The MoE Searched. The Dense Model Refused.
I ran Gemma 4 26B (MoE, 4B active) and Gemma 4 31B (dense) against GPT-4o and GPT-4o mini on a real Arabic e-commerce chatbot. Then I added three Gemma-only prompt rules. The MoE…