HomeAI · summaries
Storia in 2 fonti
smevals - a small eval suite for evaluating models, prompts, and harnesses
We've been building a new system for running evals against different models, prompts, and harnesses, with the goal of being able to identify the most appropriate small and inexpensive models for different categories of task.
Confronto fonti
2 prospettive sulla stessa storiaTimeline cronologica
- ·
simonwillison.net
smevals—a small eval suite for evaluating models, prompts, and harnesses
I've been working with Jesse Vincent's Prime Radiant applied AI research lab building out this evals framework to help answer questions about the capabilities of different models.…
- ·
primeradiant.com
smevals - a small eval suite for evaluating models, prompts, and harnesses
We've been building a new system for running evals against different models, prompts, and harnesses, with the goal of being able to identify the most appropriate small and…