TasteVal: Measuring the Experimental Research Taste of AI Systems Against Human Experts

📝Tweet, 📄 PaperWe introduce TasteVal, a benchmark that measures the experimental research taste of AI models on AI R&D tasks. We define research taste as the ability to pick interesting problems to solve, design experiments, and interpret experimental results.