You're probably not doing experiments right
I recently started working as a research engineer and it's been a significant mindset shift in how I approach my work. it's tricky to run experiments with LLMs efficiently and accurately and after months of trial and error, I've found that there are three key factors that make the biggest difference
- Being clear about what you're varying
- Investing time to build out some infrastructure
- Doing some simple sensitivity analysis
Let's see how each of these can make a difference in your experimental workflow.