The EleutherAI Research Notes are an experiment in sharing bites of preliminary research results through short and informal posts rather than the occasional paper. Our hope for this format is to encourage low-friction sharing of ideas in the fast-paced world of modern research.
Finetuning Models on Downstream Tasks
We tuned GPT-Neo on eval harness tasks to see how it would change its performance.