Blog

Posts

• Why Release a Large Language Model?
• Rotary Embeddings: A Relative Revolution

Research Notes

The EleutherAI Research Notes are an experiment in sharing bites of preliminary research results through short and informal posts rather than the occasional paper. Our hope for this format is to encourage low-friction sharing of ideas in the fast-paced world of modern research.

• On the Sizes of OpenAI API Models
• Evaluating Different Fewshot Description Prompts on GPT-3
• Finetuning Models on Downstream Tasks
• Activation Function Ablation