Blog

Discussing and disseminating open-source AI research.

2022

February

Announcing GPT-NeoX-20B

February 2, 2022 · Connor Leahy

2021

October

A Preliminary Exploration into Factored Cognition with Language Models

October 25, 2021 · Leo Gao, Kyle McDonell, Laria Reynolds, Stella Biderman

Multiple Choice Normalization in LM Evaluation

October 11, 2021 · Leo Gao

August

Downstream Evaluations of Rotary Position Embeddings

August 16, 2021 · Leo Gao

July

What A Long, Strange Trip It's Been: EleutherAI One Year Retrospective

July 7, 2021 · Connor Leahy, Eric Hallahan, Leo Gao, Stella Biderman

June

Why Release a Large Language Model?

June 2, 2021 · Connor Leahy

May

On the Sizes of OpenAI API Models

May 24, 2021 · Leo Gao

Evaluating Different Fewshot Description Prompts on GPT-3

May 24, 2021 · Leo Gao

Finetuning Models on Downstream Tasks

May 24, 2021 · Leo Gao

Activation Function Ablation

May 24, 2021 · Leo Gao

April

Rotary Embeddings: A Relative Revolution

April 20, 2021 · Stella Biderman, Sid Black, Charles Foster, Leo Gao, Eric Hallahan, Horace He, Ben Wang, Phil Wang