EleutherAI
Home
About
Blog
Blog
Discussing and disseminating open-source AI research.
2023
September
Contributor Spotlight: Mohammad Aflah Khan
September 21, 2023 路 Mohammad Aflah Khan
The first New England RLHF Hackers Hackathon
September 19, 2023 路 Suraj Anand, Stephen Casper, Louis Castricato, Arjun Khurana, Alyssa Loo, Shukai Ni, Benjamin Spiegel, Jiayu Zheng, Yong Zheng-Xin
July
EleutherAI's Thoughts on the EU AI Act
July 26, 2023 路 Aviya Skowron, Stella Biderman
Minetester: A fully open RL environment built on Minetest
July 8, 2023 路 Curtis Huebner, Robert Klassert, Stepan Shabalin, Edwin Fennell, Delta Hessler
May
馃惗Safetensors audited as really safe and becoming the default
May 23, 2023 路 Nicolas Patry, Stella Biderman, Garry Jean-Baptiste
Alignment Research @ EleutherAI
May 3, 2023 路 Curtis Huebner
April
Transformer Math 101
April 18, 2023 路 Quentin Anthony, Stella Biderman, Hailey Schoelkopf
Exploratory Analysis of TRLX RLHF Transformers with TransformerLens
April 2, 2023 路 Curt Tigges
March
EleutherAI Second Retrospective: The long version
March 26, 2023 路 Stella Biderman, Shivanshu Purohit, Curtis Huebner, Leo Gao, Connor Leahy, Eric Hallahan
The View from 30,000 Feet: Preface to the Second EleutherAI Retrospective
March 2, 2023 路 Stella Biderman, Curtis Huebner, Connor Leahy, Eric Hallahan
2022
February
Announcing GPT-NeoX-20B
February 2, 2022 路 Connor Leahy
2021
October
A Preliminary Exploration into Factored Cognition with Language Models
October 25, 2021 路 Leo Gao, Kyle McDonell, Laria Reynolds, Stella Biderman
Multiple Choice Normalization in LM Evaluation
October 11, 2021 路 Leo Gao
August
Downstream Evaluations of Rotary Position Embeddings
August 16, 2021 路 Leo Gao
July
What A Long, Strange Trip It's Been: EleutherAI One Year Retrospective
July 7, 2021 路 Connor Leahy, Eric Hallahan, Leo Gao, Stella Biderman
June
Why Release a Large Language Model?
June 2, 2021 路 Connor Leahy
May
On the Sizes of OpenAI API Models
May 24, 2021 路 Leo Gao
Evaluating Different Fewshot Description Prompts on GPT-3
May 24, 2021 路 Leo Gao
Finetuning Models on Downstream Tasks
May 24, 2021 路 Leo Gao
Activation Function Ablation
May 24, 2021 路 Leo Gao
April
Rotary Embeddings: A Relative Revolution
April 20, 2021 路 Stella Biderman, Sid Black, Charles Foster, Leo Gao, Eric Hallahan, Horace He, Ben Wang, Phil Wang