Announcement on EleutherAI Blog https://blog.eleuther.ai/categories/announcement/ Recent content in Announcement on EleutherAI Blog Hugo -- gohugo.io en-us Thu, 31 Oct 2024 00:00:00 +0000 Third-party evaluation to identify risks in LLMs’ training data https://blog.eleuther.ai/third-party-evals/ Thu, 31 Oct 2024 00:00:00 +0000 https://blog.eleuther.ai/third-party-evals/ An overview of the minetester and preliminary work Llemma: An Open Language Model For Mathematics https://blog.eleuther.ai/llemma/ Mon, 16 Oct 2023 20:00:00 -0600 https://blog.eleuther.ai/llemma/ ArXiv | Models | Data | Code | Blog | Sample Explorer Today we release Llemma: 7 billion and 34 billion parameter language models for mathematics. The Llemma models were initialized with Code Llama weights, then trained on the Proof-Pile II, a 55 billion token dataset of mathematical and scientific documents. The resulting models show improved mathematical capabilities, and can be adapted to various tasks through prompting or additional fine-tuning. Minetester: A fully open RL environment built on Minetest https://blog.eleuther.ai/minetester-intro/ Sat, 08 Jul 2023 00:00:00 +0000 https://blog.eleuther.ai/minetester-intro/ An overview of the minetester and preliminary work Alignment Research @ EleutherAI https://blog.eleuther.ai/alignment-eleuther/ Wed, 03 May 2023 00:00:00 +0000 https://blog.eleuther.ai/alignment-eleuther/ A breif overview of EAIs approach to alignment Exploratory Analysis of TRLX RLHF Transformers with TransformerLens https://blog.eleuther.ai/trlx-exploratory-analysis/ Sun, 02 Apr 2023 00:00:00 +0000 https://blog.eleuther.ai/trlx-exploratory-analysis/ A demonstration of interpretabilty for RLHF models Announcing GPT-NeoX-20B https://blog.eleuther.ai/announcing-20b/ Wed, 02 Feb 2022 11:00:00 -0500 https://blog.eleuther.ai/announcing-20b/ Announcing GPT-NeoX-20B, a 20 billion parameter model trained in collaboration with CoreWeave.