Release on EleutherAI Blog https://blog.eleuther.ai/categories/release/ Recent content in Release on EleutherAI Blog Hugo -- gohugo.io en-us Thu, 10 Oct 2024 00:00:00 +0000 RLHF and RLAIF in GPT-NeoX https://blog.eleuther.ai/rlhf-and-rlaif-in-gpt-neox/ Thu, 10 Oct 2024 00:00:00 +0000 https://blog.eleuther.ai/rlhf-and-rlaif-in-gpt-neox/ GPT-NeoX now supports post-training thanks to a collaboration with SynthLabs. The Practitioner's Guide to the Maximal Update Parameterization https://blog.eleuther.ai/mutransfer/ Thu, 19 Sep 2024 00:00:00 +0000 https://blog.eleuther.ai/mutransfer/ Exploring the implementation details of muTransfer