We want to advance process-based supervision for language models. To make it easier for others to contribute to that goal, we're sharing code for writing compositional language model programs, and a tutorial that explains how to get started:
We've been using ICE as part of our work on Elicit and have found it useful in practice.
ICE is an open-source Python library for writing, debugging, and visualizing compositional language model programs. ICE makes it easy to: