x

AI ALIGNMENT FORUM

AF

Callum Canavan — AI Alignment Forum

Callum Canavan

Callum Canavan

Message

30

Ω

11

2

1

1y

Callum Canavan

30

Ω

11

1y

Eliciting base models with simple unsupervised techniques

Authors: Aditya Shrivastava*, Allison Qi*, Callum Canavan*, Tianyi Alex Qiu, Jonathan Michala, Fabien Roger (*Equal contributions, reverse alphabetical) Wen et al. introduced the internal coherence maximization (ICM) algorithm for unsupervised elicitation of base models. They showed that for several datasets, training a base model on labels generated by their algorithm...