Ilya Nachevsky

Introduction In this post we continue to work on the project, started in our previous post, of exploring hidden reasoning of large language models (LLM). We ask whether an LLM, when given both a “general” and a “secret” question, can generate its public answer to the general question while simultaneously...

This work was done in collaboration with Ilya Nachevsky.[1] Introduction. With the advent of r1-type models, the question of whether a model's “thoughts" are truly genuine is becoming extremely interesting and important. In this post we present our approach to tackle the following problem: whether the visible chain-of-thought produced by...