February 28th, 2025
- trying to play peekaboo with my child but she's into Don Hoffman's Interface Theory of Perception:
me: where'd daddy go?
baby: my
- #2tweet it's impossible for an LLM to hold a single consistent intention without articulating that intention out loud. It is simply a giant probability distribution and any opportunity that is even vaguely compatible with what it said so far is on the table.
Which means that in addition to chain of thought being useful for solving problems via spending more time on it... It's also useful for having a coherent response to the user (which does kind of require engaging with the problem enough to have apparently decided, such that the decision articulated out loud then constraints the user facing output)- it's impossible for an LLM to hold a single consistent intention without articulating that intention out loud. It is simply a giant probability distribution and any opportunity that is even vaguely compatible with what it said so far is on the table.
- Which means that in addition to chain of thought being useful for solving problems via spending more time on it... It's also useful for having a coherent response to the user (which does kind of require engaging with the problem enough to have apparently decided, such that the decision articulated out loud then constraints the user facing output)