<p>I posit that LLMs admit neither the strict nor colloquial sense of programmability. The former could be argued formally in terms of the number of states that can be explored, using the busy beaver numbers, but that would be original research well beyond the scope of a few toots.</p><p>Practically speaking, LLMs fail even the TV remote sense of programmability — if there is some desired behavior you wish for an LLM to exhibit, there's no a priori way to decide what actions to take to achieve that.</p>
