On the Limits of Prompt-Conditioned Language Models as General-Purpose Learners — ThinkLLM