Concept learning becomes possible only when existing representations fail to account for experience. Most models of learning and inference, however, presuppose a fixed representational basis within which belief updating occurs. In this paper, I address a prior question: under what structural conditions can the representational basis itself expand in a principled and selective way? I propose a geometric framework in which conceptual growth is modeled as admissible basis extension evaluated under a Minimum Description Length (MDL) criterion. Experience, whether externally observed or internally simulated, is represented as vectors relative to a current conceptual subspace. Residual components capture systematic representational failure, and candidate conceptual extensions are restricted to low-rank, admissible transformations. I show that any MDL-accepted extension can be chosen so that its novel directions lie entirely within the residual span induced by experience, while extensions orthogonal to this span strictly increase description length and are therefore rejected. This yields a conservative account of imagination and conceptual innovation. Internally generated counterfactual representations contribute to learning only insofar as they expose or amplify structured residual error, and cannot introduce arbitrary novelty. I further distinguish representational counterfactuals--counterfactuals over an agent's conceptual basis--from causal or value-level counterfactuals, and show how MDL provides a normative selection principle governing representational change. Overall, the framework characterizes conceptual development as an error-driven, geometry-constrained process of basis extension, clarifying both the role and the limits of imagination in learning and theory change.
翻译:概念学习只有在现有表征无法解释经验时才有可能发生。然而,大多数学习与推理模型都预设了一个固定的表征基,信念更新在此基内进行。本文探讨一个更根本的问题:在何种结构条件下,表征基本身能够以有原则且选择性的方式扩展?我提出一个几何框架,其中概念增长被建模为在最小描述长度准则下评估的容许基扩展。经验——无论是外部观察还是内部模拟——都被表示为相对于当前概念子空间的向量。残差分量捕捉系统性的表征失败,而候选的概念扩展被限制为低秩的容许变换。我证明,任何被MDL接受的扩展都可以被选择,使其新方向完全位于经验诱导的残差张成空间内,而与此空间正交的扩展则会严格增加描述长度,因此被拒绝。这为想象力和概念创新提供了一个保守的解释。内部生成的反事实表征只有在暴露或放大结构化残差误差的程度上才对学习有所贡献,而不能引入任意的新颖性。我进一步区分了表征反事实(关于智能体概念基的反事实)与因果或价值层面的反事实,并展示了MDL如何为表征变化提供了一个规范的选择原则。总体而言,该框架将概念发展描述为一个误差驱动、几何约束的基扩展过程,阐明了想象力在学习和理论变革中的作用与局限。