随机文法作为通用统计模型的扩展

项目名称： 随机文法作为通用统计模型的扩展

项目编号： No.61503248

项目类型： 青年科学基金项目

立项/批准年度： 2016

项目学科： 其他

项目作者： 屠可伟

作者单位： 上海科技大学

项目金额： 20万元

中文摘要： 随机文法是形式文法的概率化扩展，在自然语言处理领域被广泛应用，并且近十年间在计算机视觉领域的扩展应用也得到了很大发展。本项目计划将随机文法扩展为一种通用的统计关系模型，从而统一现有工作对随机文法基于不同数据类型所做的扩展，并促进随机文法在更多的数据类型和人工智能问题上的应用。相比于已有的统计关系模型，基于随机文法的统计关系模型在表达能力和计算复杂度之间有望达到更好的折中，从而为解决统计关系学习领域的这个核心问题提供一个新的研究角度。以此为基础，本项目计划进一步研究随机文法在传统非关系型统计建模上的应用，以期突破传统概率图模型在表达能力上的限制。本项目的主要研究内容包括：基于随机文法的关系型和非关系型通用统计模型；所提出模型与现有的统计模型之间在表达能力上的关系；所提出模型的快速有效的推理算法和非监督、弱监督自动学习算法；最后，基于所提出通用模型对随机文法在新的领域和问题上的应用进行预研。

中文关键词： 随机文法；概率模型；统计关系模型；机器学习

英文摘要： Stochastic grammars are a probabilistic extension of formal grammars, which are widely used in the domain of natural language processing and are also increasingly extended and applied to problems in the domain of computer vision over the last ten years. This project aims to extend stochastic grammars as general-purpose statistical relational models, thus unifying the existing extensions of stochastic grammars that are designed for different data types, as well as facilitating the application of stochastic grammars on additional data types and AI problems. Compared with existing statistical relational models, the proposed models based on stochastic grammars may achieve a better trade-off between expressiveness and computational complexity, which may provide a novel direction in solving this central problem in the domain of statistical relational learning. Based on the above research, this project further plans to study the application of stochastic grammars to traditional non-relational statistical modeling, hoping to break through the representational limitation of the classical probabilistic graphical models. The main subjects of this project include: general-purpose statistical relational and non-relational models based on stochastic grammars; the relationship between such models and existing statistical models in terms of expressiveness; fast and effective inference algorithms and unsupervised and weakly-supervised automatic learning algorithms for such models; and finally, based on such general-purpose models, conducting preliminary research of novel applications of stochastic grammars on new domains and problems.

英文关键词： Stochastic Grammars;Probabilistic Models;Statistical Relational Models;Machine Learning