Minority languages continue to lack adequate resources for their development, especially in the technological domain. Likewise, the J.P. Harrington Papers collection at the Smithsonian Institution are difficult to access in practical terms for community members and researchers due to its handwritten and disorganized format. Our current work seeks to make a portion of this publicly-available yet problematic material practically accessible for natural language processing use. Here, we present the Harrington Yowlumne Narrative Corpus, a corpus of 20 narrative texts that derive from the Tejone\~no Yowlumne community of the Tinliw rancheria in Kern County, California between 1910 and 1925. We digitally transcribe the texts and, through a Levenshtein distance-based algorithm and manual checking, we provide gold-standard aligned normalized and lemmatized text. We likewise provide POS tags for each lemmatized token via a lexicon-based deterministic approach. Altogether, the corpus contains 57,136 transcribed characters aligned with 10,719 gold standard text-normalized words.
翻译:同样,史密森学会的J.P. Harrington论文集由于其手写和不成组织的形式,难以为社区成员和研究人员实际查阅,我们目前的工作力求使这一公开可得但有问题的材料的一部分能够实际用于自然语言处理。这里我们介绍Harrington Yowlumne Narture Corpus, 共有来自1910年至1925年加利福尼亚州克伦县Tejoen ⁇ no Yowlumne社区Teliw牧场的20个叙述性文字汇编。我们用数字方式对文本进行了改写,并通过Levenshtein远程算法和人工核对,提供了金标准、标准化和半质化文本。我们同样通过基于词汇的确定性方法为每一种浸礼证提供POS标记。综合而言,该文集载有57,136个转录字符,与10,719个金标准文本标准化词一致。