A set of English text marked with word roles and sentence trees.
Penn Treebank is like a grammar teacher with a giant red pen. Every word gets a name tag, and every sentence gets a family tree.
It helps train tools for word labels and sentence structure. Older language models also used it as a scoreboard.
Syntax Parse
Penn Treebank gives human-made syntax trees for training and testing.
Sequence Labeling
Its part-of-speech tags help train sequence labeling models.
LM
Early language models used Penn Treebank as a perplexity benchmark.