Monday, October 15, 2007

Frequency effects in linguistics

For the record, there are known to be a variety of “frequency effects” in language. A brief survey:

Zipf's law: roughly speaking, the most frequent word in a corpus will be about twice as frequent as the second most frequent (i.e., twice as many tokens).

Word recognition: Dahan et al (pdf) :“frequency affects the earliest moments of lexical access”

Sentence processing: Lau et al : Frequency effects “give rise to reaction time differences in sentence processing tasks"

No comments:

Putting the Linguistics into Kaggle Competitions

In the spirit of Dr. Emily Bender’s NAACL blog post Putting the Linguistics in Computational Linguistics , I want to apply some of her thou...