Monday, October 15, 2007

Frequency effects in linguistics

For the record, there are known to be a variety of “frequency effects” in language. A brief survey:

Zipf's law: roughly speaking, the most frequent word in a corpus will be about twice as frequent as the second most frequent (i.e., twice as many tokens).

Word recognition: Dahan et al (pdf) :“frequency affects the earliest moments of lexical access”

Sentence processing: Lau et al : Frequency effects “give rise to reaction time differences in sentence processing tasks"

No comments:

NLPers: How would you characterize your linguistics background?

That was the poll question my hero Professor Emily Bender posed on Twitter March 30th. 573 tweets later, a truly epic thread had been cre...