Bob Carpenter recently made the following comment on one of my posts: I'm very excited to hear that linguists are beginning to take statistics seriously (again). I'd heard the same thing from Chris Manning a year or so ago, but then other linguists I queried were more skeptical about the role of statistics.
This brought to mind a post by Harvard economist Greg Mankiw called Why Aspiring Economists Need Math. Some of his comments are relevant to linguists (not all, though). I Googled around to see if anyone had already blogged something like this, but couldn't find much (I'd be happy to hear I missed something). Being a bold blogger with little fear of humiliation (often a poor combination, btw) I decided to take a stab at it (UPDATE: I finally discovered a post from summer 2009 by Liberman at LL on basically this same topic here).
Linguists should study math* because...
- Math is a tool that helps you.
- It's not that hard.
- Math is good training for the mind.
- Math is the future.
- You will be left behind without it.
- You will be a better linguist.
Math is a tool that helps you.
Math helps you find patterns and make reliable predictions, among other things. If you are truly serious about studying linguistics, you should be greedy to get your hands on any and all tools you can find that help you study whatever sub-field you specialize in. I have provided a list of Resources for Linguists on the right panel of this blog and I continue to update it as I find more. Tools are good.
The math a linguist needs ain't rocket science. And no one is asking you to be brilliant, just competent. And you don't need to obsess over it, just a few courses. The biggest challenge is to develop a set of learning materials that are geared towards non-majors. Math and stats book are generally poorly written for the lay audience and that turns off aspiring linguists and such. As I said in my response to Carpenter: There is a natural hurdle left to encouraging linguistics students to study stats: they don't like it, that's why they're linguists. I recall a professor promoting linguistics to a large general ed undergrad course by saying it was one of the few analytical, empirical fields that did not require math. That resonated with a lot of 19 year olds. A little hand holding at the undergrad level would go a long way. A simple "stats for linguists" handbook would be perfect. I know there are some new R books focused on language data, but I don't know if they do enough hand holding.
Math is good training for the mind.
To quote Mankiw: Math is good training for the mind. It makes you a more rigorous thinker. Most athletes do push-ups. Tennis players do push-ups. Swimmers do push-ups. Cricket players do push-ups. Speed skaters do push-ups. Why do athletes from such a wide range of sports do the same exercise? Because it's a good basic exercise that helps them regardless of their sport. Math is push-ups for your mind. Nuff said.
Like it or not, mathematical models are fast becoming the best way to understand complex phenomenon. It's no coincidence that biologists, economists, sociologists, neuroscientists, etc. are developing mathematical models to understand their chosen phenomenon. They work. Once a phenomena reaches a certain level of complexity, the human mind is simply not able to understand it as a whole. Our brains evolved to reason about things close in time and space, but complex phenomena like language involve variables that are neither. How can we understand the interaction of thousands of variables? With mathematical models and statistical analysis. Math is not only "a" tool, it's the right tool.Math is the future.
You will be left behind without it.
Any 21st century linguist will be required to read about and understand mathematical models as well as understand statistical methods of analysis. Whether you are interested in Shakespearean meter (pdf), the sociolinguistic perception of identity (pdf), Hindi verb agreement violations (pdf), or the perception of vowel duration (pdf), the use of math as a tool of analysis is already here and its prevalence will only grow over the next few decades. If you're not prepared to read articles involving the term Bayesian, or (p<.01), k-means clustering, confidence interval, latent semantic analysis, bimodal and unimodal distributions, N-grams**, etc, then you will be but a shy guest at the feast of linguistics.
You will be a better linguist.
In sum, you want to be a good linguist. That's why you're getting into this. That's why you've read this far. Language problems challenge and fascinate you. You lie awake at night thinking about them. You want to be a part of the community of scholars who work to unfold the mysteries of language. Math is a tool that will help you enter that community and contribute to it in a highly productive way.
HAVING SAID THAT...
It's equally fair to say that those who are more math oriented than linguistics oriented (like the NLPers, computational linguists and such who barge into our language territory with their fancy schmancy algorithms) should tread softly as well. Yes, it is our responsibility as linguists to understand the math, but it is your responsibility to understand the linguistics, and failing to do so can lead to flawed, vacuous, and even comical results. To quote Cab Calloway in The Blues Brothers, "your lazy butts are in this too." I have consistently used this blog to critique such foolishness (and the folks at Language Log have perfected the genre). It is a mistake to take the linguistics part lightly. It's not all math. It's a little math, but it's mostly linguistics. Here are some of my previous attempts to hold non-linguists accountable for their failure to take the linguistics part seriously enough:
- The Full Liberman (taking aim at a psychologist)
- Thinking Words (taking aim at a philosopher)
- SEX! TORTURE! BANANA! (taking aim at psychologists)
- On Linguistic Fingerprinting (taking aim at physicists)
- Draft of a post on sentiment analysis, in press, so to speak (taking aim at NLPers)
**I can imagine a reader complaining that these terms are not necessarily math/stats terms, strictly speaking. Fair enough. But I believe it is basically a math/stats education that will help an aspiring linguist understand and make use of them. Also fair enough?
26 comments:
*For simplicity's sake, I chose to conflate the fields of mathematics and statistics into the single term "math." I'm sure objections can be raised.
Objection 1: Mathematics also encompasses the logic and formal languages that Chomsky allegedly introduced to linguistics (and are the subject of Partee et al.'s Mathematical Methods in Linguistics). It's a shame that too few papers in generative linguistics take formalization seriously because it could actually clarify debates and definitions (like what exactly OT is). So in addition to more rigorous statistical undertakings, we should also be calling for more papers like Scholz and Pullum's recent work together contrasting the applicability of different logics in linguistics.
B H, good points. 'm not sure which paper you're referring to, though this one seems close:
Contrasting Applications of Logic in Natural Language Syntactic Description (pdf)
Ooops, pressed publish instead of edit, in any case, yes, logic is well worth any linguists time, I agree. Thanks for the comments!
It's great how you seem to have established a good following with others; who are either involved in linguistics or have some knowledge of what you do. I still need you to help me find out how to advertise for my own blog. I particularly liked your push up analogy, and the ending statement, nicely said.
"Math is push-ups for your mind. Nuff said."
Symbol manipulation in one area probably enhances one's effectiveness in others. I think it's fair to say that a basic understanding of maths is an advantage in almost any academic discipline, linguistics included. One could advance a similar case for music, or indeed psychology or history, and so on. Specialisation is de rigueur, unfortunately.
Stan, well said. Specialization can lead to re-inventing the wheel (as a square, usually) as well as general tunnel-vision. I'm a fan of multi-disciplinary teams. Sigh, these remain remarkably rare.
*"I'm sure objections can be raised."
as a mathematician, i'd have to agree.
steve, yes, I probably could have just used "stats" and been safe. That's mostly what linguists need as a research tool (true for Mankiw's post as well). I used "math" simply because it's a term more people are going to relate to.
just stumbled into your site:
do see "The Grid of Languagee: A Deep Structure Surfaces in Tagalog" by Luis Umali Stuart at LingBuzz (ling.auf.net/lingbuzz/000996).
i'd be happy to hear what you and your readers think.
LUS
Great. Here I was deciding what branch of Linguistics to specialize in and I find this article. I'm severely dyscalculic!
I don't disagree with the sentiment but I must take strong exception to this statement: "mathematical models are fast becoming the best way to understand complex phenomenon"
1. Mathematical models do not equate understanding; they are what they are i.e. models - mathematical nets cast over the ocean of language to catch mathematically-catchable phenomena. On their own, they do nothing. For instance what does Zipf's law tell us about language? Nothing. Nevertheless, it is a very good model of certain property of written texts. What has tree-representation syntactic structure told us about language? Not a single thing (unless you're a Chomskean). However, it is extremely useful for modelling certain aspects of syntax. Hidden Markov models proved the best way to simulate speech recognition. Yet, they do not help us understand how we recognize fluent speech in the least. They model certain properties of speech to make them computable.
Mathematical models never describe (let alone understand) reality. They only model its computable aspects. Sure, they have been very successful in many practical (spectacular) respects. But they have failed just as often - NLP being the prime example.
2. It is true that certain phenomena (such as word frequencies, results of experiments, probabilities, etc.) can only be approached through mathematical models. But these models tend to serve as metaphors for non-mathematical understanding and do not represent actual understanding. Your example in a later post about the mystery of the real impact of word frequencies is a case in point.
techczech, yes you make some fair points. There are limits to the role math can play in any scholarly field. nonetheless, I still think any 24 year old entering a PhD program today would be putting themselves in a serious career hole if they didn't make some attempt at math competency.
Linguistic science necessarily involves maths, whether we like it or not. I would suggest that there are two distinct areas where linguistics research becomes reliant on maths:
1) deductive logical inference and mathematical modelling (see for instance, A singular contiguity) and
2) inductive statistical evaluation of hypotheses, models, etc., against data (see for instance, corp.ling.stats).
Even if you don't think of your research as 'mathematical', deductive and inductive implications arise. Think about the simple act of citing a particular construction in a paper. You have to consider:
1) the logical justification for choosing this utterance rather than another (which you will no doubt go on to discuss in general terms in the paper), and
2) some degree of statistical representativeness (or otherwise) of your choice.
Linguists should therefore really study some mathematics!
I thoroughly appreciate that many students who come to linguistics from a non-scientific background can find this prospect intimidating. But formal logic and set theory are a must. If you are to test hypotheses against data then you need to study an introduction to experimental design and statistics. You need to know, prosaically, that what you think you can conclude from your data is logically sound and statistically robust.
However, I think the problem is more significant than "students who do not study maths will be at a disadvantage when working in linguistics".
I would argue that the challenge for linguists in statistical analysis are frequently more taxing than those presented in, say, medical research. Many medical researchers outsource their analysis to professional statisticians (indeed in Britain, drug trials must now be carried out through approved centres). Everyone uses standard protocols, the design of the experiment belongs to a standard set and the statistical analysis processes are routine.
Again, in physics, no-one seriously disputes what are termed the 'auxiliary assumptions' of experiments (unless they obtain surprising results, such as "cold fusion"). Auxiliary assumptions are all those we take as being axiomatic for the purposes of any experiment. The success of the physical sciences rests on the robust reliability of observed laws and laboratory equipment based on these laws. Experiments can rely on solid foundations, and results can have an unambiguous interpretation.
Without labouring the point, linguistics is in neither of these situations! Linguistic data, whether obtained in the lab or extracted from a corpus, is necessarily an indirect expression of underlying generative processes (and as we know, linguists do not agree as to what these are or even what their primitives might be). Lab experiments cannot penetrate these generative processes or easily constrain output. We look through a mirror, darkly.
As I comment on my blog corp.ling.stats, I would suggest that there are challenges for linguists to try to come to terms with statistics, but also for statisticians to focus on some difficult linguistic problems. We need to talk to each other.
I am mainly a syntactician, and I think studying algebra is possibly one of the most important things I have every done in thinking about linguistics. And NOT in the sense of a statistical model, an NLP construction, or some sort of vague `evaluation metric'. Any relation, rule, logical statement, feature-targeting, recursive set operation, structural representation, transformation, abstraction about a principle, etc. is necessarily a statement about and implicitly relying on algebra.
@gerat, yes, I can see that. Algebra is just good logic training.
Cool, so I see your point as far as computational linguistics and corpus related work, but is math the future of softer branches of linguistics like EFL/ESL which is home to most of the world's small time linguists as well? Or language documentation, or where we hit the social sciences with pragmatics?
Micha, it's a fair point that the "softer" branches (..."gentler arts"?) are not yet as subsumed by mathematical modelling. ESF/EFL is often concerned with teaching methods (nothing wrong with that), but second language acquisition is now full on immersed in mathematical models of learning (take a look at this http://www2.hawaii.edu/~lucao/papers/Onnis.RoleofSLinSLA.final.pdf ).
Pragmatics is also well under way in immersion too. Check out this doosy: https://docs.google.com/viewer?a=v&q=cache:tdxzB1T-LgcJ:www.stanford.edu/~ngoodman/papers/KnowledgeImplicature-v2.pdf+&hl=en&gl=us&pid=bl&srcid=ADGEESiGIn6AVW9KiXi1Fg_DSjqpjF8uJB9t_GwTPcWy8pyTx7kF_QojdvMBNULJhiEbIpp_NKqRslIv509eyWKqcxU0SxZfjg3ZOl5mgXzcfMAq-PyrZnIitgad3TP1tNNz1OqAXgiJ&sig=AHIEtbTpiTa_PImupFCGFYxbe7U8wnv1Zg
I do not mean to suggest that everyone interested in language and linguistics should drink the kool-aid of stats and mathematical modelling. But you ignore it at your own peril.
Well, that's pretty disheartening. On the bright side it means that since I have to dust off my stats book anyway I might as well go after the fun stuff.
Micha, also consider this. ESL/EFL & Pragmatics are wide open areas for newcomers to make their mark with bold ideas. The stats people don't get that stuff at all. They'd be a eager ear for someone with some raw ideas about how to use math to help the fields. You don't have to be a math guru, but once you understand the basics of modeling, you could generate a lot of raw ideas that the hard core stats folks would never have thought of. I recommend walking through the Coursera course "Model Thinking". It's an intro to the basic ideas of using models to understand data. Not particularly language oriented, but a lot of good ideas.
hi , good site i've found
i have a question and i wud be thankful to u if u send the answer on my email .
what mathematical & also computational modules i have to be skillful in , so that i can study computational linguistics ?
thank so much
ohlife538@gmail.com
SALMAN
Chris, I'm just starting undergrad in linguistics with a view to taking applied linguistics (by coursework, not research) once I'm done. Interested in language teaching.
Would you say mathematics is as necessary for me as it would be for someone looking to become an academic?
Faction,
If you goal is to teach a specific language to second language learners, my guess is no, you probably don't need math. Not my field though.
Sir, I'm a student of language aspiring to be a linguist and preparing myself to get into some of the best universities in my country. It would be very appreciated if you can tell me what portions of math I need to concentrate on.
Mayukh,
Statistics, statistics, statistics. Maybe a little linear algebra to understand word vectors. But mostly statistics.
Thank you, Thank you, Thank you so much sir. :D
Dear Chris:
I'm currently doing a course in Theoretical Linguistics, and one of its pillars is Formal Semantics. I also study Statistical Methods, but here the answer is self-evident: you won't get anywhere without a solid foundation in statistics. My question, therefore, concerns Formal Semantics: Noab Winter in his 'Elements of Formal Semantics' makes it clear that the proper understanding of his textbook is virtually impossible without at least elementary knowledge of the naive set theory. I've found a classic introduction to this in 'Naive Set Theory' by Paul R. Halmos, but I believe there are other, more general, introductory texts in maths that are worth taking a look at. If so, could you please advise on a couple of such texts with the linguists' needs in mind?
Respectfully yours,
Dmytro
Post a Comment