muckefuck: (zhongkui)
muckefuck ([personal profile] muckefuck) wrote2013-06-08 11:19 am
Entry tags:

You've heard this rant before

On one of my most frequently visited fora, someone is trying yet again to come up with an "objective" definition of "a language". I've seen this discussion so many times at this point I've got my canned arguments all ready to go: "languages" are just high-order abstractions; judgments of "similarity" are hopelessly subjective; lexical comparisons depend on a series of increasingly arbitrary definitions (e.g. which terms you choose to compare, how you measure vocabulary size, what definition of "word" you're using). But it never seems to matter: people seem to feel very strongly that "languages" are concrete things rather than convenient social fictions and, therefore, can be defined scientifically.

Of course, the real problem is that most people don't understand what that word means. Someone linked to this laundry list of intelligibility studies and asked if we thought it was "accurate". How could anybody tell? There's no methodology given at all, so we haven't the faintest idea what the researchers actually measured. It's like asking, "Is it true that when you're embarrassed you're also 27% angry?" Yeah, sure: choose the appropriate criteria for defining "embarrassment" and "anger" and the appropriate method for quantifying the data and you can get that percentage. Does that make it "scientific"? No.

But present your results in numerical form and most people will simply accept them. The first response to that blogpost begins, "I don’t dispute the scientific validity of those findings, but..." Well, then, you're a fool. Worse, you're a cargo cultist who believes the mere presence of numerical data is evidence of "science". For all you know, someone just banged out those percentages on a pub table over a beer or two. Or maybe they abstracted them from a single reading comprehension test. Who cares? One way or another, they don't tell you what you think they're telling you.

[identity profile] paulintoronto.livejournal.com 2013-06-08 04:56 pm (UTC)(link)
I discovered many years ago that students will complain about their final mark in a course. "I only got a 63% but I think it should be much higher."

If I say, "No, that is correct. That is the mark you deserve," they are never satisfied.

But if I say: "You got 6.3 out of 10 on four tests, and 12.6 out of 20 on your essay, plus 25.2 out of 40 on the exam: that adds up to 63%," they are almost always satisfied.

If they think I have just made up the final mark, they are angry, but the anger goes away if I present six different marks (each as susceptible to being made up as the final mark they received) and then added them together.

Math is magical! (Heck, even simple arithmetic has mystical powers.)

[identity profile] snousle.livejournal.com 2013-06-08 05:51 pm (UTC)(link)
Heh, our building contractor tried exactly that trick on us, except he actually was making up the numbers. We were not amused.

[identity profile] muckefuck.livejournal.com 2013-06-08 09:22 pm (UTC)(link)
That's more than just arithmetic: You've also presented a methodology. Which is, as I rant above, precisely what the dataset in the blogpost lacks.