« The New Zealand sun alibi | Main | Lance Armstrong beat statistical odds, but it's not enough »


Feed You can follow this conversation by subscribing to the comment feed for this post.

Jordan G

That's kind of creepy. I'm not (entirely) doubting the ability for a survey to accurately predict which candidates are less likely to file for disability claims, I'm just wondering on what basis do the survey developers and business owner suggest that such claims are illegitimate. Some workers may have higher feelings of loyalty to their companies such that they are less likely to file disability claims, but that a company would rather higher "yes men" than payout potentially legitimate claims caused (on the job) to their workers should be an ethical concern to the survey developers, the article’s author, and WSJ's readers.

I question the degree to which we, as a society, privilege quantitative data and prediction models. We seem to accept all such products as if they were providing given, a priori observations requiring no further dissection, investigation, or rigor. We're going to get ourselves into a lot of trouble soon, I'm afraid.


Jordan: I haven't read Nathan Silver's book but it seems like he's bucking the trend to tell us why most predictions fail.

Phil H

Surely it's self-defeating to create a model of the ideal candidate? Sure, you can create a list of ideals and compare applicants against it. If you ignore experience there, you'll get no experienced people because they're more expensive.

Presumably they have measured existing employees and done the statistical analysis on what were the strongest predictors of quality. That then hinges on what factors were measured -- was race one of them? It also depends on the appropriateness of the quality measure.

If you measure the number of calls handled per hour I can show you a room full of monkeys that will make your model ecstatic.

The comments to this entry are closed.

Get new posts by email:
Kaiser Fung. Business analytics and data visualization expert. Author and Speaker.
Visit my website. Follow my Twitter. See my articles at Daily Beast, 538, HBR, Wired.

See my Youtube and Flickr.


  • only in Big Data
Numbers Rule Your World:
Amazon - Barnes&Noble

Amazon - Barnes&Noble

Junk Charts Blog

Link to junkcharts

Graphics design by Amanda Lee

Next Events

Jan: 10 NYPL Data Science Careers Talk, New York, NY

Past Events

Aug: 15 NYPL Analytics Resume Review Workshop, New York, NY

Apr: 2 Data Visualization Seminar, Pasadena, CA

Mar: 30 ASA DataFest, New York, NY

See more here

Principal Analytics Prep

Link to Principal Analytics Prep