« Their real enemy is not bad data. But data. Period. | Main | Prediction versus explanation: simple to state yet hard to grasp »


Feed You can follow this conversation by subscribing to the comment feed for this post.


Biostatisticians have done some work on this. A screening test is often applied to a population and then those who score highly are given a gold standard test. The only solution is to include some subjects with low scores to receive the gold standard, then analyse it properly. The secret to analysing it properly is that those who don't receive the gold standard are missing data. Judging by one talk of been to data scientists don't understand that.

The comments to this entry are closed.

Kaiser Fung. Business analytics and data visualization expert. Author and Speaker.
Visit my website. Follow my Twitter. See my articles at Daily Beast, 538, HBR, Wired.

See my Youtube and Flickr.
Numbers Rule Your World:
Amazon - Barnes&Noble

Amazon - Barnes&Noble


  • only in Big Data

Next Events

Jan: 10 NYPL Data Science Careers Talk, New York, NY

Past Events

Aug: 15 NYPL Analytics Resume Review Workshop, New York, NY

Apr: 2 Data Visualization Seminar, Pasadena, CA

Mar: 30 ASA DataFest, New York, NY

See more here


R Fundamentals, Principal Analytics Prep

Numbersense: Statistical Reasoning in Practice, Principal Analytics Prep

Applied Analytics Frameworks & Methods, Columbia

The Art of Data Visualization, NYU

Signed copies at McNally-Jackson, NYC

Excerpts: Numbersense Ch. 1, 7, 8. NRYW

Junk Charts Blog

Link to junkcharts

Graphics design by Amanda Lee