« FDA endorses masking placebos as proven drugs as a get-rich-quick scheme | Main | The most cited and most butchered statistical law »

Comments

Feed You can follow this conversation by subscribing to the comment feed for this post.

Jordan

...and yes, that's a reference to a Dominican beer.

zbicyclist

Well, it depends on how many coins you started off with. If we started off with some very, very, very large number of coins (to Gelman's point, an impossible number), it would not be unusual that we'd get one fair coin that landed heads 1,000,000 times in a row.

But we can easily move this problem into the space of the possible. If we look at how advisory (not index) mutual funds are marketed, a strategy is to start a large number of funds with small seed money. Some strategies will perform well, possibly by accident. These get heavily promoted and the rest get quietly folded.

We're told that the fund has a glowing track record (for instance, it has always gone up -- the equivalent in this space of always coming up heads) but not given full information about the sampling space.

So, the best conclusion in these situations isn't that those who run the fund are geniuses for having a run of X excellent years, but people who've flipped a whole bunch of coins and will return to coin-flip accuracy as soon as you invest in the fund.

(I note the sum of coin flips is a random walk, and there's a whole literature on stock prices as random walks)

Max

The example seems related to Gambler's fallacy http://en.wikipedia.org/wiki/Gambler%27s_fallacy

The comments to this entry are closed.

Kaiser Fung. Business analytics and data visualization expert. Author and Speaker.
Visit my website. Follow my Twitter. See my articles at Daily Beast, 538, HBR.

See my Youtube and Flickr.
Numbers Rule Your World:
Amazon - Barnes&Noble

Numbersense:
Amazon - Barnes&Noble

Search3

  • only in Big Data

Next Events

Jan: 10 NYPL Data Science Careers Talk, New York, NY

Past Events

Aug: 15 NYPL Analytics Resume Review Workshop, New York, NY

Apr: 2 Data Visualization Seminar, Pasadena, CA

Mar: 30 ASA DataFest, New York, NY

See more here

Courses

R Fundamentals, Principal Analytics Prep

Numbersense: Statistical Reasoning in Practice, Principal Analytics Prep

Applied Analytics Frameworks & Methods, Columbia

The Art of Data Visualization, NYU

Signed copies at McNally-Jackson, NYC

Excerpts: Numbersense Ch. 1, 7, 8. NRYW

Junk Charts Blog



Link to junkcharts

Graphics design by Amanda Lee

Community