« How to read Big Data studies | Main | Two unsolved problems of Big Data studies: confirmation and controls »

Comments

Feed You can follow this conversation by subscribing to the comment feed for this post.

zbicyclist

Google, Facebook and others do thousands of A/B tests each year.

In addition, advertisers do them as well. Even universities with review boards are unlikely to review A/B tests of their university web advertising ("should we show smiling multiethnic students at a football game, or students diligently studying in the library?")

But it's easy to spend practically no time writing a column expressing outrage.

Ken

I've also been amazed by the response. It hasn't taken the internet to allow this sort of project to run. I know of academics who have been involved with credit card companies mail outs to convince people to use increase their credit card limits. These are a simple randomised trial. Just send different deals to different customers and watch the responses. I expect they do the same thing to increase usage.

I actually find Amazon's and others efforts to sell me a book very worthwhile, and I'm certain that they do A/B testing to attempt to get people to buy a book. If I search them I'm more likely to find something worthwhile than I would be at my university library which doesn't care at all whether I find a book.

Last word might be XKCD http://xkcd.com/1390/ as almost always.

ZBicyclist

Supporting my earlier point that media are unfairly targeting the Facebook study as a cheap way to fill airtime:

http://chronicle.com/blogs/ticker/33-ethicists-defend-facebooks-controversial-mood-study/82091?cid=wc&utm_source=wc&utm_medium=en

Title:
33 Ethicists Defend Facebook’s Controversial Mood Study
by Andy Thomason

"A group of bioethicists wrote in a column published on Wednesday that Facebook’s controversial study of mood manipulation was not unethical, and harsh criticism of it risks putting a chill on future research. The article was written by six ethicists, joined by 27 others."

Andrew Gelman

Well put: "a huge effect for a tiny non-random segment of a large population can coexist with no effect for the entire population."

Verify your Comment

Previewing your Comment

This is only a preview. Your comment has not yet been posted.

Working...
Your comment could not be posted. Error type:
Your comment has been posted. Post another comment

The letters and numbers you entered did not match the image. Please try again.

As a final step before posting your comment, enter the letters and numbers you see in the image below. This prevents automated programs from posting comments.

Having trouble reading this image? View an alternate.

Working...

Post a comment

Marketing and advertising analytics expert. Author and Speaker. Currently at Vimeo and NYU. See my full bio.

Next Events

Mar: 26 Agilone Webinar "How to Build Data Driven Marketing Teams"

Apr: 4 Analytically Speaking Webcast, by JMP, with Alberto Cairo

May: 19-21 Midwest Biopharmaceutical Statistics Workshop, Muncie, IN

May: 25-28 Statistical Society of Canada Conference, Toronto

June: 16-19 Predictive Analytics World (Keynote), Chicago



Past Events

Feb: 27 Data-Driven Marketing Summit by Agilone, San Francisco

Dec: 12 Brand Innovators Big Data Event

Nov: 20 NC State Invited Big Data Seminar

Nov 5: Social Media Today Webinar

Nov: 1 LISA Conference

Oct: 29 NYU Coles Science Center

Oct: 9 Princeton Tech Meetup

Oct: 8 NYU Bookstore, NYC

Sep: 18 INFORMS NYC

Jul: 30 BIG Frontier, Chicago

May: 30 Book Expo, NYC

Apr: 4 New York Public Library Labs and Leaders in Software and Art Data Viz Panel, NYC

Mar: 22 INFORMS NY Student-Practitioner Forum on Analytics, NYC

Oct: 19 Predictive Analytics World, NYC

Jul: 30 JSM, Miami

Junk Charts Blog



Link to junkcharts

Graphics design by Amanda Lee

Search3

  • only in Big Data

Community