« Choosing reference levels | Main | What is the (expensive) miracle drug that cut colon cancer deaths by 20%? »


Feed You can follow this conversation by subscribing to the comment feed for this post.

Michael Thompson

Hmm, I suppose this would be a problem if they were explicitly saying the ROI is for the entire population. But they added the clause that the ROI calc is just for the population that finishes school within the timeframe. Since the population is discrete, those data points can be segregated into separate populations. As they seem to have done here.
Still, it's a good point, and a common manipulation.


Michael: You're right that it's not the way they describe the result, it's the way they conducted the analysis. This falls into what I call "true lies". It's akin to a bank claiming that their loan portfolio has tremendous returns for those loans that did not default. It is a statistic that can be computed but it is useless, and misleading.

Michael Thompson

What makes this topic very interesting is also that it is an attempt to quantify the value of an education by reducing it to a monetary equation. if it were for trade schools, I think that it would be more relevant. But I think people are actually waking up to the fact that 1) schools are not guaranteed paths to income and hopefully 2) schools are as much about enlightenment and inquiry than about career choices.

The other buyer-beware statistical fudge is portfolio returns for portolios with funds that have closed. I'm not current on my disclosure compliance rules, but I recall that a fund manager's return didn't used to have to disclose returns for all funds, both current and discontinued. Not sure if that has been universally mandated yet.

Lydia Frank

PayScale actually did consider the issue of dropouts when determining the methodology for the College Return on Investment (ROI) report. While it's true that we didn't include wage data from dropouts directly, we did weight our ROI measure by overall graduation rates for each school, as provided by the Department of Education, to approximate dropouts in our calculation. Schools with lower overall graduation rates will take a bigger hit to their ROI than schools with higher overall graduation rates.


Lydia: Thanks for clarifying but I don't understand how you adjust ROI without wage data. Can you explain what you mean by "a bigger hit" to ROI? What is the nature of this "hit"?

Verify your Comment

Previewing your Comment

This is only a preview. Your comment has not yet been posted.

Your comment could not be posted. Error type:
Your comment has been posted. Post another comment

The letters and numbers you entered did not match the image. Please try again.

As a final step before posting your comment, enter the letters and numbers you see in the image below. This prevents automated programs from posting comments.

Having trouble reading this image? View an alternate.


Post a comment

Your Information

(Name is required. Email address will not be displayed with the comment.)


Link to Principal Analytics Prep

See our curriculum, instructors. Apply.
Business analytics and data visualization expert. Author and Speaker. Founder of Principal Analytics Prep, MS Applied Analytics at Columbia. See my full bio.

Next Events

May: 2 New York Marketing Association Big Data Workshop, NYC

May: 5 NYPL Analytics Careers Talk, NYC

May: 8 Data Visualization Seminar, Denver, CO

May: 15 Data Visualization Seminar, Cambridge, MA

May: 17 Data Visualization Seminar, Philadelphia, PA

May: 22 Data Visualization Seminar, San Ramon, CA

Past Events

See here

Future Courses (New York)

Summer: Statistical Reasoning & Numbersense, Principal Analytics Prep (4 weeks)

Summer: Applied Analytics Frameworks & Methods, Columbia (6 weeks)

Junk Charts Blog

Link to junkcharts

Graphics design by Amanda Lee


  • only in Big Data