Junk Charts

Extra reading

The New York Fed has put up some impressive infographics, depicting the credit conditions around the country.

(I was going to praise the producers for this effort - a rarity among government sites but when I went back to the site today, I find that the graphic is loading only occasionally, and try as I might, I could not get rid of the big brown patch that obscures the West coast.  Hope you have better luck!)

As with similar maps, the unresolved problem is that the pattern is strongly dominated by the relative density of people around the country.  As we click through different maps, they all look similar.

But this map -- as do most infographics -- does well to put structure onto unwieldy, large data sets.  It acts as a table of contents to the data set.

Nick Rapp's team at AP produced this great chart on US life expectancy:

Very sensitive axis labels, putting the line labels into the chart (rather than in a legend box far away), showing only the current data, not every data point, subtle coloring to bring out the decades, etc.

I'm not sure about varying the thickness and tinge of the lines.  Is it necessary?  It hinders a bit as we try to compare the slopes of the lines.  Adding the initial data labels (for 1975) would also help us judge the net change over the period depicted.  If it is the change in life expectancy over time that is the main story, consider indicing all lines to the respective 1975 value.

Reference: "CDC says life expectancy in the US is up, deaths not", Miami Herald, Aug 19 2009. 

PS. This is really an awful title for the article.  It reads as if something bad has happened to the death rate while something good happened to the life expectancy, as if there is a paradox but the article makes clear that the death rate declined, which would make the point redundant.

Pure delight

 My favorite Bumps chart in the New York Times ...

For the purist, this is the original rank-based version.

With judicious use of color and background/foreground, this makes for a good story.

The color scheme here, however, is a bit bland.  Green for improvement, blue for decline and orange for USA.

Note, for example, New Zealand and England both suffered similar drastic drops as the US.

It would be better to (for example) split out the large improvements and large declines, or to split out the developed world versus the developing world.

This chart is created like this probably because the accompanying piece makes only passing reference to this chart so there is not a clear message to the creator what to do with the data.  

Interestingly, there were no ties in 1960 but quite a few ties in 2004.  I wonder why.  I'd shift the dot to the mid-point between ranks rather than move them up to the higher rank.

All in all, a much more engaging way to present this data than the reams of table found in say the UN World Development Report.

Reference: "Vital Statistics: U.S. Still Struggling With Infant Mortality", New York Times, April 6 2009.

Scale restoration

The original graph threw us off our sense of scale.  It seemed to be saying all these oil companies are roughly the same size but one grew much faster than the others.  The red color and the setting off of the data above the title of the chart seemed to announce some important find.

The junkart version on the right reversed everything to our normal sense of scale.  It is a version of the bumps chart, one of my favorites.

So we find that Total is the smallest of these oil companies, about half the size of ExxonMobil -- you wouldn't know that from those abysmal bubbles!   Adding to the problem is that the growth data is used to sort the companies while the actual production data is hidden in the data labels.

Total is indeed growing faster but BP is not far behind.  The fall of ExxonMobil and Royal Dutch Shell is equally intriguing.


Reference: "Total, the French Oil Company, Places Its Bets Globally", New York Times, Feb 21, 2009.

Mini donuts

As a reader noted, this chart is essentially unreadable.  It contains data for the composition of diets in four countries during two time periods.

What might we want to learn from this data?

Are there major differences in diet between countries?

Within each country, are there changes in diet composition over the thirty years?

If there were changes in diet inside a country over time, did those reflect a worldwide trend or a trend specific to that country?

Unfortunately, the use of donut charts, albeit in small multiples, does not help the cause.  The added dimension of the size of the pies, used to display the total calories per person per day, serves little purpose.  Seriously, who out there is comparing the pie sizes rather than reading off the numbers in the donut holes if she wants to compare total calories?

This data set has much potential, and allows me to show, yet again, why I love "bumps charts".

Here is one take on it.  (Note that the closest data I found was for six different countries - China, Egypt, Mexico, South Africa, Philippines, India - and for different periods.)

The set of small multiples recognizes that the comparison between 1970 and 2000 is paramount to the exercise.  There is a wealth of trends that can be pulled out of these charts.  For example, the Chinese and Egyptians take in much more vegetables than the people of the other countries; in particular, the Chinese increased the consumption of vegetables drastically in those 30 years. (top row, second from left)

Or perhaps, for sugars and sweetners, consumption has increased everywhere except for South Africa.  In addition, the Chinese eat a lot less sugars than the other peoples. (top row, right)

Egg consumption also shows an interesting pattern.  In 1970, the countries had similar levels but by 2000, Mexicans and the Chinese have outpaced the other countries. (bottom row, right)

These charts are very versatile.  The example shown above is not yet ready for publication.  The designer must now decide what are the key messages, and then can use color judiciously to draw the reader's attention to the relevant parts.

Also, some may not like the default scaling of the vertical axes. That can be easily fixed.

Finally, here is another take which focuses on countries rather than food groups.  We note that too many categories of foods make it hard to separate them.

References: "Who's Eating What?", Wired, Oct 2008; "The Double burden of malnutrition", FAO, 2006.

Progress and retrogress

Joran E. pointed to this "icky" chart he found on Clive Crooks' blog at the Atlantic. 


He ordered a "junkchart treatment", so here it comes.

First we wanted to process the triangles, dots and squares to make sense of this data.  We noted that the data came from a single year (2005) so the chart did not trace the development of the education sector over time.  But wait, it used a different route to get at the same idea.  The author compared different generations within each country to see if more and more citizens took university degrees.  So each vertical "arrow" was kind of a historical record of different generations within a country.  Under this criterion, Korea and Japan had come a long way while the US and China stagnated.

The chart is quite impossible to read as designed.  There is little reason to sort by 25-34-year-old proportion when the message concerns improvement over generations.  Besides, what about countries that apparently retrogressed?  (like Russia and Germany)

For this data, I returned to my favored bumps chart.  Here is version one.  There are two ways to read this chart: across countries, we note that most of the European states (blue) had similar profiles showing roughly a constant rate of growth.  The Asian duo of Japan and Korea (brown) had the most marked growth.  Of North America (black), Canada diverged from the US since the 35-44 generation.

Alternatively, we can focus on the change generation-over-generation.  From 55-64 to 45-54, almost all countries in this sample (except Japan) grew at the same rate.  Then between 45-54 and 35-44, the two Asian countries clearly set the pace.  The generation between 35-44 and 25-34 is most interesting: Korea has not slowed, Japan has slowed a little but still grew as fast as Canada.  A trio of European countries (Spain, Ireland, France) outpaced their neighbors.

Below I show version two.  This one combines bumps chart with small multiples.  North America, Europe and Asia/Australia are now in separate charts.  This removes clutter.

 

Gauging the water level

This set of charts covered the back page of one of New York Times' sections this weekend.

Regular readers will share my enthusiasm for the top chart.  It makes a clear, cogent case to support the article's thesis concerning the rise of bottled water.  Various renditions of this type of chart have appeared here, for example.

Specifically, the smart use of color to cluster the line objects helps interpret the trends.  Blue sets out the two primary interests.  (It's a mystery to me why the gray lines were separated into darker and lighter hues.)

The twenty-year horizon used is another nice touch. I'd remove the gridlines although they aren't too distracting here.

Sadly, the second graphic does not meet the high standard of the first.  The biggest problem concerns the red rectangle, purportedly showing how much of the bottled water was imported.  The choice of differently-sized bottles as objects makes it impossible to gauge what proportion of the total was imported.  If the rectangle was placed over 1-litre bottles instead, it would look smaller.

Source: "A Battle Between the Bottle and the Faucet", New York Times, July 15, 2007.

Airline bumps and bump charts

The Harvard Social Science Statistics blog pointed to an NYT article about revenue optimization in the airline industry.  Huge props to the Times for explaining the science (and art and politics) of one of the most successful applications of operations research.

In short, valuable business travellers want refundable tickets.  Because of this and other reasons, about 10% of booked tickets become no shows.  Airlines recoup the loss by over-booking.  Implicitly, they trade off the potential for dissatifying a few unlucky passengers (who would be bumped from their flights) and the potential for flying with 10% empty seats (in addition to unsold seats).  Optimization algorithms (constantly tuned by entry-level staff) try to strike a balance.

Recently, because the average percentage of seats sold has been going up, the room for such maneuvreing has been squeezed, leading to higher bump rates, and more travellers being stranded.  There is some variation across airlines due to the level of sophistication of their revenue optimization algorithms, corporate strategy, etc.

The following charts present data by airline of the bump rates in 2005 and 2006.  One would be interested in answering questions such as:

• Which airlines have the best (or worst) bump rate?
• Are some airlines consistently better (or worse) at controlling the bump rate?
• Which airlines have improved (or worsened) from year to year?
• Are the differences of practical significance?

The original chart shown on the left does not reveal the answers readily.  My favourite bumps chart offers them up clearly (well, except on the question of significance).

The biggest problem, though, is the header: number of passengers per 10,000 bumped.  The data plotted appeared to be the reverse: the number of bumps per 10,000 passengers.  Otherwise, there would have been more bumped passengers than passengers!

Source: "Bumped Fliers and No Plan B", New York Times, May 30, 2007.

Bumps charts and NYT

I just cannot resist another post on Bumps charts since  NYT finally started using them.  Here are two recent examples:

This first chart illustrates the change in property taxes in different municipalities since 1998, as compared to the national average.

A wealth of information is revealed:

• All these places charge more than the national average today
• New York City used to charge less than average but that ended in 2003
• The tax rates are clustered into three groups, about 6%, about 5% and below 4%.  The variance between different places has decreased during these years
• A sharp rise was recorded in all these places in 2001-3 although New York City lagged slightly.  The sharp rise was not observed nationwide

Reference: "Gain in Income is Offset by Rise in Property Taxes", New York Times, Aug 8 2006.

The second example is much cleaner as it involves only one period.  Bolding the "no one" line is particularly effective, bringing out the author's point well.

However, I'd have put the "no one" label on the right, just like the other labels, but bolded.

One could also argue that the real story is the simultaneous decline of "friend", "co-worker" and "neighbor" and rise of "no one" and "spouse".

Finally, it'd be interesting to see the multi-period version as the smooth linear trends are rather incredulous.

Reference: New York Times Magazine, July 16 2006.