Junk Charts

Reading

Here are some of my favorite links from other places:

A spatial journey illustrating a very long scale, created by the Genetic Science Learning Center (here)

Long scales are very difficult to deal with in charts; I have never been satisfied with log scales since it addresses the designer's challenge of trying to fit everything onto one page, bu does not deal with the reader's need to compare the elements accurately

Not sure how this helps but perhaps some of you will figure it out

Tommi left a comment about this conceptual chart by xkcd, which has been making the rounds.  Fits into our Light Entertainment category.

Says there is no optimal chart type.  A type that works very well for one data set may get hopelessly cluttered for another, similar data set.

From fellow bloggers (especially Jorge), a whole series of views of the U.S. unemployment figures by state over time.  Alternatives that are much more interesting to look at than the typically line chart. Jorge even found something in Excel that looks good.

A tale of four charts

Speaking of rules for making charts, I think the most important is "if at first you don't succeed, try, try and try again."  It's absolutely essential to produce multiple looks before settling on the one that helps tell the story.

While researching U.S. consumer credit this week, I came across these four views of presumably the same data set.

The chart on the top left (via Business Insider) shows a downward sloping line, with a steep decline on the right edge of the chart.  The authors clearly wanted to show us that consumer credit in the U.S. was collapsing.  The bottom was falling out.  To aid in this effort, they chose to:

• start the plot at the peak of the time series (2000);
• set the minimum value of the vertical scale to coincide with the lowest value attained thus far (2009) -- we have reached rock bottom, ladies and gentlemen; and
• pay no particular attention to the 0% line, which is placed in the lower half of the chart, rather than the middle, thus obscuring the fact that credit grew at faster rates during the height of the boom than it has been declining during the recession.

(Thanks to Excel's default setting, we are treated to a centipede effect on the horizontal axis.  Also thick lines and line shadows.)

Readers who previously complained about my willingness to draw a line through things that shouldn't be connected will be none too amused by the use of a line chart to plot year-on-year changes.  Thus, the zig-zagging of the line represented the change of change, which has been dubbed the "second derivative" during a period when optimists used technical wizardry to show us "green shoots".  To read this chart properly, one should focus on the actual annual decline (the dots) rather than the line.

If one takes a longer-term view, as in the chart on the top right (via Rolfe Winkler), the recent drop in consumer credit can be put in perspective.  Since the 1960s, consumer credit has been positively exploding with few years of decline.  Note, again, that the falling line between 2000 and 2008 represented a slowing rate of growth, not a decline.  The question to ask is: after so many years of almost continuous growth, is the current correction such a big cause for alarm?

This situation of exploding growth followed by a slight correction is better visualized in the third chart (lower left, via chartingtheeconomy.com)  The author also answered a question asked by Rolfe, which is to compare the total consumer credit to the population, as he plotted the per-capita consumer credit.  An eyeball estimate tells us that consumer credit jumped by more than 800 percent since the 1970s, and the current retrenchment is a blip if we take a long view.  The explosion in consumer credit has no doubt enhanced wellbeing in the U.S. for decades; even though credit might well have been over-extended in the recent past, it is far from something evil.

The final chart (bottom right, via The Big Picture) should carry a health warning.  It really should not be shown by itself, or without comment.  Both charts on the right, in fact, came from the same presentation, by David Rosenberg.  This chart, not surprisingly, is the most dramatic -- the chart designer is going for the jugular.  The decline on the right side is much more exaggerated than in any of the other three.  The trick here is:

• to plot the dollar value of credit change, rather than percentage value, and thus ensuring that the further back the time, the more insignificant the change;
• to connect dots which bring out the steep decline when in fact, the steep drop reflected the second derivative; and
  
• to put the 0% line below the middle of the chart, which causes the bottom "half" of the chart to be smaller than the top "half", which plays with our perception so that we may not realize that there were multiple years of growth above the absolute level of decline recently experienced.
  

If this chart were to be believed, our focus should not be on the cliff-diving at the far right -- instead, the chart has the hallmark of a system getting completely out of control, and oscillating to oblivion.  One hopes that is not the message intended by its creator.

For anyone creating charts, it would be a great idea to have attempted all of these versions, and more.

Too big by half

This one, from Washington Post.  What's up with the haloed semi-circles on the side?  Plus, our usual reservations about bubbles.




Reference: "The Big Get Bigger", Washington Post, Aug 28 2009.

Lining them up

Consider this simple and effective display accompanying the NYT article titled "Recession Drives Women Back to the Work Force".  This is somewhat surprising because jobs are harder to come by during a recession. 

The journalist also told us that the interpretation of this data is controversial among economists.  The trend seemed to have been a decline in participation till 2004 and then a rise since then for 25-to-34-year-old women.  If there were an up-trend, it appeared before the start of this recession.  And participation rate dropped after the 2001 recession.  So much is still under study.

The use of small multiples is a good idea, and the color coordination between the two charts is well thought out.  A minor miss is the vertical scale: for any small multiples chart, one should always use the same scale.  In this case, using the same scale will allow readers to compare the levels of participation between men and women.

The following chart plots a related data set, focusing on the difference between men and women, among those married.  As before, the participation rates are of very different levels.  The male rate has steadily declined in recent decades while the female rate rose from the 30s in the 60s to about 70% in the 90s. 

Reference: "Recession Drives Women Back to the Work Force", New York Times, September 19, 2009; Bureau of Labor Statistics.

Extra reading

The New York Fed has put up some impressive infographics, depicting the credit conditions around the country.

(I was going to praise the producers for this effort - a rarity among government sites but when I went back to the site today, I find that the graphic is loading only occasionally, and try as I might, I could not get rid of the big brown patch that obscures the West coast.  Hope you have better luck!)

As with similar maps, the unresolved problem is that the pattern is strongly dominated by the relative density of people around the country.  As we click through different maps, they all look similar.

But this map -- as do most infographics -- does well to put structure onto unwieldy, large data sets.  It acts as a table of contents to the data set.

Nick Rapp's team at AP produced this great chart on US life expectancy:

Very sensitive axis labels, putting the line labels into the chart (rather than in a legend box far away), showing only the current data, not every data point, subtle coloring to bring out the decades, etc.

I'm not sure about varying the thickness and tinge of the lines.  Is it necessary?  It hinders a bit as we try to compare the slopes of the lines.  Adding the initial data labels (for 1975) would also help us judge the net change over the period depicted.  If it is the change in life expectancy over time that is the main story, consider indicing all lines to the respective 1975 value.

Reference: "CDC says life expectancy in the US is up, deaths not", Miami Herald, Aug 19 2009. 

PS. This is really an awful title for the article.  It reads as if something bad has happened to the death rate while something good happened to the life expectancy, as if there is a paradox but the article makes clear that the death rate declined, which would make the point redundant.

Bubble after bubble

I finally checked the Junk Charts mailbox again, and I found an uprising against bubble charts and pie charts.   It appears that despite their shortcomings amply demonstrated here and elsewhere, editors everywhere continue to believe that the public has a lovefest with these creatures.

I will start off the parade with this one from the Wall Street Journal, purportedly showing that the Bank of England has continued to inject cash into the economy, and at ever increasing rates.  The headline said Bank of England to expand bond-buy plan.


This chart has a variety of problems, in addition to the use of overlapping bubbles.  As has been documented, it is almost impossible to gauge the relative sizes of circular areas, especially when they are overlapping.

If we remove all but one of the data labels, the chart is non-functional.  This is what we mean by not self-sufficient: the interpretation of this chart requires, indeed demands, that all the underlying data be printed on the same chart.  The only way readers can understand what is going on is by reading the data itself!

The horizontal axis (indicating time) is also non sensical.  The separation from month to month is variable.  Besides, and this is the key flaw of the chart, the projected number is a three-month total cumulative growth being treated like a monthly figure.

 

Since the Bank is projected to inject 175 50 billion extra pounds in the next three months, that would work out to be roughly 60 16 billion per month.  That would turn the story upside down: one would conclude that the Bank is gradually slowing the rate of injection.  The following bar chart points this out with little fuss:

 

When bars are used, there is no need to print every single data point.  The relative lengths of the bars can be estimated easily.  The months are equally spaced.

One final point: the exchange rate cited is not very helpful.  What would have been more useful for readers would be the scale of the cash injection with respect to each nation's GDP.

Reference: "Bank of England Expands Bond-Buy Plan", Wall Street Journal, Aug 7 2009.

PS. Per Andrew's comment, here is a line chart, where the growth/decline in the injection is encoded in the slope of the line segments:

Visual analogies

Many a startling faux pas in graphics start with the desire to utilize visual analogies: the recent shopping mall chart is a good example.  There is something inviting about making a chart about shopping malls look like a shopping mall, or a chart about breakfast foods look like a donut, and so on.

The New York Times (or maybe OECD) makes a chart about economic cycles look like, you guess it, cycles.  Don't really have too much to say about this one - except these two points:

• Much of the validity of the chart depends on the theory behind it.  Do the two variables being tracked (amount produced relative to trend; change in production in last 6 months) capture everything?
• The focus on generating cycles visually left out one of the most important dimension - that of time scale.   For this chart to work, we would like to know not just where we are in the cycle but how much time we'd spend at each point in the cycle.  The interactive charts (graphs 4, 5, 6, 7) show us that the cycles are traversed not at constant speed.  A proper rendering of this data needs to play up the time scale.

If you have ideas of how to improve this, feel free to comment.

Reference: "Turning a corner?", New York Times, July 2 2009.  

The case of the shrinking mall

I had a similar reaction when reading this chart but I will let our reader take center stage.

Top portion

Bottom portion

The back of today's New York Times' Week in Review section devotes half of its space to a lame infographic that wastes space and has a major error (which has been corrected lazily in the version now online at http://www.nytimes.com/interactive/2008/10/14/opinion/20090531_OPCHART.html ) The chart shows the recent decline (or in some cases, rise) of retail sales at 27 common mall chains. My main objection is that the top half of the chart is useless. Yes, it provides a baseline from which shrinkage in area (visual metaphor of income = floor space) in the bottom half can represent the relative declines in sales, but this is redundantly handled better by color. The only part of the chart that I got any information from was the bottom half, and it took me a while before I figured out why the top half was even there. Meanwhile, the error in the printed version is that the +5-10% stores were colored light green while the +0-5% store (Burger King) was colored dark green. It should have been vice-versa. The online version simply swapped the colors in the legend, rather than on the map itself, which works logically but begs the question: why do you have dark red at one end of the spectrum and light green at the other, with dark green in the middle? Thank you for listening-- just blowing off a little steam here. It's a lot of wasted space and I'll bet the New York Times paid a lot for it.

Reference: "Op-Chart: The Fall of the Mall", New York Times. (Ed: I am not sure why the date is given as October 2008.)

The trouble with two lines

It's never a good idea to put two scales on one chart, and this is another example of what not to do:

The ugliest part of this chart are the duelling gridlines. Because neither axis starts at zero, it is difficult to access whether the number of newspapers was declining at a faster pace than the circulation was. Also, line charts would be better able to trace the evolution over time. The interspersed blue and red columns interfere with each other. Note that the designer lessened our pain by plotting every other year, thus halving the number of columns.

The junkart version also puts two data series on the same chart but on the same scale. Instead of plotting the raw data, we plot indices, with 2008 as 100. This reveals a pattern that was not apparent in the original chart. There appeared to have been four periods of evolution: up till 1980, both the number of newspapers and total circulation were at a plateau; from 1980 to 1990, the circulation stayed stable while the number of papers dropped drastically, indicating perhaps consolidation; then from 1990 to 2003, both series declined at roughly equal rates; and finally, the bottom dropped off the circulation from 2003.

See our previous discussion of dual axes here, here, and here

Reference: "Channel Shift: Online Circulars: the first step by retailers toward web-to-store harmony? ", Internet Retailer (print), May 2009. Data from the Newspapers Association of America.

Bonus 1: Thinking about the column interspersing trick some more, I realize that it is, em, possible, em, that one series was plotted for odd years and the other series plotted for even years!

Bonus 2: Here is the requested scatter plot (still indiced):

Supplemental reading

What are other graphics blogs talking about recently?

Information Aesthetics highlighted the so-called New York City Subway sparklines.   (original site)  (Andrew also mentioned it.)

IA said "The general idea is that the history of subway ridership tells a story about the history of a neighborhood that is much richer than the overall trend." 

Okay but what about these sparklines would clarify that history?  From what I can tell, this is a case of making the chart and then making sense of it.

The chart designer did make a memorable comment in his blog entry: "Hammer in hand, I of course saw this spreadsheet as a bucket of nails."  The hammer is a piece of software he created; the nails, the data of trips taken.

Nathan at FlowingData gave a reluctant passing grade to this Wall Street Journal bubbles chart illustrating the recent U.S. bank "stress" test.

One should fight grade inflation with an iron fist.  (Hat tip to Dean Malkiel at Princeton.)  A simple profile chart would work nicely since the focus is primarily on ranks.  The bubbles, as usual, add nothing to the chart, especially where one can create any kind of dramatic effect by scaling them differently.

Nathan also pointed to the maps of the seven sins, which garnered some national attention.  This set of maps is a great illustration of the weakness of maps to study spatial distribution of anything that is highly correlated with population distribution.  Do cows have envy too?  See related discussion at the Gelman blog.