« Involuntary head-shaking is probably not an intended consequence of data visualization | Main | Round things, square things »

Comments

mankoff

Thanks for the clarification on the slope chart. I have one question about this display. Shouldn't there be some white space between column? I find it confusing that one of the vertical lines is 2009-15 when approached from the left, but when leaving that line moving to the right, it is then 2000-09.

Xan Gregg

Just to expand on my twitter comment to recognize that what looks like a straightforward result has a lot of work behind it. On one hand you addressed feedback and completely revised your previous chart. And graphically, the final chart is a combination of several different features: trellising, smoothing, custom coloring, overlays and labeling.

Some of those are individually straightforward in JMP, but not the labels. I'm guessing you added the labels with the annotation tool or in post-production in an image editor.

Now I also notice you erased some of the repeated axis labels for make the result cleaner. I guess that's a general challenge with trellising.

Btw, don't forget to hit the Done button in Graph Builder before you take a screen capture. I can see a little of the drop zone outlines in the corners.

Kaiser

mankoff: You are struggling with the "level of abstraction" that Andrew was complaining about. In the slope chart, we are working at one level higher of abstraction. The data are gain scores (score differentials) and so the slope is the change in score differentials. It is the change of the change in raw scores. Another way to think about it: the slope in that plot represents how the slope of the curve is changing in the raw-score plot (but they only took two samples of this series: they measured the slope between 2000-2009 and then the slope between 2009-2015).

xan: yes, I used the visual elements and titles from the Graph Builder but inserted custom axis labels and line labels. To accommodate this, you'd have to allow some free text and have the space around the chart be responsive to the text. And yes, I should have screen captured after pressing Done.

One issue I encounter with these panel plots is the awkward spacing between the divider of the panel and the edge-most vertical gridline. Ideally, I like those to coincide but almost surely, that leaves no room for the axis label. So I am forced to leave an unsightly gap between the panels. That's why I custom-made those labels.

mankoff

Kaiser: I understand the slope chart. I'm just continually bothered by an x-axis that cycles. The "vertical lines" I wrote about are not the sloped data lines, but the grid. You have an x-tick marked "2009-15", but it is *also* "2000-09", for "4th grade reading" data. Small multiples, or 3 whitespace segments between each data set, would remove this confusing display.

Neil Schneider

I had another issue with this chart and the perceived analysis it provides. The original author appears to have an agenda about the progress in the most recent years. (Or they are just an idiot, but I am giving them the benefit of doubt.) The gain they showed for reading scores between 2000 and 2009 is almost entirely due to the difference between 2000 and 2003. You can see this in the "raw score" line chart you added above. 2003 is the year "No Child Left Behind"(NCLB) went into effect and this caused a level shift in the test results. The effect was different in different states based on how they did testing prior to NCLB. While the NAEP doesn't highlight this discontinuity, this NCLB evaluation discusses it in their design section: http://educationnext.org/evaluating-nclb/ .

Ken

Another alternative is to show the change from 2000 for each test/ethnicity, in which case any differences between ethnicities would be obvious.

When I look at this data I find the similarity in shape a bit concerning. I tend to question whether educational changes are applying across all ethnicities, or whether there is some change in the test scaling causes all 3 to change by a similar amount.

Verify your Comment

Previewing your Comment

This is only a preview. Your comment has not yet been posted.

Working...
Your comment could not be posted. Error type:
Your comment has been posted. Post another comment

The letters and numbers you entered did not match the image. Please try again.

As a final step before posting your comment, enter the letters and numbers you see in the image below. This prevents automated programs from posting comments.

Having trouble reading this image? View an alternate.

Working...

Post a comment

Your Information

(Name is required. Email address will not be displayed with the comment.)

Marketing analytics and data visualization expert. Author and Speaker. Currently at Columbia. See my full bio.

Book Blog



Link to junkcharts

Graphics design by Amanda Lee

The Read



Good Books

Keep in Touch

follow me on Twitter

Residues