« The trouble with percentages | Main | Scribbling as art »

Comments

Peterh

The link to "Emergence is now a science" is broken. Care to share the right one?
thx

iain

This one:
http://www.amazon.com/Emergence-Connected-Brains-Cities-Software/dp/0684868768/sr=1-1/qid=1166159133?ie=UTF8&s=books&tag2=junkcharts-20

iain

gah, except that didn't work. let's try again: link

Kaiser

The link is fixed now. Thanks for the note.

Peter

Thinking about a solution to the percentage problem: Instead of focussing on states-as-whole, why not look at the chance of switching party for each congressperson, using, perhaps, some form of ordinal logistic regreesion, possibly within a mixed model?

Could rank the possible changes:
Switch to D
Stay same
Switch to R

then, the IVs could be at both state level and district level (and maybe national level, too).


失踪

Kaiser, as you are aware these are not emergent patterns but scientist-produced patterns occurring from data manipulation. They should not be called “emergent”. An emergent pattern is not produced by the scientist; it is only seen by the scientist. In the case of emergence the underlying elements produce the pattern through relation. The relation of the elements to each other give access to a new and emergent layer of meaning and new properties which were not seen by inspection of the isolated elements. The emergent phenomenon is biased or leads to false conclusions when inclusion/exclusion of the elements that belong to an entity is not clearly defined.

Kaiser

The reference to the Emergence book was definitely tongue-in-cheek. However, I do think one of the challenges of that field is to ascertain that observed patterns are not of random origin.

This theme in fact arises again and again. Classical statisticians are very familiar with it through the multiple comparisons issue in analysis of experiments. In machine learning, and in particular the area known as "association rules", the biggest challenge is how to declassify correlations that just happen to show up in your sample.

The comments to this entry are closed.

Kaiser Fung. Business analytics and data visualization expert. Author and Speaker.
Visit my website. Follow my Twitter. See my articles at Daily Beast, 538, HBR.

See my Youtube and Flickr.

Book Blog



Link to junkcharts

Graphics design by Amanda Lee

The Read



Keep in Touch

follow me on Twitter

Residues