« Bowled over by T-mobile | Main | People ask me what coding language should they learn to become a data scientist »

Comments

Feed You can follow this conversation by subscribing to the comment feed for this post.

Ken

It surprises me that this is still a problem as my memory is that ETS has done a massive amount of work on differential item functioning to identify when this problem occurred. However, it would seem best to get rid of this type of question, which basically is just checking how big someones vocabulary is. One option would be to supply a page or two of text explaining something and then ask questions related to the text.

It is interesting to compare what happens in the US to Australia. In Australia at the end of high school students sit a set of exams for the different subjects. The individual results are scaled and combined to give an overall estimate of what percentile result of all 18 year olds including those that did not complete high school or didn't complete subjects suitable for uni admission. This is then used as an entrance score for university. There is a sight complication that the half a dozen states all have their own curriculum and exams. There is also the option to sit for an international qualification instead.

Kaiser

Ken: yes, the book chapter covers the work on DIF. And analogy questions have been deprecated in the test. The problem of test item bias though is not limited by question type.

In the U.S., there has always been opposition to the kind of nummeric exam-based scoring used in many other countries. Admissions officials favor some kind of "holistic" approach, which is undoubtedly more subjective. The recent unsuccessful lawsuit against Harvard reveals the existence of subjective scores of applicant's "personality". That's the inconsistency I was pointing out... the SAT is being pushed out not because of subjective bias, that's not the real reason.

The comments to this entry are closed.

NEW BOOTCAMP



Full-Time Immersive
Summer 2020


Link to Principal Analytics Prep

See our curriculum, instructors. Apply.
Kaiser Fung. Business analytics and data visualization expert. Author and Speaker.
Visit my website. Follow my Twitter. See my articles at Daily Beast, 538, HBR.

See my Youtube and Flickr.
Numbers Rule Your World:
Amazon - Barnes&Noble

Numbersense:
Amazon - Barnes&Noble

Search3

  • only in Big Data

Next Events

Jan: 10 NYPL Data Science Careers Talk, New York, NY

Past Events

Aug: 15 NYPL Analytics Resume Review Workshop, New York, NY

Apr: 2 Data Visualization Seminar, Pasadena, CA

Mar: 30 ASA DataFest, New York, NY

See more here

Courses

R Fundamentals, Principal Analytics Prep

Numbersense: Statistical Reasoning in Practice, Principal Analytics Prep

Applied Analytics Frameworks & Methods, Columbia

The Art of Data Visualization, NYU

Signed copies at McNally-Jackson, NYC

Excerpts: Numbersense Ch. 1, 7, 8. NRYW

Junk Charts Blog



Link to junkcharts

Graphics design by Amanda Lee

Community