Selection bias in what gets reported When people make statistical errors, I don’t say “gotcha,” I feel sad.Even when I joke about it, I’m not happy to see the mistakes; indeed, I often blame the statistics profession—including me, as a textbook writer!I hope Cuddy can stop insulting Simmons and Simonsohn, forget about the claims of the absolute effects of power pose, and move forward, sending the message that people can help themselves by taking charge of their environment, by embodying who they want to be.The funny thing is, I think that pretty much silly, unsupported claims such as “That a person can, by assuming two simple 1-min poses, embody power and instantly become more powerful has real-world, actionable implications.” A way forward People criticize Cuddy for hyping her science and making it into a Ted talk.Also awkward was a full retraction by first author Dana Carney, who detailed many ways in which the data were handled in order to pull out apparently statistically significant findings. [No, upon reflection, I don’t think the article was fair, as it places, without rebuttal, misrepresentations of my work and that of Dana Carney — AG], given the inevitable space limitations.I wouldn’t’ve chosen to have written an article about Amy Cuddy—I think Eva Ranehill or Uri Simonsohn would be much more interesting subjects.
in 2015 and then more recently various other research teams (see, for example, here). paper was an analysis by Joe Simmons and Uri Simonsohn explaining how Carney, Cuddy, and Yap could’ve gotten it wrong in the first place.I don’t know Cuddy personally, but given everything I’ve read, I imagine that she’s a kind, thoughtful, and charming person. And I expect Satoshi Kanazawa has many fine features too.In any case, it’s not my job to judge these people nor is it their job to judge me.We learn, individually and collectively, from our mistakes.We’re all part of the process, and Dominus is doing the readers of the New York Times a favor by revealing one part of that process from the inside.—for portraying statistical methods as tools for routine discovery: Do the randomization, gather the data, pass statistical significance and collect 0. Think of the thousands of careful scientists who, for whatever combination of curiosity or personal interests or heterodoxy, decide to study offbeat topics such as ESP or the effect of posture on life success—but who conduct their studies carefully, gathering high-quality data, and using designs and analyses that minimize the chances of being fooled by noise.Regarding what gets mentioned in the newspapers and in the blogs, there’s some selection bias. Suppose, for example, that Daryl Bem had not made the serious, fatal mistakes he’d made in his ESP research.. These researchers will, by and large, quietly find null results, which for very reasonable dog-bite-man reasons will typically be unpublishable, or only publishable in minor journals and will not be likely to inspire lots of news coverage. Conversely, I’ll accept the statement that Cuddy in her Ted talks could be inspiring millions of people in a good way, even if power pose does nothing, or even does more harm than good.The only thing that really bugged me about the NYT article is when Cuddy is quoted as saying, “Why not help social psychologists instead of attacking them on your blog? I remember this came up when Dominus interviewed me for the story, and I responded right away that I helped social psychologists! I’ve given many talks during the past few years to psychology departments and at professional meetings, and I’ve published several papers in psychology and related fields on how to do better applied research, for example here, here, here, here, here, here, here, and here. In summary, I think Dominus’s article was , but I do wish she hadn’t let that particular false implication by Cuddy, the claim that I didn’t help social psychologists, go unchallenged.I even wrote an article, with Hilda Geurts, for The Clinical Neuropsychologist! Then again, I also don’t like it that Cuddy baselessly attacked the work of Simmons and Simonsohn and to my knowledge never has apologized for that. .” I never saw Cuddy present any evidence for these claims.) Good people can do bad science.But, conditional on the article being written largely from Cuddy’s perspective, [actually no, I don’t think so. As I said to Dominus when she interviewed me, I don’t have any personal animosity toward Cuddy.I just think it’s too bad that the Carney/Cuddy/Yap paper got all that publicity and that Cuddy got herself tangled up in defending it.