With the International Conference on High-Energy Physics just around the corner, rumors have been flying about what the ATLAS and CMS Experiments will have to say about the Higgs boson. As a member of the ATLAS Collaboration, I won’t comment on any specific rumors and I won’t start any of my own. In this short post, I want to emphasize one thing: rumor is an enemy of good science.
Consider this: confidence in your process is a critical hallmark of sound research. The results are only “good” if the means by which they were obtained are defensible. A “good” result is NEVER one that you simply agree with, or which confirms an expectation. In fact, many good results have dis-confirmed a long-cherished notion or a beautiful idea. But in the end, the integrity of the process determines whether you should “like” the results . . . whether or not you like the results should NEVER determine the integrity of the process.
Gossip and rumor poison the process. Researchers who practice an honest craft strive to avoid making biased decisions while at the same time deliberately designing tests that check for unconscious bias. Research methodology is also exposed to a grueling gauntlet of peer review, wherein no one is satisfied until the research has been beaten to a pulp. Good research withstands the withering meat grinder of criticism. That criticism comes from the researcher themselves, their collaborators, and their peers in the wider community.
The poison of rumor serves to do at least two things. It attempts to tip the hand of the researcher, who is purposely keeping their results private until they are certain that the research cannot be easily debunked by the community. It also attempts to trick the researcher into biasing themselves. For instance, a rumor of another scientist’s positive or negative result might plant a seed of doubt in the mind of the researcher, causing them to inadvertently make poor decisions about their research and causing either unconscious or conscious bias.
ATLAS and CMS are working under tremendous time pressure to provide good results in time for ICHEP. The data they intend to use for those results was only delivered in completion by the collider a week ago. I’m giving nothing away by saying that already the latest data is making its way into many different analysis projects that will be unveiled for ICHEP. But the gossip and rumor out there, in some cases being served up by peers in the field, is attempting to make the difficult game of doing good science into a dangerous game that now requires fending off jackals. It’s to the credit of the researchers in ATLAS and CMS that they seem to be trying hard to ignore the gossip.
Public and private together play important roles in science. Ultimately, the publication of results is a critical hallmark of good science. The community must be informed of results so that collective progress in our understanding of the universe can be made by further testing and applying those results. But the privacy of the results (until they are ready) is a critical act in insuring the integrity of the process. Privacy, for at least a time, allows the researcher to think of ways to test their own assumptions and to vet the process and the conclusions from the process. Privacy is critical to avoiding pressure to get one answer or another answer; privacy gives the data a chance to speak for itself. Violations of either of these are always a bad thing, and threaten the pace of scientific progress.
So to all of you rumor-mongerers out there who are also practicing scientists, I ask you to reflect on the importance of privacy and publicity in science. Consider that the next time you land a tasty hunk of grade-A gossip from a trusted source. One day, the poison of gossip and rumor may be turned on your work, and it tastes bad whether you or somebody else has to swallow it. In fact, it may be the one poison that ruins the poisoner and the victim.
