My Experience with Ariely's Modified Shredder: A Followup

 

I mentioned in a prior FraudBytes post that I have some suspicions about a set of experiments that Professor Ariely claimed he ran using a shredder that he said was modified so it looked like it was shredding but really wasn't (see this link for more details). After purchasing several shredders in an attempt to modify them so we could do what he claimed he did, we emailed Professor Ariely to ask him how he did it. He provided a voicemail response where he stated that it was "quite simple" to convert a shredder by breaking the teeth in the middle with a screwdriver but that he doesn't use that method any longer. (You can listen to Dr. Ariely's explanation at this link.)

As I said in the earlier post, we were unable to break any teeth on the shredders we purchased but ended up finding a way to remove some of the teeth in the center by taking the shredder apart. Unfortunately, when we did this the papers would no longer go through the shredder without getting turned to one side or another and they inevitably got stuck because the shredder no longer had enough teeth to pull them straight through. 

We concluded that it was impossible to modify any of the shredders we bought and I put an asterisk next to Dan Ariely's name as someone who made a claim regarding his research that seems very suspicious.

Since I posted about this almost two weeks ago, I did an extensive literature search (involving several others who helped out) looking for the research that he claims was done with the modified shredder. The end result is that I can't find any published paper that discusses using a modified shredder. I even called one of his co-authors and asked him if the experiment that they ran together used a modified shredder. He said the shredder in their study was not modified.

I did find a few papers that used a regular shredder but did not mention any modifications. I also found several statements (including this one and the one linked above) where he claims to use this mysterious modified shredder. Overall then, here's where we are with the shredder:

1. Dr. Ariely has made numerous claims to use a modified shredder in his matrix experiments.

2. I am unable to find any published papers by Dr. Ariely that use a modified shredder.

3. Modifying a shredder to do what he has claimed appears to be very unlikely.

So why would Dan Ariely make this claim? Perhaps he got confused about how his studies involving shredders were conducted. Or perhaps he never conducted the studies with a modified shredder. 

Unfortunately, the more I dig into things, the more I find instances where Dr. Ariely has made statements that suggest a lack of integrity on his part. For example, this NPR interview about dentists is troubling to me. He also has a paper that was recently given an "Expression of Concern" by the journal that published it (see this for details). I hope Duke University gets to the bottom of these black marks on Ariely's work and if other published studies are based on fabricated data that they get retracted like the 2012 paper. 

Unfortunately, at this point, I'm not sure what to think of the research he claims to have conducted on the psychology of dishonesty...I certainly will hesitate to cite any of his papers in my research.

Analysis Argues Ariely Retraction was a Sloppy Fraud

An analysis by Jonatan Pallesen shows that the Ariely fabrication that I posted about a few days ago was extremely sloppy. The post concludes that "This is a case of fraud that is completely bungled by ineptitude." Well, let's not mince words here....

The original analysis on the Data Colada blog identified several inconsistencies in the data that showed it was fabricated data. For example, the data is a uniform distribution that goes from 0-50,000 and stops. This new analysis, raises additional questions about the data and asserts that the analysis shows how the fraudster was able to manipulate the data to support the hypotheses tested in the paper. 

I recommend reading this analysis and deciding whether the author makes a compelling argument to support his claims. His ultimate claim is that the fraud had to be perpetrated by Ariely himself. He says: "Is it possible that someone at the car insurance company faked the data, and Dan Ariely simply received this fake data? I would say that it is not."

Bold claims require bold evidence. See what you think.

Top Honesty Researcher, Dan Ariely, Has Paper Retracted Due to Fraudulent Data

Today, truth is on my mind after I read the following quote:

"(T)ruth is not what you want it to be; it is what it is, and you must bend to its power or live a lie."–Miyamoto Musashi

This reminded me of this, my favorite, quote about truth: 

“When truth is buried underground it grows, it chokes, it gathers such an explosive force that on the day it bursts out, it blows up everything with it.”–Emile Zola

Over the years, I've found the latter quote to be very descriptive of the events that follow after the initial revelations that a fraud has taken place. For example, the explosion of truth that happened after Lance Armstrong was first accused by his former teammate, Floyd Landis, of doping. A few years later and Lance had been stripped of all his yellow jerseys and all sorts of revelations came out that exposed truth that was buried deep in the ground in hopes that it would never be revealed (this link chronicles about 150 blog posts about Lance's fraud coming to light).

Similarly, in accounting research, we had a researcher who, by many accounts, was considered accounting's most prolific academic, Jim Hunton, have a paper (ironically on auditor's detection of fraud) retracted in November 2012. Many of Professor Hunton's papers contained what he claimed was proprietary data that was obtained from confidential sources. A few years later, 37 of Jim Hunton's papers had been retracted (technically, 36.5 since one paper was partially retracted). He is currently listed as #14 on the RetractionWatch leaderboard (see this link for more information).

Over the past few days, a 2012 paper coauthored by someone who is arguably the most prolific psychology researcher on (ironically) honesty, Dan Ariely, was identified as containing fraudulent data and is being retracted (see this link for details on the investigation that led to the retraction; see this Twitter thread saying it is being retracted and giving other interesting context from one of the coauthors). Unfortunately, like Jim Hunton, Professor Ariely was in charge of the data and claims to have obtained it from a proprietary source. While it is too early to tell, this begs the question of what the future holds. Is this the early rumblings of the truth trying to free itself from its casket buried deep in the earth?

Sadly, I have had some suspicions about some experiments that Professor Ariely ran using a shredder that was modified so it looked like it was shredding but really wasn't (see this link for more details). After purchasing several shredders in an attempt to modify them so we could do what he claimed he did and even getting a BYU engineering student who was the lead TA in the Mechanical Engineering lab involved in the effort, we emailed Professor Ariely to ask him how he did it. He provided a voicemail response that was not satisfactory. He claimed it was "quite simple" to convert a shredder by breaking the teeth in the middle with a screwdriver but that he doesn't use that method any longer. (My TA found the file with Dr. Ariely's explanation; click this link if you want to hear it.)

(The photo on the left is one of the shredders we tried to modify. I'm confident that those teeth could not be broken with a screwdriver.) 

We were unable to break any teeth on the shredders we purchased but ended up finding a way to remove some of the teeth in the center by taking the shredder apart. Unfortunately, when we did this the papers would no longer go through the shredder without getting turned to one side or another and they inevitably got stuck because the shredder no longer had enough teeth to pull them through. We concluded that it was impossible to modify any of the shredders we bought and I filed the entire experience in my mind by putting an asterisk next to Dan Ariely's name as someone who made a claim regarding his research that seems potentially suspicious.

Time will tell whether this retraction is the rumblings of a massive explosion or not. If there are other implications, I hope the truth comes out because, I believe, the world is always a better place when fraud has been exposed.