Ethics: SCANDAL!

Throughout this Winter Quarter, the SSRC is partnering with the Department of Sociology to present a series of workshops and conversations about research ethics. To extend those conversations, we will be posting items about research ethics here for discussion.

One recent afternoon, a group of DePaul researchers—students, staff, and faculty—met in the SSRC conference room for the second session in our Research Ethics Workshop Series for lunch and discussion about what is and isn’t acceptable research practice, where grey areas exist, and what fundamental structures of academic research might actually contribute to poor or even fraudulent research.

That conversation, aided by the slides above, ranged from the practical to the principled. I’ll try to recapture that conversation here.

The presentation began with the case of Dutch social psychologist Diederik Stapel, who was recently found guilty of extensively fabricating data over many years in dozens of studies, at least 30 articles, and up to 14 dissertations. The universities Stapel had been affiliated with acted swiftly and thoroughly, publishing a preliminary report that outlined his methods, the effects, the academic environment that had contributed to his behavior, and issuing some recommendations. This fascinating report raises points about academic fraud and deception revealed through the tale of a charismatic swindler who abused the trust, admiration, and ambition of his colleagues and students to spin research gold from invented data, apparently in the name of selfless scientific progress.

The slides also illustrate the story of evolutionary biologist Marc Hauser, whose research assistants discovered coding inconsistencies that led to his conviction on eight counts of academic misconduct by his home institution (Harvard, no less). Though less extensive than Stapel’s fraud, Hauser ended up leaving his position at Harvard (after the faculty there voted overwhelmingly to bar him from teaching). The exact nature of his misconduct is a mystery since Harvard (hoping to protect its reputation?) has not released any information.

The workshop ended with a quiz-style round of questions related to a recent study of psychologists about their research practices. We debated the prevalence and defensibility of potentially dubious ethical practices and compared our conclusions with the study’s findings. Some discrepancies took us by surprise; others seemed the result of an over-generous interpretation of the survey questions.

A recurring theme in our conversation was the primacy transparency should have in every aspect of the research process, from collaborating with colleagues, to study design and methodology, to publishing findings. Making data and detailed information about research methodology available after publication would facilitate not only replication but peer review. We agreed that even in cases of academic misconduct, transparency as practiced by the Dutch universities in Stapel’s case was preferable to Harvard’s secrecy about what its transgressor had done—if only to address and ward against future misconduct. Transparency becomes especially important when students and faculty or others in relationships involving a power differential are working together on an ongoing basis. From the start, parties must be explicit about their expectations concerning workload, authorship, and data ownership.

Support for graduate students became a key theme in our own exploration of fraud. Academic training in a PhD program is more than scholastic education; it’s also professional training, which should offer students hands-on opportunities to develop solid (and ethical) research practices. The Dutch committees found that Stapel’s students were isolated from both each other and other faculty—unaware that Stapel’s practice of “collecting” data without their participation was unusual. Stapel abused their trust and robbed them of the opportunity to learn research skills through practice. The investigating committees emphasized the importance of having a neutral party within institutions to whom students can report unethical research practices or consult about what is acceptable.

There are many forms of “currency” in academia, not the least of which is data, earned through rigorous research practice. Stapel ran a tidy counterfeiting operation for years, trading his “data” (which he himself was said to call “gold”) for status, reputation, and international influence. Many people writing about the Stapel case have lamented the data- hoarding that too often characterizes social psychology research, and other fields. How available should data be at each stage of research? Numerous organizations are moving towards open access to data (after publication).

Publications are another form of research currency (this one needed for tenure). Authorship can be slippery to define in collaborative research.  We talked about the ethical grey areas where a mutually beneficial relationship may exist between advisers (especially those with some prestige in their field) and students whose work would go unpublished or unnoticed without the adviser’s prominent authorship. Professional societies include ethical guidelines about authorship. The American Sociological Association, for instance, specifically states that students should have lead authorship on works substantially derived from their dissertation work, a practice our participants said is not always followed. Students may feel that they benefit when their work is “brought to light” by the authorship of a more prominent researcher, but is it ethical? Is it fair?

Further reading:

Retraction Watch As the name suggests, this site tracks retractions throughout scientific scholarship.

John, L., Loewenstein, G.F. and Prelec, D. (January 31, 2012). Measuring the Prevalence of Questionable Research Practices with Incentives for Truth-Telling.

Garner, R. (2012). [Review of the book Plastic Fantastic: How the Biggest Fraud in Physics Shook the Scientific World]. Science & Society: Vol. 76, No. 1, pp. 115-135. doi: 10.1521/siso.2012.76.1.115 Available from Guilford Journals.

UPDATE: 

The Committees investigating Diederik Stapel have begun to publish the findings of their intensive review of Stapel’s publications.

Ethics: Walking the Talk

Throughout this Winter Quarter, the SSRC is partnering with the Department of Sociology to present a series of workshops and conversations about research ethics. To extend those conversations, we will be posting weekly questions about research ethics here for discussion.

This week, Scientific American posted a short interview with NASA’s chief climate scientist, Jim Hansen, often referred to as “the father of global warming”. The interview centers on Hansen’s activism in favor of policy changes to curb CO2 emissions and fossil fuel dependency to curtail climate change. In recent years, Hansen has intentionally been leaving the lab to attend protests and rallies—even getting arrested multiple times, most recently this summer at the White House protesting an oil pipeline.

woman being arrested

Suffragette Emmeline Pankhurst being arrested, via the Nationaal Archief, Netherlands

Asked at the top of the interview whether his credibility as a scientist has suffered due to his political activism around his subject of study, Hansen says:

If I was not publishing papers in the peer reviewed literature, then that would be a valid criticism. But I am still publishing. I’m trying to make that science clear to the public. It’s not easy: The scientific evidence has really become very clear, and we’re not doing a very good job of communicating that.

Hansen’s answer gets at the heart of something we talk about all the time at the SSRC: Getting socially-relevant research findings with the potential to impact policy into public discussions.

Continue reading

Annotated Bibliography: Social Media for Recruitment

Illustration by Kathleen Donovan

The ways in which scholars engage in research are gradually shifting. In the age of technology, information can be disseminated freely in a relatively short span of time. Scholars around the world are obtaining information and exchanging resources in and across their disciplines as result of social networking.

In addition to networking, surveys can be distributed via Facebook and the latest resources for faculty and students in the academy can be shared on Twitter. Social media in the western world has become such a large component of our existence that we would be remiss to not take advantage of its potential.

Recently, we put together a Social Media Annotated Bibliography (click to download the .docx file) on online survey recruitment using social media, particularly social networking sites. Although much of the literature suggests that online survey research can produce diverse convenience samples at a minimal cost to the researcher, the literature in this area also touches on crucial ethical and methodological issues in online research as well.

Provoking Big Data

As computing power expands exponentially, excitement in the research community grows regarding the availability, prevalence, and newfound ease in analyzing large data sets known colloquially as “Big Data”. Even the humanities (in the form of digital humanities) have begun to embrace computation as a mode of study, and popular publications have all but declared qualitative research dead.

Drawing on David Berry’s idea of the “computational turn” in the humanities and social sciences, researchers danah boyd and Kate Crawford raise serious, timely, and well-grounded questions about the implications, assumptions, and norms around the growing use of “Big Data” in their article, “Six Provocations for Big Data”.

The issues are largely intertwining questions of access, control, academic freedom, research ethics, and the assumptions, contours, and values of social research.

This article is valuable for anyone interested in the future of research and the use of social media data, and should provoke conversation, or at least inspire questions and second thoughts about the use of Big Data in studying society as a whole.

Oral History Protections

A brief filed by the United States Department of Justice could significantly affect researchers doing oral histories or working with subject confidentiality agreements. The brief, filed on July 1st, concerns the extent to which courts will respect academic confidentiality agreements between researchers and subjects, and clearly outlines the government’s position against such agreements when measured against court authority. The issue emerged from a dispute between Boston College and the United Kingdom over a Boston College oral history archive on the socio-political unrest in Northern Ireland.  The British government wants access to the documents which they argue relate to criminal investigations in Northern Ireland, while the college has protested that interviewees were promised confidentiality during their lifetimes.

The U.S. government’s position essentially rejects all of Boston College’s objections, arguing that no confidentiality a researcher may grant would withstand a subpoena, regardless of any promises made by the researcher. The brief acknowledges that academic confidentiality has been used to protect documents in civil lawsuits, but states that these protections do not extend to criminal cases, and says courts have not recognized an academic privilege comparable to the attorney/client privilege or Fifth Amendment protection against self-incrimination.

Not surprisingly, many historians and academics have come out in defense of Boston College’s position, arguing that the loss of trust between researcher and subject will have a chilling effect on research.

Read the full article from Inside Higher Ed: Oral History, Unprotected.

A Word From the DePaul University Office of Research Protections

Susan Loess-Perez, Director

The federal Office for Human Research Protections (OHRP) has indicated that oral history and similar activities (biography, history, journalism) that document historical events or experiences of individuals and do not aim to draw conclusions, inform policy or generalize findings do not constitute research and therefore do not require Institutional Review Board (IRB) review and approval. Only activity with research intent requires IRB review and approval.
Although this article calls the project research and those conducting it researchers, Boston College has confirmed in other articles that IRB review and approval were not obtained for the project. The article indicates that a common protection for researchers working with sensitive data is to obtain a Certificate of Confidentiality (COC). However, since oral history is not research, a COC could not be obtained and it is unclear whether it would hold up against a federal subpoena of this nature. Had this project undergone IRB review, the IRB would have had difficulty in determining whether the benefits of the research (presumably the indirect benefits of the knowledge gained) outweighed the risks (the direct risks of criminal prosecution for individuals).

The article underscores that even activities that are not research can involve potential risks to the subjects of the activity, as well as to the persons conducting the activity and their institution. Although the interviewers had interviewees sign a confidentiality agreement indicating that their identity would be sealed for a specified period of time, the government argues that there is no promise of confidentiality a researcher may grant that can withstand a subpoena. In the context of research, it is important to remember that a consent agreement is not a legal document and usually includes language about the limitation of confidentiality, including a lack of protection from subpoenas requesting the data.

From an ethical standpoint, the interviewees were never told that the content of the interviews might be subject to legal subpoena and therefore could result in substantial risk to them. The oral historians argue that this is an issue of academic freedom, but academic freedom refers to the faculty’s right to discuss or investigate any topic without interference or penalty from officials and does not appear to apply to this situation.

When conducting studies on sensitive topics that could involve risk to the researcher, subjects and the institution, it is a good idea to have a discussion with the DePaul University Office of General Counsel (OGC) regarding local or other laws that might affect the activity, and other legal issues such as limitations of confidentiality agreements and academic freedom.