Universities face difficult questions over PHD standards after Arday’s Death

By  Gabriel Princewill–

The controversy surrounding  the death of former Cambridge professor Jason Arday has raised questions over PHD standards, and the implication of plagiarised work or perceived plagiarised work, and  how effectively  universities can identify academic misconduct. Also,  how  the credibility of a doctorate  can be assessed when concerns about the underlying research emerge years after the qualification was awarded?

Those questions have acquired an additional and deeply sensitive dimension following the death of former Cambridge  professor, Jason  Arday.  Cambridge University had announced investigations into allegations concerning aspects of his academic record before his death.

Over 100,000 callas for a public inquiry and complaints to the UK press regulator, Ipso has led to the regulator announcing a review of the complaints, albeit without any clear time scale of that review. Meanwhile, the late professors memoir ‘Great and Unfortunate things has been published, notwithstanding the detracting allegations surrounding embellishments of his accomplishments which sparked a media campaign against him.

Allegations concerning his research have never been  established as factual findings of plagiarism, but the value of establishing how far plagiarism or its semblance affects the credibility of a PHD doctorate certificate remains worthy of exploration. Associated with the value of such examination is an inquiry into the substance of exposing alleged plagiarism, if it has no real or substantive effect in the eventual certificate awarded.

Besides, the controversy surrounding the late professor extended beyond his academic credentials or integrity, to wider claims he attributed to himself, many of which were found to be unverifiable. Most important for the academic world is what ramifications the entire saga has on the practices or omissions at various universities in the UK, particularly the most prestigious of them all.

The broader academic-integrity questions  that remain significant have long term benefits .At issue is not simply whether particular passages in a doctoral thesis bear similarities to material produced by another researcher. The more fundamental question is what level of assurance a university can reasonably provide when it awards a doctorate, and whether that assurance can subsequently be revisited when new evidence becomes available.

Arday’s case has brought the issue into particular focus because approximately 100 passages in his doctoral thesis were reportedly identified as bearing similarities to work by another student. The identification of similarities is not in itself equivalent to a finding of plagiarism. Such a finding requires an assessment of the nature of the similarities, the source material, attribution, the extent of the reproduction and the academic rules applicable at the time.

As Dr Aloke, a PhD holder and lecturer in law, explains:that  “the fact that a hundred passages have been identified as similar does not, without further analysis, tell us the legal or academic significance of those passages. We need to know what was copied, how it was copied, whether it was attributed, the nature and extent of the similarities, and whether the material was presented as the candidate’s own work.” That distinction is particularly important in a case that has attracted substantial public attention. The existence of material warranting investigation should not be confused with the conclusion of an investigation.

The awarding of a PhD to student amounts to a formal academic judgement that the candidate’s research has met the institution’s requirements for doctoral-level work. The qualification normally reflects an assessment of the originality, methodology, scholarship, contribution to knowledge and overall academic standard of the research.

The award is deemed an important institutional endorsement of the candidate’s research capability. Such a prestigious award provides no  official confirmation that every sentence, source, proposition or intellectual influence contained in a thesis has been exhaustively checked against every item of relevant academic literature.

Dr Aloke said: ”A PHD is fundamentally a certification by a university that, at the time of examination, the candidate’s research satisfied the institution’s requirements for doctoral-level scholarship. It is not necessarily a certification that every sentence, source or intellectual influence in the thesis has been exhaustively verified against every piece of literature that exists.”

The distinction becomes particularly relevant when questions about a thesis arise many years after the original examination. A thesis is expectedly examined in accordance with the standards and information available at the time, while subsequent developments in technology, digitisation and access to academic literature make it possible to identify material that earlier examiners could not reasonably have located.

Experts agree that such a possibility does not, by itself, establish that the original examiners acted improperly. It does demonstrate that the process by which doctoral research is assessed has practical limitations worth examining and reflecting upon.

When does similarity constitute plagiarism?

The public discussion of plagiarism can sometimes give the impression that the identification of matching text is sufficient to establish misconduct. Academic practice is more nuanced.

Universities increasingly use text-matching systems to identify similarities between submitted work and material contained in academic publications, books, websites, dissertations and other sources. Such systems are valuable because they can direct examiners or investigators towards passages requiring further examination.

They do not, however, determine whether plagiarism has occurred. A similarity may arise because a researcher has properly quoted and cited a source. It may involve established terminology or conventional language within a particular discipline. Alternatively, it may reveal material that has been reproduced without appropriate acknowledgement.

Determining which of those circumstances applies requires human assessment.

Dr Aloke said: “Text-matching software can identify similarities; it cannot determine plagiarism. That determination requires a human assessment of context, attribution, authorship and academic standards.” That distinction should inform any assessment of the reported similarities in Arday’s thesis. The relevant issue is not simply the number of passages identified, but what an examination of those passages establishes.

Questions would include whether the material was reproduced verbatim or substantially paraphrased, whether the source was acknowledged, whether the similarities concern wording or underlying ideas, whether the material represented conventional academic language, and what significance the passages had within the thesis as a whole. The answers to those questions are matters for the relevant academic investigation rather than for assumption based solely on the reported number of similarities.

The importance of distinguishing allegations from findings

The handling of allegations of academic misconduct requires universities to maintain a distinction between an allegation, an investigation and an established finding.

Liverpool John Moores University, which awarded Arday his doctorate, previously investigated complaints concerning his thesis and did not uphold the plagiarism allegations. Cambridge subsequently announced that it had received new information and would undertake further investigations. (cam.ac.uk)

The significance of that distinction is wider than the Arday case. An allegation may justify investigation without establishing misconduct, while a previous investigation does not necessarily prevent a university from examining genuinely new evidence.

The credibility of the process depends upon universities being prepared to investigate credible concerns while also ensuring that allegations are not treated as findings before the evidence has been assessed.

Dr Aloke said: “There are two dangers that universities have to avoid. One is failing to investigate credible allegations of academic misconduct. The other is allowing an allegation to become a finding before the evidence has been properly examined.”

That balance is particularly important when allegations concern established academics whose reputations and professional careers may be affected by public reporting before an investigation has reached a conclusion.

What universities cannot know

The controversy also raises a broader question concerning the effectiveness of academic-integrity systems. Universities have procedures for investigating suspected plagiarism and other forms of academic misconduct. They have examination regulations, disciplinary processes and increasingly sophisticated technological tools for identifying similarities between academic works.

What they cannot establish with certainty is the number of cases that remain undetected. This is a problem inherent in measuring misconduct that may never come to the attention of an institution. A university can report the number of cases identified and substantiated during a particular period, but those figures cannot establish the number of cases that were never reported, never identified or could not be investigated because sufficient evidence was unavailable.

That limitation should not be interpreted as evidence that widespread plagiarism exists among PhD graduates. There is no basis for making such a generalisation.

Dr Aloke said: “Universities can tell us how many cases of academic misconduct they have detected, but they cannot tell us with certainty how many cases they have failed to detect. That is an inherent limitation of any system dealing with misconduct that may remain undiscovered.”

The limitations facing doctoral examiners

The responsibilities placed upon doctoral examiners are substantial. They must determine whether a candidate’s research satisfies the academic requirements for a doctorate, including its originality, methodology, engagement with relevant literature and contribution to knowledge.

An examiner, however, is not expected to possess comprehensive knowledge of every publication that has ever appeared in the relevant field. Nor is the examination process ordinarily a forensic investigation into every sentence contained within a lengthy thesis. PHD students are provided with a supervisor who is expected to have oversight of the student’s academic development when preparing a thesis.

Dr Aloke said:“A doctoral examiner is an expert in a particular field, but an examiner cannot realistically be expected to know or identify every sentence that has previously appeared in every book, thesis, article or conference paper in that field.”

This limitation is particularly relevant when examining older doctoral research. The availability of academic material has changed substantially as journals, dissertations, books and other research have been digitised and made searchable. A thesis examined many years ago may therefore be subjected today to a level of textual scrutiny that was not practically available to the original examiners.

That development does not necessarily establish a failure in the original examination. It illustrates instead that the ability to scrutinise academic work changes over time.

What happens when misconduct is established later?

The more difficult question arises when substantial academic misconduct is subsequently established. If a university concludes that a doctoral candidate deliberately engaged in serious plagiarism in obtaining the qualification, there is an obvious question about whether the integrity of the original award has been compromised.

The issue is not merely reputational. A PhD can be a prerequisite or significant foundation for an academic career. A researcher may subsequently become a lecturer, publish extensively, supervise students, obtain research funding and eventually hold a senior academic position.

If serious misconduct in the doctoral research is established years later, it may therefore be reasonable to consider whether the circumstances surrounding the original qualification have implications for subsequent professional achievements.

But the reverse proposition is equally important. An allegation that is investigated but not established should not automatically be treated as proof that the qualification was improperly obtained.

Dr Aloke said: “If substantial and deliberate plagiarism is subsequently established, it is entirely legitimate to ask whether the integrity of the original award has been compromised. But that is different from saying that an allegation, or even a similarity between two pieces of work, automatically invalidates a doctorate.”

The distinction is fundamental. Academic integrity requires accountability where misconduct is established, but it also requires fairness where allegations cannot be substantiated.

The detection problem

There is an unavoidable asymmetry in any system that depends upon detection.Two researchers could theoretically engage in similar misconduct, while only one is identified because the relevant material is discovered by an examiner, another researcher or a subsequent investigator.

The person whose conduct is detected becomes subject to an investigation and, where misconduct is established, potentially to disciplinary or academic consequences. The conduct of the other researcher may never come to institutional attention. That does not demonstrate that undetected misconduct is common. It demonstrates that detection is a necessary precondition to institutional action.

The distinction is important when interpreting academic-integrity statistics. A reduction in confirmed cases might reflect improved academic practice, more effective prevention or simply differences in reporting and detection. Conversely, an increase in detected cases might reflect more effective scrutiny rather than a corresponding increase in underlying misconduct.For that reason, the number of confirmed cases should not be treated as a precise measure of the prevalence of academic misconduct.

Should doctoral degrees be classified?

The controversy also invites consideration of the structure of doctoral qualifications.Doctoral degrees are generally awarded on a pass-or-fail basis rather than through classifications comparable with those used for many undergraduate and master’s qualifications. This reflects the nature of doctoral education: the candidate is required to demonstrate that the research has met the threshold required for the award.

That system has obvious advantages. A PhD is not intended to be a competition in which candidates are ranked against one another. Research in different disciplines is also difficult to compare using a common classification system. Nevertheless, there may be room for a broader discussion about how universities communicate the quality and limitations of doctoral research.

Academics believe  a classification system may not be the appropriate answer. Greater transparency about the examination process, research contribution and any significant academic-integrity concerns may be more useful than assigning a simple grade to highly specialised research.

Dr Aloke said: “The pass-or-fail nature of a PhD reflects the fact that doctoral research is intended to meet a threshold of originality and academic contribution. But the system could legitimately debate whether there should be greater transparency about the strengths, limitations and integrity of doctoral research rather than treating the certificate as an absolute statement of scholarly perfection.

‘The credibility of a doctoral qualification ultimately depends not only on the quality of individual researchers but also on the integrity of the institutions that examine and award those qualifications. Universities therefore face a dual responsibility.

‘They must investigate credible allegations of misconduct thoroughly and fairly. At the same time, they must ensure that individuals are not effectively convicted by allegation alone. This is particularly important where allegations become the subject of widespread public discussion before an institutional investigation has concluded.

‘The digital environment makes that challenge more acute. Allegations can be reproduced across websites and social-media platforms almost immediately, while subsequent findings that do not substantiate the allegations may receive considerably less attention.’

Robust

A robust academic-integrity system must therefore protect both sides of the process: the integrity of the qualification and the fairness owed to the person whose work is being investigated.

Whilst the controversy surrounding Arday may suggest that PhDs are generally unreliable or that universities routinely award doctorates to researchers who have engaged in plagiarism, academics warn that there is no evidence to support such a conclusion. The more significant issue is what universities can reasonably guarantee when they award a doctorate.

They can confirm that qualified examiners assessed the candidate’s work against the institution’s doctoral requirements and determined that the threshold for the qualification had been met.

They cannot reasonably guarantee that every possible source has been identified, that every intellectual influence has been detected, or that no future evidence could ever raise questions about the research. That is not necessarily a weakness unique to doctoral education. It is a limitation inherent in any system that relies upon human examination and available evidence.

Dr Aloke said: ”The appropriate response is therefore neither complacency nor wholesale distrust. Universities should continue to strengthen doctoral examination, improve access to academic archives, maintain effective procedures for investigating credible allegations and ensure that decisions are based on evidence.

‘They should also distinguish clearly between three very different circumstances. A qualification whose integrity has not been questioned, an allegation that has not been established, and misconduct that has been proven. Those distinctions are increasingly important at a time when academic reputations can be affected by allegations long before an investigation is completed.

‘The Arday controversy has therefore raised a legitimate public-interest question without necessarily providing a simple answer to the question; what does a PhD actually guarantee?The answer is not that a doctorate guarantees that no misconduct could ever have occurred. Nor is it that the discovery of a similarity automatically invalidates the qualification.

‘Rather, the PhD represents a university’s considered judgement that the research met its doctoral requirements at the time it was examined. Where credible evidence subsequently raises questions about that judgement, the proper response is investigation, evidence and due process.

‘The credibility of higher education depends upon universities being willing to do all three’.