Using public money to keep publicly funded data from the public

Update. Some have questioned whether QMUL had to pay VAT, or whether the VAT could be reclaimed by QMUL. I have done a further FOIA request to clarify and received a response on 14/09/16:

‘VAT at 20% was paid on these amounts.’

 

After publication of the PACE trial comparing different interventions (Cognitive Behavioural Therapy [CBT], Graded Exercise Therapy [GET], Adaptive Pacing Therapy and Specialist Medical Care) for ME/CFS, patients questioned the claims for the effectiveness of CBT and GE. These criticisms have been reported by David Tuller and James Coyne (a series on his blog here), and supported in her own look at the trial by Rebecca Goldin for the website jointly run by the American Statistical Association and Sense About Science America.

A number of Freedom of Information requests were made for the data in order to test the conclusions drawn by the Principal Investigators. Many of the patients’ requests were rejected, deemed vexatious, by the responsible research centre, Queen Mary University of London (QMUL).  In one instance, however, Alem Matthees successfully complained to the Information Commissioner (IC), and QMUL were ordered to release the data Matthees had requested.

QMUL appealed the IC’s decision and a hearing of the First-Tier Tribunal (Information Rights) was held in April this year.

Valerie Eliot Smith, a qualified barrister, has done a series of blogs on the hearing and I am grateful to her for information used here. On her website a number of downloads are available, including one which lists the attendees (bottom of page here).

Those at the Tribunal for QMUL include: a QC, Timothy Pitt-Payne; a solicitor, Edward Hadcock; two assistant solicitors, Alison Williams Mills and Gary Attle; four witnesses, Peter White (QMUL), Steve Thornton (QMUL), Trudie Chalder (KCL) and Ross Anderson (Cambridge); and two observers, Jane Pallant (Deputy Academic Registrar) and Paul Smallcombe (FOI Officer).

Hiring a QC for three days does not come cheap. I made an FOI request to QMUL to discover exactly how much the hearing had cost and have now received a reply.

It is claimed that the attendance of all those witnesses and any preparation involved for the Tribunal cost the University nothing. Presumably Anderson covered his own travel costs and the attendance at and preparation for the hearing by White and the others were considered part of normal work duties.

QMUL has said how much they paid in legal fees:

Mills & Reeve LLP: £149,482.30 ex VAT
Timothy Pitt-Payne QC: £48,320.00 ex VAT
Disbursements/expenses (Mills & Reeve LLP): £6,985.43 ex VAT

VAT is charged at 20% on legal fees. I make the total amount of public money QMUL has so far spent to keep data secret:

£245,745.27

 

Screenshot of email from QMUL:

https://postimg.org/image/qru6r5jx3/

Advertisements

Why the dispute about PACE trial data matters to everyone.

 

Queen Mary University of London are appealing an Information Commissioner decision that the data for the PACE trial  should be released.

The Principal Investigators for that trial are also trying to claim that the PLOS One data-sharing regulations should not apply.

Since just about everything to do with Myalgic Encephalomyelitis/Chronic Fatigue Syndrome (ME/CFS) is disputed, it’s no surprise that there has been controversy surrounding the PACE trial from the start. But now this argument threatens to become much wider and drag in a large part of academic research, any study, in fact, in any field, that involves human participants.

The publicly funded PACE trial, published in 2011 in The Lancet, compared different interventions (Cognitive Behavioural Therapy, Graded Exercise Therapy, Adaptive Pacing Therapy and Specialist Medical Care) for ME/CFS. Since its inception the study has been criticized by patients, and after its publication they made a series of Freedom of Information requests for the data. The responsible research centre, Queen Mary University of London, has received 35 requests for 160 pieces of information. Many have been rejected, deemed vexatious, on the grounds that patients were waging a campaign to discredit the trial.

This dispute, largely until that point between patients and the investigators, escalated at the end of last year after a series of blog posts by David Tuller and the intervention of Professor James Coyne. Coyne, who has a long history of exposing and debunking pseudoscience, made his own request for the data from the publishers of a PACE follow-up study on the cost effectiveness of the interventions. This study was not in the Lancet but carried by PLOS One, which has a stated policy of data sharing. Coyne applied under the PLOS One regulations in force at the time of publication.

At first, Coyne was also told his request was being rejected as vexatious. This was clearly absurd: Coyne is well respected with an excellent reputation, indeed could be argued as having a bigger career reach than any of the trial investigators. It was then suggested that trial data could not be properly anonymized. This reason was in turn dropped: a sibling trial, FINE, had shared data, and the FOI commissioner recently ruled on another PACE request by patients that the data could be anonymized. Peter White, the most senior of the trial principal investigators (PIs), conceded in a recent letter to the Wall Street Journal that the data can be anonymized.

White now claims, as stated in the letter, that they must safeguard the data to protect the patients’ interests; they have a duty of care such that any request for data must be in the context of a defined research proposal deemed acceptable by institutional committee. It is this claim that, were it to succeed, would have a stifling effect on academic research in many fields. If any such claim were recognized, it would not just apply to this trial but be a precedent applied across disciplines to any studies involving human participants.

It must not be allowed to succeed.

It is also false.

First, institutional committees, while no doubt full of people with good intentions, are liable to be over-respectful to their colleagues. They are more likely to support the PIs’ views of what is deemed proper. They would be a potential brake on challenging false reports. Trial investigators would effectively be granted a veto as to who could see their data.

Second, ‘defined research proposals’ need funding and often an infrastructure to support them. Such a requirement would create a closed shop in academic research: the ‘citizen scientist’, the curious student and the lone professor would all be excluded. Often advances come not from planned studies but from discoveries revealed by ‘playing around’ with data. That avenue would be shut off.

Third, this interest, which the PIs claim patients have in data from trials in which they have participated, does not exist. Participants do have certain rights, including a right to know of investigators’ conflicts of interest, something which was not revealed to patients in the PACE trial. They have the right to be treated humanely throughout the trial and to have their health and well-being protected. They have the right to know that their personal details will be secure and any shared data will be properly anonymized, such that no one, for example, could reverse engineer the data and reveal their identity. But once such rights have been safeguarded, then the data are just numbers. There is nothing further to be protected. Investigators cannot invent some duty of care which would give them the right to lock away data in perpetuity, sacred runes that only selected High Priests could see.

Furthermore, if a public interest does exist, then it is in having the data made available as widely as possible. Participants’ time and effort should be properly rewarded by making the greatest use of the data. They should be confident that any analysis of that data, including by the trial investigators, is open to the widest and deepest scrutiny; that, in fact, investigators are not allowed to protect themselves by putting up artificial barriers to inspection of the data. This is an interest shared by the wider society: open science benefits us all. Such an interest is even greater when the data have been obtained by public funding, as with the PACE trial.

Data do not need to be protected. Science, all academic study, is eventually self-correcting. We should have confidence in the robustness of the scientific process, an essential element of which is the greatest possible openness. Paternalistic protection of rows of numbers serves no one other than those with something to hide.

If the PIs are allowed to create this duty of care based on participants’ interest, then every trial investigator will be free to claim it. Drug companies and homeopaths will be able to hide behind this wall, but so will anyone who has conducted a trial using human subjects in medicine, science, psychology, economics, law, philosophy… Every field.

The PACE trial has had a massive impact. It has shaped public policy and perception of the illness in the UK. It has been referenced by health bodies around the world. The findings and the model it purports to evidence have been supported by Professor Sir Simon Wessely, the Lancet and its editor, Richard Horton, NICE, NHS Choices, the Science Media Centre, Sense About Science (UK) and most of the British media, including, for example, Tom Feilden of the BBC.

Patients who challenged the study and rejected the illness model were portrayed as science deniers who were unwilling or unable to accept the truth of their illness, desperate to avoid the stigma of mental illness, erroneously clinging to a false mind/body dualism. They were accused of waging personal vendettas against the PIs and Wessely in particular.

Then about 18 months ago things started to change: separate reports, here and here, to the US NIH and IOM rejected the psychogenic model and pretty much supported everything patients have been saying for decades. Prominent scientists, Lipkin and Hornig from Columbia, Montoya from Stanford and Komaroff from Harvard Universities have been investigating the illness and finding more and more evidence of physiological changes in patients. The NIH has recently announced a multi-million dollar project to study ME as a biological illness. After a small but successful trial of Rituximab, an editorial in New Scientist talked of the scientific story’s being brought full circle, back to the ‘post-viral’ approach of 25 years ago. Alongside Tuller’s blogs and Coyne’s interventions, 40 doctors and scientists wrote an open letter to the Lancet asking for the PACE trial data to be released for analysis. Amongst others, neuroscientist Keith Laws, statistician Andrew Gelman and biologist and campaigner against scientific fraud Leonid Schneider have all posed questions about PACE and its follow-up studies. Professor of mathematical sciences Rebecca Goldin took a detailed look at PACE for  the website jointly run by the American Statistical Association and Sense About Science America. Her conclusion was that ‘flaws in this design were enough to doom its results from the start’.

It is estimated that 250,000 patients suffer from ME in the UK. For their sake, the data need to be released and the questions over the trial answered. For everyone’s sake, the PACE PIs cannot be allowed to introduce a restriction on access to data that would act as a massive constraint on a great deal of academic research.