‘Should not be used’: 1 in 5 COVID-19 antibody tests not accurate

Disinfectant professionals work to protect against the COVID-19 outbreak in Seoul, South Korea.(Getty Images)

share

EXCLUSIVE: Two COVID-19 antibody kits have failed post-market testing, raising more questions about the 20 point-of-care kits approved for sale in Australia.

Four of the 20 point-of-care tests (PoCT) available in Australia, or one in five, have now failed independent post-market testing in Australia and the UK.

In Australia, the Peter Doherty Institute for Infection and Immunity identified PoCT tests made by US company CTK Biotech and Chinese company VivaCheck Biotech as not being as sensitive as claimed by the manufacturers.

The kits should not be used to diagnose COVID-19 and have “limited, if any” use for medical professionals, the Doherty Institute said in a report released late yesterday.

PoCT tests check for antibodies, the proteins the body makes once it’s had a disease, as opposed to lab-based antigen tests that can tell whether a person has a disease now.

Accurate PoCT tests have been mooted as a way to gain population-level data or as a way to find out who has immunity and therefore can return to work, but authorities are cautious about the latter because scientists just don’t know yet how immune recoverers are to COVID19 or for how long.

1 in 5 PoCT tests available in Australia don’t measure up

PoCT kits made by Chinese companies Wondfo Biotech and Alltest Biotech, both of which have been approved for sale in Australia, have also failed independent tests.

Cellmid (ASX:CDY) is importing the Wondfo Biotech test.

A New York Times investigation revealed that $31m worth of kits bought by the UK government from Wondfo Biotech were found to be “insufficiently accurate” after independent testing.

Cellmid says its own validation of the 12,000 tests it has imported so far confirmed the Chinese manufacturer claims, but its shares have been suspended again “in relation to a media article”.

Stockhead is seeking comment from Cellmid, which has already come under fire after CEO Maria Halazs revealed the company would be importing a COVID-19 test on social media a day before the news was released to the ASX.

Other ASX companies selling COVID-19 tests are Genetic Signatures (ASX:GSS), which made its own, and TBG Diagnostics (ASX:TDL) which is importing one made in China to Europe.

Both kits are lab-based antigen tests.

Should not be used

The Doherty Institute report said its findings “strongly suggest” the PoCT devices it tested shouldn’t be used to diagnose COVID-19 and “have limited, if any, role” for medical professionals.

“Our findings suggest that the performance characteristics of both PoCT are below that reported by the manufacturer in the instructions for use,” the report said.

“Although the sensitivities of the two PoCT devices improved with increasing duration between sample collection and symptom onset, they did not match the manufacturer’s stated performance criteria at any time point.”

The Therapeutic Goods Administration (TGA) fast-tracked approvals of COVID-19 testing kits to ensure Australia had enough.

The condition was the sponsors had to report safety and efficacy data within 12 months and the Doherty Institute, which was first to map the COVID-19 genome, would test and validate COVID-19 test kits already in the market. The CTK and VivaCheck kist were the first to be checked.

What the Doherty Institute found

The TGA says PoCT blood tests shouldn’t be used until at least two weeks after symptoms have started and that the sensitivity of these tests in the early stages of infection is poor so shouldn’t be used for diagnosis, a position the Public Health Laboratory Network and the Royal College of Pathologists of Australasia have held from the start of the crisis.

The US-made test from CTK Biotech claimed to have 96.86 per cent sensitivity, or how often it correctly generates a positive result, and 99.39 per cent specificity, or how often it correctly comes up with a negative result.

The Doherty Institute found sensitivity to in fact be 56.9 per cent and total antibody specificity was 95.6 per cent.

The China-made test from VivaCheck claimed sensitivity of 81.25 per cent between days four to 10 and 97.1 per cent between days 11 to 24, and specificity of 100 per cent.

What the Australian testing found was overall sensitivity of 51.8 per cent and specificity of 97.8 per cent.

The Doherty Institute said direct comparison with the manufacturers’ claims was difficult as the performance information provided in the instructions for use was limited.

The TGA wants more information from the sponsors of these tests on the clinical studies undertaken by the manufacturer to support their performance claims.

The sponsors are Endo X which is includes Franston and Rosebud hospital head of gastroenterology David Badov on its board, medical device distributors Device Technologies Australia and MD Solutions Australasia, and truck and trailer distributor Stonestar Wholesale.