Volume 25, Number 10—October 2019
Research
Comparison of Serologic Assays for Middle East Respiratory Syndrome Coronavirus
On This Page
Downloads
Altmetric
Ruth Harvey, Giada Mattiuzzo
, Mark Hassall, Andrea Sieberg, Marcel A. Müller, Christian Drosten, Peter Rigsby, Christopher J. Oxenford, and study participants
, Mark Hassall, Andrea Sieberg, Marcel A. Müller, Christian Drosten, Peter Rigsby, Christopher J. Oxenford, and study participantsAbstract
Middle East respiratory syndrome coronavirus (MERS-CoV) was detected in humans in 2012. Since then, sporadic outbreaks with primary transmission through dromedary camels to humans and outbreaks in healthcare settings have shown that MERS-CoV continues to pose a threat to human health. Several serologic assays for MERS-CoV have been developed globally. We describe a collaborative study to investigate the comparability of serologic assays for MERS-CoV and assess any benefit associated with the introduction of a standard reference reagent for MERS-CoV serology. Our study findings indicate that, when possible, laboratories should use a testing algorithm including >2 tests to ensure correct diagnosis of MERS-CoV. We also demonstrate that the use of a reference reagent greatly improves the agreement between assays, enabling more consistent and therefore more meaningful comparisons between results.
Since the emergence of Middle East respiratory syndrome coronavirus (MERS-CoV) in 2012 (1), more than 2,250 laboratory-confirmed cases have been reported to the World Health Organization (WHO); approximately one third of these cases were fatal. A large proportion of MERS-CoV cases have been the result of human-to-human transmission in healthcare settings (2,3); outbreaks have occurred in several countries, with the largest outbreaks seen in Saudi Arabia, United Arab Emirates, and South Korea (4). Dromedary camels are the putative reservoir hosts for MERS-CoV; they experience no or mild symptoms upon infection (5). Primary infection can occur from dromedary camels to humans, and new cases with evidence of camel contact continue to occur sporadically (6). MERS-CoV is 1 of the 10 high-threat pathogens on the WHO Research and Development Blueprint (7), a document that sets out a roadmap for research and development of diagnostics, preventive and therapeutic products for prevention, and early detection and response to these high-priority pathogens. The WHO roadmap for MERS-CoV lists several priority activities, including improved diagnostics and vaccines for humans and camels as well as basic and translational research (8). Serologic assays are critical for the evaluation of the efficacy of new vaccines and patient treatment, as are diagnostic tools to confirm infections and perform serosurveillance. A variety of serologic assays have been developed globally, both commercially and in-house; however, there is no evidence supporting the quality of performance of these assays and their consistency with one another. Participants at the WHO intercountry meeting on MERS-CoV in Cairo, Egypt, June 20–22, 2013, recognized this issue as a public health priority and called for a study to compare currently available serologic assays (9). Therefore, we assembled a panel of human serum or plasma and polyclonal antibodies to compare the performance of serologic assays for MERS-CoV. We invited participants to use their testing algorithms to diagnose each sample as if it were a real patient sample. The assays were evaluated for sensitivity and specificity. Pas et al. described in 2015 the impact that a single international standard would have on reducing interlaboratory variability for MERS-CoV diagnostics (albeit in this case for NAT assays) (10). To this end, we included 2 samples in the panel as examples of potential WHO International Standard material, and we assessed their effectiveness in harmonization of the data from the participant laboratories.
Study Samples
The National Institute for Biological Standards and Control (NIBSC) Human Material Advisory Committee (project 16/005MP) approved this project. The Ministry of Health, Oman; Ministry of Health, Saudi Arabia; and Korea National Institute of Health, South Korea, donated convalescent serum and plasma samples from PCR-confirmed MERS-CoV–infected patients. All patient donors gave informed consent for the use of their serum or plasma, and samples were anonymized.
We treated all MERS-CoV convalescent-phase serum and plasma with solvent detergent using a validated method (11) to ensure there was no residual infectious virus. We stored all study samples at −20°C until dispatched on ice packs to participants. We blind coded the study samples provided to the participants (Table 1).
Figure 1. Pooling of serum samples based on their ELISA titers in study of serologic assays for Middle East respiratory syndrome coronavirus. Bar shading indicates the mean ELISA unit value of 2 independent...
We included 5 plasma samples (samples 1, 5, 9, 11, and 12) as individual patient samples. Other smaller serum donations were pooled in 3 samples (samples 14, 16, and 18) based on their antibody titer, which we determined using the Recombivirus human MERS-CoV nucleoprotein (NP) antibody (IgG) ELISA kit (Alpha Diagnostic International, ). We categorized samples into high-, medium-, or low-positive pools (Figure 1).
We included MERS-CoV–negative serum with antibodies against other human coronavirus HCoV-229E, HCoV-NL63, HCoV-OC43, and HCoV-HKU1 (samples 3, 6, 7, 8, 13, 15, and 17) to test specificity of the assays (Table 2). Co-authors A.S., M.A.M., and C.D. precharacterized and donated these samples. Purified human MERS polyclonal antibodies from transchromosomal (Tc) cattle (12) immunized with either recombinant spike protein or whole inactivated virus (samples 2, 4, and 10) were donated by Eddie J. Sullivan (SAB Biotherapeutics, Inc., Sioux Falls, SD, USA). We diluted the material in universal buffer (10 mmol/L Tris-HCl, pH 7.4, 0.5% human serum albumin, 2% trehalose) at a concentration of 1 mg/mL.
Participants
The 10 participating laboratories (listed at the end of this article) were located in Australia, China (2 mainland, 1 Hong Kong), Germany, South Korea, the Netherlands, United States, and the United Kingdom (2 laboratories). Participating organizations included national control laboratories, diagnostic laboratories, and research laboratories.
Study Protocol
Participants tested the sample panel using their routine assays for MERS-CoV serology. We asked participants to perform 3 independent assays on different days. We provided an Excel spreadsheet (Microsoft, ) for reporting the raw data for each assay and any interpretation of the results, such as positive or negative diagnosis of the samples.
Statistical Methods
We combined titers and relative potency (relative titer) estimates as unweighted geometric means (GMs) for each sample and laboratory and used these laboratory GMs to calculate overall unweighted GMs for each sample. We expressed variability between laboratories using geometric coefficients of variation (GCV = [10s − 1]×100%, where s is the SD of log10 transformed estimates). To mitigate the effect of any potential outliers, we calculated robust estimates of s using the R package WRS2 (13).
Coding of Returned Data
We referred to all participating laboratories by code numbers, which were randomly allocated. If a laboratory returned data using different assay methods, we assayed the results separately for each method and referred to them according to their laboratory number and assay code; for example, 04 ppNT (pseudoparticle neutralization test) and 04 TCID50 (50% tissue culture infectious dose).
A total of 27 datasets were returned (Table 3). Data covered a range of different assay formats: neutralization assays, ELISA, immunofluorescence tests, and 1 microarray. In general, there was good agreement between all the assays tested in this study. In assays with a quantitative measurement, the limit of detection and titer of samples varied greatly, but overall determination of positive or negative agreed between all assays except for 1 (laboratory 04 TCID50 MN [microneutralization]), which failed to detect 2 positive samples (samples 9 and 18) that all other tests detected as positive.
The panel of negative control samples was deemed to be negative in all quantitative assays. There were 3 instances of laboratories reporting a result above cutoff for samples in 1 assay, but these samples were correctly diagnosed as negative overall by their testing algorithms: laboratory 02 detected samples 3 and 7 as above cutoff at 1:80 dilution in 1 assay only; laboratory 02 detected sample 13 as above cutoff at 1:100 and 1:400 dilutions in 1 assay; and laboratory 03 detected sample 13 as above cutoff at 1 dilution tested.
Participants detected pool A, the high-titer MERS-CoV antibody pool (sample 16) in all assays (Table 3). They detected pool B, the medium-titer pool (sample 18), in all but 1 of the quantitative assays, a TCID50 MN assay from laboratory 04. In all other quantitative assays, participants detected the high pool at a higher titer than the medium pool. In the qualitative assays, 3 assays gave borderline positive or equivocal results for the medium pool; these assays were a Euroimmun S1 ELISA () in laboratories 01 and 10 and an in-house immunofluorescence assay in laboratory 07. The low-positive pool (pool C, sample 14) was only detected as positive in a single assay in the study, the Alpha Diagnostic International MERS NP ELISA performed in laboratory 05.
In all the qualitative assays, participants scored positive the 2 purified IgG samples from MERS-CoV–immunized transchromosomal bovine samples (samples 4 and 10); however, in 2 of the quantitative assays, N ELISA from laboratory 02 and the Alpha Diagnostic International MERS NP ELISA from laboratory 05, these 2 samples were scored negative. We expected these 2 NP assays to fail to detect sample 10 because this antibody was raised against recombinant MERS spike protein only; however, it was surprising that the assays did not detect sample 4, which was an antibody raised against whole inactivated virus.
Figure 2. Endpoint titers of individual positive patient plasma samples in study of serologic assays for MERS-CoV. The titers for the 5 individual MERS-CoV–positive patient plasma were determined by ELISA (green circles), neutralization...
For the individual convalescent-phase plasma samples, we saw more variability in the results when compared with the pooled material, but despite this, 3 of the samples (samples 5, 11, and 12) were correctly identified as positive in all tests. Sample 1 was correctly diagnosed as positive in all tests but was identified as borderline positive by laboratory 01 in a Euroimmun ELISA assay. Sample 9 was the most difficult individual patient plasma to detect as positive; it was negative in the TCID50 MN assay in laboratory 04; equivocal/positive in the in-house immunofluorescence assay in laboratory 07; and, in the Euroimmun ELISA, borderline/negative in lab 01, equivocal in lab 07, and weak positive in lab 10. Sample 9 was the weakest positive of the individual samples tested in the panel, as we saw from the titers in the quantitative assays that detected it as positive. We compiled the results of quantitative assays for the 5 individual positive plasma samples (Figure 2).
Figure 3. Relative titers of the individual positive patient plasma sample against a reference standard in study of serologic assays for MERS-CoV. Each panel represents a MERS-CoV–positive patient plasma sample: sample 1 (A),...
To simplify comparison of the assays, we reported results from the different laboratories as relative to either the transchromosomal bovine IgG sample raised against whole inactivated virus (sample 4) or the high-positive pooled human serum (pool A, sample 16). When we expressed data as a potency relative to either of the 2 chosen potential reference preparations with an assigned arbitrary value of 1,000, we observed improvement in the agreement between tests (Table 4; Figure 3). We saw the greatest reduction in the variation between laboratories (smaller SEM in Figure 3 and smaller percentage geometric coefficient of variation [GCV] in Table 4) when we used pooled human serum (sample 16) as standard. The transchromosomal bovine IgG raised against whole virus (sample 4) showed a substantial improvement in the agreement between laboratories; however, 2 ELISA methods included in this study could not identify this sample as positive.
As detection of sporadic cases of MERS-CoV continues, development of new vaccines to combat the disease remains important, as does serosurveillance to understand exposure to the disease and the severity of illness in persons exposed to the virus (14). The importance of serologic assays for the diagnosis of MERS cases should also be considered; the WHO guideline for laboratory testing for MERS-CoV, updated in January 2018, specifically includes sample collection from suspected MERS-CoV cases for serology (15). The guideline lists 3 situations in which laboratories should conduct serologic testing for MERS-CoV: for defining a sporadic MERS-CoV case if molecular testing, such as nucleic acid amplification methods, is not possible; as part of an investigation of an ongoing outbreak; or serologic surveys, such as retrospective analysis of the extent of an outbreak.
In this collaborative study, we evaluated the performance of assays to detect MERS-CoV antibodies using a panel of serologic samples. All laboratories correctly identified the negative samples in the panel, including those containing antibodies against other coronaviruses, implying good specificity of the assays. Laboratories reported the positive results correctly except for sample 14, which tested negative by all but 1 assay; however, these results demonstrated the importance of a testing algorithm. We observed 14 instances of a sample being incorrectly determined as negative or borderline/equivocal in a single test in a single laboratory (Table 3). However, because each laboratory used a testing algorithm involving >1 method of analysis, all the samples with sporadic spurious results were correctly diagnosed as positive or negative; if they had used a single assay type, we would have found a higher proportion of incorrect results. The results for sample 14, which was a pool of serum samples from patients with confirmed MERS-CoV, highlight a lack of sensitivity in most of the assays in this study; further investigation would be needed to determine why the antibody titers in this pool were below the limit of detection in all but 1 assay targeting N protein. It is important to understand whether there is a specific window of time in which clinical samples for serology should be taken or whether some patients do not mount a detectable antibody response against the spike protein during infection. Such information may lead to further updates of WHO guidelines on laboratory testing for MERS-CoV.
The raw titers reported from the laboratories performing quantitative assays varied greatly, for some samples >1,000-fold, between laboratories (Table 3). The use of a reference material in the assays tightened the values from the laboratories for all the samples, enhanced comparability (Figure 3), and reduced the GCV percentage between all laboratories (Table 4), perhaps unsurprisingly, but the magnitude of reduction in GCV percentage was noteworthy. MERS-CoV is an example of an important emerging pathogen with potential to cause outbreaks; diagnostic tests for emerging pathogens are often developed during outbreaks without proper validation or calibration.
This study showed the importance of using a standard reagent to allow better comparison of results from different laboratories or interpretation of results from different studies or clinical trials. As we continue to face emerging pathogens, which pose significant risks to human health, it is important to use the experience gained from studies such as this to improve our response to the next threat. Standardizing assays is a key issue when different groups around the world are working to develop and produce novel assays and vaccine products. The need for a standard for MERS-CoV serology was discussed and was widely supported at the WHO–International Vaccine Institute joint symposium for MERS-CoV vaccine development in Seoul, South Korea, June 26–27, 2018. Several potential vaccines are in development, and the immune response elicited, their efficacy, and correlates of protection must be assessed. The use of a reference such as WHO International Standards (16) will enable worldwide harmonization of assays and comparability of the results from different preclinical and clinical studies. Assessing the specificity and sensitivity of methods is crucial to improve our understanding of the use and limitations of serologic assays for emerging diseases for which we have little knowledge of disease progression, antibody profiles, and other key information that is available for other infectious diseases.
Study participants who contributed data: L. Caly (Victorian Infectious Diseases Reference Laboratory, Melbourne, Australia); C. Li (National Institutes for Food and Drug Control, Beijing, China); L. Zhao and W. Tan (National Institute for Viral Disease Control and Prevention, Chinese Center for Disease Control and Prevention, Beijing, China); M. Peiris and M. Perera (School of Public Health, The University of Hong Kong, Hong Kong, China); M. Müller and C. Drosten (Institute of Virology, Charité–Universitätsmedizin Berlin, Berlin, Germany); C. Kang and J.-S. Wang (Korea Centers for Disease Control and Prevention, Center for Laboratory Control of Infectious Diseases, Chungcheonhbuk-do, South Korea); B. Haagmans and N.M.A. Okba (Department of Viroscience, Erasmus Medical Center, Rotterdam, the Netherlands); R. Gopal (High-Containment Microbiology, National Infection Service, Public Health England – Colindale, London, UK); S. Myhill and G. Mattiuzzo (National Institute for Biologic Standards and Control, South Mimms, UK); N. Thornburg (Centers for Disease Control and Prevention, Atlanta, Georgia, USA).
Dr. Harvey is a principal scientist at the National Institute for Biological Standards and Control, United Kingdom. Her research interests include influenza virus vaccines and respiratory viruses including MERS coronavirus.
Acknowledgments
We thank the following institutions and organizations: Universitätsklinikum, Bonn, Germany; Charité-Universitätsmedizin, Berlin, Germany; Korea National Institute of Health; the Central Public Health Laboratory, Ministry of Health, Sultanate of Oman; Public Health Department, Supreme Council of Health, Qatar; the Ministry of Health, Public Health Directorate, Kingdom of Saudi Arabia; SAb Biotherapeutics, South Dakota, USA. We also thank Humayun Asghar from the WHO Eastern Mediterranean Regional Office for assistance obtaining the serum for the study.
C.D. was supported by the Federal Ministry of Education and Research (BMBF) grant RAPID (no. 01KI1723A) and the EU-Horizon 2020 grants COMPARE (no. 643476) and EVAg (no. 653316).
References
- Zaki AM, van Boheemen S, Bestebroer TM, Osterhaus AD, Fouchier RA. Isolation of a novel coronavirus from a man with pneumonia in Saudi Arabia. N Engl J Med. 2012;367:1814–20.
- World Health Organization. WHO MERS-CoV global summary and assessment of risk. 2017 Jul 21 [cited 2019 Feb 12]. .
- Alanazi KH, Killerby ME, Biggs HM, Abedi GR, Jokhdar H, Alsharef AA, et al. Scope and extent of healthcare-associated Middle East respiratory syndrome coronavirus transmission during two contemporaneous outbreaks in Riyadh, Saudi Arabia, 2017. Infect Control Hosp Epidemiol. 2019;40:79–88.
- World Health Organization. Middle East respiratory syndrome coronavirus (MERS-CoV). 2019 Mar 11 [cited 2019 Jul 31].
- Khalafalla AI, Lu X, Al-Mubarak AI, Dalab AH, Al-Busadah KA, Erdman DD. MERS-CoV in upper respiratory tract and lungs of dromedary camels, Saudi Arabia, 2013–2014. Emerg Infect Dis. 2015;21:1153–8.
- Conzade R, Grant R, Malik MR, Elkholy A, Elhakim M, Samhouri D, et al. Reported direct and indirect contact with dromedary camels among laboratory-confirmed MERS-CoV cases. Viruses. 2018;10:425.
- World Health Organization. Meeting report: 2018 annual review of diseases prioritized under the Research and Development Blueprint; February 6–7, 2018; Geneva, Switzerland. Geneva: The Organization; 2018 [cited 2019 Aug 13].
- Modjarrad K, Moorthy VS, Ben Embarek P, Van Kerkhove M, Kim J, Kieny MP. A roadmap for MERS-CoV research and product development: report from a World Health Organization consultation. Nat Med. 2016;22:701–5.
- World Health Organization. Report on the intercountry meeting on the Middle East respiratory syndrome coronavirus (MERSCoV) outbreak in the Eastern Mediterranean Region; June 20–22, 2013; Cairo, Egypt. Contract no.: WHO-EM/CSR/063/E/08.13. Geneva: The Organization; 2013 [cited 2019 Aug 13].
- Pas SD, Patel P, Reusken C, Domingo C, Corman VM, Drosten C, et al. First international external quality assessment of molecular diagnostics for Mers-CoV. J Clin Virol. 2015;69:81–5.
- Dichtelmüller HO, Biesert L, Fabbrizzi F, Gajardo R, Gröner A, von Hoegen I, et al. Robustness of solvent/detergent treatment of plasma derivatives: a data collection from Plasma Protein Therapeutics Association member companies. Transfusion. 2009;49:1931–43.
- Matsushita H, Sano A, Wu H, Jiao JA, Kasinathan P, Sullivan EJ, et al. Triple immunoglobulin gene knockout transchromosomic cattle: bovine lambda cluster deletion and its effect on fully human polyclonal antibody production. PLoS One. 2014;9:
e90383 . - Mair P, Schoenbrodt F, Wilcox R. WRS2: Wilcox robust estimation and testing. 2017 [cited 2019 Aug 13].
- Aguanno R, ElIdrissi A, Elkholy AA, Ben Embarek P, Gardner E, Grant R, et al.; FAO-OIE-WHO MERS Technical Working Group. MERS: Progress on the global response, remaining challenges and the way forward. Antiviral Res. 2018;159:35–44.
- World Health Organization. Laboratory testing for Middle East respiratory syndrome coronavirus interim guidance. Contract no.: WHO/MERS/LAB/15.1/Rev1/2018. Geneva: The Organization; 2018 [cited 2019 Aug 13].
- World Health Organization. Recommendations for the preparation, characterization, and establishment of international and other biological reference standards (revised 2004). In: WHO Expert Committee on Biological Standardization: fifty-fifth report. WHO technical report series, no. 932. Geneva: The Organization; 2004.
Figures
Tables
Cite This ArticleOriginal Publication Date: 8/19/2019
1Study participants who contributed data are listed at the end of this article.
No hay comentarios:
Publicar un comentario