jueves, 22 de marzo de 2018

Ahead of Print -External Quality Assessment for Zika Virus Molecular Diagnostic Testing, Brazil - Volume 24, Number 5—May 2018 - Emerging Infectious Disease journal - CDC

Ahead of Print -External Quality Assessment for Zika Virus Molecular Diagnostic Testing, Brazil - Volume 24, Number 5—May 2018 - Emerging Infectious Disease journal - CDC

Volume 24, Number 5—May 2018


External Quality Assessment for Zika Virus Molecular Diagnostic Testing, Brazil

Carlo Fischer, Celia Pedroso, Alfredo Mendrone, Ana Maria Bispo de Filippis, Antonio Carlos Rosário Vallinoto, Bergmann Morais Ribeiro, Edison Luiz Durigon, Ernesto T.A. Marques, Gubio S. Campos, Isabelle F.T. Viana, José Eduardo Levi, Luciano Cesar Scarpelli, Mauricio Lacerda Nogueira, Michele de Souza Bastos, Nathalia C. Santiago Souza, Ricardo Khouri, Sanny Lira, Shirley Vasconcelos Komninakis, Cécile Baronti, Rémi N. Charrel, Beate M. Kümmerer, Christian Drosten, Carlos Brites, Xavier de Lamballerie, Matthias Niedrig, Eduardo Martins Netto, and Jan Felix DrexlerComments to Author 
Author affiliations: German Centre of Infection Research, associated partner Charité–Universitätsmedizin, Berlin, Germany (C. Fischer, C. Drosten, J.F. Drexler)Universidade Federal de Bahia, Salvador, Brazil (C. Pedroso, C. Brites, E.M. Netto)Fundação Pro-Sangue/Hemocentro de São Paulo, São Paulo, Brazil (A. Mendrone Jr., J.E. Levi)Instituto Oswaldo Cruz, Rio de Janeiro, Brazil (A.M.B de Filippis)Federal University of Para, Belém, Brazil (A.C. Rosário Vallinoto)University of Brasília, Brasília, Brazil (B. Morais Ribeiro)University of São Paulo, São Paulo (E.L. Durigon, J.E. Levi, N.C.S. Souza)Oswaldo Cruz Foundation, Pernambuco, Brazil (E.T.A. Marques Jr., I.F. Viana)Universidade Federal da Bahia, Salvador (G.S. Campos)Diagnósticos da América, São Paulo (J.E. Levi, L.C. Scarpelli)Hospital Israelita Albert Einstein, São Paulo (J.E. Levi, S. Lira)Faculdade de Medicina de São José do Rio Preto, São José do Rio Preto, Brazil (M.L. Nogueira)Fundação de Medicina Tropical Dr. Heitor Vieira Dourado, Manaus, Brazil (M.de Souza Bastos)Fundação Oswaldo Cruz, Salvador, Brazil (R. Khouri)Federal University of São Paulo, São Paulo (S.V. Komninakis)Aix Marseille Université, Marseille, France (C. Baronti, R.N. Charrel, X. de Lamballerie)Assistance Publique-Hopitaux Marseille, Marseille (C. Baronti, R.N. Charrel, X. de Lamballerie)University of Bonn Medical Centre, Bonn, Germany (B.M. Kümmerer)Robert Koch Institute, Berlin, Germany (M. Niedrig)


We conducted an external quality assessment of Zika virus molecular diagnostic tests in Brazil using a new Zika virus standard. Of 15 laboratories, 73% showed limited sensitivity and specificity. Viral load estimates varied significantly. Continuous quality assurance is needed to adequately estimate risk for Zika virus–associated disease and determine patient care.
The catastrophic Zika virus outbreak in the Americas has affected millions of persons. Brazil was the most affected country and reported ≈95% of all cases of suspected Zika virus–associated congenital disease (1). Limited sensitivity and specificity of tests hampers serologic detection of Zika virus–specific antibodies in tropical regions (2). Thus, real-time reverse transcription PCR (RT-PCR) has been key for diagnosing acute Zika virus infection and epidemiologic studies (35). However, Zika virus molecular diagnostic testing is challenged by short-term viremia and low viral loads (3).
A recent external quality assessment (EQA) in Europe revealed that 60% of laboratories need to improve molecular Zika virus detection (6). Laboratories in affluent countries conduct Zika virus diagnostic testing predominantly in travelers returning from tropical regions. In resource-limited settings to which multiple co-circulating arboviruses are endemic, the diagnostic demands differ entirely. To evaluate the diagnostic landscape in the region most affected by Zika virus, we performed an EQA of molecular Zika virus diagnostic testing in Brazil during 2017.

The Study

Fifteen laboratories from 7 Brazilian states participated in this study; these laboratories are spread across ≈2,500 km longitude, including the areas most affected during Brazil’s Zika virus outbreak (1). Participants were university laboratories, hospital laboratories, federal research institutes supporting public health services, and a diagnostic testing company. We provided EQA panels to all laboratories. Each panel comprised 12 lyophilized samples containing inactivated full virus spiked into human plasma tested negative for arboviruses beforehand. The panel consisted of 4 Zika virus–positive specimens of 103–106 RNA copies/mL to assess sensitivity and determine viral load. Zika virus–negative specimens to assess specificity comprised dengue virus serotypes 2 and 4, Japanese encephalitis virus, St. Louis encephalitis virus, West Nile virus, yellow fever virus, and chikungunya virus at ≈105 50% tissue culture infective dose/mL each and a negative plasma specimen (Table 1). Moreover, each panel included the international World Health Organization (WHO) Zika virus standard for quantification (7). However, the WHO standard has limited availability. International shipment of this standard is subject to strong biosafety restrictions because it derives from live Zika virus. Therefore, we designed and acquired a Zika virus armored RNA (Asuragen, Austin, TX, USA). The Zika virus armored RNA is a synthetic RNA covering the target sites of 9 Zika virus–specific real-time RT-PCRs as described previously (3), encapsulated into bacteriophage proteins. This highly stable, noninfectious, pseudoviral particle can be used as a universal control for the covered assays, shipped without biosafety concerns, and used as a control for both nucleic acid preparation and RT-PCR.
We asked all laboratories to conduct molecular Zika virus diagnostics as routinely done with clinical samples and to quantify Zika virus–positive specimens using both standards. All but 1 laboratory used the same real-time RT-PCR protocol developed by Lanciotti et al. (2), highlighting the wide dissemination of this assay in Brazil and suggesting comparability of test results within this study (Table 1). We found no significant difference between samples containing comparable quantities of the Asian and the African Zika virus lineage, suggesting suitability of the protocols for both lineages (p = 0.313 by Fisher exact test).
Thumbnail of External quality assessment (EQA) performance and lower limits of detection (LODs) for Zika virus molecular diagnostic testing, Brazil. A) EQA performance of individual laboratories. Gray bars above the baseline indicate correctly tested samples; bars below the baseline indicate incorrectly tested samples. Laboratories are sorted by the quantity of correct samples and the numeric order of the laboratory identification numbers. Laboratory 8 tested only 9 of 12 samples. B) Projected 9
Figure 1. External quality assessment (EQA) performance and lower limits of detection (LODs) for Zika virus molecular diagnostic testing, Brazil. A) EQA performance of individual laboratories. Gray bars above the baseline indicate correctly...
EQA results varied among laboratories. Of 15 laboratories, 4 (27%) reported correct results for all samples. Five (33%) reported 1 or 2 false-negative results from samples with low Zika virus concentrations (Table 1Figure 1, panel A). EQA participants correctly tested only the 2 samples containing the highest Zika virus concentrations of 8.1 × 105 and 7.0 × 103 copies/mL (exact test of goodness-of-fit p = 1.00 and p = 0.14, respectively). This finding suggests a potential lack of sensitivity that may be problematic given that viral loads of 103–104 copies/mL are commonly observed in Zika virus–infected patients (3).
Six (40%) laboratories reported >3 false results, including at least 2 false-positive detections of Zika virus–negative specimens. No heterologous flavivirus was particularly affected by false-positive detection, suggesting that false-positive results did not result from unspecific binding of assay oligonucleotides (Table 1). Instead, false-positive results hint at the possibility of laboratory contamination potentially resulting from virus isolation attempts or PCR amplicons generated during prior Zika virus experimentation.
EQA performance varied according to the way viral RNA was prepared. The 8 laboratories conducting Zika virus detection using automated platforms performed generally superior (n = 8; Youden index, 0.661) compared with the 7 laboratories conducting manual RNA extraction (Youden index, 0.446) (Table 2). This finding might indicate an increased risk for contamination during manual RNA preparation. However, automated RNA preparation also might represent a proxy for more affluent settings of those laboratories.
As previously reported (3), RNA extraction critically influences the clinical lower limit of detection (LOD). Although all participants used highly sensitive real-time RT-PCRs, clinical LODs varied considerably because of different RNA extraction protocols (Figure 1, panel B). Lack of detection of low-concentration EQA samples is thus not surprising because even a small decrease in sensitivity readily causes clinical LODs above the concentration of the lowest EQA panel specimen (Figure 1, panel C). This finding highlights that optimized RNA extraction protocols are crucial for sensitive Zika virus diagnostics.
Thumbnail of Quantification of Zika virus–positive samples using WHO Zika virus and armored RNA testing standards, Brazil. Zika virus–positive samples contained either inactivated strain MRS_OPY_Martinique_PaRi 2015 (Asian lineage) or strain MR766 (African lineage). Horizontal lines indicate median of the calculated Zika virus; whiskers indicate interquartile ranges. Statistical analysis was performed using GraphPad Prism 5.03 (GraphPad Software, Inc., La Jolla, USA). WHO, World Health Organizat
Figure 2. Quantification of Zika virus–positive samples using WHO Zika virus and armored RNA testing standards, Brazil. Zika virus–positive samples contained either inactivated strain MRS_OPY_Martinique_PaRi 2015 (Asian lineage) or strain MR766 (African lineage)....
Quantification of Zika virus loads did not differ significantly between use of the armored RNA and the WHO Zika virus standard, with only 0.76 log10median deviation between results (p = 0.429 by Wilcoxon signed rank test). This observation suggests usability of the armored RNA for Zika virus quantification in tropical regions. Irrespective of the standard, viral load determinations among laboratories were comparable with 0.12–0.88 log10median deviations of viral load estimates among laboratories for individual Zika virus specimens. However, we also observed drastic deviations of up to 6 orders of magnitude (Figure 2), suggesting that caution must be taken upon comparing viral load determinations as markers for severe Zika virus disease (8,9) among different laboratories.


Some laboratories in Brazil showed suboptimal sensitivity and specificity of Zika virus diagnostic testing. However, these laboratories performed comparably to those in Europe (6). Neither sensitivity nor specificity differed significantly between laboratories in Brazil compared with those in Europe (p = 0.767 and p = 0.324, respectively, by Fisher exact test). Similarly, the proportion of perfectly performing laboratories in this EQA (27%) was comparable with previous EQAs of flavivirus molecular diagnostics, including yellow fever virus (18%), dengue virus (24%), and West Nile virus (27%) (1012). Flavivirus molecular diagnostics are thus generally challenging and benefit greatly from controls, such as those provided in this EQA. This study underscores the need to combine RT-PCR and serologic testing in Zika virus diagnostic testing, despite their inherent limitations (3).
Independently of the challenges of Zika virus molecular detection, because of taxation and distributor margins, RT-PCR reagents in Latin America are usually 100%–200% more expensive than in affluent countries (13). Limited resources and relatively higher costs potentially force laboratories in Brazil to seek inferior, more affordable solutions. Enhanced access of laboratories in tropical regions to state-of-the-art reagents is thus an unresolved key component of outbreak response. Further EQAs in Brazil should involve state laboratories that carry a large proportion of Zika virus testing within the public health care system. Unfortunately, the state laboratories we contacted for this EQA could not participate because of limited resources.
Finally, lack of sensitivity directly affects estimates of the absolute risk for Zika virus–induced congenital disease upon maternal infection during pregnancy (14). False-positive results potentially have dramatic consequences for patients, as illustrated by a >90% increase in illegal abortion requests in Latin America during the 2016 Zika virus epidemic (15). Our results emphasize the need for continuous quality assessments of Zika virus diagnostic testing globally.
Mr. Fischer is a PhD student at the Institute of Virology at Charité-Universitätsmedizin Berlin, Germany, and the German Centre for Infection Research, Germany. His main research interests are diagnostics of emerging arboviruses.


We thank Michaele Josten, Monika Eschbach-Bludau, and Stefan Holtin for technical support.
The Zika virus armored RNA standard is available for noncommercial use for quality assurance at the EVAg portal (https://www.european-virus-archive.com/)
This work was supported by the German Centre for Infection Research through a fast-track program for Zika virus outbreak response to J.F.D. and partially supported by the European Union’s Horizon 2020 research and innovation program (ZIKAlliance, grant agreement no. 734548 to X.d.L. and EVAg, grant agreement no. 653316 to C.D.).


  1. de Oliveira WKde França GVACarmo EHDuncan BBde Souza Kuchenbecker RSchmidt MIInfection-related microcephaly after the 2015 and 2016 Zika virus outbreaks in Brazil: a surveillance-based analysis. Lancet2017;390:86170DOIPubMed
  2. Lanciotti RSKosoy OLLaven JJVelez JOLambert AJJohnson AJet al. Genetic and serologic properties of Zika virus associated with an epidemic, Yap State, Micronesia, 2007. Emerg Infect Dis2008;14:12329DOIPubMed
  3. Corman VMRasche ABaronti CAldabbagh SCadar DReusken CBet al. Assay optimization for molecular detection of Zika virus. Bull World Health Organ2016;94:88092DOIPubMed
  4. Brasil PPereira JP JrMoreira MERibeiro Nogueira RMDamasceno LWakimoto Met al. Zika virus infection in pregnant women in Rio de Janeiro. N Engl J Med2016;375:232134DOIPubMed
  5. de Araújo TVBRodrigues LCde Alencar Ximenes RAde Barros Miranda-Filho DMontarroyos URde Melo APLet al.investigators from the Microcephaly Epidemic Research GroupBrazilian Ministry of HealthPan American Health OrganizationInstituto de Medicina Integral Professor Fernando FigueiraState Health Department of PernambucoAssociation between Zika virus infection and microcephaly in Brazil, January to May, 2016: preliminary report of a case-control study. Lancet Infect Dis2016;16:135663DOIPubMed
  6. Charrel RMögling RPas SPapa ABaronti CKoopmans Met al. Variable sensitivity in molecular detection of Zika virus in European expert laboratories: external quality assessment, November 2016. J Clin Microbiol2017;55:321926DOIPubMed
  7. Baylis SAHanschmann KOSchnierle BSTrösemeier JHBlümel JZika Virus Collaborative Study GroupHarmonization of nucleic acid testing for Zika virus: development of the 1stWorld Health Organization International Standard. Transfusion2017;57(3pt2):74861DOIPubMed
  8. Halai UANielsen-Saines KMoreira MLde Sequeira PCJunior JPPde Araujo Zin Aet al. Maternal Zika virus disease severity, virus load, prior dengue antibodies, and their relationship to birth outcomes. Clin Infect Dis2017;65:87783DOIPubMed
  9. Terzian ACBSchanoski ASMota MTOda Silva RAEstofolete CFColombo TEet al. Viral load and cytokine response profile does not support antibody-dependent enhancement in dengue-primed Zika virus–infected patients. Clin Infect Dis2017;65:12605DOIPubMed
  10. Domingo CEscadafal CRumer LMéndez JAGarcía PSall AAet al. First international external quality assessment study on molecular and serological methods for yellow fever diagnosis.PLoS One2012;7:e36291DOIPubMed
  11. Domingo CNiedrig MTeichmann AKaiser MRumer LJarman RGet al. 2nd International external quality control assessment for the molecular diagnosis of dengue infections. PLoS Negl Trop Dis2010;4:e833DOIPubMed
  12. Niedrig MLinke SZeller HDrosten CFirst international proficiency study on West Nile virus molecular detection. Clin Chem2006;52:18514DOIPubMed
  13. Drexler JFKupfer BPetersen NGrotto RMRodrigues SMGrywna Ket al. A novel diagnostic target in the hepatitis C virus genome. PLoS Med2009;6:e31DOIPubMed
  14. Moreira-Soto ASarno MPedroso CNetto EMRockstroh ALuz Eet al. Evidence for congenital Zika virus infection from neutralizing antibody titers in maternal sera, north-eastern Brazil. J Infect Dis2017;216:15014DOIPubMed
  15. Aiken ARScott JGGomperts RTrussell JWorrell MAiken CERequests for abortion in Latin America related to concern about Zika virus exposure. N Engl J Med2016;375:3968DOIPubMed



Suggested citation for this article: Fischer C, Pedroso C, Mendrone A, Jr, Bispo de Filippis AM, Rosário Vallinoto AC, Morais Ribeiro B, et al. External quality assessment for Zika virus molecular diagnostic testing, Brazil. Emerg Infect Dis. 2018 May [date cited]. https://doi.org/10.3201/eid2405.171747

DOI: 10.3201/eid2405.171747

No hay comentarios:

Publicar un comentario