Volume 22, Number 10—October 2016
Population-Level Effects of Human Papillomavirus Vaccination Programs on Infections with Nonvaccine Genotypes
Persistent infection with a high-risk human papillomavirus (HPV) genotype is necessary for development of cervical cancer (1). Two high-risk types, HPV16 and HPV18, cause ≈70%–80% of cervical cancers (2–4). The HPV vaccines currently available commercially have been shown in trial settings to have ≈100% vaccine efficacy against cervical disease caused by vaccine-specific high-risk HPV types: bivalent and quadrivalent vaccines against HPV16 and HPV18 and the new nonavalent vaccine against HPV31, HPV33, HPV45, HPV52, and HPV58 (5–7). Clinical trial data for the bivalent and quadrivalent vaccines have shown low-to-moderate protection (i.e., cross-protection) against other high-risk HPV types that are phylogenetically related to HPV16 and HPV18 (8,9).
Many countries have now introduced HPV vaccination programs (10). A recently published systematic review and meta-analysis assessed population-level effects of HPV vaccination on vaccine HPV types and showed strong evidence that HPV vaccination is highly effective against infections with these vaccine-specific high-risk types (11). The review also examined closely related HPV types as a single group and found evidence of cross-protection overall in a population-based setting (11). However, assessment of changes in the prevalence of closely related HPV types combined may not provide full evidence of the effects of a national vaccination program because examining the types as a single group potentially conceals decreases or increases in the prevalence of individual types. Grouping HPV types together limits the possibility of examining cross-protection provided by specific HPV types and of detecting changes in other individual nonvaccine types. For example, a theoretical concern is that reduced prevalences of infection with HPV16 and HPV18 could lead to other high-risk HPV types occupying those niches and becoming more common causes of disease. Although type replacement was not observed in the clinical trials (12), monitoring for possible type replacement in population-based settings after the introduction of national HPV vaccination programs is important. Furthermore, because nonvaccine HPV types are far less common than vaccine HPV types, a single study may have limited scope to determine whether type replacement has occurred. Combining data from several reports improves the ability to investigate type replacement. We aimed to investigate population-level effects of HPV vaccination programs that used bivalent or quadrivalent vaccines on type-specific prevalences of infection caused by individual nonvaccine high-risk HPV types.
Using data from surveys conducted before an HPV vaccination program was introduced and data from surveys after the program was introduced, we compared HPV prevalences for similar populations within the same country. We conducted a systematic literature search to determine changes in HPV prevalence for each nonvaccine high-risk HPV type. At the time of our search, any eligible study would have considered vaccination that used bivalent or quadrivalent vaccines; consequently, high-risk HPV types used only in the nonavalent vaccine were considered nonvaccine HPV types. Each individual type was presented separately in our analysis. We included HPV types for which some cross-protection had been demonstrated in clinical trials (HPV31 and HPV33, which are phylogenetically related to HPV16; and HPV45, which is phylogenetically related to HPV18) (8,9,13); other high-risk HPV types included in the nonavalent vaccine (HPV52 and HPV58); other high-risk and probably high-risk HPV types (HPV35, HPV39, HPV51, HPV56, HPV59, and HPV68); and other possibly high-risk HPV types (HPV26, HPV53, HPV70, HPV73, and HPV82), as classified by the International Agency for Research on Cancer (14). This systematic review and meta-analysis was reported in accordance with PRISMA guidelines (15).
Search Strategy and Selection Criteria
Using Embase, Medline, LILACS, and African Index Medicus databases, we searched for eligible publications published from 2007, the year that the first HPV vaccination programs were introduced, through February 19, 2016. To identify relevant studies that mentioned both vaccination and HPV infection or a related disease (such as HPV-related precancerous lesions, cancers, and genital warts), the search strategy incorporated MeSH terms from the PubMed database (http://www.ncbi.nlm.nih.gov/mesh) and relevant words found in the title or abstract (Technical Appendix[PDF - 1.51 MB - 22 pages]). The search had no language restrictions.
Eligible studies were those that assessed population-level effects of HPV vaccination over time by comparing the prevalence of HPV infection (defined by the detection of HPV DNA in patient samples) during a prevaccination period with the prevalence during a postvaccination period. We excluded studies comparing HPV infection in vaccinated persons with HPV infection in unvaccinated persons as part of an individually randomized trial because such studies would not measure population-level effects. Similarly, we excluded studies in which HPV infection was compared only between unvaccinated and vaccinated persons in the postvaccination period. We also excluded studies in which only a small proportion (<2%) of the postvaccination study population was vaccinated (i.e., studies conducted in largely unvaccinated populations). One author (D.M.) initially reviewed titles and abstracts of studies for eligibility; we reviewed in full those studies that appeared to address changes in HPV prevalence after introduction of HPV vaccination programs. We also compared search results with those identified in a recent related review (11), which compared prevaccination and postvaccination periods for high-risk vaccine types (HPV16 and HPV18), cross-protected types (HPV31, HPV33, and HPV45), and all high-risk HPV nonvaccine types combined.
Data Extraction and Data Quality
For each study, we extracted data on study design and country of study. Then, for both prevaccincation and postvaccination periods, we extracted data on year(s) of sample collection, study setting and population, sample size, specimen type, assay used for HPV DNA testing, HPV genotypes included in the assay, demographic and sexual behavior data collected, and the measure of effect (and method used to determine any effect). For the postvaccination period, we also extracted data on the method used to ascertain estimated vaccination coverage.
In addition, we assessed the potential bias in each study by considering the comparability of the study populations in the prevaccination versus postvaccination periods (i.e., similar setting and population demographics); the extent of adjustment for potential confounders; the suitability of the specimen type to assess HPV DNA infection; the suitability of the assay used for accurate HPV DNA testing (and whether the suitability of assays differed between the prevaccination and postvaccination periods); and the method used to estimate HPV vaccination coverage. To assess external validity, we considered whether the study samples were population based. Each of these factors was scored as either low risk or high risk.
When published data on HPV prevalence and prevalence ratios (PRs) for individual high-risk HPV types were unavailable, we contacted authors to request the HPV type-specific prevalences during the prevaccination and postvaccination periods and the PRs for the 2 periods for each nonvaccine high-risk HPV type. We requested PRs adjusted for demographic and sexual behavior data or the unadjusted PRs if data on confounders were unavailable; we calculated unadjusted PRs if authors provided raw data. By using data from a previously conducted validation study, 1 study included adjusted odds ratios rather than PRs to adjust for the change in assay used during the prevaccination and postvaccination periods (16).
We used estimates weighted to account for selection processes if that data were available from authors (Tables and Figures in this article use unweighted numbers, except for Technical Appendix Table 1). We also stratified data by age group (i.e., <19 and 20–24 years of age) because of expected lower rates of vaccination coverage and lower vaccine effectiveness in those vaccinated at older ages. Consequently, for each study, we requested data from authors for the same 2 age groups. One study included data for girls <13 years of age, so we requested data restricted to those 16–19 years of age (17).
To enable calculation of a PR for a prevalence of 0 during either the prevaccination or postvaccination period, we used a continuity correction of 0.5. When prevalence was 0 for both the prevaccination and postvaccination periods, we excluded the study from the meta-analysis for the relevant age group and HPV type. Results were further stratified by type of vaccine used (i.e., bivalent or quadrivalent). PRs within each subgroup were combined to obtain a summary PR by using a fixed-effects model if data were not shown to be heterogeneous; lack of heterogeneity was determined by a p value >0.10 calculated with the Cochrane Q test or by an I2 value <25% (18). Sensitivity analyses were restricted to studies that used cervical, vulval, or vaginal swabs as specimen type because urine samples have lower sensitivity for detecting HPV DNA infection (19).
After we eliminated duplications, we identified 4,648 unique articles in searches from all 4 databases (Figure 1). An initial search of title and abstracts of these articles excluded 4,508 (97.0%) because of ineligibility. For the remaining 140 articles, we examined the full text to determine compliance with eligibility criteria and identified 10 eligible studies (Figure 1). Of these 10 studies, 1 met all eligibility criteria, but the type-specific PRs were unavailable from authors (20). Therefore, we included 9 studies in the systematic review and meta-analysis (16,17,21–27). All eligible studies were repeat cross-sectional studies that compared changes in prevalence in populations before and after introduction of a national HPV vaccination program (Technical Appendix[PDF - 1.51 MB - 22 pages] Table 1). Because only 1 study considered changes in HPV infection among male and female populations, we considered only female populations in the analysis. Two studies were population-based national surveys (23,26); 3 studies were conducted among young women obtaining chlamydia screening (16,17,27); 2 studies comprised young women attending a primary care clinic, community health center, or hospital-based adolescent clinic (21,22); and 2 studies comprised women obtaining cervical screening (24,25) (Technical Appendix[PDF - 1.51 MB - 22 pages] Table 1). The included studies contained data on 13,886 girls and women <19 years of age and 23,340 women 20–24 years of age.
The studies varied in methodologic quality on the basis of potential bias (Table 1). Most studies collected some demographic and sexual behavior data to enable appropriate adjustment of the relative risks, although the number of factors collected was limited in some studies (16,17,24,25) (Table 1; Technical Appendix[PDF - 1.51 MB - 22 pages] Table 1).
HPV Types Included in Nonavalent HPV Vaccines
HPV Types with Prior Evidence for Cross-Protection
We found evidence of reduced prevalence of HPV31 (Figure 2; Table 2) among girls and women <19 years of age (PR 0.73, 95% CI 0.58–0.91) but found little evidence of changed prevalences for HPV33 or HPV45 among this age group (PR 1.04, 95% CI 0.78–1.38 for HPV33; PR 0.96, 95% CI 0.75–1.23 for HPV45). Results were heterogeneous for HPV31, HPV33, and HPV45 in women 20–24 years of age; consequently, we did not calculate summary PRs (Figure 2; Table 2).
Other HPV Types
We found evidence of increased prevalence of HPV52 in those <19 years of age (PR 1.34, 95% CI 1.13–1.59) (Figure 3; Table 2), but because of heterogeneity, we did not calculate summary PRs for those 20–24 years of age. We found no evidence of a changed prevalence for HPV58 among the younger age group (PR 1.01, 95% CI 0.80–1.26) but found borderline evidence of an increase for those 20–24 years of age (PR 1.14, 95% CI 0.99–1.31).
Other High-Risk and Possibly High-Risk HPV Types
No consistent patterns appeared across the studies for other HPV vaccine types not used in the nonavalent vaccine (Table 2; Technical Appendix[PDF - 1.51 MB - 22 pages] Figure 1). We found evidence of increased prevalences from the prevaccination period to the postvaccination period in those <19 years of age for HPV39 (PR 1.27, 95% CI 1.05–1.54), HPV53 (PR 1.51, 95% CI 1.10–2.06), and HPV73 (PR 1.36, 95% CI 1.03–1.80). For women 20–24 years of age, evidence indicated increased prevalence for HPV39 (PR 1.13, 95% CI 1.00–1.28).
As a sensitivity analysis, we performed 3 additional analyses, all stratified by age group: by type of vaccine used (i.e., bivalent or quadrivalent); by potential bias of the original study (i.e., relatively low potential bias, defined as <3 factors indicating high risk of bias; or relatively high potential bias, defined >3 factors indicating high risk of bias) (Table 1); and by vaccination coverage (i.e., low <50%; high >50%). For studies in settings that used the bivalent vaccine, we found evidence of increased prevalence between the prevaccination period and postvaccination periods among those <19 years of age for HPV52, HPV53, HPV56, and HPV70 (Technical Appendix[PDF - 1.51 MB - 22 pages] Table 2, Figures 2–4). Prevalence of HPV53 among women 20–24 years of age also increased. For the quadrivalent vaccine, evidence showed increased prevalences of HPV39, HPV51, and HPV59 for those <19 years of age. Among those 20–24 years of age, evidence indicated increased prevalence of HPV52 and HPV70 (Technical Appendix[PDF - 1.51 MB - 22 pages] Table 2, Figures 2–4).
Many of our analyses that were stratified by potential bias of the included studies had results similar to those in the unstratified analyses (Technical Appendix[PDF - 1.51 MB - 22 pages] Table 3). However, among those <19 years of age, studies with a relatively low potential bias showed no evidence of increased prevalence for HPV52 or HPV39, although evidence existed when the studies were unstratified. For studies with relatively high potential bias, among this younger age group, evidence showed increased prevalences of HPV51 and HPV70, although these increases were not present in the unstratified analysis. In women 20–24 years of age, evidence showed decreased prevalence for HPV33 in those studies with a relatively low potential bias. No summary estimate was provided in the unstratified analysis because of heterogeneity of data. Studies with a relatively high potential bias showed evidence of increased prevalences of HPV52 and HPV58 among women 20–24 years of age. Among this older age group, evidence existed for decreased prevalence of HPV82 in those studies with both relatively high potential bias and relatively low potential bias, although those studies with relatively high potential bias had a larger decrease. Again, no summary estimate was provided in the unstratified analysis because of heterogeneity.
Vaccination coverage was high for the younger age group in all studies (Technical Appendix[PDF - 1.51 MB - 22 pages] Table 4). For the older age group, studies with high vaccination coverage showed decreased prevalence for HPV31. No summary estimate was provided for the unstratified analysis because of heterogeneity. For the older age group, we found evidence of increased prevalences for HPV39 and HPV58 (similar to results from the unstratified analysis) but only in studies with low vaccination coverage. Although not seen in the unstratified analysis, we also found evidence of an increased prevalence for HPV70 in low-coverage studies and borderline evidence of an increased prevalence for HPV26 in high-coverage studies. No summary estimates were provided for the unstratified analyses because of heterogeneity.
Comprehensive postvaccination surveillance should not only consider reductions of vaccine type–specific infection and associated disease but should also assess any other potential effects of reductions of targeted infections. We assessed changes in nonvaccine HPV types to determine evidence of cross-protection for individual HPV types and to investigate the potential concern that reductions in certain HPV types after the introduction of HPV vaccination in a population could create a niche that enables other nonvaccine high-risk HPV types to become more common (i.e., type replacement). We found evidence of a reduction in the prevalence of HPV31 among girls and women <19 years of age. Our main analysis showed increases in other nonvaccine HPV types (HPV39, HPV52, HPV53, HPV58, and HPV73), but these increases were inconsistent for the 2 age groups examined and the vaccines used.
A previous systematic review evaluated changes in high-risk HPV types combined and found evidence of a reduction in the prevalence of HPV types closely related to vaccine types (HPV31, HPV33, or HPV45) when they were considered as a single group (PR 0.72, 95% CI 0.54–0.96 for girls and women 13–19 years of age) (11). Our review provides evidence of reduced prevalence for HPV31 but little evidence of reduced prevalence for HPV33 or HPV45.
Comparing HPV prevalence in a prevaccination period to prevalence in a similar population in a postvaccination period enables consideration of population-level effects of HPV vaccination on HPV prevalence. However, these repeat cross-sectional study designs have limitations. Although all studies addressed similar populations in the prevaccination and postvaccination periods, these populations may have undergone temporal changes that are independent of HPV vaccination over time and that possibly affect HPV prevalence. For example, increases in diagnoses of other sexually transmitted infections have occurred during the same period as that of HPV vaccination programs (28). Furthermore, incidence of genital warts increased in many countries before vaccine introduction (29–31) and has continued to increase postvaccination in persons ineligible for vaccination (11). Such findings suggest that the increases we observed in some HPV types are possibly associated with broad increases in sexual risk over time. We considered changes in demographics and sexual behavior for the populations over time when information was available, but unrecorded population changes or other temporal changes affecting the relative proportions of high-risk HPV types likely occurred over time (32,33). Also, more geographic variation exists in the relative frequency of nonvaccine HPV types in populations compared with the prevalence of HPV16, which, before the vaccination programs, was the most frequent high-risk type observed in almost all populations (34).
Furthermore, the change in assay used during the prevaccination and postvaccination periods was a potential source of bias in 1 study (16), which calculated odds ratios (ORs) adjusted for differences in diagnostic accuracy. This adjusted OR could not be converted to a PR by using the log-binomial model and was included as an OR. However, given the low prevalence of individual HPV types, the use of an OR instead of a PR for this study was unlikely to have affected the results substantially.
Another limitation is that the broad-spectrum assays used in these studies (and in baseline prevaccination evaluations globally) can lack sensitivity for detecting individual HPV types when multiple types are present, particularly if another HPV type with a higher viral load is present. In the postvaccination period, in the absence of HPV16 and HPV18, this lack of sensitivity could lead to an apparent but artificial increase in nonvaccine types because these types were underestimated in the prevaccine period because of the predominance of HPV16 or HPV18. Studies have shown this potential unmasking effect (35,36); some increases in nonvaccine types that we observed could result from unmasking.
Given the low prevalence of some nonvaccine HPV types, assessing changes in prevalence for individual types since the introduction of HPV vaccination has been challenging. By combining data from several studies, we enhanced our power to consider changes in individual HPV types. However, even with data from 13,886 girls and women <19 years of age and 23,340 women 20–24 years of age, we still had limited power to consider changes in very rare HPV types or to investigate reasons for the heterogeneity in findings for some HPV types because of inconsistent evidence for increases of specific nonvaccine types between age groups and the 2 (i.e., bivalent and quadrivalent) vaccines. Conversely, type 1 errors can occur with multiple testing, so modest evidence for increases should be interpreted with caution.
We decided against performing random-effects meta-analyses in the presence of between-study heterogeneity because, in most instances, inconsistency occurred in the direction of effect, making a summary estimate (i.e., the average value of these opposing effects) uninformative (37). Exploring the causes of heterogeneity could provide further insight into the reasons for these increases, so we performed 3 subgroup analyses by vaccine used, potential bias, and vaccine coverage. Results of the stratification by potential bias suggested that increased PRs for some HPV types may have been reported more often in the studies with relatively high potential bias. However, for all 3 subgroup sensitivity analyses, the small number of studies in each stratum limited the interpretation of the analyses. Similarly, we were limited to only 8 studies for each age group and had insufficient ability to perform meta-regression analyses (because meta-regression should generally not be considered for <10 studies) (37). As further data accrue, a useful future analysis would be exploring the association between reductions in the HPV vaccine types and any increases (not resulting from unmasking) in nonvaccine HPV types. If increases result from type replacement, then we would expect to see increasing prevalences of nonvaccine HPV types as prevalences of vaccine HPV types decrease.
Our confirmation of reductions in a cross-protected HPV type is encouraging. However, the results of this systematic review and meta-analysis provide no clear evidence for type replacement because the data are unclear about the extent to which any observed increases result from other temporal changes, changes in the study populations, or an unmasking effect of broad spectrum HPV assays. Large-scale epidemiologic analyses that use various designs have not detected evidence of any interactions between high-risk types, and the known high evolutionary stability of these viruses lessens the risk that type replacement will be a problem (38,39).
Most women included in the surveillance studies were those vaccinated at older ages (i.e., potentially vaccinated after HPV exposure), and some studies included populations with relatively low coverage, compared with nationally reported vaccination coverage for routine cohorts. Future studies should continue to monitor population-level prevalences of these HPV types. In particular, studies should consider populations vaccinated at young ages and having high vaccination coverage and, perhaps more important, should examine the absolute prevalence of cervical intraepithelial neoplasia 3 lesions attributed to each high-risk HPV type.
Mr. Mesher is a senior scientist at Public Health England. His work involves monitoring and evaluating the population-level effects of the national HPV vaccination program.
The authors thank Kavita Panwar, who performed the HPV testing for Mesher et al. (16).
This research was supported by Public Health England.
- Walboomers JM, Jacobs MV, Manos MM, Bosch FX, Kummer JA, Shah KV, Human papillomavirus is a necessary cause of invasive cervical cancer worldwide. J Pathol. 1999;189:12–9.
- de Sanjose S, Quint WG, Alemany L, Geraets DT, Klaustermeier JE, Lloveras B, ; Retrospective International Survey and HPV Time Trends Study Group. Human papillomavirus genotype attribution in invasive cervical cancer: a retrospective cross-sectional worldwide study. Lancet Oncol.2010;11:1048–56.
- Li N, Franceschi S, Howell-Jones R, Snijders PJ, Clifford GM. Human papillomavirus type distribution in 30,848 invasive cervical cancers worldwide: Variation by geographical region, histological type and year of publication. Int J Cancer. 2011;128:927–35.
- Mesher D, Cuschieri K, Hibbitts S, Jamison J, Sargent A, Pollock KG, Type-specific HPV prevalence in invasive cervical cancer in the UK prior to national HPV immunisation programme: baseline for monitoring the effects of immunisation. J Clin Pathol. 2015;68:135–40.
- Ault KA; Future II Study Group. Effect of prophylactic human papillomavirus L1 virus-like-particle vaccine on risk of cervical intraepithelial neoplasia grade 2, grade 3, and adenocarcinoma in situ: a combined analysis of four randomised clinical trials. Lancet. 2007;369:1861–8.
- Lehtinen M, Paavonen J, Wheeler CM, Jaisamrarn U, Garland SM, Castellsagué X, ; HPV PATRICIA Study Group. Overall efficacy of HPV-16/18 AS04-adjuvanted vaccine against grade 3 or greater cervical intraepithelial neoplasia: 4-year end-of-study analysis of the randomised, double-blind PATRICIA trial. Lancet Oncol. 2012;13:89–99.
- Joura EA, Giuliano AR, Iversen OE, Bouchard C, Mao C, Mehlsen J, ; Broad Spectrum HPV Vaccine Study. A 9-valent HPV vaccine against infection and intraepithelial neoplasia in women. N Engl J Med. 2015;372:711–23.
- Brown DR, Kjaer SK, Sigurdsson K, Iversen OE, Hernandez-Avila M, Wheeler CM, The impact of quadrivalent human papillomavirus (HPV; types 6, 11, 16, and 18) L1 virus-like particle vaccine on infection and disease due to oncogenic nonvaccine HPV types in generally HPV-naive women aged 16-26 years. J Infect Dis. 2009;199:926–35.
- Wheeler CM, Castellsagué X, Garland SM, Szarewski A, Paavonen J, Naud P, ; HPV PATRICIA Study Group. Cross-protective efficacy of HPV-16/18 AS04-adjuvanted vaccine against cervical infection and precancer caused by non-vaccine oncogenic HPV types: 4-year end-of-study analysis of the randomised, double-blind PATRICIA trial. Lancet Oncol. 2012;13:100–10.
- Cervical Cancer Action. Global maps. Global progress in HPV vaccination. 2014 Sep [cited 2016 Apr 22].http://www.cervicalcanceraction.org/comments/comments3.php
- Drolet M, Bénard É, Boily MC, Ali H, Baandrup L, Bauer H, Population-level impact and herd effects following human papillomavirus vaccination programmes: a systematic review and meta-analysis. Lancet Infect Dis. 2015;15:565–80.
- Palmroth J, Merikukka M, Paavonen J, Apter D, Eriksson T, Natunen K, Occurrence of vaccine and non-vaccine human papillomavirus types in adolescent Finnish females 4 years post-vaccination. Int J Cancer. 2012;131:2832–8.
- Malagón T, Drolet M, Boily MC, Franco EL, Jit M, Brisson J, Cross-protective efficacy of two human papillomavirus vaccines: a systematic review and meta-analysis. Lancet Infect Dis. 2012;12:781–9.
- Bouvard V, Baan R, Straif K, Grosse Y, Secretan B, El Ghissassi F, ; WHO International Agency for Research on Cancer Monograph Working Group. A review of human carcinogens—Part B: biological agents. Lancet Oncol. 2009;10:321–2.
- Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JP, The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Med. 2009;6:e1000100.
- Mesher D, Panwar K, Thomas SL, Beddows S, Soldan K. Continuing reductions in HPV 16/18 in a population with high coverage of bivalent HPV vaccination in England: an ongoing cross-sectional study. BMJ Open. 2016;6:e009915.
- Söderlund-Strand A, Uhnoo I, Dillner J. Change in population prevalences of human papillomavirus after initiation of vaccination: the high-throughput HPV monitoring study. Cancer Epidemiol Biomarkers Prev. 2014;23:2757–64.
- Higgins JP, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ. 2003;327:557–60.
- Bissett SL, Howell-Jones R, Swift C, De Silva N, Biscornet L, Parry JV, Human papillomavirus genotype detection and viral load in paired genital and urine samples from both females and males. J Med Virol. 2011;83:1744–51.
- Dunne EF, Naleway A, Smith N, Crane B, Weinmann S, Braxton J, Reduction in human papillomavirus vaccine type prevalence among young women screened for cervical cancer in an integrated US healthcare delivery system in 2007 and 2012–2013. J Infect Dis. 2015;212:1970–5.
- Cummings T, Zimet GD, Brown D, Tu W, Yang Z, Fortenberry JD, Reduction of HPV infections through vaccination among at-risk urban adolescents.Vaccine. 2012;30:5496–9.
- Kahn JA, Brown DR, Ding L, Widdice LE, Shew ML, Glynn S, Vaccine-type human papillomavirus and evidence of herd protection after vaccine introduction. Pediatrics. 2012;130:e249–56.
- Sonnenberg P, Clifton S, Beddows S, Field N, Soldan K, Tanton C, Prevalence, risk factors, and uptake of interventions for sexually transmitted infections in Britain: findings from the National Surveys of Sexual Attitudes and Lifestyles (Natsal). Lancet. 2013;382:1795–806.
- Tabrizi SN, Brotherton JM, Kaldor JM, Skinner SR, Liu B, Bateson D, Assessment of herd immunity and cross-protection after a human papillomavirus vaccination programme in Australia: a repeat cross-sectional study. Lancet Infect Dis. 2014;14:958–66.
- Cameron RL, Kavanagh K, Pan J, Love J, Cuschieri K, Robertson C, Human papillomavirus prevalence and herd immunity after introduction of vaccination program, Scotland, 2009–2013. Emerg Infect Dis. 2016;22:56–64.
- Markowitz LE, Liu G, Hariri S, Steinau M, Dunne EF, Unger ER. Prevalence of HPV after introduction of the vaccination program in the United States.Pediatrics. 2016;137:e20151968.
- Chow EP, Danielewski JA, Fehler G, Tabrizi SN, Law MG, Bradshaw CS, Human papillomavirus in young women with Chlamydia trachomatis infection 7 years after the Australian human papillomavirus vaccination programme: a cross-sectional study. Lancet Infect Dis. 2015;15:1314–23.
- Public Health England. Sexually transmitted infections (STIs): annual data tables. 2015 Jun 23 [cited 2016 Apr 22].https://www.gov.uk/government/statistics/sexually-transmitted-infections-stis-annual-data-tables
- Ali H, Donovan B, Wand H, Read TR, Regan DG, Grulich AE, Genital warts in young Australians five years into national human papillomavirus vaccination programme: national surveillance data. BMJ. 2013;346:f2032.
- Chow EP, Read TR, Wigan R, Donovan B, Chen MY, Bradshaw CS, Ongoing decline in genital warts among young heterosexuals 7 years after the Australian human papillomavirus (HPV) vaccination programme. Sex Transm Infect. 2015;91:214–9.
- Howell-Jones R, Soldan K, Wetten S, Mesher D, Williams T, Gill ON, Declining genital Warts in young women in england associated with HPV 16/18 vaccination: an ecological study. J Infect Dis. 2013;208:1397–403.
- Lehtinen M, Kaasila M, Pasanen K, Patama T, Palmroth J, Laukkanen P, Seroprevalence atlas of infections with oncogenic and non-oncogenic human papillomaviruses in Finland in the 1980s and 1990s. Int J Cancer. 2006;119:2612–9.
- Laukkanen P, Koskela P, Pukkala E, Dillner J, Läärä E, Knekt P, Time trends in incidence and prevalence of human papillomavirus type 6, 11 and 16 infections in Finland. J Gen Virol. 2003;84:2105–9.
- Bruni L, Diaz M, Castellsagué X, Ferrer E, Bosch FX, de Sanjosé S. Cervical human papillomavirus prevalence in 5 continents: meta-analysis of 1 million women with normal cytological findings. J Infect Dis. 2010;202:1789–99.
- Tota JE, Ramanakumar AV, Villa LL, Richardson H, Burchell AN, Koushik A, Evaluation of human papillomavirus type replacement postvaccination must account for diagnostic artifacts: masking of HPV52 by HPV16 in anogenital specimens. Cancer Epidemiol Biomarkers Prev.2015;24:286–90.
- Cornall AM, Phillips S, Cummins E, Garland SM, Tabrizi SN. In vitro assessment of the effect of vaccine-targeted human papillomavirus (HPV) depletion on detection of non-vaccine HPV types: implications for post-vaccine surveillance studies. J Virol Methods. 2015;214:10–4.
- Higgins JPT, Green S, editors. Cochrane handbook for systematic reviews of interventions. Version 5.1.0 [updated March 2011]. The Cochrane Collaboration, 2011 [cited 2016 Apr 22]. http://handbook.cochrane.org/
- Tota JE, Ramanakumar AV, Jiang M, Dillner J, Walter SD, Kaufman JS, Epidemiologic approaches to evaluating the potential for human papillomavirus type replacement postvaccination. Am J Epidemiol. 2013;178:625–34.
- Safaeian M, Rodriguez AC. Invited commentary: multiple human papillomavirus infections and type replacement-anticipating the future after human papillomavirus vaccination. Am J Epidemiol. 2014;180:1076–81.
Suggested citation for this article: Mesher D, Soldan K, Lehtinen M, Beddows S, Brisson M, Brotherton JML, et al. Population-level effects of human papillomavirus vaccination programs on infections with nonvaccine genotypes. Emerg Infect Dis. 2016 Oct [date cited].http://dx.doi.org/10.3201/eid2210.160675