Variability in detection and quantification of interferon β-1b–induced neutralizing antibodies
- Hans-Peter Hartung1, 12Email author,
- Bernd Kieseier1,
- Douglas S Goodin2,
- Barry GW Arnason3,
- Giancarlo Comi4,
- Stuart Cook5,
- Massimo Filippi4,
- Douglas R Jeffery6,
- Ludwig Kappos7,
- Timon Bogumil8,
- Brigitte Stemper9,
- Rupert Sandbrink1, 9,
- Yukiko Nakada10,
- Haruhiko Nakajima10,
- Susanne Schwenke9,
- Stephan Lehr9,
- Jürgen Heubach9,
- Christoph Pohl9, 11 and
- Joachim Reischl9
© Hartung et al.; licensee BioMed Central Ltd. 2012
Received: 29 February 2012
Accepted: 15 June 2012
Published: 15 June 2012
Interferon-beta (IFNB) therapy for multiple sclerosis can lead to the induction of neutralizing antibodies (NAbs) against IFNB. Various methods are used for detection and quantification of NAbs.
Blood samples from 125 IFNB-1b–treated patients, which were tested NAb negative or NAb positive after conclusion of a clinical study, were retested three years after first being assessed in four different laboratories that offer routine NAb testing to practicing neurologists. The myxovirus protein A (MxA) induction assay, the cytopathic effect (CPE) assay (two laboratories), or the luciferase assay were used. Intra- and inter-laboratory agreement between assays with respect to NAb detection and NAb titer quantification were evaluated.
High agreement for NAb detection (kappa coefficient, 0.86) and for titer levels was observed for the intra-laboratory comparison in the laboratory using the MxA induction assay performed three years ago and now. A similarly high agreement for NAb detection (kappa coefficient, 0.87) and for titer quantification was noted for the MxA assay of this laboratory with one of two laboratories using the CPE assay. All other inter-laboratory comparisons showed kappa values between 0.57 and 0.68 and remarkable differences in individual titer levels.
There are considerable differences in the detection and quantification of IFNB-induced NAbs among laboratories offering NAb testing for clinical practice using different assay methods. It is important that these differences are considered when interpreting NAb results for clinical decision-making and when developing general recommendations for potentially clinically meaningful NAb titer levels.
KeywordsMultiple sclerosis Clinical trials randomized controlled IFNB-1b Interferon beta Neutralizing antibodies Round robin
Up to 40% of people with multiple sclerosis (MS) treated with interferon-β (IFNB) develop IFNB neutralizing antibodies (NAbs) . Anti-IFNB NAbs have been associated with reduced therapeutic efficacy  exemplified by an increased annualized relapse rate and increased disease activity on brain magnetic resonance imaging. Furthermore, in-vitro studies have demonstrated that NAbs can lead to alterations in the transcription rate of MS-relevant genes [3, 4]. In contrast, other studies have indicated that the relapse rate is not significantly different between NAb-negative and NAb-positive patients . Generally, the frequency of NAbs against IFNB diminishes over time, and especially patients who develop NAbs to IFNB-1b (Betaferon®, Chiron Corporation, Emeryville, CA, USA) often revert to NAb-negative status upon subsequent testing [5–9]. High NAb titers appear to be more persistent and thus may have a greater impact on the efficacy of IFNB-1b [2, 10, 11].
Part of the inconsistent findings with regard to the clinical relevance of NAbs might result from the fact that various methods are used for evaluating NAbs in MS patients treated with IFNB and that IFNB-1a and -1b–treated patients are assessed jointly in some studies on NAbs. The objective of this study was to compare NAb detection and quantification of NAb titers in laboratories offering NAb testing for treatment decision making in clinical routine. These laboratories use different assay methods, that is, the myxovirus protein A (MxA) induction assay and the cytopathic effect (CPE) assay [1, 2, 12].
Blood samples obtained in the Betaferon Efficacy Yielding Outcomes of a New Dose (BEYOND) study were used. The BEYOND study was a randomized, parallel group, Phase 3 study conducted across 198 centers in 26 countries worldwide . In total, 2,244 patients with relapsing-remitting MS were enrolled and randomly assigned in a ratio of 2:2:1 to receive one of two doses of IFNB-1b (either 250 μg or 500 μg) subcutaneously every other day or 20 mg glatiramer acetate subcutaneously every day. Serum samples for NAb testing were collected at baseline and then every six months under treatment. At the end of the study, these samples were tested for NAb positivity and for NAb titer quantification with an MxA induction assay. A sample was considered “NAb positive” with a titer of at least 20 units (lower limit of quantification, LLOQ) using this assay. If no quantifiable NAb titer is detectable, the respective sample was considered “NAb negative.” Comprehensive details of the measurement, quantification and NAb titers in the BEYOND study have been reported previously . The Institutional Review Boards of all participating centres approved the study protocol and all patients gave written informed consent before trial entry.
The present study used serum samples of the BEYOND study. Of serum samples obtained 1.5 years after the start of IFNB-1b 250 μg treatment, 125 were selected for the intra- and inter-laboratory comparison based on the original test results from Laboratory A (A(I)). Sample selection was not representative of the NAb status distribution nor of NAb titers observed in the BEYOND trial, but optimized for dense and steady coverage of the entire NAb titer range (n = 82) while including enough NAb-negative samples (n = 43). The samples had been stored at −20° and thawed and frozen once during aliquoting. Three years after the original NAb analysis, sample aliquots were reanalyzed at Laboratory A using the same MxA induction assay (A[II]). In addition, the aliquots were tested in three other laboratories using the CPE bioassay (Laboratories B, LLOQ = 8, and C, LLOQ = 20) and the luciferase bioassay in Laboratory D (LLOQ = 20). There was no upper limit of quantification for Laboratories A and B, but it was 640 for the CPE assay performed at Laboratory C and 1,202 for the luciferase assay of Laboratory D. The principles of NAb testing using these three bioassays have been published previously [15–19].
All of the laboratories that assayed the samples for neutralizing antibody activity in this study offer neutralizing antibody testing in clinical practice, but it was agreed that they would remain anonymous when reporting the results of this study. The ability of neutralizing antibodies to block the biological activity of IFNB, which is dependent on the molecule binding to its receptor, is measured in neutralization assays. In the MxA assay, serum samples were mixed with IFNB-1b and incubated with A549 cells (human embryonic lung cells) . Cell lysates were then tested for MxA protein using ELISA. The neutralizing titer was the reciprocal serum dilution that reduced the MxA-inducing activity 10-fold. At the end of the BEYOND study and after storage for three years, the samples were tested by Rentschler, Laupheim, Germany.
In the luciferase assay, HL116 cells stably transfected with a luciferase reporter gene cassette were used, as described before . Briefly, a transcellular signaling mechanism is activated when the IFNB molecule binds to its receptor, which activates the IFN-stimulated response element. This translocates to the nucleus where it causes the transcription of the luciferase gene; the resulting luminescence signal was read by a conventional reader. The amount of luciferase produced in response to a known quantity is predictable, but this response is blocked by neutralizing antibody. IFNB-1a was used in this assay.
A number of CPE assays have been developed using a variety of cell lines and viruses to determine the titer of an IFN sample. The addition of neutralizing antibodies to the interferon allows the titer of neutralizing antibody to be quantified. Many of these assays provide a rapid, simple and sensitive assay. The CPE assay reported under laboratory B was performed by the Mitsubishi Chemical Medience Corporation (Tokyo, Japan) using FL cells and Sindbis virus. IFNB-1b was used in this assay. The IFN used in the CPE assay performed by laboratory C was not specified. No details about the assay were provided and the laboratory did not agree to disclose its identity for this publication.
Patient samples with NAb titers below the LLOQ are defined as being NAb negative, and samples with quantifiable NAb titers as being NAb positive. The agreement between the different bioassays regarding NAb negative versus NAb positive status was assessed using the kappa coefficient. The kappa coefficient is commonly used in studies that measure agreement between two or more observations, since it accounts for the fact that observers will occasionally agree purely by chance . A kappa of 0 indicates agreement by chance, whereas a kappa of 1 indicates perfect agreement . Titer values were compared graphically by means of scatter plots.
Distribution of NAb titers reported by different laboratories
Intra- and inter-laboratory comparison of NAb titer values
Consistency of NAb test results across laboratories
Intra- and inter-laboratory agreement of the NAb testing in terms of NAb positive versus NAb negative status
Recently, an international panel of MS experts on NAbs to IFNB therapy convened under the auspices of the Neutralizing Antibodies on Interferon beta in Multiple Sclerosis consortium (NAbinMS: a collaborative project funded by the European Union) and issued recommendations for clinical use of data on NAb to IFNB therapy . In this position paper, the use of the MxA induction assay is suggested to test neutralizing activity to IFNB therapy and a switch to a non-IFNB therapy is recommended in cases of sustained high-titer NAb positivity and/or lack of IFNB bioactivity. However, in clinical practice, other assays are also employed to detect and quantify the level of neutralizing activity to IFNB treatment, such as the CPE and the luciferase assay. These assays differ not only in their sensitivity and specificity but also in their performance in various laboratories resulting in differences with respect to NAb detection and titer quantification . Furthermore, difficulties in standardizing these assays have considerably hindered inter-laboratory comparison of NAb data .
Here, we assessed the variability and agreement of NAb testing results between different methods and laboratories offering routine NAb testing to detect and quantify neutralizing activity to IFNB treatment in clinical practice. There was a high intra-laboratory agreement for NAb detection and quantification with the MxA induction assay that was used in the BEYOND trial. This finding reveals a robust stability of the neutralizing activity in patient sera stored for several years and a good retest reliability of the MxA induction assay that was used. With respect to the inter-laboratory comparisons, there remained high agreement of NAb detection and quantification between the MxA induction assay and one laboratory using a CPE assay, with just a systematic difference in titers. This contrasted with only moderate agreement between the MxA assay and the CPE assay used by a second laboratory and to the modest agreement between the NAb findings of the two CPE laboratories. Also, the agreement between the MxA assay and both CPE assays with a luciferase assay was only moderate. Of note, when comparing individual titer levels, substantial differences were recorded between laboratories: we frequently observed that high-titer NAb positivity was measured by one lab in a sample that was found to contain low-titer NAb positivity by another lab. Occasionally, even high-titer NAb positivity was reported for samples that were tested NAb negative by another laboratory using a different method.
The focus of this work was to investigate the differences in NAb testing and quantification between laboratories offering NAb services in clinical practice. More research is warranted to better understand the observed discrepancies. This research could constitute the starting point for further standardization of NAb testing. For instance, higher titers have been observed when IFNB-1a vs. IFNB-1b was used as the antigen to test neutralizing activity, a finding that is in line with the somewhat higher titers of our laboratory D using IFNB-1a in a Luciferase assay . In light of our findings, results of NAb testing obtained in different assays/laboratories must be interpreted or compared with caution. This is of particular importance when titer thresholds are considered for clinical decision-making as there are both systematic shifts and potentially high variability between test methods and among laboratories. Because high-titer NAb positivity may be regarded as a sufficient reason to stop IFNB and switch to a non-IFNB product even if patients are doing well , a false-positive NAb titer might have disadvantageous therapeutic consequences. Therefore, our findings underscore the need for global standardization efforts whenever complex indirect biological assays are to be used. They also support the recommendation of NAb experts to supplement testing for NAbs with more direct measurements of IFNB-induced biological activity in patients undergoing IFNB treatment (such as the measurement of MxA induction following an IFNB injection) . Yet, the predictive value of measuring IFNB activity needs still to be established in a well-designed prospective trial .
There are differences in the detection and quantification of IFNB-1b-induced NAbs between different laboratories and the assay methods used in clinical practice. It is important that these differences are considered not only when interpreting NAb results but also when developing general recommendations for potentially clinically relevant NAb titer levels.
lower limit of quantification
myxovirus protein A
The authors wish to thank Ray Ashton, Maria Bell and Bari Samson at PAREXEL for help with editing the manuscript. PAREXEL was funded by Bayer HealthCare Pharmaceuticals.
- Giovannoni G, Munschauer FE, Deisenhammer F: Neutralising antibodies to interferon beta during the treatment of multiple sclerosis. J Neurol Neurosurg Psychiatry. 2002, 73: 465-469. 10.1136/jnnp.73.5.465.PubMed CentralView ArticlePubMed
- Goodin DS, Frohman EM, Hurwitz B, O'Connor PW, Oger JJ, Reder AT, Stevens JC: Neutralizing antibodies to interferon beta: assessment of their clinical and radiographic impact: an evidence report: report of the therapeutics and technology assessment subcommittee of the American academy of neurology. Neurology. 2007, 68: 977-984. 10.1212/01.wnl.0000258545.73854.cf.View ArticlePubMed
- Gilli F, Bertolotto A, Sala A, Hoffmann F, Capobianco M, Malucchi S, Glass T, Kappos L, Lindberg RL, Leppert D: Neutralising antibodies against IFN-beta in multiple sclerosis: antagonization of IFN-beta mediated suppression of MMPs. Brain. 2004, 127: 259-268. 10.1093/brain/awh028.View ArticlePubMed
- Hesse D, Sellebjerg F, Sørensen PS: Absence of MxA induction by interferon beta in patients with MS reflects complete loss of bioactivity. Neurology. 2009, 73: 372-377. 10.1212/WNL.0b013e3181b04c98.View ArticlePubMed
- Rice GP, Paszner B, Oger J, Lesaux J, Paty D, Ebers G: The evolution of neutralizing antibodies in multiple sclerosis patients treated with interferon beta-1b. Neurology. 1999, 52: 1277-1279. 10.1212/WNL.52.6.1277.View ArticlePubMed
- Bellomi F, Scagnolari C, Tomassini V, Gasperini C, Paolillo A, Pozzilli C, Antonelli G: Fate of neutralizing and binding antibodies to IFN beta in MS patients treated with IFN beta for 6 years. J Neurol Sci. 2003, 215: 3-8. 10.1016/S0022-510X(03)00173-4.View ArticlePubMed
- Petkau AJ, White RA, Ebers GC, Reder AT, Sibley WA, Lublin FD, Paty DW: Longitudinal analyses of the effects of neutralising antibodies on interferon beta-1b in relapsing-remitting multiple sclerosis. Mult Scler. 2004, 10: 126-138. 10.1191/1352458504ms1004oa.View ArticlePubMed
- Sørensen PS, Koch-Henriksen N, Ross C, Clemmesen KM, Bendtzen K, Danish Multiple Sclerosis Study Group: Appearance and disappearance of neutralizing antibodies during interferon-beta therapy. Neurology. 2005, 65: 33-39. 10.1212/01.WNL.0000166049.51502.6A.View ArticlePubMed
- Reder AT, Ebers GC, Traboulsee A, Li D, Langdon D, Goodin DS, Bogumil T, Beckmann K, Konieczny A, Investigators of the 16-Year Long-Term Follow-Up Study: Cross-sectional study assessing long-term safety of interferon-β-1b for relapsing-remitting MS. Neurology. 2010, 74: 1877-1885. 10.1212/WNL.0b013e3181e240d0.View ArticlePubMed
- Killestein J, Polman CH: Determinants of interferon β efficacy in patients with multiple sclerosis. Nat Rev Neurol. 2011, 7: 221-228. 10.1038/nrneurol.2011.22.View ArticlePubMed
- Malucchi S, Gilli F, Caldano M, Marnetto F, Valentino P, Granieri L, Sala A, Capobianco M, Bertolotto A: Predictive markers for response to interferon therapy in patients with multiple sclerosis. Neurology. 2008, 70: 1119-1127.View ArticlePubMed
- Massart C, Gibassier J, Oger J, Le Page E, Edan G: Neutralizing antibodies to interferon beta in multiple sclerosis: analytical evaluation for validation of a cytopathic effect assay. Clin Chim Acta. 2007, 377: 185-191. 10.1016/j.cca.2006.09.021.View ArticlePubMed
- O'Connor P, Filippi M, Arnason B, Comi G, Cook S, Goodin D, Hartung H-P, Jeffery D, Kappos L, Boateng F, Filippov V, Groth M, Knappertz V, Kraus C, Sandbrink R, Pohl C, Bogumil T, BEYOND Study Group: 250 μg or 500 μg interferon beta-1b versus 20 mg glatiramer acetate in relapsing-remitting multiple sclerosis: a prospective, randomized, multicentre study. Lancet Neurol. 2009, 8: 889-897. 10.1016/S1474-4422(09)70226-1.View ArticlePubMed
- Goodin DS, Hartung HP, O'Connor P, Filippi M, Arnason B, Comi G, Cook S, Jeffery D, Kappos L, Bogumil T, Knappertz V, Sandbrink R, Beckmann K, White R, Petkau J, Pohl C, BEYOND Study Group: Neutralizing antibodies to interferon beta-1b multiple sclerosis: a clinico-radiographic paradox in the BEYOND trial. Mult Scler. 2012, 18: 181-195. 10.1177/1352458511418629.View ArticlePubMed
- Files JG, Gray JL, Do LT, Foley WP, Gabe JD, Nestaas E, Pungor E: A novel sensitive and selective bioassay for human type I interferons. J Interferon Cytokine Res. 1998, 18: 1019-1024. 10.1089/jir.1998.18.1019.View ArticlePubMed
- Pungor E, Files JG, Gabe JD, Do LT, Foley WP, Gray JL, Nelson JW, Nestaas E, Taylor JL, Grossberg SE: A novel bioassay for the determination of neutralizing antibodies to IFN-beta-1b. J Interferon Cytokine Res. 1998, 18: 1025-1030. 10.1089/jir.1998.18.1025.View ArticlePubMed
- Grossberg SE, Taylor JD, Siebenlist RE, et al: Biological and immunological assays of human interferons. Manual of Clinical Immunology. Edited by: Rocklin R. 1986, ASM Publishing, Washington, DC, 295-299. 3
- Farrell R, Kapoor R, Leary S, Rudge P, Thompson A, Miller D, Giovannoni G: Neutralizing anti-interferon beta antibodies are associated with reduced side effects and delayed impact on efficacy of Interferon-beta. Mult Scler. 2008, 14: 212-218.View ArticlePubMed
- Lam R, Farrell R, Aziz T, Gibbs E, Giovannoni G, Grossberg S, Oger J: Validating parameters of a luciferase reporter gene assay to measure neutralizing antibodies to IFNbeta in multiple sclerosis patients. J Immunol Methods. 2008, 336: 113-118. 10.1016/j.jim.2008.03.014.View ArticlePubMed
- Viera AJ, Garrett JM: Understanding interobserver agreement: the kappa statistic. Fam Med. 2005, 37: 360-363.PubMed
- Polman C, Bertolotto A, Deisenhammer F, Giovannoni G, Hartung H-P, Hemmer B, Killestein J, McFarland HF, Oger J, Pachner AR, Petkau J, Reder AT, Reingold SC, Schellekens H, Sørensen PS: Recommendations for clinical use of data on neutralising antibodies to interferon-beta therapy in multiple sclerosis. Lancet Neurol. 2010, 9: 740-750. 10.1016/S1474-4422(10)70103-4.View ArticlePubMed
- Deisenhammer F, Schellekens H, Bertolotto A: Measurement of neutralizing antibodies to interferon beta in patients with multiple sclerosis. J Neurol. 2004, 251 (suppl 2): II31-II39.PubMed
- McKay F, Schibeci S, Heard R, Stewart G, Booth D: Analysis of neutralizing antibodies to therapeutic interferon-beta in multiple sclerosis patients: a comparison of three methods in a large Australasian cohort. J Immunol Methods. 2006, 310: 20-29. 10.1016/j.jim.2005.11.011.View ArticlePubMed
- Files JG, Hargrove D, Delute L, Cantillon M: Measured neutralizing titers of IFN-beta neutralizing antibodies (NAbs) can depend on the preparations of IFN-beta used in the assay. J Interferon Cytokine Res. 2007, 27: 637-642. 10.1089/jir.2006.0131.View ArticlePubMed
- Hemmer B, Berthele A: Should we measure the bioavailability of interferon β in vivo in patients with multiple sclerosis?. Nat Clin Pract Neurol. 2009, 4: 126-127.View Article
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.