THE ASTHMA SYMPTOM UTILITY INDEX: RELIABILITY, VALIDITY, AND RESPONSIVENESS AMONG ADULT ASTHMA PATIENTS By Christian Bime A THESIS Submitted to Michigan State University in partial fulfillment of the requirements for the degree of MASTER OF SCIENCE Epidemiology 2012 ABSTRACT THE ASTHMA SYMPTOM UTILITY INDEX: RELIABILITY, VALIDITY, AND RESPONSIVENESS AMONG ADULT ASTHMA PATIENTS By Christian Bime Patient reported outcome (PRO) instruments are frequently used to assess effectiveness of asthma therapy in clinical research and clinical practice. Several instruments exist for assessing asthma control and asthma-related quality of life. We used the Asthma Symptom Utility Index (ASUI), an instrument designed to assess asthma symptoms, as an example to demonstrate the methodology for evaluating the psychometric properties of PRO instruments. The ASUI is a 10-item instrument developed to measure the frequency and impact of asthma symptoms over a two week recall period. In two groups of adult asthma patients participating in large multicenter randomized trials, we showed that the ASUI has good construct validity as demonstrated by significant correlations between ASUI scores and Asthma Control Questionnaire (ACQ) scores (Spearman correlation r = -0.79, 95% CI [-0.85, -0.75], P<0.001) and Mini Asthma Quality of Life Questionnaire (Mini AQLQ) scores (r = 0.59, 95% CI [0.51, 0.61], P<0.001). The ASUI also showed robust internal consistency reliability of 0.74 (Cronbach’s alpha), test-retest reliability 0.76 (intra-class correlation), as well as responsiveness to change. To my lovely wife Philomina and our daughters – Megan, Mariah, Melanie and Michelle iii ACKNOWLEDGEMENTS I would like to thank all the people, without whom, this project would not have been possible. First of all, I would like to thank my adviser, Dr. Mat Reeves, for his guidance throughout my training in epidemiology and for reading through multiple revisions of this thesis. Also special thanks to my committee members, Dr. Janet T. Holbrook, and Dr. David Todem for their guidance and support. Thanks to Dr. Robert A. Wise, my academic mentor during fellowship at the Division of Pulmonary and Critical Care Medicine, Johns Hopkins University School of Medicine for providing me the opportunity to work with the data coordinating center of the American Lung Association – Asthma Clinical Research Center (ALA-ACRC). Thanks to the wonderful staff of the ALA-ACRC for their outstanding support in conducting this work, especially Christine Wei for her assistance with data analysis and Johnson Ukken for his assistance with the formatting. And finally, thanks to my wife, parents, brothers and sisters, and numerous friends who supported me through this long journey. iv TABLE OF CONTENTS LIST OF TABLES ........................................................................................................... vii LIST OF FIGURES ........................................................................................................ viii ABBREVIATIONS ........................................................................................................... ix INTRODUCTION ............................................................................................................. 1 CHAPTER 1 PATIENT REPORTED OUTCOME MEASURES IN ASTHMA CLINICAL RESEARCH .................................................................................................................... 4 Composite scores of asthma control .................................................................... 4 Asthma-related quality of life ................................................................................ 5 Asthma symptoms ................................................................................................ 9 Asthma diaries ........................................................................................... 9 Retrospective asthma symptom questionnaires ...................................... 10 CHAPTER 2 CRITERIA FOR EVALUATING THE PSYCHOMETRIC PROPERTIES OF PATIENT REPORTED OUTCOME INSTRUMENTS .................................................................... 12 Validity ................................................................................................................ 12 Reliability ............................................................................................................ 14 Responsiveness ................................................................................................. 16 CHAPTER 3 THE PSYCHOMETRIC PROPERTIES OF THE ASTHMA SYMPTOM UTILITY INDEX (ASUI): METHODS AND RESULTS.............................................................................. 17 Methods .............................................................................................................. 18 Data collection ......................................................................................... 18 Patients ......................................................................................... 18 Procedures .................................................................................... 19 Assessments ........................................................................................... 20 Construct validity ........................................................................... 20 Known-groups validity ................................................................... 20 Predictive validity .......................................................................... 21 Reliability ....................................................................................... 21 Responsiveness ............................................................................ 22 Results ............................................................................................................... 24 Study population ...................................................................................... 24 v Construct validity of the ASUI .................................................................. 26 Known-groups validity of the ASUI .......................................................... 26 Predictive validity of the ASUI .................................................................. 31 Reliability of the ASUI .............................................................................. 33 Responsiveness of the ASUI ................................................................... 32 CHAPTER 4 DISCUSSION ................................................................................................................ 36 APPENDIX .................................................................................................................... 40 REFERENCES .............................................................................................................. 44 vi LIST OF TABLES Table 1: Asthma-specific quality of life questionnaires .................................................... 7 Table 2: Patient characteristics at baseline ................................................................... 25 Table 3: Known-groups validity tests on mean ASUI scores at baseline ....................... 27 Table 4: Pairwise comparison of differences in mean ASUI score by categories of lung function and asthma severity …………………………………………..........28 Table 5: Predictive validity of the ASUI: relationship to frequency of EPACs and exacerbations .................................................................................................. 32 Table 6: Mean changes in ASUI scores as a function of changes in percent predicted FEV1 values and ACQ scores ........................................................ 34 Table 7: Mean difference in ASUI scores by EPAC status for all visits ......................... 35 Table 8: Mean VAS Preferences, SG Utilities, and ASUI-Derived Utilities for Multi-symptom States……………………………………………………………….42 Table 9: Multiattribute utility function on worst possible symptom state to no symptoms scale for ASUI…………………………………………………………..43 vii LIST OF FIGURES Figure 1: Mean of ASUI with Standard Error by Categories of Percent Predicted FEV1 .............................................................................................................. 29 Figure 2: Mean of ASUI with Standard Error by Category of Asthma Severity .............. 30 viii ABBREVIATIONS ABP Asthma Bother Profile ACT Asthma Control Test ACQ Asthma Control Questionnaire AIS Asthma Impact Survey ALA-ACRC American Lung Association-Asthma Clinical Research Centers ANOVA Analysis of Variance AQLQ Asthma Quality of Life Questionnaire AQLQ-S Asthma Quality of Life Questionnaire-Standardized ASF Asthma Short Form ASUI Asthma Symptom Utility Index c-ACT Childhood Asthma Control Test CHSA Child Health Survey for Asthma CHSA-C Child Health Survey for Asthma –child version COPD Chronic Obstructive Pulmonary Disease EPAC Episodes of Poor Asthma Control FEV1 Forced Expiratory Volume in One second GINA Global Initiative for Asthma ICC Intraclass correlation M-AQLQ Marks – Modified Asthma Quality of Life MID Minimal Important Difference Mini-AQLQ Mini-Asthma Quality of Life Questionnaire ix NAEPP National Asthma Education and Prevention Program NIH National Institutes of Health PACD Pediatric Asthma Caregiver Diary PACQLQ Pediatric Asthma Caregiver Quality of Life Questionnaire PAQLQ Pediatric Asthma Quality of Life Questionnaire PASDS Electronic Pediatric Asthma Symptom Diary Scale PedsQL 3.0 Asthma Module Pediatric Quality of Life Inventory 3.0 Asthma Module PEF Peak Expiratory Flow Rate Pictorial PAQLQ Pictorial Quality of Life Measure for Young children with Asthma PPI proton pump inhibitors PRO Patient reported Outcome RR Relative Risk SARA Study of Acid Reflux and Asthma SD Standard Deviation SEM Standard Error of Measurement SIIVA Safety of Inactivated Influenza Vaccine in Asthma VAS Visual Analog Scale x INTRODUCTION Outcome measures in asthma clinical research and routine clinical care include 1 2 objective measures such as lung function , biomarkers of airway inflammation , asthma 3 4 exacerbations , and health care utilization and costs . However, these objective measures may correlate poorly with the patients’ perception of asthma control in terms 5, 6 of symptoms and impact on their quality of life . Recent international guidelines for the assessment and monitoring of asthma have defined the concepts of asthma severity 7-9 and asthma control . Asthma severity is an inherent trait of the patient that reflects the 9 intrinsic intensity of the disease process and is more or less constant . Asthma control is the extent to which manifestations of the disease are reduced or removed by 9 therapy . Two domains of asthma control are identified in the guidelines: current impairment and future risk. Current impairment includes the extent of asthma 9 symptoms, the amount of activity limitation, and asthma-related quality of life . The risk domain of asthma control is defined by the presence of adverse outcomes such as 9 exacerbations, accelerated decline in lung function, or treatment-related side effects . The clinical manifestations of asthma have wide patient variability in frequency and intensity 8, 9 and no single asthma symptom is ideal for the comprehensive assessment of asthma control. Asthma questionnaires that group several individual asthma manifestations to provide a composite score are thus essential. Patient-reported 1 outcomes (PRO) are questionnaires that provide a report of a patient’s health condition, 7 directly from the patient and without any interpretation of the response by a clinician . It has been recommended in international asthma management guidelines that PROs be used to assess the effectiveness of asthma therapy in clinical research and clinical 8, 9 practice . Several PRO instruments currently exist for use in assessing asthma outcomes in clinical research. Unfortunately, there is a lack of outcome standardization in asthma clinical research making it difficult to examine and compare asthma outcomes across clinical studies. In March, 2010, a consortium of several National Institutes of Health (NIH) institutes, and the Agency for Healthcare Research and Quality convened an Asthma Outcomes workshop in Bethesda, MD to establish standard definitions and data collection methodologies for validated PRO instruments in asthma clinical research and 10 also to identify promising outcome measures for use in asthma clinical research . Three types of PRO instruments were identified - composite scores of asthma control, 10 asthma-related quality of life, and asthma symptoms . The NIH workshop further defined the outcome measures as core outcomes, supplemental outcomes, or emerging 10 outcomes based on the degree of standardization and validation . Core asthma outcome measures are well standardized, well validated, and include the most 10 important clinical aspects of asthma . These are considered as required outcome measures in the funding of NIH-initiated asthma clinical trials and large observational 10 studies . Supplemental asthma outcome measures are also well standardized and 2 10 somewhat well validated but inclusion in funded research is not mandatory . Emerging asthma outcome measures are those that are not yet well standardized and still require 10 further development and validation . The workshop recommended that core instruments be identified for each of the three domains - composite scores of asthma 10 control, asthma-related quality of life, and asthma symptoms . The Asthma Symptom Utility Index (ASUI) was identified as a supplemental outcome measure for assessing asthma symptoms. In the first part of this dissertation, we present a summary of some PRO instruments currently available for use in asthma clinical research. Next, we briefly describe the criteria for evaluating the psychometric properties of PRO instruments. Finally, we use the ASUI as an example to demonstrate the methodology for evaluating the psychometric properties of an instrument. 3 CHAPTER 1 PATIENT REPORTED OUTCOME MEASURES IN ASTHMA CLINICAL RESEARCH Typical asthma manifestations such as cough, wheeze, dyspnea, activity limitation, nocturnal awakening, and airway obstruction are characterized by marked intra-patient and inter-patient variability. Consequently, they require frequent monitoring to document their occurrence and to assess their impact on patients. In asthma research, the methodical assessment of asthma symptoms, overall asthma control, and asthmarelated quality-of-life is best achieved with standardized instruments, such as asthma diaries or asthma questionnaires. Composite scores of asthma control Retrospective questionnaires for assessing asthma control usually combine 11, 12 several individual asthma related variables to generate a composite score . The goal is to reflect the degree to which all manifestations of asthma disease are seen by the patient as globally controlled by therapy. These manifestations include asthma symptoms, the amount of activity limitation, asthma-related quality of life, and lung function as measured by the peak expiratory flow rate (PEF) or the forced expiratory volume in the first second (FEV1) 9, 12 . In developing questionnaires to assess asthma control, the choice of items is generally based on expert opinion, focus group 11, 12 discussions, or both . Overall, there is no consensus regarding which specific items 4 should be included in questionnaires for assessing asthma control Control Questionnaire (ACQ) 12 11, 12 and the Asthma Control Test (ACT) . The Asthma 11 are well standardized, well validated, and have been extensively used in asthma clinical research for assessing asthma control in adults. Both questionnaires are recommended 13 by the NIH workshop as core outcome instruments for measuring asthma control . The Childhood Asthma Control Test (c-ACT) 14 is well validated in children aged 6-16 years and is also recommended as a core asthma outcome instrument in the pediatric 13 population . A list of some currently available questionnaires for assessing asthma control is presented on Table 1. Asthma-related quality of life The burden of asthma as measured by other objective methods does not always 5, 6 correlate with the patient’s perception of the impact of asthma on their quality of life . Asthma-related quality of life questionnaires are intended to assess the perceived 15 impact of asthma on the patient’s daily activities . They also assess the patient’s 15 perspective on the overall effectiveness of asthma disease management . Unfortunately, a majority of the currently available asthma-related quality of life instruments include many items that relate more to the domain of impairment (health status, functional status, emotional and social occupational functioning etc.) as opposed to how much such impairment matters to the patient 5 16-20 . Some currently available asthma quality of life questionnaires are presented on Table 1. Many of these questionnaires have not been extensively validated among low-income, low literacy, or 15 minority populations that are disproportionately affected by the burden of asthma . In light of these limitations, the NIH workshop does not recommend any particular asthma15 related quality of life instrument as a core outcome measure . Many of the validated asthma-related quality of life instruments are recommended as supplemental outcome 15 measures in asthma clinical research . 6 Table 1: Questionnaires for assessing asthma control and asthma-specific quality of life in adults and children Adult asthma control questionnaires ¶ 11 ACT- Asthma Control Test Pediatric asthma control questionnaires ¶ c-ACT – Childhood Asthma Control Test ¶ ¶ ACQ – Asthma Control Questionnaire 12 ¥ ATAQ – Asthma Therapy Assessment Questionnaire 53 53 ACQ – Asthma Control Questionnaire ¥ c-ATAQ – ATAQ for Children and Adolescents ¥ ¥ ¥ ¥ ¥ ¥ ¥ 54 ¥ ACSS – Asthma Control Scoring System PCAQ – Perceived Control of Asthma Questionnaire SASCQ – Seattle Asthma Severity and Control Questionnaire ACCI – Asthma Control and Communication Instrument   14 CAN – Asthma Control in Children Breathmobile – Breathmobile Assessment of Asthma Control PACT – Pediatric Asthma Control Tool TRACK – Test for Respiratory and Asthma Control in Kids   7 Table 1 (cont’d). Adult asthma quality of life questionnaires Pediatric asthma quality of life questionnaires 21 ¥ ABP- Asthma Bother Profile ¥ CHSA – Child Health Survey for 22 Asthma 23 ¥ AIS – Asthma Impact Survey ¥ AQLQ-S – Asthma Quality of Life 16, 24 §§ CHSA-C – Child version 22 ¥ PAQLQ – Pediatric Asthma Quality of 18 Questionnaire Life Questionnaire ¥ ¥ Mini-AQLQ – Mini-Asthma Quality of 19 PACQLQ – Pediatric Asthma Caregiver 17 Life Questionnaire Quality of Life Questionnaire ¥ §§ LWAQ – Living With Asthma Questionnaire Pictorial PAQLQ - Pictorial Quality of Life Measure for Young children with 26 Asthma ¥ ¥ 25 M-AQLQ-Marks – Modified Asthma 20 Quality of Life ¥ PedsQL 3.0 Asthma Module – Pediatric Quality of Life Inventory 3.0 Asthma 27 Module 28 ASF - Asthma Short Form ¶ - Recommended by the NIH workshop as a core instrument 15 §§ - Recommended by NIH workshop as emerging instrument 15 ¥ - Recommended by NIH workshop as supplementary instrument 8 15 Asthma symptoms The diagnosis of asthma in clinical practice is usually suggested by typical symptoms such as cough, chest tightness, dyspnea, wheeze, nocturnal awakening, and activity limitation. Asthma symptoms have considerable variability in frequency and intensity. Asthma symptoms can be recorded prospectively over a defined period of time (asthma diaries), or with the use of retrospective questionnaires completed during clinic or research visits. Prospectively recorded symptoms are often reported in asthma clinical research as symptom-days, symptom-free days, and number of symptom-days 30-33 per week or as a summary score . Retrospective questionnaires for asthma 34 symptoms usually report a summary score . However, unlike asthma control questionnaires which focus on the overall patient assessment of how their asthma disease is controlled, symptom questionnaires measure the severity and frequency of specific asthma symptoms. Asthma diaries In addition to information about asthma symptoms, diaries also include questions that inform about the occurrence of major asthma-related events such as exacerbations or loss of control (use of systemic corticosteroids for asthma, an unscheduled contact with a healthcare provider for asthma). A daily measure of lung function such as PEF 30 and FEV1 is often included in asthma diaries as well . Asthma diaries have the advantage of not being limited by patient recall. Also, information about major asthma- 9 related events are recorded and monitored in real time with an opportunity for timely intervention. The main concerns with paper diaries include incorrect data, incomplete or missing data, and fabricated data. Use of telephone-administered diaries, online diaries, or handheld electronic diaries can potentially mitigate some of these concerns. The Daytime Symptom Diary Scale and Nocturnal Diary Scale (daily diary) 33 is a 29 recommended supplemental outcome measure for use in adult asthma patients . The Pediatric Asthma Caregiver Diary (PACD) 32 is recommended as a supplemental 29 outcome instrument in children aged 2 to 5 years old . Another diary, the Electronic Pediatric Asthma Symptom Diary Scale (PASDS) 31 is recommended by the NIH 29 workshop as an emerging outcome measure in children aged 6 to 14 years old . Despite the availability of these diaries, many asthma researchers tend to use customized asthma diaries based on their specific research needs. Retrospective asthma symptom questionnaires The Asthma Symptom Utility Index (ASUI) 34 is the only available standardized retrospective questionnaire for asthma symptoms. It is a 10-item questionnaire designed to assess the frequency and severity of four asthma symptoms (cough, wheeze, dyspnea, and nocturnal awakening), as well as side effects from asthma medications over a two week recall period. The items are weighted according to patient preferences and the scoring is done using a calculation based on a previously derived 34 formula . The details on how the ASUI was developed and how the multiattribute 10 utility function was derived are provided in the appendix. The summary score of the ASUI is a continuous scale from 0 to 1 with lower scores indicating worse asthma symptoms. The ASUI is a good alternative in cases where researchers do not want to use daily asthma symptom diaries. Even though some items on the ASUI may overlap with 16, 19, 20 items on other asthma control and asthma quality of life questionnaires , composite scores obtained from these other instruments allocate the same weight to all items even though some symptoms may be more troublesome to patients than others. By integrating the patient’s preference for specific symptom states, the ASUI is ideal for use in cost utility analyses. The ASUI has emerged as the major asthma symptom scale 35-37 in multiple clinical trials . However, it was not recommended by the NIH workshop as a core asthma outcome measure because of limited characterization of the 29 psychometric properties . 11 CHAPTER 2 CRITERIA FOR EVALUATING THE PSYCHOMETRIC PROPERTIES OF PATIENT REPORTED OUTCOME INSTRUMENTS The methodology for evaluating a PRO instrument includes an assessment of its validity, reliability, and responsiveness 15, 38-40 . Validity The validity of a PRO instrument is the degree to which it actually measures what 15, 39, 40 it purports to measure . Several dimensions of validity can be assessed including: content validity, face validity, construct validity, criterion validity, and predictive validity. In the context of asthma, content validity is the extent to which all the components of the measured domain - asthma control, or asthma-related quality of life, or asthma symptoms - are comprehensively sampled by the items in the questionnaire, 15 as determined by a panel of experts . Face validity refers to the subjective determination by an expert panel that the 15 items included in the instrument seem appropriate and relevant . There is no quantitative measurement for face validity. Construct validity evaluates whether the instrument correlates with other instruments that measure the same domain or other domains of the disease in a 15 predictable manner . When the outcome measures are a continuous scale, as is the case with the ASUI, construct validity is calculated using Pearson’s or Spearman’s 12 15 correlation coefficients . Pearson’s correlation is best used for interval data that has a normal distribution. Pearson’s correlation between instruments A and B for a population sample with sample size n is derived from the following equation: ∑ ∑ ∑ ∑ ∑ ∗ ∑ ∑ Where X denotes values obtained from instrument A, and Y denotes the values obtained from instrument B at the same point in time. Nominal data of ordinal data such as data derived from most PRO instruments in asthma are nonparametric and therefore the Spearman’s rank correlation is the more appropriate method for determining correlation between results obtained from two instruments. Consider two instruments A and B with results on an ordinal scale, administered at the same time to n subjects. The Spearman’s rank correlation between instruments A and B will be determined by the following equation: ∑ ∑ ̅ ̅ ∑ Where i = paired score. The raw values Xi, and Yi, are converted to ranks xi, and yi. In the current PRO literature, there is no defined level of correlation that is accepted as the standard to define good construct validity. In general, most reports use a correlation of 11-14 greater than 0.5 to indicate good construct validity . Construct validity is also 15, 23, referred to as convergent validity, known-groups validity, or discriminant validity 41 . 13 Criterion validity is the degree of correlation of an instrument with the “gold standard” outcome measure and is measured by Pearson’s or Spearman’s correlation coefficients 12, 19, 42 . Predictive validity is the ability of different pre-specified levels of an instrument to predict the occurrence of a subsequent event, such as an asthma exacerbation, during 41 a defined period of time . This is determined by first grouping the sample into different levels and then calculating the relative risk or the odds of an outcome such as an exacerbation. Reliability Reliability of a PRO instrument refers the degree to which it is free from random measurement error 39, 40 . According to the reliability theory, the variance of scores 2 2 obtained from an instrument (σ X) is the sum of the variance of true scores (σ T) plus 2 the variance of errors of measurement (σ E). σ2X = σ2T + σ2E. If we assume that the variation in scores is due only to variability in true scores and variability in errors of measurement. The reliability coefficient is therefore defined as the ratio of the true variance to the total variance: ρ = σ2T/ σ2X. Or alternatively ρ = 1- σ2E / σ2X. 14 In practice, there is no way to observe or directly calculate the true score. The two methods that have been frequently used to estimate the reliability of PRO instruments 39, 40 are internal consistency reliability and test-retest reliability . Internal consistency reliability is a measure that is based on the correlations 40 between different items on the same questionnaire . It therefore assesses the extent to 40 which the individual items on the questionnaire measure the same construct . The Cronbach’s alpha statistic is generally used as a measure of internal consistency 39, 40 . 2 To calculate the Cronbach’s alpha coefficient (α), let σ X be the variance of the 2 observed total test scores and let σ Yi be the variance of component i for the current sample of persons. The Cronbach’s alpha coefficient is therefore defined by; 1 ∑ . Where K is the number of components (K-items). Values of Cronbach’s alpha above 39 0.70 are generally accepted to indicate a good internal consistency for an instrument . Test-re-test reliability or reproducibility measures the variation in measurements taken by the instrument during periods when the participants are assumed to have 39 remained stable . The intraclass correlation coefficient (ICC = ρ = σ2T/ σ2X) for continuous data and the Kappa coefficient (κ) for categorical data are used to assess 39 test-retest reliability . Test-retest reliability values of at least 0.70 are considered 15 minimally acceptable for the purpose of assessing the psychometric properties of PRO 39 measures . Responsiveness Responsiveness refers to the ability of an instrument to detect clinically important changes in the disease over a time period during which change is expected to have 15, 40 occurred . Responsiveness is a measure of the longitudinal validity of the instrument. It is calculated by determining the extent to which changes in questionnaire scores correlate with changes in other measures of the same construct in the 40 hypothesized direction over a defined period of time . In addition to determining that there is a statistically significant correlation in terms of questionnaire scores with other measures, there is need to determine a minimal level of change in the score on the instrument that is consistent with a real benefit or worsening. 16 CHAPTER 3 THE PSYCHOMETRIC PROPERTIES OF THE ASTHMA SYMPTOM UTILITY INDEX (ASUI): METHODS AND RESULTS The ASUI was developed in 1998 by Revicki et al. to measure the degree of 34 asthma symptoms and their impact on patients . It is a 10-item questionnaire designed to assess the frequency and severity of four asthma symptoms (cough, wheeze, dyspnea, and nocturnal awakening), as well as side effects from asthma medications over a two week recall period. The items are weighted according to patient 34 preferences and scored based on a previously derived formula . The summary score of the ASUI is a continuous scale from 0 to 1 with lower scores indicating worse asthma symptoms. The initial study by Revicki et al. showed that the ASUI had good reproducibility (intraclass correlation [ICC] = 0.74), good construct validity (Pearson’s correlation 34 coefficient with the AQLQ = 0.77), and good discriminant validity . Test-retest reliability, predictive validity, and responsiveness to change have not been previously determined. In addition, a minimal important difference (MID) for the ASUI is not yet established. Our objective was to assess the reliability, validity, and responsiveness to change of the ASUI in a population of adult asthma patients participating in two multicenter randomized trials. 17 Methods Data collection Patients Data from 1648 adult asthma participants (≥ 18 years) enrolled in two completed clinical trials conducted by the American Lung Association-Asthma Clinical Research Centers (ALA-ACRC) were included in this analysis 36, 43 . The Study of Inactivated Influenza Vaccine in Asthmatics (SIIVA) was a multicenter, randomized, double-blind, placebo-controlled, crossover trial to investigate the safety of the inactivated trivalent split-virus influenza vaccine in 2032 patients with asthma (age range, 3 to 64 years). It 43 was conducted between September 15 and November 30, 2000 . The patients were followed for 14 days after injection of either the influenza vaccine or placebo for a total of 28 days of follow-up for each participant. The study showed that the inactivated 43 trivalent split-virus influenza vaccine was safe in adults and children with asthma . The Study of Acid Reflux and Asthma (SARA) trial was a multicenter, randomized, placebo-controlled, double-blind trial conducted between October 2004 and May 2008, to test if six months of proton pump inhibitors (PPIs) (esomeprazole - Nexium, AstraZeneca) versus placebo improved asthma control 36 . It showed esomeprazole that did not improve asthma control in adults whose asthma was not well controlled on inhaled 36 corticosteroids . 18 Procedures The protocols for both studies were approved by institutional review boards in each of the participating centers and informed consent was obtained from each participant. The SARA trial was registered on ClinicalTrials.gov (NCT00069823); the SIIVA trial was conducted before NIH registration requirements were instituted. In the SIIVA trial, baseline demographic data and ASUI score were obtained for all participants (N=1236). Baseline spirometry was obtained in a subset of participants (N=704). After administration of either vaccine or placebo, participants were followed for 14 days during which they kept a daily asthma diary with information on asthma related symptoms, peak expiratory flow rate (PEF), healthcare utilization, and medication use. 43 After crossover, there was another 14 day follow-up period . The primary outcome measure was an exacerbation of asthma. In the SARA trial (N=412), baseline demographic data, spirometry, ASUI score, ACQ score, and the Mini AQLQ score were obtained. Patients were then randomized to either esomeprazole 40mg twice daily or placebo in addition to their inhaled corticosteroid regimen for a total of twenty-four weeks. During follow-up clinic visits that occurred every four weeks, ASUI scores, ACQ scores, and Mini AQLQ scores were obtained. Patients also kept an asthma diary that 36 was returned during each clinic visit . The primary outcome for the SARA trial was the rate of episodes of poor asthma control, as assessed on the basis of entries in asthma 36 diaries . An episode of poor asthma control (EPAC) was defined as the occurrence of any one of the following: 1) peak flow decrease of ≥30% from personal best, 2) increased rescue medication use above the average reported during the two weeks 19 before randomization, 3) new or increased oral corticosteroids for asthma, 4) an unscheduled use of healthcare for treatment of asthma. Assessments Construct validity Construct validity of the ASUI was assessed using data from the SARA trial by computing Spearman’s rank correlations (as described above) between baseline ASUI scores and (1) baseline ACQ scores, and (2) baseline Mini AQLQ scores. Known-groups validity Known-groups validity is a form of construct validity that involves categorizing the patients by one method of measurement and then using ANOVA methods to test the significance of differences in mean scores of another measurement method across the previously defined categories. The categories are usually based on a well-known classification scheme for that method of measurement. Known-groups validity was assessed using data from the SIIVA trial by comparing the mean baseline ASUI score across three categories of baseline percent predicted pre-bronchodilator forced expiratory volume in one second (FEV1) values: (1) less than 60%; (2) 60% to 79 %; (3) greater than or equal to 80%. These categories of FEV1 are based on approximate levels of asthma severity by lung function criteria as defined by the National Asthma Education and Prevention Program (NAEPP). The mean baseline ASUI score was also compared across a four point scale of ascending asthma severity among SIIVA 20 participants based on asthma medication use at baseline (1 = intermittent, 2 = mild, 3 = moderate, 4 = severe) 44 . Previous studies have shown that current asthma medication 45, 46 use complements other classifications of asthma severity . One-way ANOVA was used to test the significance of group differences in mean ASUI scores and the Tukey Honest Significant Difference (HSD) method was used for pairwise comparisons. Predictive validity Using data from the SIIVA trial, predictive validity was assessed by comparing the frequency of EPACs and asthma exacerbations over the next two weeks by quartiles of baseline ASUI. An asthma exacerbation was defined by new use of systemic corticosteroids or an unscheduled contact with a health care provider. The ASUI was classified by quartiles because on exploratory data analysis, baseline ASUI scores had a skewed distribution, such that a majority of patients had very high scores and fewer patients had low scores. Using the highest ASUI quartile as the reference, the relative risks (RR) for each quartile of baseline ASUI was then calculated. Reliability To evaluate the internal consistency reliability, the Cronbach’s α coefficient was calculated using baseline ASUI data from both SIIVA and SARA. Test-retest reliability was assessed by calculating the intraclass correlation coefficient (ICC) between the baseline ASUI score and the ASUI score at the next follow-up visit (four weeks apart) using data from participants in the SARA trial with stable asthma. Stable asthma was defined by the absence of an episode of poor 21 asthma control (EPAC) 36 , and no clinically significant change in the ACQ scores and Mini AQLQ scores (change less than 0.5 points). An EPAC was defined by the occurrence of at least one of the following events: an increase in rescue medication use for asthma symptoms by four or more inhalations per day over baseline, the occurrence of an unscheduled contact with a healthcare provider for asthma, use of systemic corticosteroids for asthma, or a decrease of 30% or more in morning PEF on 2 36 consecutive days, as compared with the patient’s best PEF during the run-in period . Responsiveness To determine the responsiveness to change of the ASUI, data from the SARA trial was used. For each participant, there were seven clinic visits each separated by four week intervals from randomization to the end of the study. During each clinic visit, ASUI, ACQ, and Mini AQLQ scores were obtained. All participants were instructed to keep a daily asthma diary that was returned to the clinic during subsequent visits. Linear regression with robust variance estimates and exchangeable correlation structure was used to compare mean changes in ASUI scores across groups of participants who 47 differed by ≥ 10% in percent predicted FEV1 values, and by 0.5 points in ACQ . The participant groups for each measure were derived as follows: 1. Percent predicted FEV1 values: Previous studies have used 10% as the cutoff for significant change in percent predicted FEV1based on findings among the chronic obstructive pulmonary disease (COPD) population 41, 48, 49 23, . The change in percent predicted FEV1 values was derived by 22 subtracting the baseline percent predicted FEV1 values from the follow-up percent predicted FEV1 and dividing by the baseline percent predicted value. Participants were categorized as better if the increase in percent predicted FEV1 was greater than or equal to 10%, worse if the percent predicted FEV1 decreased by greater than or equal to 10%, else they were categorized as unchanged. The mean changes in ASUI were then compared between the three groups. 2. ACQ scores: The minimal change in the ACQ score that indicates a clinically important difference to the patient (MID) has been determined to 12 be 0.5 points . Participants were categorized as better if the decrease in their ACQ score was greater than or equal to 0.5, worse if the increase in ACQ score was greater than or equal to 0.5, or unchanged if the change was between -0.5 and +0.5. The mean changes in the ASUI scores were then compared between the three groups: better, same, or worse. 23 Results Study populations A summary of the baseline characteristics of the study participants from the SIIVA and SARA trials is presented in Table 2. Data from 1236 study participants ages 18 years and older were included in the SIIVA trial. The mean age of these asthma patients was 42 years (SD, 12). A majority of them were female (75%), and White (67%). The SARA trial included 412 participants. The mean age of asthma patients in SARA was 41 years (SD, 13). The majority were again female (68%), fifty percent were White, and 38% were Black. 24 Table 2: Patient characteristics at baseline Characteristic SIIVA (n=1236) Age, year (SD) SARA (n= 412) 42 (12) 41 (13) 923 (75) 279 (68) White 828 (67) 205 (50) Black 281 (23) 157 (38) Hispanic 79 (6) 41 (10) Other 44 (4) 9 (2) ASUI↑ (0-1) 0.82 (0.18) 0.76 (0.16) ACQ↓ (0-7) NA 1.7 (0.9) Mini AQLQ↑ (1-7) NA 4.7 (1.2) Female (%) Race or ethnic group – no. (%) Asthma questionnaire scores, mean (SD) Pulmonary function, mean (SD)* SIIVA (n=704) SARA (n= 412) Pre-bronchodilator FEV1, Liters 2.6 (0.9) 2.4 (0.7) Pre-bronchodilator FEV1, % 83.4 (21) 76.7 (15) predicted *Pulmonary function available for 704 (57%) SIIVA participants ASUI: Asthma Symptom Utility Index. Scores on the ASUI range from 0 to 1, with higher scores indicating less severe asthma symptoms ACQ : Asthma Control Questionnaire. Scores on the ACQ range from 0 to 7, with lower scores indicating better asthma control and 0.5 as the minimal clinically important difference. Mini AQLQ : Mini Asthma Quality of Life Questionnaire. Scores on the Mini AQLQ range from 1 to 7, with higher scores indicating better quality of life and 0.5 as the minimal clinically important difference. FEV1: forced expiratory volume in 1 second 50 and the predicted values are from Hankinson et al. SARA: Study of Acid Reflux and Asthma. SIIVA: Safety of Inactivated Influenza Vaccine in Asthma 25 Construct validity of the ASUI Statistically significant Spearman’s correlations were observed between baseline ASUI scores and baseline ACQ scores (r = -0.79, P <0.001), and baseline Mini AQLQ scores (r = 0.59, P <0.001). The negative correlation with the ACQ is due the fact that unlike the ASUI, lower scores in the ACQ indicate good asthma control. Known-groups validity The F statistics from the overall one-way ANOVA tests were significant indicating that one group differed significantly from another. We then proceeded with pairwise comparisons using the Tukey Honest Significant Difference (HSD) method. The difference in mean ASUI scores between patients with poor baseline lung function (percent predicted FEV1 <60%) and those with good baseline lung function (percent predicted FEV1 ≥ 80%) was statistically significant (0.76 vs. 0.85, P <0.0001) [Tables 3 and 4]. This a positive linear relationship between the mean ASUI score and category of percent predicted FEV1 is also demonstrated in Figure 1. The difference in mean ASUI scores between patients with severe asthma and those with intermittent asthma was statistically significant (0.71 vs. 0.85, P <0.0001) [Tables 3 and 4]. This negative linear relationship between mean ASUI score and asthma severity based on asthma medication use at baseline is also demonstrated in Figure 2. 26 Table 3: Known-groups validity tests on mean ASUI scores at baseline [SIIVA trial] Number of Mean (SD) ASUI F statistic/P- participants score value (N) Percent predicted FEV1 12.5/<0.0001 ≥ 80% 405 0.85 (0.15) 60% to 79% 188 0.81 (0.17) 97 0.85 (0.18) < 60% Asthma severity based on baseline medication use 25.4/<0.0001 Intermittent 332 0.85 (0.14) Mild 453 0.83 (0.16) Moderate 298 0.80 (0.19) Severe 137 0.71 (0.20) ASUI: Asthma Symptom Utility Index, SIIVA: Safety of Inactivated Influenza Vaccine In Asthma, FEV1: Forced expiratory volume in the first second and the predicted 50 values are from Hankinson et al. 27 Table 4: Pairwise comparison of differences in mean ASUI score by categories of lung function and asthma severity [SIIVA trial] Predicted Comparison Difference in mean ASUI score 95%CI P-value Percent predicted FEV1 FEV1 <60% vs. FEV1 ≥ 80% -0.09 -0.13 -0.06 0.03 FEV1 <60% vs. 60% ≤ FEV1 ≤79% -0.05 -0.09 -0.007 0.06 Asthma severity based on baseline medication use Intermittent vs. Severe -0.14 -0.19 -0.10 0.02 Intermittent vs. moderate -0.02 0.08 -0.06 -0.09 Mild vs. Severe -0.12 -0.16 -0.08 0.02 Moderate vs. Severe -0.09 -0.13 -0.04 0.03 Pairwise comparisons of means were obtained using the Tukey Honest Significant Difference (HSD) method with difference in mean ASUI score the 95%CI reported. 28 Figure 1. Mean of ASUI with Standard Error by Categories of Percent Predicted FEV1     29 Figure 2. Mean of ASUI with Standard Error by Category of Asthma Severity 30 Predictive validity of the ASUI In the SIIVA data, an episode of poor asthma control (EPAC) was defined as the occurrence of any one of the following: 1) peak flow decrease of ≥30% from personal best, 2) increased rescue medication use above the average reported during the two weeks before randomization, 3) new or increased oral corticosteroids for asthma, 4) an unscheduled use of healthcare for treatment of asthma. The frequency of EPACs ranged from 13% in the highest quartile of ASUI to 39% in the lowest quartile of ASUI (table 5). Compared to patients in the highest quartile of baseline ASUI (score >0.95), SIIVA participants with a baseline ASUI score of ≤ 0.73 (lowest quartile) were 1.44 times more likely to experience an EPAC over the next two weeks (Table 5). There was a dose response relationship with increasing likelihood of an EPAC by decreasing quartile of baseline ASUI score (Table 5). The overall frequency of asthma exacerbations as defined by new or increased oral corticosteroid use or an unscheduled healthcare contact for asthma, was low (4-11%) across all four groups. Participants in the lowest quartile were 8% more likely to experience an exacerbation compared to those in the highest quartile (Table 5). 31 Table 5: Predictive validity of the ASUI: relationship to frequency of EPACs and exacerbations. [SIIVA trial] EPACS* Frequency Relative risk Frequency Relative risk (%) Quartiles of ASUI Exacerbations** (%) (RR) (95%CI) (RR) (95% CI) >0.95 (n=321) 13 Reference = 1 4 Reference = 1 0.87 to 0.95 (n= 263) 24 1.13 (1.05-1.23) 4 1.00 (0.96-1.03) 0.74 to 0.86 (n= 290) 30 1.24 (1.13-1.35) 7 1.03 (0.99-1.07) ≤ 0.73 (n=304) 40 1.44 (1.30-1.60) 11 1.08 (1.03-1.13) EPAC: Episodes of Poor Asthma Control. ASUI: Asthma Symptom Utility Index *EPACs: Any one of the following: 1) peak flow decrease of ≥30% from personal best, 2) increased rescue medication use above the average reported during the two weeks before randomization, 3) new or increased oral corticosteroids for asthma, 4) an unscheduled use of healthcare for treatment of asthma ** Exacerbations: Any one of the following: 1) new or increased oral corticosteroids for asthma, 2) an unscheduled healthcare encounter for treatment of asthma 32 Reliability of the ASUI The internal consistency reliability (Cronbach’s alpha) was 0.74 (n = 1223) in the SIIVA sample and 0.71 (n = 413) in the SARA sample indicating that all the individual items that comprise the ASUI do in fact measure the same construct. Test-retest reliability (intra class correlation coefficient) among the 13% (n=55) participants in the SARA trial who had stable asthma over a four week period was 0.76 indicating that the ASUI had good reproducibility over time. Responsiveness of the ASUI The ASUI demonstrated good responsiveness to change. As hypothesized, ASUI scores improved significantly among participants whose percent predicted FEV1 improved by greater than or equal to 10% compared to those with no change in percent predicted FEV1 (Table 6). Likewise, there was a significant change in ASUI scores (in the hypothesized direction) when ACQ scores changed by more than the minimally important difference of 0.5 points compared to when the ACQ scores were unchanged (Table 6). After adjusting for visit period, the GEE-based repeated measures analysis revealed that there was a statistically significant difference in mean change in ASUI scores between visits with an EPAC in the prior period and those without an EPAC (P<0.0001) [Table 7]. Similar significant differences were seen for all four EPAC components (Table 7). 33 Table 6: Mean changes in ASUI scores as a function of changes in percent predicted FEV1 values and ACQ scores (Baseline vs. end of follow-up) [SARA trial] N (pts.)** Mean change in ASUI (95% CI) P value Changes in percent predicted FEV1 Better (ΔFEV1 ≥ 10%) Same (-10% ≤ ΔFEV1 <10%) 213 (163) 0.05 (0.03, 0.07) 1657 0.01 (0.00, 0.01) (384) Worse (ΔFEV1 ≤-10%) 222 (170) -0.03 (-0.05, -0.02) <0.0001 Changes in ACQ* (ΔACQ ) Better ΔACQ ≥ -0.5 Same +0.5 > ΔACQ < -0.5 Worse ΔACQ ≥ + 0.5 442 (366) 0.15 (0.14, 0.17) 1254 (369) 0.00 (-0.00, 0.01) 372 (297) -0.15 (-0.16, -0.13) <0.0001 Note: MID for ACQ is 0.5 points ACQ: Asthma Control Questionnaire, ASUI: Asthma Symptom Utility Index, FEV1: Forced expiratory volume in the first second *ACQ: Better = decrease by ≥ 0.5 points; same = change by <0.5 points; Worse = increase by ≥ 0.5 points. **N denotes frequency of events and “pts.” indicates the number of patients GEE based repeated measures analysis with independent working correlation. 34 Table 7: Mean Difference is ASUI scores by EPAC status for all visits [SARA trial] ASUI #EPAC (% visits) Mean 95% CI P-value* difference* Any EPAC 750(35) 0.09 0.01, 0.10 <0.0001 Peak flow drop 426(20) 0.08 0.06, 0.10 <0.0001 Rescue inhalers 414(19) 0.10 0.01, 0.12 <0.0001 Oral steroid use 168(8) 0.16 0.12, 0.20 <0.0001 Urgent care contact 103(6) 0.15 0.11, 0.20 <0.0001 EPAC components 2,155 follow-up visit periods evaluated among 390 participants EPAC: Episodes of Poor Asthma Control. ASUI: Asthma Symptom Utility Index CI: Confidence Interval *Mean difference in scores between visits with an EPAC in the prior period and those without an EPAC, adjusted for visit period; GEE based repeated measures analysis with independent correlation. 35 CHAPTER 4 DISCUSSION We have presented a summary of some PRO instruments used in asthma clinical research. We then described the methodology for evaluating the psychometric properties of PRO instruments. Finally, we used the Asthma Symptom Utility Index (ASUI) as an example to demonstrate the procedures and methods used to evaluate the psychometric properties of an instrument. Our results show that the ASUI, an asthma-specific utility index designed to summarize the frequency and severity of selected asthma-related symptoms 34 based on two week retrospective recall by the patients, has good psychometric properties in 34 two groups of asthma patients. We confirmed the findings of Revicki et al. that ASUI 34 scores have an acceptable construct validity and discriminant validity . We also showed that baseline ASUI scores have good predictive validity. Patients with the lowest baseline ASUI scores were 40% more likely to have an EPAC and 8% more likely to have an asthma exacerbation over the next two weeks compared to those with the highest baseline ASUI scores. The ability to predict EPACs and asthma exacerbations suggests that the ASUI could be useful in guiding asthma therapy in clinical practice. In addition, we have shown that the ASUI is responsive to changes in asthma control. 36 Some items on the ASUI are similar to those on other questionnaires that assess asthma control and asthma-related quality of life 11, 12, 16, 20, 23, 41, 51 . Asthma control as measured by the ACQ is a normative construct developed by physicians and 12, 41 validated against physician assessment of asthma . Asthma-related quality of life instruments measure the extent to which asthma symptoms interfere with physical functioning in daily life 16, 19, 20 . The ASUI focuses on the frequency and severity of asthma symptoms. In addition, it is a patient weighted, preference based scale and thus 34 suitable for economic analyses that incorporate disability-adjusted life years . A key strength of this analysis is that data from two separate trials conducted at different time periods, with different entry criteria, and different interventions were used. However, because of the differing study designs, we were not able to perform the same validation analyses in both trials. In both trials, we showed similar internal consistency reliability for the ASUI. This confirmed the findings of the original study by Revicki et al. 34 It was necessary to use data from both studies in order to fully characterize the psychometric properties of the ASUI. The SIIVA study included asthma patients with a 43 wide range of clinical severity but ASUI was only administered at baseline , so testretest reliability and longitudinal validity could not be assessed in this study population. Also patients in the SIIVA study had only 28 days of follow-up data, which may have limited the number of events, especially exacerbations. Nonetheless, because of the large population, we were able to demonstrate predictive validity based on the frequency of EPACS. In addition, ACQ scores and Mini AQLQ scores were not 37 available for the SIIVA study participants so construct validity could not be determined. The SARA trial which included multiple ASUI measurements provided a good 36 opportunity to determine responsiveness . Generalizability to other patient populations is an important aspect of health utility 40 tools . The initial development and validation of the ASUI included asthma patients 34 who were relatively well educated and mostly White . The current scoring of the ASUI in the United States is based on the multi-attribute utility function that was originally derived by Revicki et al. 34 . However, the preference weights, utility functions and 34 mean ASUI scores derived in the United States differ significantly from those obtained 52 in other countries in Europe (Italy, France, and the United Kingdom) . Nonetheless, the relative rank ordering of the mean ASUI scores in patients with asthma symptoms is 52 maintained . In the current analysis, we included participants with a good representation of women and racial minorities 36, 43 . Data on education level or socioeconomic status was not available. However, many of the study sites were located in large urban centers in the United States that generally serve patients of low socioeconomic status. Currently, the use of the ASUI has been largely limited to large epidemiological studies and clinical trials. The ASUI can be complex to calculate for an individual patient in the clinical setting compared to the ACT and this will limit its routine use in clinical practice. However, computers can address this problem. The ASUI has been used as a secondary outcome measure is several asthma clinical trials35, 36, 43. It is typically used together with other asthma questionnaires 38 including the ACT, ACQ, MiniAQLQ etc. as well as asthma diaries. These have mostly been negative studies in terms secondary outcomes. Use of the ASUI to practically calculate disability-adjusted life years (DALYs) has not previously been performed. In summary, we demonstrated that the ASUI has good psychometric properties among adult asthmatics when used in the context of clinical trials in the United States. This work has been accepted for publication in the Journal of Allergy and Clinical Investigation (JACI). 39 APPENDIX 40 I. Copy of ASUI used in SIIVA and SARA trials Asthma Symptom Utility Index (Self-administered) 1. How, many days were you bothered by coughing in the past 2 weeks (check only one) (1) Not at all → Skip to item 3, (2) 1-3 days, (3) 4-7 days, (4) 8-14 days 2. On average, how severe was your cough during the past 2 weeks (check only one) (1) Mild, (2) Moderate, (3) Severe 3. How many days were you bothered by wheezing during the past 2 weeks (check only one) (1) Not at all → Skip to item 5, (2) 1-3 days, (3) 4-7 days, (4) 8-14 days 4. On average, how severe was your wheezing during the past 2 weeks ( check only one) (1) Mild, (2) Moderate, (3) Severe 5. How many days were you bothered by shortness of breath during the past 2 weeks (check only one) (1) Not at all → Skip to item 7, (2) 1-3 days, (3) 4-7 days, (4) 8-14 days 6. On average, how severe was your shortness of breath during the past 2 weeks (check only one) (1) Mild, (2) Moderate, (3) Severe 7. How many days were you awakened at night by your asthma during the past two weeks (check only one) (1) Not at all → Skip to item 9, (2) 1-3 days, (3) 4-7 days, (4) 8-14 days 8. On average, how much of a problem was being awakened at night during the past 2 weeks (check only one) (1) Mild, (2) Moderate, (3) Severe 9. How many days were you bothered by side effects of asthma medications during the past 2 weeks (check only one) (1) Not at all → Stop, (2) 1-3 days, (3) 4-7 days, (4) 8-14 days 10. On average, how severe were the side effects during the past 2 weeks (check only one) (1) Mild, (2) Moderate, (3) Severe 41 I. Original method used to derive the Multi-symptom states that were included in the final equation for calculating the ASUI TABLE 8-- Mean VAS Preferences, SG Utilities, and ASUI-Derived Utilities for Multi-symptom States VAS‡ Mean (SD) SG Utility§ Mean (SD) ASUI Mean Severe cough 0.26 (0.25) 0.69 (0.21) 0.70 Severe wheeze 0.24 (0.25) 0.66 (0.21) 0.67 Severe dyspnea 0.16 (0.21) 0.60 (0.25) 0.61 Severe awaken at night 0.25 (0.25) 0.67 (0.25) 0.68 Severe medication side effects 0.25 (0.26) 0.66 (0.23) 0.67 Moderate cough and dyspnea (1-3 d) 0.31 (0.25) 0.67 (0.23) 0.73 Moderate cough and wheeze (4-7 d) 0.22 (0.20) 0.62 (0.24) 0.56 Severe cough; moderate wheeze and dyspnea (1-3 d) 0.20 (0.20) 0.60 (0.21) 0.54 Severe cough; moderate wheeze, dyspnea, and awaken at night (1-3 d) 0.17 (0.18) 0.59 (0.24) 0.50 State Corner states* † Multisymptom states Severe cough, dyspnea, and awaken at 0.08 (0.12) 0.46 (0.27) 0.31 night; moderate wheeze and side effects (1-3 d) ‡ The VAS (visual analog scale) and SG (standard gamble) utility scores are on a 0 to 1 scale with higher scores indicating better health. § ASUI-derived utility score based on multiattribute utility functions (see text for details). * One symptom is described as severe for 8 to 14 days and remaining symptoms are not present. †For multisymptom states if a symptom is not mentioned, it is described as mild in the health state. 39 Obtained from Revicki et al. 42 II. Applying the Multiattribute Utility function to a theoretical asthma patient TABLE 9 -- Multiattribute utility function on worst possible symptom state to no symptoms scale for ASUI* Symptom (Attribute) Medication Side Effects S5 Cough S1 Wheeze S2 Dyspnea S3 Awaken at Night S4 1.0 1.0 1.0 1.0 1.0 2 Mild, 1-3 0.985 0.962 0.946 0.955 0.970 3 Mild, 4-7 0.963 0.940 0.920 0.931 0.954 4 Mild, 8-14 0.935 0.913 0.885 0.899 0.930 5 Moderate, 1-3 0.955 0.913 0.892 0.909 0.924 6 Moderate, 4-7 0.920 0.886 0.860 0.880 0.900 7 Moderate, 8-14 0.875 0.851 0.818 0.845 0.862 8 Severe, 1-3 0.863 0.810 0.771 0.821 0.824 9 Severe, 4-7 0.813 0.772 0.729 0.781 0.789 Level, d 1 None 10 Severe, 8-14 0.751 0.729 0.681 0.734 0.730 *Calculating ASUI scores is as follows: ASUI = 1.200 × (S1 × S2 × S3 × S4 × S5) - 0.200. For example, if a person is classified as level 3 on cough (S1 ), level 4 on wheeze (S2 ), level 2 on dyspnea (S3 ), level 3 on awaken at night (S4 ), and level 2 on medication side effects (S5 ), his or her ASUI score equals (1.200 [0.963 × 0.913 × 0.946 × 0.931 × 0.970] - 0.200) or 0.701. 39 Obtained from Revicki et al.   43 REFERENCES 44 REFERENCES 1. Tepper RS, Wise RS, Covar R, Irvin CG, Kercsmar CM, Kraft M, Liu MC, O'Connor GT, Peters SP, Sorkness R, et al. Asthma outcomes: Pulmonary physiology. J Allergy Clin Immunol 2012 3;129(3, Supplement):S65-87. 2. Szefler SJ, Wenzel S, Brown R, Erzurum SC, Fahy JV, Hamilton RG, Hunt JF, Kita H, Liu AH, Panettieri Jr. RA, et al. Asthma outcomes: Biomarkers. J Allergy Clin Immunol 2012 3;129(3, Supplement):S9-S23. 3. Fuhlbrigge A, Peden D, Apter AJ, Boushey HA, Camargo Jr. CA, Gern J, Heymann PW, Martinez FD, Mauger D, Teague WG, et al. Asthma outcomes: Exacerbations. J Allergy Clin Immunol 2012 3;129(3, Supplement):S34-48. 4. Akinbami LJ, Sullivan SD, Campbell JD, Grundmeier RW, Hartert TV, Lee TA, Smith RA. Asthma outcomes: Healthcare utilization and costs. J Allergy Clin Immunol 2012 3;129(3, Supplement):S49-64. 5. Jenkins CR, Thien FCK, Wheatley JR, Reddel HK. Traditional and patient-centred outcomes with three classes of asthma medication. European Respiratory Journal 2005 July 01;26(1):36-44. 6. Carranza Rosenzweig JR, Edwards L, Lincourt W, Dorinsky P, ZuWallack RL. The relationship between health-related quality of life, lung function and daily symptoms in patients with persistent asthma. Respir Med 2004 Dec;98(12):1157-65. 7. Patrick DL, Guyatt GH, Acquadro C. Patient-reported outcomes. In: Cochrane handbook for systematic reviews of interventions. John Wiley & Sons, Ltd; 2008; 2008. . 8. Expert panel report 3 (EPR-3): Guidelines for the diagnosis and management of Asthma–Summary report 2007. J Allergy Clin Immunol 2007 11;120(5, Supplement 1):S94-S138. 9. Reddel HK, Taylor DR, Bateman ED, Boulet L, Boushey HA, Busse WW, Casale TB, Chanez P, Enright PL, Gibson PG, et al. An official american thoracic Society/European respiratory society statement: Asthma control and exacerbations: Standardizing endpoints for clinical asthma trials and clinical practice. Am J Respir Crit Care Med 2009 July 1;180(1):59-99. 10. Busse WW, Morgan WJ, Taggart V, Togias A. Asthma outcomes workshop: Overview. J Allergy Clin Immunol 2012 3;129(3, Supplement):S1-8. 45 11. Nathan RA, Sorkness CA, Kosinski M, Schatz M, Li JT, Marcus P, Murray JJ, Pendergraft TB. Development of the asthma control test: A survey for assessing asthma control. J Allergy Clin Immunol 2004 1;113(1):59-65. 12. Juniper E, O'Byrne P, Guyatt G, Ferrie P, King D. Development and validation of a questionnaire to measure asthma control. European Respiratory Journal 1999 October 01;14(4):902-7. 13. Cloutier MM, Schatz M, Castro M, Clark N, Kelly HW, Mangione-Smith R, Sheller J, Sorkness C, Stoloff S, Gergen P. Asthma outcomes: Composite scores of asthma control. J Allergy Clin Immunol 2012 3;129(3, Supplement):S24-33. 14. Liu AH, Zeiger R, Sorkness C, Mahr T, Ostrom N, Burgess S, Rosenzweig JC, Manjunath R. Development and cross-sectional validation of the childhood asthma control test. J Allergy Clin Immunol 2007 4;119(4):817-25. 15. Wilson SR, Rand CS, Cabana MD, Foggs MB, Halterman JS, Olson L, Vollmer WM, Wright RJ, Taggart V. Asthma outcomes: Quality of life. J Allergy Clin Immunol 2012 3;129(3, Supplement):S88-S123. 16. Juniper EF, Buist AS, Cox FM, Ferrie PJ, King DR. Validation of a standardized version of the asthma quality of life questionnaire. Chest 1999 May;115(5):1265-70. 17. Juniper EF, Guyatt GH, Feeny DH, Ferrie PJ, Griffith LE, Townsend M. Measuring quality of life in the parents of children with asthma. Qual Life Res 1996 Feb;5(1):27-34. 18. Juniper EF, Guyatt GH, Feeny DH, Ferrie PJ, Griffith LE, Townsend M. Measuring quality of life in children with asthma. Qual Life Res 1996 Feb;5(1):35-46. 19. Juniper E, Guyatt G, Cox F, Ferrie P, King D. Development and validation of the mini asthma quality of life questionnaire. Eur Respir J 1999 July 1;14(1):32-8. 20. Marks GB, Dunn SM, Woolcock AJ. A scale for the measurement of quality of life in adults with asthma. J Clin Epidemiol 1992 5;45(5):461-72. 21. Hyland ME, Ley A, Fisher DW, Woodward V. Measurement of psychological distress in asthma and asthma management programmes. Br J Clin Psychol 1995 Nov;34 ( Pt 4)(Pt 4):601-11. 22. Asmussen L, Olson LM, Grant EN, Fagan J, Weiss KB. Reliability and validity of the children's health survey for asthma. Pediatrics 1999 December 01;104(6):e71-. 23. Schatz M, Zeiger RS, Yang S, Chen W, Kosinski M. Further validation and definition of the psychometric properties of the asthma impact survey. J Allergy Clin Immunol 2011 7;128(1):44,49.e1. 46 24. Juniper EF, Guyatt GH, Epstein RS, Ferrie PJ, Jaeschke R, Hiller TK. Evaluation of impairment of health related quality of life in asthma: Development of a questionnaire for use in clinical trials. Thorax 1992 February 01;47(2):76-83. 25. Hyland ME. The living with asthma questionnaire. Respir Med 1991 Sep;85 Suppl B:13,6; discussion 33-7. 26. Everhart RS, Fiese BH. Development and initial validation of a pictorial quality of life measure for young children with asthma. J Pediatr Psychol 2009 Oct;34(9):966-76. 27. Josie KL, Greenley RN, Drotar D. Health-related quality-of-life measures for children with asthma: Reliability and validity of the children's health survey for asthma and the pediatric quality of life inventory 3.0 asthma module. Annals of Allergy, Asthma & Immunology 2007 3;98(3):218-24. 28. Bayliss MS, Espindle DM, Buchner D, Blaiss MS, Ware JE. A new tool for monitoring asthma outcomes: The ITG asthma short form. Qual Life Res 2000;9(4):451-66. 29. Krishnan JA, Lemanske Jr. RF, Canino GJ, Elward KS, Kattan M, Matsui EC, Mitchell H, Sutherland ER, Minnicozzi M. Asthma outcomes: Symptoms. J Allergy Clin Immunol 2012 3;129(3, Supplement):S124-35. 30. Juniper EF, O'Byrne PM, Ferrie PJ, King DR, Roberts JN. Measuring asthma control . clinic questionnaire or daily diary? Am J Respir Crit Care Med 2000 October 1;162(4):1330-4. 31. Santanello NC, Davies G, Galant SP, Pedinoff A, Sveum R, Seltzer J, Seidenberg BC, Knorr BA. Validation of an asthma symptom diary for interventional studies. Archives of Disease in Childhood 1999 May 01;80(5):414-20. 32. Santanello NC, DeMuro-Mercon C, Davies G, Ostrom N, Noonan M, Rooklin A, Knorr B. Validation of a pediatric asthma caregiver diary. J Allergy Clin Immunol 2000 11;106(5):861-6. 33. Santanello N, Barber B, Reiss T, Friedman B, Juniper E, Zhang J. Measurement characteristics of two asthma symptom diary scales for use in clinical trials. European Respiratory Journal 1997 March 01;10(3):646-51. 34. Revicki DA, Leidy NK, Brennan-Diemer F, Sorensen S, Togias A. Integrating patient preferences into health outcomes assessment: The multiattribute asthma symptom utility index. Chest 1998 Oct;114(4):998-1007. 35. Tiotropium step-up therapy in asthma. N Engl J Med 2011 02/10; 2011/12;364(6):578-9. 47 36. American Lung Association Asthma Clinical Research Centers, Mastronarde JG, Anthonisen NR, Castro M, Holbrook JT, Leone FT, Teague WG, Wise RA. Efficacy of esomeprazole for treatment of poorly controlled asthma. N Engl J Med 2009 Apr 9;360(15):1487-99. 37. Castro M, Rubin AS, Laviolette M, Fiterman J, De Andrade Lima M, Shah PL, Fiss E, Olivenstein R, Thomson NC, Niven RM, et al. Effectiveness and safety of bronchial thermoplasty in the treatment of severe asthma: A multicenter, randomized, double-blind, sham-controlled clinical trial. Am J Respir Crit Care Med 2010 January 15;181(2):116-24. 38. Guyatt GH, Osoba D, Wu AW, Wyrwich KW, Norman GR, Clinical Significance Consensus Meeting Group. Methods to explain the clinical significance of health status measures. Mayo Clinic Proceedings 2002 April 01;77(4):371-83. 39. Lohr KN. Assessing health status and quality-of-life instruments: Attributes and review criteria. Qual Life Res 2002 May;11(3):193-205. 40. Terwee CB, Bot SDM, de Boer MR, van der Windt DAWM, Knol DL, Dekker J, Bouter LM, de Vet HCW. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol 2007 1;60(1):34-42. 41. Schatz M, Sorkness CA, Li JT, Marcus P, Murray JJ, Nathan RA, Kosinski M, Pendergraft TB, Jhingran P. Asthma control test: Reliability, validity, and responsiveness in patients not previously followed by asthma specialists. J Allergy Clin Immunol 2006 3;117(3):549-56. 42. Juniper EF. Assessing asthma control. Curr Allergy Asthma Rep 2007 Sep;7(5):3904. 43. The safety of inactivated influenza vaccine in adults and children with asthma. N Engl J Med 2001 11/22; 2011/12;345(21):1529-36. 44. McCoy K, Shade DM, Irvin CG, Mastronarde JG, Hanania NA, Castro M, Anthonisen NR. Predicting episodes of poor asthma control in treated patients with asthma. J Allergy Clin Immunol 2006 12;118(6):1226-33. 45. Miller MK, Johnson C, Miller DP, Deniz Y, Bleecker ER, Wenzel SE. Severity assessment in asthma: An evolving concept. J Allergy Clin Immunol 2005 11;116(5):990-5. 46. Schatz M, Dombrowski MP, Wise R, Thom EA, Landon M, Mabie W, Newman RB, Hauth JC, Lindheimer M, Caritis SN, et al. Asthma morbidity during pregnancy can be predicted by severity classification. J Allergy Clin Immunol 2003 8;112(2):283-8. 48 47. Zeger SL, Liang K. Longitudinal data analysis for discrete and continuous outcomes. Biometrics 1986 Mar.;42(1):pp. 121-130. 48. Schatz M, Kosinski M, Yarlas AS, Hanlon J, Watson ME, Jhingran P. The minimally important difference of the asthma control test. J Allergy Clin Immunol 2009 10;124(4):719,723.e1. 49. Cazzola M, MacNee W, Martinez FJ, Rabe KF, Franciosi LG, Barnes PJ, Brusasco V, Burge PS, Calverley PMA, Celli BR, et al. Outcomes for COPD pharmacological trials: From lung function to biomarkers. European Respiratory Journal 2008 February 01;31(2):416-69. 50. HANKINSON JL, ODENCRANTZ JR, FEDAN KB. Spirometric reference values from a sample of the general U.S. population. Am J Respir Crit Care Med 1999 January 1;159(1):179-87. 51. Juniper E, Guyatt G, Cox F, Ferrie P, King D. Development and validation of the mini asthma quality of life questionnaire. European Respiratory Journal 1999 July 01;14(1):32-8. 52. Flood EM, De Cock E, Mork AC, Revicki DA. Evaluating preference weights for the asthma symptom utility index (ASUI) across countries. Health Qual Life Outcomes 2006 Aug 15;4:51. 53. Bime C, Nguyen J, Wise RA. Measures of asthma control. Current Opinion in Pulmonary Medicine. 18(1):48-56, January 2012. 49