Search

BIO DESIGN

pISSN 2288-6982
eISSN 2288-7105

Article

Article

ARTICLE

Phys. Ther. Korea 2020; 27(3): 212-219

Published online August 20, 2020

https://doi.org/10.12674/ptk.2020.27.3.212

© Korean Research Society of Physical Therapy

Construct Validity of a Korean Version of the WHOQOL-BREF and EQ-5D Questionnaire Applied on Various Cancer Survivors Undergoing Palliative Rehabilitation Programs

Bong-sam Choi , PT, MPH, PhD

Department of Physical Therapy, College of Health and Welfare, Woosong University, Daejeon, Korea

Correspondence to: Bong-sam Choi
E-mail: bchoi@wsu.ac.kr
https://orcid.org/0000-0002-0165-4941

Received: June 29, 2020; Revised: July 16, 2020; Accepted: July 29, 2020

This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0)which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

Background: Although the original version of the health-related quality of life (HRQOL) questionnaires are found to be acceptable, the cross-culturally adapted versions may not be comparable to their original version.
Objects: To examine dimensionality and construct validity of two Korean versions of the brief version of the World Health Organization Quality of Life (WHOQOL-BREF) and EuroQOL-5 dimension (EQ-5D) questionnaires.
Methods: A total of 77 cancer survivors undergoing palliative rehabilitation programs from two rehabilitation institutes was recruited from April 16, 2018 to June 26, 2019. The WHOQOL- BREF and the EQ-5D were filled out by the various cancer survivors following a particular session of rehabilitation programs. The scores were analyzed with Winsteps Rasch analysis computer program using the rating scale model. Rasch fit statistics were used to determine the dimensionality and the item difficulty calibrations of WHOQOL-BREF and EQ-5D.
Results: All items except two, negative feeling, need treatment function and pain prevent activity (mean square [MnSq] = 2.42, 1.82 and 2.51, respectively), were found to be acceptable, while two items of the EQ-5D, anxiety/depression and self-care, were misfit (infit MnSq = 1.65 and 0.38, respectively). Item difficulty calibrations of WHOQOL-BREF match person ability measures (i.e., HRQOL) fairly well. However, the person ability distribution showed obvious ceiling effects for EQ-5D. All items of EQ-5D were appeared to be less challenged in comparison with those of WHOQOL-BREF.
Conclusion: Item-level analysis using the Rasch model supports the quality of culturally adapted items used to measure the HRQOL one exception; that is, whether or not to include misfit items as part of the HRQOL measurements. Additionally, cancer survivors undergoing palliative rehabilitation programs appear to have more of a tendency to view the EQ-5D items as being more challenging than the WHOQOL-BREF.

Keywords: Cancer survivors, Health related quality of life, Palliative medicine, Psychometrics

The latest worldwide cancer statistics estimated 9.6 million deaths in 2018 and reported an increasing burden of care resulting from various cancers. It is one of the most costly conditions of global population with the economic impact exceeding 1.16 trillion dollars in 2010 in the United States [1]. According to the national cancer control institute in Korea, the average 5-year survival rate of individuals with various cancer conditions increased about 69.4% in 2017 [2]. Despite potential improvements in the survivorship, these cancer survivors are generally susceptible to have some limitations in their health-related quality of life (HRQOL). Yet they are three times more likely to report their limitations during the course of survivorship [3].

In general, palliative rehabilitation program (PRP) controlling negative symptoms includes approaches primarily intended to enhance the HRQOL of the cancer survivors. This has been well evidenced in many peer-reviewed journals [3-7]. The primary goals of PRP are now acknowledged to include concept of the HRQOL addressing the palliative care of cancer survivors [8,9]. The HRQOL questionnaires often include global ratings of health status and multidimensional status of HRQOL. These measures often deal with a broad spectrum of health concepts and are intended to provide scores that are sensitive to all ranges of the concept being measured. By contrast, some measures are designed to assess the aspects of health status resulting from a particular pathology and to view the attribution of functional limitations to the specific condition [4,5].

Most commonly used HRQOL questionnaires, if not all, have often been noted for being psychometrically narrow, whereas the HRQOL is a multidimensional health-oriented concept encompassing aspects of health or health care, such as functioning and symptoms [8]. Therefore, the outcome measures require underlying constructs reflecting particular goals of the types of rehabilitation programs, such as improving the HRQOL before death, controlling symptoms and supporting other factors [10]. During the course of cancer survivorship, it is imperative to monitor how the programs impact the HRQOL and how optimally assess any variation of the HRQOL over time in suitable manner.

Of the most widely accepted HRQOL questionnaires, the brief version of the World Health Organization Quality of Life (WHOQOL-BREF) and EuroQOL-5 dimension descriptive system (EQ-5D) are considered to be optimal for cancer survivors in many peer reviewed journals in regards to construct validity and psychometric adequacy [7,11-13]. Cross-culturally adapted versions of them were validated in many peer-reviewed journals and proved to be reliable, also responsive [12,14,15]. Since these two questionnaires were simultaneously developed in many countries, such approaches offered intriguing a possibilities warranting the cross-cultural adaptation related validity of the measure. However, as demand for the measure grew in countries where no language version of the measure existed, it naturally developed many translated versions. Accordingly, in such cases, the most appropriate version has been used as a starting point for the adaptation and updated by many authors.

Numerous classical test theory (CTT)-based HRQOL measures for cancer survivors have been developed and cross-culturally adapted into other languages. With almost endless array of translated HRQOL measures attempted to maintain psychometrical properties after cross-cultural adaptation procedure, often there is little distinction between the versions of the measures [13-16]. While designed to assess on-going difficulties on the dimension of HRQOL, cross-culturally adapted versions of the measures often fail to maintain the dimensions referred to in the original version [6]. An evidence was obtained for a multidimensional perspective of the HRQOL in regards to construct validity. That is, the measurement structure accounts for construct validity in item responses either due to factors underlying the data or mistakenly treated latent traits they are intended to measure [6].

In addition, despite the myriad existing HRQOL measures, most investigators are often faced with a prevailing challenge of selecting an optimal measure. Although most CTT-based questionnaires have adequate psychometric properties, they may be insensitive either to a broad range of HRQOL level or to the actual variations that result from particular cancer experiences. One of the reasons is that these questionnaires are commonly developed to target the average person, hence the questionnaires are more likely to be sensitive at center than at both extremes in the ability range [17]. Consequently, these measures often demonstrate ceiling effects when these measures are administered to persons with low ability score and floor effects when administered to persons with high ability score [18-20].

The purpose of this study was to compare dimensionality and construct validity of two Korean version of WHOQOL-BREF and EQ-5D questionnaires.

1. Subjects

A total of 77 cancer survivors undergoing palliative rehabilitation programs from an oriental medicine hospital in Busan and a rehabilitation hospital in Daejeon, Republic of Korea were recruited from April 16, 2018 to June 26, 2019. Potential subjects consisted of all appropriate clients undergoing the palliative rehabilitation program at the participating sites during the period. All participants received detailed information on the present study including informed consent and potential conflict of interests of which non-participation in the study may not influence whether the palliative rehabilitation programs terminated. Subjects were asked to sign an informed consent and the Korean version of the WHOQOL-BREF and the EQ-5D approved by the Institutional Review Board of College of Health and Welfare, Woosong University (approval No. 1041549-190114-SB-70). The Korean versions of the WHOQOL-BREF and the EQ-5D [21,22] were administered (i.e, WHOQOL-BREF was followed by EQ-5D) upon the last entry of the first bout of rehabilitation program into physical therapy service and was subsequently requested from the survivors at discharge following the completion of the program. Of the participants who completed two measures, more than 35 percent were male (n = 35) and less than 65 percent (n = 42) were female with an average age of 52.9 ranged from 35 through 77. In addition, forty-six percent of the participants were diagnosed with breast cancer and fifty-four percent were diagnosed with various cancers (i.e., cancers on colon, lung, stomach, pancreas, kidney, prostate, liver, ovary, lymphatic system related, tonsil, bile duct and brain).

2. Data Analysis

Scores were analyzed with the Winsteps software program version 3.57.2 (Wisteps.com, Chicago, IL, USA) using a rating scale model [23,24]. Rasch fit statistics and item difficulty calibrations were examined to determine the dimensionality of the Korean version of the WHOQOL-BREF. The construct validity of the Korean version of the WHOQOL-BREF was visually examined using the person-item map. The Rasch model transforms raw scores into the estimate of person ability (i.e., the level of HRQOL) and item difficulty (i.e., more or less challenging items) in logits. All descriptive statistics were calculated using the SPSS software version 25.0 (IBM Co., Armonk, NY, USA).

The Winsteps software program provides goodness-of-fit statistics for each item and subject. These fit statistics were examined to detect items that did not fit the Rasch rating scale model criterion of dimensionality (or unidimensionality). The Infit and outfit mean square (MnSq) ≥ 1.4 and ≤ 0.6 and a standardized score greater than 2.0 were considered to be misfit, which is an indication that the particular item or survivor responded in unexpected ways [23]. The unexpected response indicated by the fit statistics suggests that the particular item is measuring another construct rather than the HRQOL. The program also generates a log odds unit (i.e., logit) scale to present the survivor’s level of HRQOL and item difficulty. The logit scale is based on the probability of getting success over the probability of getting failure on a response category of each item. The logical fashion of the analysis places test items along a continuum of the most to the least in difficulty. The hierarchical order of item difficulty provides a means to examine the construct validity of the instrument [23].

To determine how well the EQ-5D and the WHOQOL-BREF represent the construct of HRQOL, data were analyzed by exploratory factor analysis. A correlation matrix in which inter-correlations between individual test items was used respectively. The dimensionality of the matrix can be reduced by inspecting the items highly correlating with a group of other items. However, the matrix may represent low correlations with items outside of that group [25]. In a nutshell, these items with high correlations could measure the trait being measured well, which is called a “factor”. The obtained factor creates a new dimension visualizing classification axes along with test items can be plotted. This projection of the scores of the original test items on the factor leads to two concepts: factor score and loadings. Factor scores are the scores of a subject on a particular factor, while the loadings are the correlations of the original test items with a factor. The factor loadings are now especially useful in determining the substantive importance of a particular item to a factor [25]. A rotated factor analysis was used to compute maximizing the loadings from the original factor matrix with eigenvalues greater than 1. In addition, greater than 0.40 as a significant loading was used.

Rasch fit statistics were examined to determine the dimensionality of the Korean version of WHOQOL-BREF and EQ-5D. Using the criterion of misfit as MnSq > 1.4 and ZSTD > 2.0, the Table 1 presents item measures, infit/outfit statistics for the 26 WHOQOL-BREF items. All items, except the negative feeling, need treatment function and pain prevent activity items, show acceptable fit statistics (Table 1). For the EQ-5D items, all items, except the anxiety/depression and self-care items being slightly misfit, present acceptable fit statistics (Table 2).

Table 1 . Fit statistics of the WHOQOL-BREF in descending order of difficulty.

ItemsDifficulty (logits)Infit MnSqZSTDOutfit MnSqZSTD
WHOQOL 26 negative feeling0.762.425.32.555.7
WHOQOL 14 leisure activity0.700.92–0.40.92–0.4
WHOQOL 21 sex life0.450.89–0.40.980
WHOQOL 9 healthy environment0.440.95–0.21.000.1
WHOQOL 4 need treatment to function0.371.823.92.205.2
WHOQOL 3 pain prevent activity0.362.515.53.216.9
WHOQOL 18 work capacity0.340.64–2.20.63–2.1
WHOQOL 2 general health0.321.060.41.060.6
WHOQOL 23 living place0.150.86–0.70.86–0.7
WHOQOL 11 bodily appearance0.130.73–1.40.73–1.4
WHOQOL 12 enough money0.121.050.31.160.7
WHOQOL 5 enjoy life0.030.73–1.50.75–1.4
WHOQOL 10 energy for daily life–0.010.69–1.60.61–1.7
WHOQOL 16 sleep–0.041.291.61.311.7
WHOQOL 15 get around–0.100.70–1.90.67–2.0
WHOQOL 13 available information–0.140.76–1.40.75–1.4
WHOQOL 22 support from friend–0.160.9800.980
WHOQOL 17 satisfaction on daily life–0.220.69–1.80.69–1.8
WHOQOL 19 self-satisfaction–0.220.75–1.30.75–1.4
WHOQOL 20 personal relationship–0.230.78–1.30.77–1.3
WHOQOL 1 overall quality of life–0.260.85–0.70.87–0.7
WHOQOL 24 health service–0.280.84–0.80.81–1.0
WHOQOL 8 feel safe for daily life–0.470.71–1.60.72–1.5
WHOQOL 25 transport–0.540.80–1.00.79–1.1
WHOQOL 6 meaningful life–0.720.83–0.80.83–0.8
WHOQOL 7 ability to concentrate–0.780.83–0.90.83–0.8

WHOQOL-BREF, brief version of the World Health Organization Quality of Life; MnSq, mean square standardized residuals; ZSTD, Z score standardized.


Table 2 . Fit statistics of the EQ-5D in descending order of difficulty.

ItemsDifficulty (logits)Infit MnSqZSTDOutfit MnSqZSTD
EQ-5D 4 - pain/discomfort0.720.95–0.11.220.9
EQ-5D 3 - usual activities0.610.62–1.90.52–2.2
EQ-5D 1 - mobility0.060.82–0.61.040.2
EQ-5D 5 - anxiety/depression0.021.652.71.692.2
EQ-5D 2 - self-care–1.410.38–2.20.22–1.4

EQ-5D, EuroQOL-5 dimension; MnSq, mean square standardized residuals; ZSTD, Z score standardized.



To further examine the dimensionality of the WHOQOL-BREF, exploratory factor analysis was applied to the WHOQOL-BREF questionnaires. Table 3 presents factor loadings of the WHOQOL-BREF with a total of 7 constructs addressing HRQOL domains. Furthermore, the factor analysis revealed that a total of 22 items loaded on factor 1 and other items loaded either one or two factors (Table 3). Unlike the underlying 4 constructs originally designed, the factor analysis did not support the 4 constructs for the WHOQOL-BREF.

Table 3 . Factor loadings for the WHOQOL-BREF.

ItemsFactor loadings

1234567
WHOQOL1 - overall quality of life0.604–0.204–0.048–0.1200.3460.3990.098
WHOQOL2 - general health0.540–0.513–0.250–0.0130.262–0.166–0.035
WHOQOL3 - pain prevent activity–0.4950.2220.2200.3430.2960.1130.326
WHOQOL4 - need treatment to function–0.1840.2470.7850.094–0.0660.1630.043
WHOQOL5 - enjoy life0.7160.0160.360–0.0340.2870.1040.031
WHOQOL6 - meaningful life0.573–0.0520.599–0.3060.008–0.0620.158
WHOQOL7 - ability to concentrate0.5980.3060.1550.483–0.055–0.1620.011
WHOQOL8 - feel safe for daily life0.707–0.1450.0410.1770.2090.201–0.054
WHOQOL9 - healthy environment0.4830.511–0.2750.383–0.1500.285–0.004
WHOQOL10 - energy for daily life0.7540.0140.0160.2390.310–0.2220.000
WHOQOL11 - bodily appearance0.7050.3860.0530.0650.091–0.308–0.082
WHOQOL12 - enough money0.5360.528–0.1180.038–0.1540.274–0.110
WHOQOL13 - available information0.7020.2460.074–0.190–0.3010.206–0.222
WHOQOL14 - leisure activity0.605–0.1560.0590.005–0.0470.383–0.261
WHOQOL15 - get around0.778–0.232–0.1510.1340.0970.006–0.133
WHOQOL16 - sleep0.242–0.466–0.0780.199–0.3980.2200.546
WHOQOL17 - satisfaction on daily life0.760–0.355–0.0180.3580.145–0.0710.055
WHOQOL18 - work capacity0.826–0.0880.0290.2480.0550.136–0.045
WHOQOL19 - self satisfaction0.703–0.2570.366–0.079–0.235–0.265–0.013
WHOQOL20 - personal relationship0.6280.1800.1440.068–0.184–0.404–0.120
WHOQOL21 - sex life0.560–0.169–0.179–0.311–0.2030.027–0.372
WHOQOL22 - support from friend0.435–0.0120.237–0.6570.1000.1920.124
WHOQOL23 - living place0.5870.226–0.386–0.3100.002–0.0800.309
WHOQOL24 - health service0.5740.337–0.192–0.3590.158–0.2600.269
WHOQOL25 - transport0.6390.397–0.240–0.139–0.0120.0690.330
WHOQOL26 - negative feeling–0.5670.306–0.034–0.1260.5490.085–0.242

WHOQOL-BREF, brief version of the World Health Organization Quality of Life.



The person-item match analysis presents the relationship between the survivors’ various levels of HRQOL and item difficulty measures in logits for the two questionnaires. For the WHOQOL-BREF questionnaire, item difficulty calibrations were fairly well matched to the survivors’ levels of HRQOL throughout the whole range with some ceiling and floor effects. However, the EQ-5D showed a serious gap which was unable to effectively measure most cancer survivors at the medium and high levels of HRQOL. The items of the EQ-5D were only able to measure the individuals at the lower levels of HRQOL (Figure 1).

Figure 1. Person-item match of the Korean version of the WHOQOL-BREF. The graph represents the relationship among the survivors’ level of HRQOL and item difficulty calibrations in logits. Each “#” on the left side of each map represents two subjects, with the #s at the bottom of the scale representing individuals of low HRQOL level and #s at the top of the scale representing individuals with high HRQOL level. WHOQOL-BREF, brief version of the World Health Organization Quality of Life; HRQOL, health-related quality of life; EQ-5D, EuroQOL-5 dimension.

Construct validity of two well-established HRQOL questionnaires was tested using the Rasch-fit statistics and exploratory factor analysis. Overall, the Korean version of the WHOQOL-BREF showed acceptable construct validity except for few erratic items (i.e., negative feeling, need treatment function and pain prevent activity items of the WHOQOL-BREF, Anxiety/depression and self-care items of the EQ-5D with slight high/low fit). The exploratory factor analysis revealed that a total of 24 items loaded on factor 1 and other items loaded either one or two factors. Consequently, the WHOQOL-BREF showed nearly a single underlying construct. Furthermore, item difficulty hierarchy of the WHOQOL-BREF was fairly well matched to the HRQOL levels of the survivors throughout the whole range despite some ceiling and floor effects. However, item difficulty hierarchy of the EQ-5D showed a serious gap which was unable to measure all cancer survivors at the medium and high QOL levels. The items of the EQ-5D were only able to measure the individuals at the lower levels of HRQOL.

Items fit the Rasch model based on the probability of getting a rating on each item. For example, a cancer survivor with high level of HRQOL would be expected to have more difficulty on challenging items (i.e., WHOQOL-BREF item 26 through item 2 in Table 1) than less challenging items (i.e., WHOQOL-BREF item 7 through item 22 in Table 1). Similarly, a cancer survivor with low level of HRQOL would be expected to have even more difficulty on those challenging items than the survivors with high level of HRQOL. For the EQ-5D questionnaire with 5 items, the pain/discomfort item is the most challenging, while self-care item is the least challenging. Likewise, a survivor who is having difficulty on the self-care item would be expected to have more difficulty on the pain/discomfort item. However, these logical fashions are not demonstrated by the self-care item of the EQ-5D questionnaire as well as the negative feeling and pain prevent activity items of the WHOQOL-BREF (i.e., misfit items).

The World Health Organization (WHO) defines QOL as “individuals’ perception of their position in life in the context of the culture and value systems in which they live and in relation to their goals, expectations, standards and concerns” [26]. Although the multidimensional concept of QOL has increasingly become a focus in the fields of health care, it is not clearly defined. The WHOQOL-BREF, a brief version of QOL questionnaire developed by the WHO, provides insights into the impact of all aspects on QOL as well as on Health-Related QOL. In an effort to focus on the assessment of health and QOL, the term, health-related QOL is now widely accepted and used. The HRQOL, in general, can be impacted by the notion of which presence of particular disease does not inevitably mean poor QOL [6]. The implication of this is that various cancer survivors with such an experience of cancer related conditions may perceive their HRQOL as better than healthy individuals as long as palliative rehabilitation program goes successfully. Thus, it is advisable for clinicians to continually monitor their status of the HRQOL.

The construct of HRQOL questionnaire commonly changes and is unable to maintain the dimensions referred to in the original measures when a questionnaire is cross-culturally adapted [6]. Traditionally, investigators establish construct validity of a measure by correlating it with a number of other measures by inspecting the pattern of the correlations, in which the measure is associated with these variables in predictable ways [27]. However, a previous study, in a review of dimensionality problems with versions of the WHOQOL-BREF questionnaire, encouraged using item level analysis in evaluating dimensionality issues for validation procedure for the instrument [6,24,28]. The authors indicated that the nature of sample dependence often causes the dimensionality change which was explained as a dynamic construct model. That is, when translating a questionnaire into other languages, the questionnaire is more likely to be subject to change over time. To overcome this psychometric property limitation, item level analysis using item response theory is recommended to be used by focusing on the items of a questionnaire instead of the questionnaire as a whole [24]. This study focused on items of the two well-known HRQOL questionnaires and attempted to determine whether the latent structure accounted for a single construct purported to measure by the items can be confirmed.

The present study carries some inherent limitations because the Rasch analysis was applied to a possible multidimensional structure of the HRQOL and exploratory factor analysis was applied without optimal sample sizes. It is unknown whether the determination in the fit statistics and the factor loadings was optimal. In addition, the present study includes the misfit items for all analyses due to the items’ critical roles within the questionnaires. In addition, the study subjects with various stages of cancer related conditions were recruited from two institutions where different palliative rehabilitation programs were carried. These factors could make substantial differences towards the levels of HRQOL. Future research is needed to investigate the effects of excluding the problematic items to confirm a single construct of the HRQOL.

Item level analyses using the Rasch model (1-parameter item response theory model) supports some psychometric properties of culturally adapted versions of the WHOQOL-BREF and the EQ-5D except two erratic items for each questionnaire. Whether or not to include the misfit items as part of the two questionnaires, cancer survivors undergoing palliative rehabilitation programs appear to have more of a tendency to view the WHOQOL-BREF items as being more challenging than the EQ-5D.

This research is based on the support of 2020 Woosong University Academic Research Funding.

No potential conflict of interest relevant to this article was reported.

  1. World Health Organization. Cancer. World Health Organization [Internet]. Geneva: 2018 Sep 12 [cited 2020 Jul 12].
    Available from: https://www.who.int/news-room/fact-sheets/ detail/cancer.
  2. Kang DW, Lee EY, An KY, Min J, Jeon JY, Courneya KS. Associations between physical activity and comorbidities in Korean cancer survivors. J Cancer Surviv 2018;12(4):441-9.
    Pubmed CrossRef
  3. Oliveira IS, da Cunha Menezes Costa L, Fagundes FR, Cabral CM. Evaluation of cross-cultural adaptation and measurement properties of breast cancer-specific quality-of-life questionnaires: a systematic review. Qual Life Res 2015;24(5):1179-95.
    Pubmed CrossRef
  4. Caplan N, Robson H, Robson A, Kelly M, Wilkes G. Changes in health-related quality of life (EQ-5D) dimensions associated with community-based musculoskeletal physiotherapy: a multi-centre analysis. Qual Life Res 2018;27(9):2373-82.
    Pubmed KoreaMed CrossRef
  5. Efthymiadou O, Mossman J, Kanavos P. Differentiation of health-related quality of life outcomes between five disease areas: results from an international survey of patients. Int J Technol Assess Health Care 2018;34(5):498-506.
    Pubmed CrossRef
  6. Perera HN, Izadikhah Z, O'Connor P, McIlveen P. Resolving dimensionality problems with WHOQOL-BREF item responses. Assessment 2018;25(8):1014-25.
    Pubmed CrossRef
  7. Skevington SM, Lotfy M, O'Connell KA; WHOQOL Group. The World Health Organization's WHOQOL-BREF quality of life assessment: psychometric properties and results of the international field trial. A report from the WHOQOL group. Qual Life Res 2004;13(2):299-310.
    Pubmed CrossRef
  8. Kaasa S, Loge JH. Quality of life in palliative care: principles and practice. Palliat Med 2003;17(1):11-20.
    Pubmed CrossRef
  9. Desai MJ, Kim A, Fall PC, Wang D. Optimizing quality of life through palliative care. J Am Osteopath Assoc 2007;107(12 Suppl 7):ES9-14.
    Pubmed
  10. Avoine-Blondin J, Parent V, Lahaye M, Humbert N, Duval M, Sultan S. Identifying domains of quality of life in children with cancer undergoing palliative care: a qualitative study with professionals. Palliat Support Care 2017;15(5):565-74.
    Pubmed CrossRef
  11. Khan I, Morris S, Pashayan N, Matata B, Bashir Z, Maguirre J. Comparing the mapping between EQ-5D-5L, EQ-5D-3L and the EORTC-QLQ-C30 in non-small cell lung cancer patients. Health Qual Life Outcomes 2016;14:60.
    Pubmed KoreaMed CrossRef
  12. Payakachat N, Ali MM, Tilford JM. Can the EQ-5D detect meaningful change? A systematic review. Pharmacoeconomics 2015;33(11):1137-54.
    Pubmed KoreaMed CrossRef
  13. Skevington SM, Sartorius N, Amir M. Developing methods for assessing quality of life in different cultural settings. The history of the WHOQOL instruments. Soc Psychiatry Psychiatr Epidemiol 2004;39(1):1-8.
    Pubmed CrossRef
  14. Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol 1993;46(12):1417-32.
    Pubmed CrossRef
  15. Schmidt S, Bullinger M. Current issues in cross-cultural quality of life instrument development. Arch Phys Med Rehabil 2003;84(4 Suppl 2):S29-34.
    Pubmed CrossRef
  16. Escobar A, Trujillo-Martín Mdel M, Rueda A, Pérez-Ruiz E, Avis NE, Bilbao A. Cross-cultural adaptation, reliability and validity of the Spanish version of the Quality of Life in Adult Cancer Survivors (QLACS) questionnaire: application in a sample of short-term survivors. Health Qual Life Outcomes 2015;13:182.
    Pubmed KoreaMed CrossRef
  17. Jette AM, Haley SM, Ni P. Comparison of functional status tools used in post-acute care. Health Care Financ Rev 2003;24(3):13-24.
    Pubmed KoreaMed
  18. McHorney CA. Health status assessment methods for adults: past accomplishments and future challenges. Annu Rev Public Health 1999;20:309-35.
    Pubmed CrossRef
  19. Liang MH, Lew RA, Stucki G, Fortin PR, Daltroy L. Measuring clinically important changes with patient-oriented questionnaires. Med Care 2002;40(4 Suppl):II45-51.
    Pubmed CrossRef
  20. Speyer R, Kim JH, Doma K, Chen YW, Denman D, Phyland D, et al. Measurement properties of self-report questionnaires on health-related quality of life and functional health status in dysphonia: a systematic review using the COSMIN taxonomy. Qual Life Res 2019;28(2):283-96.
    Pubmed CrossRef
  21. Kim SH, Kim HJ, Lee SI, Jo MW. Comparing the psychometric properties of the EQ-5D-3L and EQ-5D-5L in cancer patients in Korea. Qual Life Res 2012;21(6):1065-73.
    Pubmed CrossRef
  22. Min SK, Kim KI, Lee CI, Jung YC, Suh SY, Kim DK. Development of the Korean versions of WHO Quality of Life scale and WHOQOL-BREF. Qual Life Res 2002;11(6):593-600.
    Pubmed CrossRef
  23. Bond TG, Fox CM. Applying the Rasch model: fundamental measurement in the human sciences. Mahwah: Lawrence Erlbaum; 2001;23-8.
    CrossRef
  24. Young TA, Rowen D, Norquist J, Brazier JE. Developing preference-based health measures: using Rasch analysis to generate health state values. Qual Life Res 2010;19(6):907-17.
    Pubmed CrossRef
  25. Ledesma RD, Valero-Mora P, Macbeth G. The Scree test and the number of factors: a dynamic graphics approach. Span J Psychol 2015;18:E11.
    Pubmed CrossRef
  26. World Health Organization. Programme on mental health: WHOQOL user manual. Geneva: World Health Organization; 1998;48-9.
  27. Westen D, Rosenthal R. Quantifying construct validity: two simple measures. J Pers Soc Psychol 2003;84(3):608-18.
    Pubmed CrossRef
  28. Danielsen AK, Pommergaard HC, Burcharth J, Angenete E, Rosenberg J. Translation of questionnaires measuring health related quality of life is not standardized: a literature based research study. PLoS One 2015;10(5):e0127050.
    Pubmed KoreaMed CrossRef