Patient- and person-reports on healthcare: preferences, outcomes, experiences, and satisfaction – an essay
© Klose et al. 2016
Received: 4 February 2016
Accepted: 7 May 2016
Published: 21 May 2016
With the shift towards patient-centered healthcare, patient- and person-reports of health-related factors, including outcomes, are seen as important determinants for evaluating and improving healthcare. However, a comprehensive, systematic categorization of patient- and person-reports is currently lacking in the literature. This study aims at developing a new classification system with well-defined constructs for patients’ and persons’ self-reports on health and healthcare. A literature research and evaluation by the Reported Health Outcomes (RHO) Group were used to develop this classification system. The new classification system includes patient- and person-reported preferences, outcomes, experiences, and satisfaction related to healthcare and health outcomes. Moreover, the most constitutive methods to measure these four categories – preferences, outcomes, experiences, and satisfaction – have been described in this article. Even though the value of patients’ and persons’ perspectives on healthcare is increasingly being recognized, its measurement and implementation presents a lasting challenge to researchers, clinicians, patients, and the general population.
KeywordsPatient reports Patient-reported outcomes/PRO Experiences Satisfaction Preference
Patient- and person-reports: differing outcomes and aspects
Patient-reported factors including patients’ adherence to treatment, satisfaction with treatment, and experienced health outcomes – as determined by patient preferences – are increasingly seen as important for clinical adherence and uptake of healthcare interventions . In this context, the terms patient-reported outcome (PRO) or patient-reported outcome measure (PROM) are frequently used to evaluate healthcare systems. However, PRO is a multifarious term and a comprehensible categorization is lacking, even though several methods are used to measure patient-reports. This study attempts to clarify the term ‘PRO’ and methods used for measuring PROs.
PRO is frequently used as an umbrella term for health outcomes that are directly and subjectively reported by patients . The Food and Drug Administration (FDA) defines PRO as “any report of the status of a patient’s health condition that comes directly from the patient, without interpretation of the patient’s response by a clinician or anyone else” . Hence, PROs measure health status from the patient’s perspective. PRO has also been defined more broadly, addressing information about health conditions and its management . Thus, definitions differ considerably and continue to be used inconsistently.
To clarify PRO content, several classification systems were developed (e.g., by Valderas and Alonso ), many of which are based on specific constructs despite an universal agreement that PRO constructs do not exist. Symptoms, functioning, general health perception, well-being, Health-Related Quality of Life (HRQoL), patient satisfaction, preferences, adherence to treatment and other elements of healthcare and its results have been defined in this context [2–4, 6–8]. However, the terms PRO and outcome are ambiguous, rendering it difficult to determine PRO constructs. Within healthcare, the term outcome refers to end results or consequences of treatment, interventions, or healthcare . However, it is debatable whether adherence to treatment can be regarded as a consequence of treatment. Adherence is an aspect of the therapy, process, and management involved in healthcare that helps to achieve the treatment’s results . Moreover, preference might not solely be seen as an outcome; individuals are often asked about their treatment or health status preferences without any prior experience. Furthermore, there is a fierce discussion on whether PROs should be self-reports or whether others’ assessments (e.g., close relatives) may be considered as PROs [6, 8]. Thus, the term PRO is used in different contexts and can be interpreted differently.
Based on this lack of clarity, we aimed to develop a new classification system for different aspects of health- and healthcare-related reports obtained directly from a patient or a person. A literature research, evaluated by a group of interdisciplinary researchers (health economics, public health and economics) – the Reported Health Outcomes (RHO) Group – was used to develop this classification system. Additionally, the most constitutive methods to measure the categories of the classification system are described here.
A new classification system for patient- and person-reports on health and healthcare
The various patient- and person-reported constructs can be classified into four categories: preferences, outcomes, experiences, and satisfaction, as shown in Fig. 1. Patient- and person-reported preferences (PRP) refer to preferences to choose or to prefer one item more than another (e.g., a therapy component). Through PRP, researchers can obtain information regarding the best option or treatment from the respondents’ point of view . The second category, patient- and person-reported outcomes (PRO), includes constructs that describe healthcare outcomes. These constructs focus on the patient’s or a person’s health status (e.g., functioning in daily life). The third category, patient- and person-reported experiences (PRE), considers constructs regarding patients’ and persons’ experiences assessed during and after healthcare (e.g., about the occurrence of specific events). Hence, in contrast to PRO, PRE describes reports that focus less on a patient’s and person’s health status while emphasize the external care process. Patient- and person-reported satisfaction (PRS) includes self-reported satisfaction pertaining to outcomes or elements of healthcare. In contrast to PRE, PRS involves evaluation. However, experiences and satisfaction are often used synonymously in literature .
Patient- and Person-Reported Preferences (PRP)
Preferences are defined as liking something better than another or tendency to choose . The term refers to the relative desirability of something or someone (e.g., healthcare technology), but is conceptualized differently across disciplines. In economics, the desirability of a good or service (e.g., healthcare) can be understood in terms of its utility, a measure of (expected) satisfaction gained from the consumption of a product or service. Thus, preferences are a result of relative subjective assessments of the costs and benefits of alternatives. Preference, utility, and value are often used interchangeable despite their differences [1, 19]. Preference is characterized as an umbrella term. The result of the preference measurement – utility or value – depends on the way of measurement, e.g., the framing of the question. A question framed under certainty will yield values, whereas a question framed under uncertainty will yield utilities . In this article, preferences are broadly defined as values that individuals attach to aspects of health as outcomes and elements of healthcare  (see Fig. 1).
Similarly, the term patient preferences does not have a clear definition. However, it is generally accepted that patient preferences are statements made by patients regarding the relative desirability of a range of health experiences, treatment options, and health states . In this article, the term patient preferences is used to indicate the value that patients or persons attach to aspects of health as outcomes and elements of healthcare (health-related preferences). Patient preferences refer to the individuals’ evaluation of the dimensions of health outcomes among a large number of preferences that may influence healthcare choices. These judgments are materialized through statements (e.g., during a counselling interview) or actions (e.g., selection of physician or therapy) [1, 20].
Market orientation in the healthcare system leads to higher competition between healthcare organizations that increasingly focus on patients’ needs. Knowledge about preferences of patients and the general population allow healthcare organizations to optimize their consumer- or patient-oriented approach. Interest in measuring and including individual’s preferences in healthcare is growing [1, 21, 22]. This includes the preferences of persons – general population/healthy individuals – as well as patients. Preference elicitation techniques can be used to gauge consumer preferences of health status, healthcare programs, or health technology assessment . Besides the ethical considerations for patient views, there are various reasons for integrating patient preferences in healthcare policy, such as improving treatment uptake and real-world efficiency of healthcare technologies, facilitating consumer empowerment, and advancing shared medical decision-making. For example, measuring patient preferences can help clinicians making decisions that are consistent with patient preferences (patient-centered healthcare), thereby improving health outcomes [1, 21].
Patient- and Person-Reported Outcomes (PRO)
Outcome is defined as something that results or follows from an activity or process . In the context of healthcare, outcome is defined as the results or consequences of treatment or healthcare . As depicted in Fig. 1, outcomes comprise the most commonly addressed constructs in PRO literature: symptoms, functioning, well-being, and HRQoL [2, 3, 6, 8, 17]. These four constructs provide information about the patient’s and person’s current health status that can be assessed through self-reports.
Symptoms are defined as “subjective evidence of disease or physical disturbance observed by a patient” . In contrast to a sign of a disease (e.g., high cholesterol level), symptoms can only be reported by patients and persons .
The construct functioning is synonymous with functional status [2, 8]. Functioning includes body functions and body structure, as well as activities and participation. According to the International Classification of Functioning, Disability and Health (ICF), functioning is defined as a “dynamic interaction between a person’s health condition and the contextual factors: environmental and personal factors” .
Well-being has been defined inconsistently in existing literature. Its previously accepted definition as “a condition characterized by happiness, health, or prosperity”  has been criticized for focusing descriptions or dimensions of well-being instead of its definition . Happiness, life satisfaction, ability to fulfil goals, and positive emotions are the most commonly cited aspects of well-being in the context of health [27–29]. A newer approach defines well-being as “the balance point between an individual’s resource pool and the challenges faced” [8, 26]. Thus, measuring well-being provides information about how a patient or person feels .
Similarly, there is no consistent definition of the construct HRQoL. It can be defined as a multidimensional construct that includes physical, emotional, mental, social, and behavioral components of well-being and functioning from the point of view of the patient and/or observer . This definition is based on the WHO definition of health . It is important to differentiate HRQoL from the broader construct Quality of Life (QoL) that comprises different components of life (including health) .
Collectively, the different PRO constructs are indicators of disease activity and progression and therefore have applications in various fields within the healthcare system . In health economics, PROs are often used to include the patient’s perspective in the evaluation of healthcare and for quality assurance in the healthcare system . In clinical trials, a PRO instrument may be used to measure the patient-relevant outcomes of a medical intervention .
Patient- and Person-Reported Experiences (PRE)
The word experience stems from the Latin experientia, meaning a trial or experiment . This close connection to the word experiment demonstrates the need for real-life observations of the given facts in order to gain new experiences and report about experience. Throughout life, one gains experiences. Thus, a person’s experiences are constantly evolving.
Patient experience is a concept frequently applied in the healthcare setting as it provides a report of the healthcare from the receiver’s perspective. Patient-reported experience measures (PREMs) for specific services, events, or the entire treatment process is a detailed report of the patient’s or person’s perspective, offering evidence on areas of improvement or on humaneness of care (i.e. whether the patient is treated with dignity and respect) [17, 32]. Experiences are objective facts of events that occur in relation to an individual; however, the individual’s or observer’s assessment of experience adds valence, which is either positive or negative . An individual’s evaluation of an experience is based on reference values and previous experiences that lead to satisfaction or dissatisfaction.
PREMs are used to explore patients’ and persons’ experiences throughout the care process, rather than at the end of their treatment . Hence, unlike PROs, they are not used to evaluate the outcome of care. These measures include, among others, information given to patients, the extent to which the patient’s social environment was involved in the treatment process, and coordination of care, including transition between sectors and waiting times [17, 35, 36]. Information is identified about different elements of healthcare as presented in Fig. 1. However, patients and persons report on their experience rather than their satisfaction with these elements of healthcare.
Patient- and Person-Reported Satisfaction (PRS)
Satisfaction is the fulfilment of one’s wishes, expectations, needs, or desires . According to this definition, something that is not desired or anticipated will not lead to satisfaction or dissatisfaction. Satisfaction involves a comparative process in which experiences gained in a specific situation are compared to previously formed expectations ; the lower these expectations are, the higher the level of satisfaction, and vice versa.
Patient satisfaction has not been clearly defined. Patient satisfaction is a subjective evaluation of medical care by the patient based on the extent to which the patients’ expectations were fulfilled . The main elements that patients can assess subsequently leading to their satisfaction or dissatisfaction are (1) medical treatment, (2) non-medical aspects of treatment (e.g., communication), (3) infrastructure (e.g., technical equipment), and (4) financial factors connected to the treatment . While patient satisfaction is predominantly based on elements of healthcare, it also includes satisfaction with treatment outcomes (see Fig. 1). Satisfaction with healthcare can be measured by asking the patient himself/herself, a person as proxy or by measuring the person’s (as a relative of a patient) own satisfaction with medical care.
Improving the processes and structures of healthcare can lead to increased patient satisfaction . However, there is no consensus on whether patients’ satisfaction reflects the quality of care administered. Inaccuracies are likely because of the cognitive mechanisms outlined above and because patients may perceive elements other than the technical quality of care as important; thus, even poor quality healthcare may be perceived as satisfactory . Hence, patient satisfaction is a more subjective than objective assessment of the quality of care. Nonetheless, patient satisfaction continues to be used extensively to include the patient’s perspective in quality assurance and treatment evaluation .
The strong interlinks between satisfaction and experiences and the clear distinction between them are important to note. Satisfaction cannot arise without the experience, but the isolated experience – without being compared with past experiences or expectations – does not equate to satisfaction or dissatisfaction. As satisfaction is based on the comparison of past and present experiences, it always contains some sort of evaluation and is therefore subjective. Reports of experiences are more descriptive, allowing for more objectivity. Due to this important distinction, they are treated as different concepts, illustrated as two separate columns in Fig. 1.
Measuring patient- and person-reports
After presenting the classification system, we attempt to clarify the methods that can be used to measure patient- and person-reports. Healthcare literature includes a large number of different methods used by researchers. However, the purpose served by each method, their theoretical basis, and practical applications vary. Generally, qualitative, quantitative, or mixed-methods approaches are used in studies measuring PRP, PRO, PRE, and PRS.
In the following section, the methods used for measuring patient- and person-reports are clarified. Because the measurement of preferences is a relatively new approach in healthcare, diverse methods have been used and no complete overview of their distinctive characteristics has been published. Therefore, we first present an overview of preference elicitation techniques (methods measuring PRP). The methods for measuring PRO, PRE, and PRS are then described. For measuring PRO, PRE, and PRS there are no special methods in comparison to PRP methods, but there are also possibilities to differ the methods presented in the following section with examples.
Various methods to assess patient and person preferences are available. Preference elicitation techniques can be applied within a qualitative approach of data collection through different forms of interviews and quantitative data collection via standardized self-reported questionnaires. Prior to collecting quantitative data on preferences, qualitative pre-studies are often conducted in the first step of a research study with a mixed methods approach (e.g., identifying relevant attributes and levels in focus groups for developing choice sets in discrete choice experiments [DCE]). Besides qualitative and mixed methods approaches, quantitative methods are most frequently used to measure PRP and are therefore the focus of the following section.
Stated preference elicitation techniques
Rooted in welfare economics, namely in the neo-classical concept of economic value based on individual utility maximization. Contingent valuation surveys directly obtain a monetary (Hicksian) measure of welfare associated with providing a good/service.
• Direct query about willingness-to-pay or willingness-to-accept
• For example: “Please state the largest amount you are willing to pay for the good/service.”
Various statistical methods depending on study aims (e.g., minimum, maximum, mean, and regression)
• Dichotomous question with reference to a given price
• For example: “Would you be willing to pay X € for the good/service?”
Binary choice models (e.g., binary logit, binary probit)
Bidding game 
• Dichotomous question in form of an auction
• For example: Would you be willing to pay X € for the good/service? Would you be willing to pay X + Y € (X-Y €) for the good/service?
Various statistical methods depending on study aims (e.g., minimum, maximum, mean, parametric, and non-parametric tests)
Self-explicated approaches 
No underlying economic theory
• Unacceptable attributes are removed
• The level of each attribute is evaluated on a desirability scale (e.g., 0 the worst level of the attribute and 100 the best)
• The respondent is asked to allocate, for example, 100 points across the attributes to reflect their relative importance
• In stage 1 or 2, different combinations of comparative or non-comparative methods could be used
• Part-worth: multiplying the importance weights (stage 2) with the attribute and level of desirability ratings (stage 1), additive assumption
• Overall utility: sum of the part-worth
No underlying economic theory
1. The attributes that contribute to the problem must be identified and arranged in a hierarchy according to aims, attributes, and alternatives
2. Hierarchy levels are assessed by paired comparisons
3. A matrix is created using pairwise ratios and the relative weights are calculated
4. Relative weights of the levels in stage 3 are aggregated
Calculating the relative weights of hierarchy levels with the eigenvector method
Not choice-based 
Depends on the method and approaches used
Variety of methods and approaches, such as rating or ranking of different alternatives
• Interval scaling (e.g., OLS* regressions)
• Ordinal scaling (e.g., MONANOVA*, PREFMAP*, LINMAP*, ordered logit-/probit-regressions)
Random utility theory
• Choice between two or more discrete alternatives (selection of most preferred alternative)
• Alternatives are described by a set of attributes and each attribute takes one of several levels
• Two alternatives in the choice set: binary discrete choice models (e.g., binary logit, binary probit)
• Three or more alternatives in the choice set: multiple discrete choice models (e.g., multinomial logit, nested logit, mixed logit, multinomial probit, heteroscedastic extreme value)
Standard gamble 
Utility theory by von Neumann and Morgenstern
• Choice between a fixed health status and a lottery with the probability p to obtain the best possible outcome and the probability 1 - p to obtain the worst possible health status
• For example: a chronic health state preferred over death:
1. Respondents are offered two alternatives:
(A): two possible outcomes; aa) the subject lives in a good health with the probability p for a fixed time t, or ab) the subject dies immediately with the probability 1 - p
(B): the subject lives in a fixed health status i for the rest of his/her life t
2. Respondents’ indifference point is located by varying the probability p
• For example: chronic health state preferred to death: At indifference point, the required preference score for health state i is h i = p
No underlying economic theory
• Trade-off between life years in a state of less than perfect health and a shorter life span in a state of perfect health
• For example: a chronic health state preferred over death:
1. Respondents are offered two alternatives:
(A) health state i for time t, followed by death;
(B) full health for time x < t, followed by death
2. Respondents’ indifference point is located by varying the time x
• For example: chronic health state preferred to death: At indifference point the required preference score for health state i is given: h i = x/t
No underlying economic theory
• Direct rating on a line with or without internal markings
• For example: a chronic health state preferred to death:
1. Respondents receive information about a batch of chronic health states, age of onset, the age of death, and two reference states (“full health”, “death”)
2. Respondents are usually asked to select the best and the worst of those health states
3. The remaining health states are placed on the rating scale relative to each other
• For example: a chronic health state preferred to death. Preference value for health state is the scale value of its placement
Stated preference elicitation techniques can be classified in different ways. The most widely accepted classification is into Contingent Valuation (CV) and multi-attributive preference methods . CV is a method that directly estimates the respondents’ willingness-to-pay (WTP) or willingness-to-accept (WTA) for goods, services, or negative interferences in healthcare through questionnaires. In a hypothetical market scenario, goods and negative interferences are tradable. The respondents’ WTP/WTA are determined via various question techniques (e.g., open-ended CV, dichotomous choice, or bidding game; see Table 1) [42, 44]. While CV analyzes one attribute of the product at a time, multi-attributive preference methods explore more than one attribute simultaneously. The latter is an umbrella term for modeling preferences for a healthcare product or service that is described in terms of its attributes and levels . There are three different types of multi-attributive preference measurement: (1) direct or compositional preference measurement, (2) de-compositional methods, and (3) a combination of both. For compositional preference measurement, single characters – each attribute and level – of a product or service are directly valued by the respondent and composed ex-post into the overall utility (direct utility measurement using e.g., self-explicated approaches and analytic hierarchy process [AHP]; see Table 1). During a de-compositional preference measurement, a (whole) product or service with different characters is valued by the respondent and the part-worth for individual characteristics is deductively investigated (indirect utility measurement through e.g., conjoint analysis [CA]). The main difference between traditional or not choice-based CA and the choice-based CA (also called DCE) is that respondents rank or rate each alternative product or service defined in terms of their characteristics in the not choice-based CA. In contrast to this, respondents choose between two or more products or services in DCE (see Table 1). Beside compositional and de-compositional methods, a hybrid of both can be applied to elicit stated preferences in healthcare (e.g., adaptive conjoint analysis) [42, 45, 46].
Different patient and person preferences can be measured like therapy options as elements of healthcare. Regarding health state valuation – as a healthcare outcome – standard gamble (SG), time trade-off (TTO), and rating scales are the most widely used techniques to elicit health state preferences (e.g., to develop preference-based HRQoL instruments like EQ-5D). DCE is increasingly used in this context [11, 19]. Health state valuation methods and analysis depend on the selected elicitation technique (see Table 1).
Measuring PRO, PRE, and PRS
PRO, PRE, and PRS can be measured by qualitative, quantitative, and mixed methods. However, there is no standardized method specific to each. The following section will briefly introduce the methods that can be used by researchers for PRO, PRE, and PRS. The selection of methods to assess the patient- and person-reported constructs within a study depends on the research question and study population.
Regarding qualitative methods, PRO, PRE, and PRS can be assessed through different forms of interviews such as one-to-one interviews – semi-structured, guided, or open forms like narrative interviews – and focus groups . Other qualitative methods include using open, semi-standardized, or computerized diaries as self-observational protocols (e.g., for reporting the occurrence of special events) [48, 49].
Examples of standardized self-administered questionnaires for measuring PRO, PRE, and PRS
Patient- and Person-Reported Outcomes (PRO)
Medical Outcome Study (MOS) Sleep Scale
MD Anderson Symptom Inventory (MDASI)
WHO Disability Assessment Schedule 2.0 (WHODAS-2.0)
Functional Status Questionnaires (FSQ)
Oxford Happiness Questionnaire (OHQ)
Affected Balance Scale (ABS)
Scale of Positive and Negative Experience (SPANE)
Short-Form 36 (SF-36)
World Health Organization Quality of Life Assessment (WHOQOL-100)
Patient- and Person-Reported Experiences (PRE)
Patient Experience Questionnaire (PEQ)
Improving Practices Questionnaire (IPQ)
Patient Assessment Survey (PAS)
Patient- and Person-Reported Satisfaction (PRS)
Patient Satisfaction Questionnaire (PSQ)
European Project on Patient Evaluation of General Practice Care (EUROPEP) Questionnaire
Moreover, quantitative standardized interviews, standardized diaries, or diaries with statistics can be conducted [49, 51, 52]. A quantitative interview is based on a standardized questionnaire where the respondents are assisted by an interviewer who may give additional explanations. Some questionnaires like the EQ-5D can also be used as interviewer-administered standardized questionnaires, conducted either face-to-face or via telephone .
The method of analyzing patient- and person-reports depends on the assessment method; a qualitative method necessitates qualitative strategies for analyzing interviews or diaries (e.g., Mayring’s content analyses ), while for quantitative methods, statistical analysis like t-tests, non-parametric tests, or regressions using a statistics program have to be performed.
Although patient- and person-reports gain importance for evaluating healthcare systems and decision-making, a comprehensible categorization with a clear definition of constructs is still lacking. To bridge this gap the RHO Group presents a comprehensible and well-justified classification of patient- and person-reports of preferences, outcomes, experiences, and satisfaction in the healthcare setting.
In contrast to existing classification systems (e.g., Valderas & Alonso 2008 ), it embraces aspects of patient- and person-reports, incorporating several constructs, including also preferences that are gaining importance in healthcare. The categorization indicates the richness and diversity of patient- and person-reports.
While this classification is the first to consider all constructs reported by both patients as well as persons, including proxy-reports by caregivers, relatives, and the general population, it has some limitations. Any existing link between the four categories was deliberately excluded from the classification system by the RHO Group. Although the constructs are interrelated and interdependent, the objective of the new classification of preferences, outcomes, experiences, and satisfaction was to distinguish between the different concepts rather than illustrate all possible associations. A description that accounts for interrelations is beyond the scope of this research but should be considered in the future. Researchers should be aware of the links between the constructs, such as between satisfaction and outcome. Even though healthcare outcomes do not strongly affect the patient’s assessment of healthcare quality , low health status or chronic conditions negatively influence satisfaction . Furthermore, satisfaction itself can influence outcomes. Higher patient satisfaction improves adherence . Increased compliance to medical and non-medical treatments improves treatment outcomes . Hence, patient satisfaction is linked to improved treatment outcomes through improved compliance.
Furthermore, differentiation of the four constructs and their dimensions is difficult; this differentiation depends on the constructs’ fundamental definitions and is therefore not selective. Moreover, the RHO Group decided to exclude the construct adherence to treatment from the present classification system as it depends not only on the individual, but also on the close cooperation between patient and practitioner and the influence of both. It was also excluded because it could not be separated from preferences, outcomes, satisfaction, and experiences. Moreover, it could not be incorporated within these categories because of the strong interrelations between adherence and these constructs. Hence, adherence could have influenced multiple constructs; for example, adherence could have influenced patient satisfaction and could have been influenced by patient’s satisfaction. As our aim was to provide a clear classification, rather than depict these interrelations, adherence was excluded. Nonetheless, patients’ adherence is an important concept and has a relevant impact on treatment outcomes [55, 56].
In addition to reorganizing constructs relating to existing patient- and person-reports, this paper also outlined the most constitutive methods for measuring such reports. These measures were first isolated and then grouped or structured. However, the grouping or structuring of the measures was difficult and was therefore not selective. The present classification system can be used when planning studies in health- and healthcare-related research. However, the choice of methods depends on the research aims. The (way of) results and interpretation will depend on the method used. Thus, methods for measuring patient- and person-reports should be carefully selected.
This article aims at presenting a new and all-embracing classification system with well-defined constructs for reports related to health and healthcare provided by patients or persons. Measuring individuals’ preferences, outcomes, experiences, and satisfaction is gaining increasingly importance in health economics. Even though patient- and person-reports are always subjective and its ability to evaluate healthcare is often questioned, these reports comprise an essential and complementary part of patient- and person-centered healthcare. An overview of methods that can be used to measure the four categories of patient- and person-reports has been presented. While the value of understanding and using these reports in healthcare is increasingly recognized, its measurement and implementation presents a daunting challenge to researchers, clinicians, and patients . Although there is a movement towards involving the client in healthcare policy-making, systematic and explicit consideration of research evidence on patient- and person-reported preferences, outcomes, experiences, and satisfaction in healthcare policy decisions seems to be still limited . Future measurement of self-report in routine healthcare should be considered a standard process as it demonstrates long-term benefit for patients and the general population.
Compliance with ethical standards and competing interests
This submission is a theoretical original research article and does not include data which were collected from human participants or animals. Therefore, no informed consent or ethics approval was required for this paper. All authors declare that they have no conflict of interest. They received no funding to develop the classification system and to prepare the manuscript.
affected balance scale
analytic hierarchy process
discrete choice experiments
European Project on Patient Evaluation of General Practice Care
Food and Drug Administration
functional status questionnaires
health-related quality of life
international classification of functioning, disability and health
improving practices questionnaire
linear programming technique for multidimensional analysis of preference
MD Anderson Symptom Inventory
monotonic analysis of variance
medical outcome study
Oxford Happiness Questionnaire
ordinary least squares
patient assessment survey
patient experience questionnaire
patient- and person-reported experiences
patient-reported experience measures
patient- and person-reported outcomes
patient-reported outcome measure
patient- and person-reported preferences
patient- and person-reported satisfaction
patient satisfaction questionnaire
quality of life
- RHO Group:
Reported Health Outcomes Group
scale of positive and negative experience
World Health Organization
World Health Organization Disability Assessment Schedule 2.0
World Health Organization Quality of Life Assessment
The publication of this article was funded by the Open Access fund of Leibniz University Hannover. Further members of the RHO Group who made substantial contributions to the conception of the study and to the development of the new classification system:
J.-Matthias, Graf von der Schulenburgb (firstname.lastname@example.org)
Wolfgang, Greinera (email@example.com)
Volker, Amelungc (Amelung.Volker@mh-hannover.de)
Christian, Krauthc (Krauth.Christian@mh-hannover.de)
a) Health Economics and Health Care Management, University of Bielefeld, Germany (P.O. Box 10 01 31, 33501 Bielefeld)
b) Center for Health Economics Research Hannover (CHERH), Leibniz University Hannover, Germany (Otto-Brenner-Straße 1, 30159 Hannover)
c) Center for Health Economics Research Hannover (CHERH), Hannover Medical School, Germany (Carl-Neuberg-Straße 1, 30625 Hannover)
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
- Dirksen CD, Utens CM, Joore MA, van Barneveld TA, Boer B, Dreesens DH, et al. Integrating evidence on patient preferences in healthcare policy decisions: protocol of the patient-VIP study. IS. 2013;8:64. doi:10.1186/1748-5908-8-64.PubMedPubMed CentralGoogle Scholar
- Brettschneider C, Lühmann D, Raspe H. Der Stellenwert von Patient Reported Outcomes (PRO) im Kontext von Health Technology Assessment (HTA). Köln: DIMDI; 2011.Google Scholar
- U.S. Department of Health and Human Services Food and Drug Administration, Center for Drug Evaluation and Research, Center for Biologics Evaluation and Research, Center for Devices and Radiological Health. Guidance for Industry. 2009. http://www.fda.gov/downloads/Drugs/Guidances/UCM193282.pdf. Accessed 14 May 2016.
- Lohr KN, Zebrack BJ. Using patient-reported outcomes in clinical practice: challenges and opportunities. Qual Life Res. 2009;18:99–107. doi:10.1007/s11136-008-9413-7.View ArticlePubMedGoogle Scholar
- Valderas JM, Alonso J. Patient reported outcome measures: a model-based classification system for research and clinical practice. Qual Life Res. 2008;17:1125–35. doi:10.1007/s11136-008-9396-4.View ArticlePubMedGoogle Scholar
- Acquadro C, Berzon R, Dubois D, Leidy NK, Marquis P, Revicki D, Rothman M. Incorporating the Patient's Perspective into Drug Development and Communication: An Ad Hoc Task Force Report of the Patient-Reported Outcomes (PRO) Harmonization Group Meeting at the Food and Drug Administration, February 16, 2001. Value Health. 2003;6:522–31. doi:10.1046/j.1524-4733.2003.65309.x.View ArticlePubMedGoogle Scholar
- Doward LC, Gnanasakthy A, Baker MG. Patient reported outcomes: looking beyond the label claim. HQLO. 2010;8:89. doi:10.1186/1477-7525-8-89.PubMedPubMed CentralGoogle Scholar
- Patrick DL, Guyatt GH, Acquadro C. Patient-reported outcomes. In: Higgins JPT, Green S, editors. Cochrane Handbook for Systematic Reviews of Interventions. 5th ed. 2011.Google Scholar
- Maloney K, Chaiken BP. An Overview of Outcomes Research and Measurement. JHQ. 1999;21:4–9.PubMedGoogle Scholar
- Metcalfe R. Compliance, adherence, concordance - what's in a NAME. Pract Neurol. 2005;5:192–3. doi:10.1111/j.1474-7766.2005.00313.x.View ArticleGoogle Scholar
- Brazier J, Ratcliffe J, Salomon JA, Tsuchiya A. Measuring and Valuing Health Benefits for Economic Evaluation. Oxford: Oxford University Press; 2007.Google Scholar
- Devlin NJ, Appleby J. Getting the most out of PROMS: Putting health outcomes at the heart of NHS decision-making. London: King's Fund; 2010.Google Scholar
- Oppe M, Devlin NJ, van Hout B, Krabbe PFM, de Charro F. A Program of Methodological Research to Arrive at the New International EQ-5D-5L Valuation Protocol. Value Health. 2014;17:445–53. doi:10.1016/j.jval.2014.04.002.View ArticlePubMedGoogle Scholar
- Coucill W, Bryan S, Bentham P, Buckley A, Laight A. EQ-5D in patients with dementia: an investigation of inter-rater agreement. Med Care. 2001;39:760–71.View ArticlePubMedGoogle Scholar
- Pickard AS, Knight SJ. Proxy evaluation of health-related quality of life: a conceptual framework for understanding multiple proxy perspectives. Med Care. 2005;43:493–9.View ArticlePubMedPubMed CentralGoogle Scholar
- Ravens-Sieberer U, Karow A, Barthel D, Klasen F. How to assess quality of life in child and adolescent psychiatry. Dialogues Clin Neurosci. 2014;16:147–58.PubMedPubMed CentralGoogle Scholar
- Coulter A, Fitzpatrick R, Cornwell J. Measures of patients' experience in hospital: purpose, methods and uses. London: King's Fund; 2009.Google Scholar
- Gove PB. Webster's third new international dictionary of the English language, unabridged. Springfield: Merriam-Webster; 2002.Google Scholar
- Drummond MF, Sculpher MJ, Torrance GW, O’Brien BJ, Stoddart GL. Methods for the Economic Evaluation of Health Care Programmes. 3rd ed. Oxford: Oxford University Press; 2005.Google Scholar
- Brennan PF, Strombom I. Improving Health Care by Understanding Patient Preferences: The Role of Computer Technology. JAMIA. 1998;5:257–62. doi:10.1136/jamia.1998.0050257.PubMedPubMed CentralGoogle Scholar
- Ruland CM. Improving Patient Outcomes by Including Patient Preferences in Nursing Care. AMIA 1998:448–52.
- Sacristán JA. Patient-centered medicine and patient-oriented research: improving health outcomes for individual patients. BMC Med Inform Decis Mak. 2013;13:6. doi:10.1186/1472-6947-13-6.View ArticlePubMedPubMed CentralGoogle Scholar
- Mühlbacher AC, Johnson FR. Choice Experiments to Quantify Preferences for Health and Healthcare: State of the Practice. Appl Health Econ Health Policy. 2016. doi:10.1007/s40258-016-0232-7.Google Scholar
- Cleeland CS. Symptom Burden: Multiple Symptoms and Their Impact as Patient-Reported Outcomes. JCNI Monographs, 2007:16–21. doi:10.1093/jncimonographs/lgm005.
- World Health Organization. How to use the ICF. 2013. http://www.who.int/classifications/drafticfpracticalmanual.pdf. Accessed 14 May 2016.
- Dodge R, Daly A, Huyton J, Sanders L. The challenge of defining wellbeing. JHW. 2012;2:222–35. doi:10.5502/ijw.v2i3.4.Google Scholar
- Diener E, Suh E. Measuring quality of life: economic, social, and subjective indicators. SIR. 1997;40:189–216. doi:10.1023/A:1006859511756.Google Scholar
- Foresight Mental Capital and Wellbeing Project. Mental Capital and Wellbeing: Making the most of ourselves in the 21st century. 2008. https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/292453/mental-capital-wellbeing-summary.pdf. Accessed 14 May 2016.
- Pollard EL, Lee PD. Child well-being: a systematic review of the literature. SIR. 2003;61:59–78. doi:10.1023/A:1021284215801.Google Scholar
- World Health Organisation. Preamble to the Constitution of the World Health Organization as adopted by the International Health Conference. 1948. http://www.who.int/about/definition/en/print.html. Accessed 14 May 2016.
- Fayers PM, Machin D. Quality of Life: The assessment, analysis and interpretation of patient-reported outcomes. 2nd ed. Chichester: John Wiley & Sons Ltd; 2007.View ArticleGoogle Scholar
- Black N. Patient reported outcome measures could help transform healthcare. BMJ. 2013;346:19–21. doi:10.1136/bmj.f167.View ArticleGoogle Scholar
- Black N, Jenkinson C. How can patients’ views of their care enhance quality improvement? BMJ. 2009;339:202–5. doi:10.1136/bmj.b2495.Google Scholar
- Reay N. How to measure patient experience and outcomes to demonstrate quality in care. Nurs Times. 2010;106:12–4.PubMedGoogle Scholar
- Jenkinson C, Coulter A, Bruster S, Richards N, Chandola T. Patients' experiences and satisfaction with health care: results of a questionnaire study of specific aspects of care. Qual Saf Health Care. 2002;11:335–9. doi:10.1136/qhc.11.4.335.View ArticlePubMedPubMed CentralGoogle Scholar
- Tadić V, Hogan A, Ahmed R, Knowles R, Rahi J. Patient Reported Outcomes and Experience Measures (PROMs and PREMs): Service Users’ Perspectives. 2012. http://www.ucl.ac.uk/childproms/docs/PROM_PREM_FocusGroup_report_Oct2012.pdf. Accessed 14 May 2016.
- Crow R, Gage H, Hampson S, Hart J, Kimber A, Storey L, Thomas H. The measurement of satisfaction with healthcare: implications for practice from a systematic review of the literature. HTA. 2002;6:1–244.PubMedGoogle Scholar
- Cummins RA, Nistico H. Maintaining life satisfaction: The role of positive cognitive bias. JOHS. 2002;3:37–69. doi:10.1023/A:1015678915305.Google Scholar
- Ware JE, Snyder MK, Wright W, Davies AR. Defining and measuring patient satisfaction with medical care. Eval Program Plann. 1983;6:247–63. doi:10.1016/0149-7189(83)90005-8.View ArticlePubMedGoogle Scholar
- Rademakers J, Delnoij D, de Boer D. Structure, process or outcome: which contributes most to patients' overall assessment of healthcare quality? BMJ Qual Saf. 2011;20:326–31. doi:10.1136/bmjqs.2010.042358.View ArticlePubMedGoogle Scholar
- Cleary PD, McNeil BJ. Patient Satisfaction as an Indicator of Quality Care. Inquiry. 1988;25:25–36.PubMedGoogle Scholar
- Merino-Castelló A. Eliciting Consumers Preferences Using Stated Preference Discrete Choice Models. 2003. http://www.econ.upf.edu/docs/papers/downloads/705.pdf. Accessed 14 May 2016.
- Kjær T. A review of the discrete choice experiment - with emphasis on its application in health care. 2005. http://static.sdu.dk/mediafiles/Files/Om_SDU/Centre/c_ist_sundoke/Forskningsdokumenter/publications/Working%20papers/20051pdf.pdf. Accessed 14 May 2016.
- Diener A, O’Brien B, Gafni A. Health care contingent valuation studies: A review and classification of the literature. Health Econ. 1998;7:313–26. doi:10.1002/(SICI)1099-1050(199806)7:4<313::AID-HEC350>3.0.CO;2-B.View ArticlePubMedGoogle Scholar
- Abu-Assab S. Integration of Preference Analysis Methods into Quality Function Deployment. Wiesbaden: Gabler Verlag; 2012.View ArticleGoogle Scholar
- Saaty TL. How to make a decision: The Analytic Hierarchy Process. EJOR. 1990;48:9–26. doi:10.1016/0377-2217(90)90057-I.View ArticleGoogle Scholar
- Flick U. An introduction to qualitative research. 5th ed. Los Angeles: Sage; 2014.Google Scholar
- Alaszewski A. Using diaries for social research. London, Thousand Oaks, CA: Sage; 2006.View ArticleGoogle Scholar
- Sheble L, Wildemuth B. Research diaries. In: Wildemuth BM, editor. Applications of social research methods to questions in information and library science. Westport, Conn: Libraries Unlimited; 2009. p. 211–21.Google Scholar
- Dawson J. Measuring Health Status. In: Neale J, editor. Research methods for health and social care. Basingstoke, New York: Palgrave Macmillan; 2009. p. 181–94.Google Scholar
- Babbie ER. The practice of social research. 12th ed. Belmont, Calif: Wadsworth Cengage; 2010.Google Scholar
- Brown NR, Williams RL, Barker ET, Galambos NL. Estimating frequencies of emotions and actions: A web-based diary study. Appl Cognit Psychol. 2007;21:259–76. doi:10.1002/acp.1303.View ArticleGoogle Scholar
- Schreier M. Qualitative content analysis in practice. Thousand Oaks, California: SAGE Publications; 2012.Google Scholar
- Cleary PD, Edgman-Levitan S, Roberts M, Moloney TW, McMullen W, Walker JD, Delbanco TL. Patients evaluate their hospital care: a national survey. Health Aff. 1991;10:254–67. doi:10.1377/hlthaff.10.4.254.View ArticleGoogle Scholar
- van der Wal MH, van Veldhuisen DJ, Veeger N, Rutten FH, Jaarsma T. Compliance with non-pharmacological recommendations and outcome in heart failure patients. Eur Heart J. 2010;31:1486–93. doi:10.1093/eurheartj/ehq091.View ArticlePubMedGoogle Scholar
- Simpson SH, Eurich DT, Majumdar SR, Padwal RS, Tsuyuki RT, Varney J, Johnson JA. A meta-analysis of the association between adherence to drug therapy and mortality. BMJ. 2006;333:15. doi:10.1136/bmj.38875.675486.55.View ArticlePubMedPubMed CentralGoogle Scholar
- Carson RT, Hanemann WM. Contingent valuation. In: Mäler K-G, Vincent JR, editors. Handbook of environmental economics. Amsterdam: Elsevier; 2005. p. 821–936.Google Scholar
- Hoyos D, Mariel P. Contingent valuation: Past, present and future. Prague Economic Papers. 2010;19:329–43. doi:10.18267/j.pep.380.View ArticleGoogle Scholar
- Boyle KJ. Dichotomous-Choice, Contingent-Valuation Questions: Functional form is important. NJARE. 1990;19:125–31.Google Scholar
- Srinivasan V. A conjunctive-compensatory approach to a self-explication of multiattributed preferences. Decis Sci. 1988;19:295–305. doi:10.1111/j.1540-5915.1988.tb00268.x.View ArticleGoogle Scholar
- Zahedi F. The Analytic Hierarchy Process: A Survey of the Method and its Applications. Interfaces. 1986;16:96–108.View ArticleGoogle Scholar
- Green PE, Srinivasan V. Conjoint Analysis in Marketing: New Developments with Implications for Research and Practice. J Mark. 1990;54:3–19. doi:10.2307/1251756.View ArticleGoogle Scholar
- Lancsar E, Louviere J. Conducting Discrete Choice Experiments to Inform Healthcare Decision Making: A User's Guide. Pharmacoeconomics. 2008;26:661–77.View ArticlePubMedGoogle Scholar
- Torrance GW. Measurement of health state utilities for economic appraisal: A Review. J Health Econ. 1986;5:1–30.View ArticlePubMedGoogle Scholar
- Torrance GW, Furlong W, Feeny D. Health utility estimation. Expert Rev Pharmacoecon Outcomes Res. 2002;2:99–108. doi:10.1586/14737126.96.36.199.View ArticlePubMedGoogle Scholar