Skip Navigation
Skip to contents

Perspect Integr Med : Perspectives on Integrative Medicine

OPEN ACCESS
SEARCH
Search

Articles

Page Path
HOME > Perspect Integr Med > Volume 5(3); 2026 > Article
Original Article
Author-Organized Development of a Partly Delphi-Endorsed Draft Geriatric Mental Health Questionnaire in Korean Medicine
Tae-Yoon Kim1,‡orcid, Jung-Hyun Kim2,‡orcid, Sun-Yong Chung3,*orcid
Perspectives on Integrative Medicine 2026;5(3):188-196.
DOI: https://doi.org/10.56986/pim.2026.10.003
Published online: October 20, 2026

1Department of Neuropsychiatry, Kyung Hee University College of Korean Medicine, Seoul, Republic of Korea

2Department of Acupuncture and Moxibustion, Kyung Hee University Hospital, Gangdong, Seoul, Republic of Korea

3Department of Neuropsychiatry, College of Korean Medicine, Kyung Hee University, Kyung Hee University Hospital, Gangdong, Seoul, Republic of Korea

*Corresponding author: Sun-Yong Chung, Department of Neuropsychiatry, College of Korean Medicine, Kyung Hee University, Kyung Hee University Hospital at Gangdong, 892 Dongnam-ro, Gangdong-gu, Seoul 05278, Republic of Korea, Email: lovepwr@khu.ac.kr
‡ Tae-Yoon Kim and Jung-Hyun Kim contributed equally as co-first authors.
• Received: April 11, 2026   • Revised: August 11, 2026   • Accepted: August 27, 2026

©2026 Jaseng Medical Foundation

This is an open access article under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

prev next
  • 471 Views
  • 3 Download
  • Background
    Mental-health instruments in Korean medicine (KM) exist for specific constructs such as Hwa-Byung, but a multidomain patient-reported outcome measure (PROM) specifically addressing broader mental health in geriatrics has not been established. This study synthesized expert opinion to inform a preliminary KM-informed geriatric mental-health PROM.
  • Methods
    A web-based Delphi survey, designed by 4 experienced KM clinicians, was conducted in 3 rounds. The questionnaire covered conceptualization, construction, symptom concepts, and sources of content. Statements/items were classified according to the distribution of ratings (1–3, 4–6, and 7–9 bands). There were 43 statements/items rated in Round 1 and Round 3 was prespecified as the final round. Eligible participants (board-certified KM neuropsychiatry specialists or professors of KM neuropsychiatry at KM universities in Korea) were invited (N = 56). Patients and caregivers did not participate.
  • Results
    Eleven experts completed all 3 rounds. Agreement consensus was reached on the need for a KM-informed geriatric mental-health PROM, Likert-type responses, a 1-month recall period, and several symptom concepts and content sources. After the Delphi rounds, a 36-statement/item draft was organized into depression (9 items), anxiety (10 items), anger (8 items), and helplessness (9 items). The domains were not expert panel-rated, and were only partly Delphi-endorsed due to literature-derived and expert-developed content.
  • Conclusion
    The Delphi process informed selected concepts and development choices but does not validate the specific 36-item/4-domain draft. The resulting instrument is an author-curated, partly Delphi-endorsed preliminary KM-informed geriatric mental-health PROM draft. Patient-facing content evaluation, management of somatic confounding, and confirmatory psychometric testing are required before clinical or research use.
Aging is a dynamic process typically accompanied by decline in physical, social, and mental functioning, and because older adults occupy multiple family and social roles, these changes can affect their capacity to adapt, and affect their autonomy and quality of life [1,2].
The World Health Organization describes mental health as a state of well-being in which individuals can realize their abilities, cope with ordinary stress, work productively, and contribute to their communities [3]. A negative result on a mental health disorder-focused screening test does not necessarily indicate preserved mental well-being, and deterioration in mental health may precede or accompany clinically recognized mental illness [4,5]. A self-report measure that captures broader changes in affective (emotional), bodily (somatic), and functional (operational) experience could complement disorder-specific screening in older adults.
Several established conventional medicine instruments address related but narrower constructs. The Geriatric Depression Scale (GDS) was developed specifically for depressive symptoms in older adults, whereas the Patient Health Questionnaire-9 (PHQ-9) operationalizes depressive-disorder symptoms and severity [6,7]. Korean medicine (KM) instruments also exist, including the Hwa-Byung Scale, which assesses a culturally patterned anger-related syndrome rather than general mental health in older adults [8]. Traditional Chinese medicine has produced constitution-oriented instruments for older adults, including the Constitution in Chinese Medicine Questionnaire (Elderly Edition), but its target is body constitution and health management rather than a multidomain mental-health outcome [9]. The Korean Medical Pathologic Aging Scale addresses pathological aging and dementia-related pattern features but was not designed as a comprehensive geriatric mental-health patient-reported outcome measure (PROM) [10]. These instruments establish relevant precedents but gaps are highlighted when the diagnostic term “Heo-ro” is considered.
In traditional KM, Heo-ro refers to an age- or depletion-related condition characterized by reduced vitality, fatigue, functional decline, and combined somatic and psychological manifestations. In this study, Heo-ro served as a conceptual anchor in the identification of mental-health-related experiences that may not be fully represented in disorder-specific psychiatric screening instruments as previously reported [11,12]. The proposed instrument will not be distinctive because every item is unique to KM; rather, its intended distinction lies in the organization of the overlapping affective symptoms together with bodily, sensory, and functional expressions within an age-related depletion framework to bridge the gap of the currently available instruments.
Three considerations supported the development of a KM-informed geriatric PROM. Firstly, KM provides a framework for interpreting age-related functional decline [13]. Secondly, KM has a holistic treatment perspective (treats bodily and psychological manifestations as interrelated rather than as independent symptoms) [14]. Thirdly, KM is used at a relatively high rate by older adults in Korea, yet assessment tools tailored to geriatric mental health in this setting remain broad and limited.
This study aimed to use expert-consensus and draft-generation phases in the design of a KM-informed geriatric mental-health PROM. The Delphi process, consensus classifications, preliminary conceptual organization, and candidate item pool will be described. This study will not establish patient-perceived content validity, structural validity, reliability, diagnostic accuracy, or readiness for field use.
1. Study design
A web-based Delphi study was conducted in 3 rounds and it was reported in accordance with the Conducting and REporting of DElphi Studies guidelines [15]. The completed checklist is provided in Supplementary Appendix B. The survey used anonymous individual ratings and controlled feedback between rounds; no face-to-face panel meetings were held.
2. Delphi procedure
The Delphi based questionnaire was designed by 4 KM clinicians. The drafting team included a professor and a board-certified KM neuropsychiatrist (with more than 15 years of clinical experience) and clinicians in KM neuropsychiatry (with more than 3 years of clinical experience). Its overall structure was informed by prior PROM-development and Delphi-consensus studies [12,16].
Across all 3 rounds, the Delphi questionnaire comprised 4 sections: conceptualization, construction, symptom concepts, and sources of content for the Korean Medicine Mental Health Questionnaire for Older Adults. In Section 4 the expert panelists were asked to rate potential content sources, including interviews with older adults (aged 65–75 years) and family members, existing geriatric PROMs, and KM and conventional medicine texts [17–20]. Panelists could provide free-text comments in each round. Three KM neuropsychiatry specialists reviewed the wording for clarity and consistent interpretation.
3. Participant selection and ethics
Eligible participants were board-certified KM neuro-psychiatry specialists or professors of KM neuropsychiatry at KM universities in Korea. They were approached individually by email through the KM Neuropsychiatric Association, received written information about the study, and provided written informed consent to participate as an expert panelist in the study.
The study was approved by the Kyung Hee University institutional bioethics committee [KHSIRB-19-343-(RA)] before recruitment and data collection. Fifty-six eligible experts were invited, and Round 1 was distributed through a mobile/web link on February 12, 2020. All participating panelists were engaged in clinical care and held academic appointments.
4. Data collection
Round 1 remained open for 2 weeks, and Rounds 2 and 3 both remained open for 1 week [21]. Nonresponders to the initial invitation were not contacted again as defined in the original recruitment procedure. Item-level missing responses among consenting panelists were followed up once by email when necessary.
5. Data management and consensus classification
Ratings were collected on a 9-point scale. For Sections 1–3, 1 indicated overall disagreement and 9 indicated overall agreement. For Section 4, 1 indicated “not at all important” and 9 indicated “very important.” Ratings were grouped into 1–3, 4–6, and 7–9 bands, consistent with a commonly used Research and Development/University of California, Los Angeles-style categorization of 9-point ratings [22].
A distribution of at least 2-thirds of expert panelists in any 1 band was originally treated as a terminal classification for carry-forward decisions: 7–9 indicated agreement or high importance, 4–6 indicated an intermediate classification, and 1–3 indicated disagreement or low importance. Only the 7–9 and 1–3 bands were interpreted as substantive agreement or disagreement consensus. With 11 panelists, the minimum integer count for a terminal band classification was 8 out of 11. Statements/items without a terminal classification were rated again in the next round, whereas classified statements/items were removed from subsequent rounds.
The study protocol prespecified 3 Delphi rounds, with Round 3 as the final round irrespective of whether all statements/items had reached a terminal classification. Between rounds, the expert panelists received the group mean, median, standard deviation, the frequency distribution across the 3 rating bands, and anonymized free-text comments. The wording of each statement/item to be rated again was shown. Round-level flow is summarized in Supplementary Table S2 as previously described [23].
6. Statistical analyses and archived data
Sociodemographic data were summarized as frequencies and percentages. Delphi ratings were summarized using band counts, the percentage of ratings in the 7–9 band, mean, median, standard deviation, and round of classification. Statements/items with exactly 8 out of 11 ratings in the 7–9 band were flagged as threshold-level agreement consensus. Analyses were performed using Microsoft Office Excel 2019 (Microsoft Corporation, Redmond, WA, USA).
The archived analytic records retain the questionnaire, aggregate band-level counts, summary statistics, and round classifications, but individual panelist-level ratings are no longer retrievable. Exact interquartile ranges, within-panel stability metrics, and independent individual-level reanalysis therefore cannot be produced. No individual ratings or distributional statistics were imputed or reconstructed from the aggregate tables.
7. Preliminary conceptual framework and questionnaire draft
A preliminary conceptual framework was developed using Delphi-endorsed symptom concepts, KM neuropsychiatry source texts, geriatric mental-health literature, and subsequent expert draft review. The 4-domain structure including depression, anxiety, anger, and helplessness was organized post hoc by the authors after the Delphi rounds to group clinically related concepts. The domains were not separately rated by the panelists.
During item drafting, the research team referred to literature on mental and general health in adults aged 65 years or older, and KM and conventional psychiatry and source texts were selected through the Delphi process as previously described [24]. A 3-member expert drafting panel reviewed item relevance, wording for older adults, clinical usability, and recall period. Item-to-domain assignment was reviewed after Round 3. The resulting 36-item draft combined Delphi-endorsed concepts with literature-derived, and expert-developed content. This preliminary instrument draft should therefore be understood as an author-curated synthesis rather than Delphi-endorsed item structure instrument. The available archived files do not support a fully auditable item-by-item reconstruction of drafting provenance.
Patients and caregivers were not included in the Delphi expert panel. The complete English-language draft questionnaire and response format are provided in Supplementary Appendix A. An item-level archived-provenance classification for all 36 candidate items, including the closest documented Delphi concept/status, was identifiable (Table 1). Because contemporaneous item-level source tracking was incomplete, the provenance entries are explicitly presented as the best-supported reconstruction from the surviving study records rather than as a fully auditable contemporaneous item log. An expanded post hoc conceptual mapping to Heo-ro/KM concepts and to overlapping conventional symptom content is provided in Supplementary Table S5. This mapping was not rated by the Delphi expert panel and does not establish pattern validity or diagnostic specificity.
1. Panelists
Of 56 invited experts, 11 consented to participate and completed all rounds (participation rate of 19.6%). Eight panelists had more than 20 years of clinical experience and 3 had 10–20 years of experience; 9 were men and 2 were women. All were board-certified KM neuropsychiatry specialists engaged in clinical care and academic appointments. No follow-up reminders were sent to nonresponders, and individual-level characteristics of nonresponders were unavailable. Two item-level missing responses occurred across the 3 rounds and were resolved by a single follow-up email. Detailed panel characteristics are provided in Supplementary Table S1.
2. Delphi results
Flow across the prespecified 3 rounds is summarized in Supplementary Table S2. In Round 1, 43 statements/items were rated; 30 reached agreement or high-importance consensus and 13 were carried forward. In Round 2, 3 reached agreement or high-importance consensus, 4 received terminal intermediate-band classifications, and 6 were carried forward. After Round 3, all 6 remaining statements/items were classified as uncertain. No statement/item reached disagreement or low-importance consensus in the 1–3 band. Accordingly, the final classification of the 43 original statements/items resulted in 33 agreement/high-importance consensus, 4 terminal intermediate classifications, and 6 uncertain. No statements/items were added or modified between rounds on the basis of free-text comments.
All 7 conceptualization statements reached agreement consensus. All panelists supported the need for a standardized questionnaire for use in KM treatment or research with older adults. Eight of 11 supported restricting self-report to respondents with adequate cognitive and reality-testing abilities. Agreement consensus was also reached for using chronic-fatigue/Heo-ro concepts and the Korean Medical Pathologic Aging Scale as theoretical references and for providing both domain and total scores (Table 2) [10].
For questionnaire construction, agreement consensus was reached for targeting adults aged 65 years or older, using Likert-type response options and visual analogue scales, and applying a 1-month recall period. The 3-month recall period received a terminal intermediate-band classification and was not interpreted as agreement consensus. Age thresholds of 70 or 75 years, dichotomous response options, and 1- or 2-week recall periods remained uncertain after Round 3 (Table 2).
Symptom concepts rated during the Delphi rounds are listed individually in Supplementary Table S3. Agreement consensus was reached in Round 1 for meaninglessness, sensitivity, unworthiness, unjustness, intelligence, complexion, vitality, fatigue, hypersomnia, insomnia, emotional incontinence, anxiety, depression, and dizziness. Agreement consensus was reached in Round 2 for being easily startled. Thirst and chest discomfort received terminal intermediate-band classifications. Headache remained uncertain after Round 3 and was excluded from the draft questionnaire.
Rated content sources are summarized in Supplementary Table S4. High-importance consensus was reached for transcribed interviews with older adults, an existing geriatric PROM, KM psychiatry and life-nurturing texts, conventional psychiatry and geriatrics texts, and articles on psychiatric PROMs for older adults. Transcribed interviews with partners and offspring received a terminal intermediate-importance classification.
3. Preliminary conceptual framework and draft questionnaire
The drafting stage produced 36 candidate items organized by the authors into 4 provisional domains: depression (9 items), anxiety (10 items), anger (8 items), and helplessness (9 items). The domains were not rated by the Delphi expert panel, and the final item set was not restricted to concepts that reached Delphi agreement consensus. Conversely, not every Delphi-endorsed label was retained as a standalone item. The final structure was therefore partly author construction that combined Delphi-endorsed, literature-derived, and expert-developed content.
Item-level provenance classification of all 36 candidate items is presented in Table 1. For each item, the closest documented Delphi concept/status is identified where a defensible correspondence can be made and distinguishes direct Delphi correspondence, use of a terminal intermediate Delphi concept, and literature/expert drafting without a direct Delphi symptom label. These entries are a best-supported reconstruction from archived records rather than a contemporaneous source-tracking log. Headache is not included because it remained uncertain. Complexion is represented directly by the depression item “My complexion appears dull,” and reduced vitality is represented by low-activity and low-energy items in the helplessness domain. Dizziness, hypersomnia, and intelligence, although Delphi-endorsed labels, were not retained as standalone final items after drafting review. The full 36-item wording and 5 response options are presented in Supplementary Appendix A, and the expanded post hoc conceptual mapping is provided in Supplementary Table S5.
This 3-round Delphi study documented the specialist-consensus and draft-generation phase of a KM-informed geriatric mental-health PROM. The panel supported the need for such a measure, a 1-month recall period, Likert-type responses, and several candidate symptom concepts and content sources. However, the study does not establish a validated 4-domain structure or a fully Delphi-endorsed 36-item instrument.
The proposed measure should be distinguished from related instruments by target construct and population rather than by claiming that all items are unique. The GDS is a geriatric depression measure, and the PHQ-9 is a criteria-based depression severity instrument [6,7]. The Hwa-Byung Scale was developed using literature review, patient interviews, item reduction, and psychometric testing to assess a specific culturally patterned syndrome [8]. The Constitution in Chinese Medicine Questionnaire Elderly Edition used a 3-round Delphi process followed by validation in older adults, but it assesses Chinese medicine constitution rather than mental-health outcomes [9]. Instead, the present draft instrument attempts to organize affective, bodily, sensory, and functional experiences relevant to older adults within a Heo-ro-informed framework. This narrower rationale acknowledges important overlap with existing instruments.
The item-level provenance presented in Table 1 and Supplementary Table S5 show the overlap. Worthlessness, low mood, worry, insomnia-related content, fatigue, diminished interest, and appetite loss are not specific to KM and overlap with GDS- or PHQ-9-related content. The intended KM contribution lies in the configuration of these shared symptoms with features such as dull complexion, frequent sighing, bitter or dry mouth, frequent dreaming, flank or throat-chest discomfort, facial flushing with anger, reduced speech and activity, shortness of breath, and the sense that formerly manageable tasks have become burdensome. The KM mapping is post hoc and interpretive; it should be tested empirically rather than treated as evidence that the domains correspond to validated Heo-ro or pattern-identification constructs.
Similarly, the anger domain should not be interpreted as a generic externalizing syndrome. Its final items combine irritability and perceived injustice with bodily expressions that KM clinicians may interpret in relation to constraint or heat patterns. However, the domain was author-curated and not expert panel-rated, and its construct validity remains untested.
Somatic and sensory items create a risk of false-positive interpretation in older adults. Fatigue, dizziness, reduced appetite, hypersomnia, dry mouth, bodily heaviness, dyspnea, and reduced activity may reflect physical disease, frailty, pain, sleep disorders, dehydration, or medication effects, including exposure to an anticholinergic or a diuretic. The preliminary draft tool should therefore not be used as a diagnostic screener, and endorsement of a somatic item should not be attributed to mental-health deterioration or a KM pattern in isolation. Future studies need to collect comorbidity and medication data, examine known-group validity and differential item functioning, compare models with and without medically nonspecific somatic items, and determine whether clinician attribution rules or separate somatic reporting are required.
The sequence of subsequent development work also requires clarification. After the Delphi phase, separate patient/family focus groups, and concept-elicitation work were conducted, followed by item refinement and preliminary reliability and clinical-applicability analyses. These patient-facing activities were not formal cognitive debriefing designed to test the comprehension and interpretation of each item. Formal COnsensus-based Standards for the selection of health status Measurement INstruments-aligned cognitive debriefing has not been completed and should precede confirmatory psychometric validation or field implementation [25]. Earlier wording that implied completion of a definitive validation study has been removed, and the FDA guidance citation previously attached to that claim has been deleted because it did not support the sequence or status of the work.
Several limitations materially constrain the interpretation of this study. The participation rate was 19.6%, nonresponder characteristics were unavailable, and the panel was recruited through 1 professional society. The findings may therefore overrepresent specialists interested in KM neuropsychiatry or PROM development and cannot be assumed to represent general KM practitioners, geriatricians, allied health professionals, patients, or caregivers. The final 4-domain/36-item draft is partly author-curated and not fully Delphi-endorsed.
A further limitation concerns data integrity and reproducibility. Individual expert panel-level ratings could not be retrieved from the archived study files. The surviving aggregate counts permit verification of reported band classifications but do not permit exact IQR calculation, stability assessment, or independent individual-level reanalysis. The interval between 2020 data collection and publication increases the importance of this limitation. Unavailable values were not reconstructed, and the study should be interpreted as a historical expert-consensus record with incomplete reproducibility at the individual-rating level.
The Delphi rounds did not establish an operational cognitive-screening threshold. Future administration protocols should specify a cognitive screening procedure validated in the target language and setting or a protocol-defined clinician judgment. Cross-cultural transfer should not be assumed because several items use KM nosology or idiomatic bodily expressions. Adaptation would require forward-backward translation, bicultural expert review, cognitive interviewing, and testing of structural validity, measurement invariance, and differential item functioning.
The next step should be a prospectively documented sequence: (1) formal cognitive debriefing with older adults; (2) revision of ambiguous or medically nonspecific items; and (3) confirmation of content validity and only then confirmatory evaluation of structural validity, internal consistency, test-retest reliability, construct validity, and responsiveness. The author-curated domains and post hoc KM mapping reported here should be treated as hypotheses for testing, not as validated pattern assignments.
This study provides Delphi-informed input to an author-curated, partly Delphi-endorsed 36-item draft tool across 4 provisional domains. The domains were not rated by the Delphi expert panel, but the final item pool combined Delphi-endorsed, literature-derived, and expert-developed content. The draft tool is not ready for diagnostic, clinical, or research field use. Formal patient-facing content evaluation, management of somatic confounding, and confirmatory psychometric testing are required.
Supplementary materials are available at doi: https://doi.org/10.56986/pim.2026.10.003.

Author Contributions

TYK and JHK contributed equally to this work. Conceptualization, methodology, investigation, data curation, formal analysis, visualization, and writing the original draft: TYK. Conceptualization, methodology, investigation, data curation, formal analysis, and writing (review and editing): JHK. Conceptualization, methodology, supervision, project administration, validation, and writing (review and editing): SYC. All authors read and approved the final manuscript.

Conflicts of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Author Use of AI Tools Statement

The authors used Grammarly and Trinka during manuscript revision for language editing, consistency check, and formatting assistance. All AI-assisted output was critically reviewed and revised by the authors, who take full responsibility for the final content. AI tools were not used to generate or analyze study data, derive results, or make scientific conclusions.

Funding

The authors received no financial support for the research, authorship, and/or publication of this article.

Ethics Statement

The study protocol was reviewed and approved by the institutional bioethics committee of Kyung Hee University [KHSIRB-19-343-(RA)] before recruitment and data collection. The first Delphi round was distributed on February 12, 2020. All procedures were conducted in accordance with the Declaration of Helsinki and relevant institutional regulations. Participation was voluntary, and written informed consent was obtained before data collection.

The surviving Delphi materials consist of the questionnaire, aggregate band-level counts, summary statistics, and round classifications and are available from the corresponding author upon reasonable request. Individual panelist-level ratings are no longer retrievable; therefore, exact IQRs, stability statistics, and independent individual-level reanalysis cannot be reproduced.
pim-2026-10-003f1.jpg
Table 1
Item-level Archived Provenance Classification of the 36-item Draft
Domain Item Final item wording Closest documented Delphi concept/status Best-supported archived provenance classification
Depression 1 I feel emotionally weighed down, as if something is pressing on my mind. Depression - agreement consensus (Round 1) Delphi agreement concept operationalized with literature/expert wording
Depression 2 My complexion appears dull. Complexion - agreement consensus (Round 1) Direct correspondence to Delphi agreement concept
Depression 3 My heart feels heavy with sadness. Depression - agreement consensus (Round 1) Delphi agreement concept operationalized with literature/expert wording
Depression 4 I feel as if I am completely alone in the world. No direct Delphi symptom label documented Literature/expert drafting; no direct Delphi symptom correspondence documented
Depression 5 I feel depressed when I think about myself growing older. Depression - agreement consensus (Round 1) Delphi agreement concept combined with geriatric literature/expert wording
Depression 6 Everything feels meaningless. Meaninglessness - agreement consensus (Round 1) Direct correspondence to Delphi agreement concept
Depression 7 I feel worthless. Unworthiness - agreement consensus (Round 1) Direct correspondence to Delphi agreement concept
Depression 8 I question the meaning of the life I have lived. Meaninglessness - agreement consensus (Round 1) Related Delphi agreement concept combined with literature/expert wording
Depression 9 I sigh often. No direct Delphi symptom label documented Literature/Korean medicine source-text and expert drafting; no direct Delphi symptom correspondence documented
Anxiety 1 I worry all the time. Anxiety - agreement consensus (Round 1) Direct/near-direct operationalization of Delphi agreement concept
Anxiety 2 My mind does not feel at ease. Anxiety - agreement consensus (Round 1) Delphi agreement concept operationalized with expert wording
Anxiety 3 My heart pounds or I feel restless. Anxiety - agreement consensus (Round 1) Delphi agreement concept operationalized with bodily-arousal wording
Anxiety 4 Worries come to mind when I try to sleep. Anxiety and insomnia - agreement consensus (Round 1) Combination of Delphi agreement concepts with expert wording
Anxiety 5 I feel anxious because of bodily changes or pain. Anxiety - agreement consensus (Round 1) Delphi agreement concept combined with geriatric somatic context
Anxiety 6 Unlike before, I become fixated on 1 thought. No direct Delphi symptom label documented Literature/expert drafting; no direct Delphi symptom correspondence documented
Anxiety 7 I cry or laugh even over minor things. Emotional incontinence - agreement consensus (Round 1) Direct/near-direct operationalization of Delphi agreement concept
Anxiety 8 My mouth tastes bitter, or my mouth and lips feel dry. Thirst - terminal intermediate classification (Round 2) Terminal intermediate Delphi concept combined with Korean medicine literature/expert wording
Anxiety 9 I feel as if I am standing at the edge of a cliff. Anxiety - agreement consensus (Round 1) Delphi agreement concept operationalized with expert wording
Anxiety 10 I have many dreams when I sleep. No direct Delphi symptom label documented Literature/Korean medicine source-text and expert drafting; no direct Delphi symptom correspondence documented
Anger 1 I get angry even over minor matters. No direct Delphi symptom label documented Literature/expert drafting within author-organized anger domain
Anger 2 My flank area feels full and uncomfortable. No direct Delphi symptom label documented Korean medicine source-text/expert drafting; no direct Delphi symptom correspondence documented
Anger 3 At times, my chest feels as if it is burning. Chest discomfort - terminal intermediate classification (Round 2) Terminal intermediate Delphi concept combined with Korean medicine literature/expert wording
Anger 4 I feel as if something is stuck between my throat and chest. Chest discomfort - terminal intermediate classification (Round 2) Terminal intermediate Delphi concept combined with Korean medicine literature/expert wording
Anger 5 My eyes and face become red because of anger. No direct Delphi symptom label documented Korean medicine source-text/expert drafting; no direct Delphi symptom correspondence documented
Anger 6 I have become more sensitive than before. Sensitivity - agreement consensus (Round 1) Direct correspondence to Delphi agreement concept
Anger 7 I find it difficult to accept views that differ from mine. No direct Delphi symptom label documented Literature/expert drafting within author-organized anger domain
Anger 8 At times, I feel wronged. Unjustness - agreement consensus (Round 1) Direct/near-direct operationalization of Delphi agreement concept
Helplessness 1 I feel numb and do not feel any emotions. No direct Delphi symptom label documented Literature/expert drafting; no direct Delphi symptom correspondence documented
Helplessness 2 I sometimes stare blankly and am easily startled. Easily startled - agreement consensus (Round 2) Delphi agreement concept operationalized with expert wording
Helplessness 3 I have almost no motivation to do anything. Vitality/fatigue - agreement consensus (Round 1) Related Delphi agreement concepts combined with literature/expert wording
Helplessness 4 I feel uninterested in and bored by things happening around me. No direct Delphi symptom label documented Literature/expert drafting; no direct Delphi symptom correspondence documented
Helplessness 5 I am less active and speak less. Vitality - agreement consensus (Round 1) Related Delphi agreement concept operationalized with functional wording
Helplessness 6 I become short of breath even without vigorous activity. No direct Delphi symptom label documented Korean medicine source-text/expert drafting; no direct Delphi symptom correspondence documented
Helplessness 7 My body feels exhausted and lacking in energy. Fatigue/vitality - agreement consensus (Round 1) Direct/near-direct operationalization of Delphi agreement concepts
Helplessness 8 My appetite has decreased compared with before, and I eat less. No direct Delphi symptom label documented Literature/Korean medicine source-text and expert drafting; no direct Delphi symptom correspondence documented
Helplessness 9 Things I used to do easily now feel burdensome. Fatigue/vitality - agreement consensus (Round 1) Related Delphi agreement concepts combined with functional wording

Provenance entries are the best-supported post hoc classifications that can be made from the surviving Delphi tables, final questionnaire, and documented drafting process. They are not a contemporaneous item-level audit trail. “Direct correspondence” indicates clear lexical/conceptual correspondence to a Delphi agreement concept; “related” indicates that a Delphi concept was operationalized or combined during drafting; “terminal intermediate” indicates a concept that was classified in the 4–6 band rather than agreement consensus; and “no direct Delphi symptom label documented” indicates literature/source-text and expert drafting without a defensible direct symptom-concept match. Headache was excluded. Dizziness, hypersomnia, and intelligence reached Delphi agreement but were not retained as standalone final items.

Table 2
Consensus Classifications for Questionnaire Conceptualization and Construction
Category Statement 1–3 (n) 4–6 (n) 7–9 (n) 7–9 (%) Mean Median SD Round Conclusion
 Section 1: Questionnaire conceptualization
 Need for a standardized questionnaire for Korean medicine treatment or research in older adults 0 0 11 100.0 8.64 9 0.5 1 Agreement consensus
 Respondents should have adequate cognitive and reality-testing abilities 1 2 8 72.7 7.36 8 1.96 1 Agreement consensus*
 The theoretical basis should include symptoms of chronic fatigue/Heo-ro 0 3 8 72.7 6.91 7 0.94 1 Agreement consensus*
 The questionnaire should refer to the Korean Medical Pathologic Aging Scale 0 2 9 81.8 7.27 7 1.19 1 Agreement consensus
 The questionnaire should measure daily functions 0 2 9 81.8 7.73 8 1.19 1 Agreement consensus
 The questionnaire should provide a total score 0 0 11 100.0 8.0 8 0.77 1 Agreement consensus
 The questionnaire should provide a score for each domain 0 0 11 100.0 7.91 8 0.83 1 Agreement consensus
 Section 2: Questionnaire construction
 Age (y) Target adults aged ≥ 65 years 0 1 10 90.9 7.5 8 0.85 1 Agreement consensus
 Age (y) Target adults aged ≥ 70 years 2 3 6 54.5 5.73 7 2.37 3 Uncertain
 Age (y) Target adults aged ≥ 75 years 6 5 0 0.0 3.55 3 1.57 3 Uncertain
 Response Use Likert-type response options 0 1 10 90.9 7.36 7 1.12 1 Agreement consensus
 Response Use visual analogue scales 1 2 8 72.7 6.64 7 1.57 1 Agreement consensus*
 Response Use dichotomous yes/no options 4 6 1 9.1 4.18 5 1.78 3 Uncertain
 Recall Ask about the previous 1 week 5 3 3 27.3 4.27 4 2.33 3 Uncertain
 Recall Ask about the previous 2 weeks 3 2 6 54.5 5.82 7 2.27 3 Uncertain
 Recall Ask about the previous 1 month 0 3 8 72.7 6.82 7 1.17 1 Agreement consensus*
 Recall Ask about the previous 3 months 3 8 0 0.0 4.18 4 1.17 2 Intermediate classification‡

Consensus was defined as ≥ 2/3 of panelists rating a statement in the 7–9 agreement band or the 1–3 disagreement band; with 11 panelists, the minimum integer count was 8. A score of ≥ 8/11 ratings in the 4–6 band was treated as a terminal intermediate classification for carry-forward decisions but not as agreement consensus.

* Threshold-level agreement consensus: 8/11 ratings in the 7–9 band.

‡ Terminal intermediate-band classification. SD, standard deviation.

  • [1] Cruz RR, Beltrame V, Dallacosta FM. Aging and vulnerability: an analysis of 1,062 elderly persons. Rev Bras Geriatr Gerontol 2019;22(3):e180212. Article
  • [2] Ruan Y, Zhu D, Lu J. Social adaptation and adaptation pressure among the “drifting elderly” in China: a qualitative study in Shanghai. Int J Health Plann Manage 2019;34(2):e1149−65.ArticlePubMedPDF
  • [3] World Health Organization. Promoting mental health: concepts, emerging evidence, practice: summary report. Geneva (Switzerland), World Health Organization, 2004.
  • [4] Auerbach RP, Mortier P, Bruffaerts R, Alonso J, Benjet C, Cuijpers P, et al. WHO world mental health surveys international college student project: prevalence and distribution of mental disorders. J Abnorm Psychol 2018;127(7):623−38.ArticlePubMedPMC
  • [5] Payton AR. Mental health, mental illness, and psychological distress: same continuum or distinct phenomena? J Health Soc Behav 2009;50(2):213−27.ArticlePubMedPDF
  • [6] Yesavage JA, Brink TL, Rose TL, Lum O, Huang V, Adey M, et al. Development and validation of a geriatric depression screening scale: a preliminary report. J Psychiatr Res 1982;17(1):37−49.ArticlePubMed
  • [7] Kroenke K, Spitzer RL, Williams JBW. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med 2001;16(9):606−13.ArticlePubMedPMC
  • [8] Kwon JH, Park DG, Min SK, Kim JW, Kwon HI, Lee MS. Development and validation of the Hwa-Byung scale. Korean J Clin Psychol 2008;27(1):237−52. [in Korean].Article
  • [9] Song H, Bai M, Wang J, Xia J, Wang Q, Ni C. Revision and validation of the constitution in Chinese medicine questionnaire (elderly edition) based on the Delphi process. J Tradit Chin Med Sci 2022;9(3):246−56.Article
  • [10] Lee GE, Moon KS, Kim NK, Chung SY, Jung IC, Kang HW. Preliminary study to develop the Korean medical pathologic aging scale and Korean medical pattern identification for dementia. J Korean Med 2017;38(3):111−23. [in Korean].Article
  • [11] Kim JW, Ji GY, Kim KC, Lee IS, Eun JW, Kim KK, et al. Inquiry on post-surgery-induced consumption from the Hyungsang medicine perspective. J Physiol Pathol Korean Med 2008;22(4):930−42. [in Korean]. https://koreascience.kr/article/JAKO200831049579067.do.
  • [12] Kim JH, Kim JU, Kim KH. Review of research topics on consumptive disease and chronic fatigue. J Physiol Pathol Korean Med 2013;27(5):587−93. [in Korean]. https://koreascience.kr/article/JAKO201301442489651.page.
  • [13] Hsu YC, Chiu CJ, Wray LA, Beverly EA, Tseng SP. Impact of traditional Chinese medicine on age trajectories of health: evidence from the Taiwan longitudinal study on aging. J Am Geriatr Soc 2015;63(2):351−7.ArticlePubMedPDF
  • [14] Wang X, Sun H, Zhang A, Sun W, Wang P, Wang Z. Potential role of metabolomics approaches in the area of traditional Chinese medicine: As pillars of the bridge between Chinese and Western medicine. J Pharm Biomed Anal 2011;55(5):859−68.PubMed
  • [15] Jünger S, Payne SA, Brine J, Radbruch L, Brearley SG. Guidance on Conducting and REporting DElphi Studies (CREDES) in palliative care: recommendations based on a methodological systematic review. Palliat Med 2017;31(8):684−706.ArticlePubMedPMCPDF
  • [16] Choi Y, Back Y, Lee J. A study on the development of a mental-emotional health assessment tool and the health status of Korean older adults. Korean J Adult Nurs 1990;2:5−29. [in Korean].
  • [17] Blazer D. Emotional problems in later life: intervention strategies for professional caregivers. New York (NY), Springer Publishing Company, 1998.
  • [18] Luo MS, Chui EWT, Li LW. Longitudinal associations between physical health and mental health among older adults. Aging Ment Health 2020;24(12):1990−8.PubMed
  • [19] Lyons A, Alba B, Heywood W, Fileborn B, Minichiello V, Barrett C, et al. Experiences of ageism and the mental health of older adults. Aging Ment Health 2018;22(11):1456−64.ArticlePubMed
  • [20] Färber F, Rosendahl J. Trait resilience and mental health in older adults: a meta-analytic review. Pers Ment Health 2020;14(4):361−75.ArticlePubMedPDF
  • [21] Veziari Y, Kumar S, Leach M. The development of a survey instrument to measure barriers to the conduct and application of research in complementary and alternative medicine: a Delphi study. BMC Complement Altern Med 2018;18(1):335. PubMedPMC
  • [22] Fitch K, Bernstein SJ, Aguilar MD, Burnand B, LaCalle JR, Lazaro P, et al. The RAND/UCLA appropriateness method user’s manual. Santa Monica (CA), RAND Corporation, 2001.
  • [23] McMillan SS, King M, Tully MP. How to use the nominal group and Delphi techniques. Int J Clin Pharm 2016;38(3):655−62.ArticlePubMedPMCPDF
  • [24] Mölsä M, Punamäki RL, Saarni SI, Tiilikainen M, Kuittinen S, Honkasalo ML. Mental and somatic health and pre- and post-migration factors among older Somali refugees in Finland. Transcult Psychiatry 2014;51(4):499−525.ArticlePubMedPDF
  • [25] Terwee CB, Prinsen CAC, Chiarotto A, Westerman MJ, Patrick DL, Alonso J, et al. COSMIN methodology for evaluating the content validity of patient-reported outcome measures: a Delphi study. Qual Life Res 2018;27(5):1159−70.ArticlePubMedPMCPDF

Figure & Data

References

    Citations

    Citations to this article as recorded by  

      • PubReader PubReader
      • ePub LinkePub Link
      • Cite
        Download Citation
        Download a citation file in RIS format that can be imported by all major citation management software, including EndNote, ProCite, RefWorks, and Reference Manager.

        Format:
        • RIS — For EndNote, ProCite, RefWorks, and most other reference management software
        • BibTeX — For JabRef, BibDesk, and other BibTeX-specific software
        Include:
        • Citation for the content below
        Author-Organized Development of a Partly Delphi-Endorsed Draft Geriatric Mental Health Questionnaire in Korean Medicine
        Perspect Integr Med. 2026;5(3):188-196.   Published online October 20, 2026
        Close
      • XML DownloadXML Download
      Figure
      • 0
      Author-Organized Development of a Partly Delphi-Endorsed Draft Geriatric Mental Health Questionnaire in Korean Medicine
      Image
      Graphical abstract
      Author-Organized Development of a Partly Delphi-Endorsed Draft Geriatric Mental Health Questionnaire in Korean Medicine
      Domain Item Final item wording Closest documented Delphi concept/status Best-supported archived provenance classification
      Depression 1 I feel emotionally weighed down, as if something is pressing on my mind. Depression - agreement consensus (Round 1) Delphi agreement concept operationalized with literature/expert wording
      Depression 2 My complexion appears dull. Complexion - agreement consensus (Round 1) Direct correspondence to Delphi agreement concept
      Depression 3 My heart feels heavy with sadness. Depression - agreement consensus (Round 1) Delphi agreement concept operationalized with literature/expert wording
      Depression 4 I feel as if I am completely alone in the world. No direct Delphi symptom label documented Literature/expert drafting; no direct Delphi symptom correspondence documented
      Depression 5 I feel depressed when I think about myself growing older. Depression - agreement consensus (Round 1) Delphi agreement concept combined with geriatric literature/expert wording
      Depression 6 Everything feels meaningless. Meaninglessness - agreement consensus (Round 1) Direct correspondence to Delphi agreement concept
      Depression 7 I feel worthless. Unworthiness - agreement consensus (Round 1) Direct correspondence to Delphi agreement concept
      Depression 8 I question the meaning of the life I have lived. Meaninglessness - agreement consensus (Round 1) Related Delphi agreement concept combined with literature/expert wording
      Depression 9 I sigh often. No direct Delphi symptom label documented Literature/Korean medicine source-text and expert drafting; no direct Delphi symptom correspondence documented
      Anxiety 1 I worry all the time. Anxiety - agreement consensus (Round 1) Direct/near-direct operationalization of Delphi agreement concept
      Anxiety 2 My mind does not feel at ease. Anxiety - agreement consensus (Round 1) Delphi agreement concept operationalized with expert wording
      Anxiety 3 My heart pounds or I feel restless. Anxiety - agreement consensus (Round 1) Delphi agreement concept operationalized with bodily-arousal wording
      Anxiety 4 Worries come to mind when I try to sleep. Anxiety and insomnia - agreement consensus (Round 1) Combination of Delphi agreement concepts with expert wording
      Anxiety 5 I feel anxious because of bodily changes or pain. Anxiety - agreement consensus (Round 1) Delphi agreement concept combined with geriatric somatic context
      Anxiety 6 Unlike before, I become fixated on 1 thought. No direct Delphi symptom label documented Literature/expert drafting; no direct Delphi symptom correspondence documented
      Anxiety 7 I cry or laugh even over minor things. Emotional incontinence - agreement consensus (Round 1) Direct/near-direct operationalization of Delphi agreement concept
      Anxiety 8 My mouth tastes bitter, or my mouth and lips feel dry. Thirst - terminal intermediate classification (Round 2) Terminal intermediate Delphi concept combined with Korean medicine literature/expert wording
      Anxiety 9 I feel as if I am standing at the edge of a cliff. Anxiety - agreement consensus (Round 1) Delphi agreement concept operationalized with expert wording
      Anxiety 10 I have many dreams when I sleep. No direct Delphi symptom label documented Literature/Korean medicine source-text and expert drafting; no direct Delphi symptom correspondence documented
      Anger 1 I get angry even over minor matters. No direct Delphi symptom label documented Literature/expert drafting within author-organized anger domain
      Anger 2 My flank area feels full and uncomfortable. No direct Delphi symptom label documented Korean medicine source-text/expert drafting; no direct Delphi symptom correspondence documented
      Anger 3 At times, my chest feels as if it is burning. Chest discomfort - terminal intermediate classification (Round 2) Terminal intermediate Delphi concept combined with Korean medicine literature/expert wording
      Anger 4 I feel as if something is stuck between my throat and chest. Chest discomfort - terminal intermediate classification (Round 2) Terminal intermediate Delphi concept combined with Korean medicine literature/expert wording
      Anger 5 My eyes and face become red because of anger. No direct Delphi symptom label documented Korean medicine source-text/expert drafting; no direct Delphi symptom correspondence documented
      Anger 6 I have become more sensitive than before. Sensitivity - agreement consensus (Round 1) Direct correspondence to Delphi agreement concept
      Anger 7 I find it difficult to accept views that differ from mine. No direct Delphi symptom label documented Literature/expert drafting within author-organized anger domain
      Anger 8 At times, I feel wronged. Unjustness - agreement consensus (Round 1) Direct/near-direct operationalization of Delphi agreement concept
      Helplessness 1 I feel numb and do not feel any emotions. No direct Delphi symptom label documented Literature/expert drafting; no direct Delphi symptom correspondence documented
      Helplessness 2 I sometimes stare blankly and am easily startled. Easily startled - agreement consensus (Round 2) Delphi agreement concept operationalized with expert wording
      Helplessness 3 I have almost no motivation to do anything. Vitality/fatigue - agreement consensus (Round 1) Related Delphi agreement concepts combined with literature/expert wording
      Helplessness 4 I feel uninterested in and bored by things happening around me. No direct Delphi symptom label documented Literature/expert drafting; no direct Delphi symptom correspondence documented
      Helplessness 5 I am less active and speak less. Vitality - agreement consensus (Round 1) Related Delphi agreement concept operationalized with functional wording
      Helplessness 6 I become short of breath even without vigorous activity. No direct Delphi symptom label documented Korean medicine source-text/expert drafting; no direct Delphi symptom correspondence documented
      Helplessness 7 My body feels exhausted and lacking in energy. Fatigue/vitality - agreement consensus (Round 1) Direct/near-direct operationalization of Delphi agreement concepts
      Helplessness 8 My appetite has decreased compared with before, and I eat less. No direct Delphi symptom label documented Literature/Korean medicine source-text and expert drafting; no direct Delphi symptom correspondence documented
      Helplessness 9 Things I used to do easily now feel burdensome. Fatigue/vitality - agreement consensus (Round 1) Related Delphi agreement concepts combined with functional wording
      Category Statement 1–3 (n) 4–6 (n) 7–9 (n) 7–9 (%) Mean Median SD Round Conclusion
       Section 1: Questionnaire conceptualization
       Need for a standardized questionnaire for Korean medicine treatment or research in older adults 0 0 11 100.0 8.64 9 0.5 1 Agreement consensus
       Respondents should have adequate cognitive and reality-testing abilities 1 2 8 72.7 7.36 8 1.96 1 Agreement consensus*
       The theoretical basis should include symptoms of chronic fatigue/Heo-ro 0 3 8 72.7 6.91 7 0.94 1 Agreement consensus*
       The questionnaire should refer to the Korean Medical Pathologic Aging Scale 0 2 9 81.8 7.27 7 1.19 1 Agreement consensus
       The questionnaire should measure daily functions 0 2 9 81.8 7.73 8 1.19 1 Agreement consensus
       The questionnaire should provide a total score 0 0 11 100.0 8.0 8 0.77 1 Agreement consensus
       The questionnaire should provide a score for each domain 0 0 11 100.0 7.91 8 0.83 1 Agreement consensus
       Section 2: Questionnaire construction
       Age (y) Target adults aged ≥ 65 years 0 1 10 90.9 7.5 8 0.85 1 Agreement consensus
       Age (y) Target adults aged ≥ 70 years 2 3 6 54.5 5.73 7 2.37 3 Uncertain
       Age (y) Target adults aged ≥ 75 years 6 5 0 0.0 3.55 3 1.57 3 Uncertain
       Response Use Likert-type response options 0 1 10 90.9 7.36 7 1.12 1 Agreement consensus
       Response Use visual analogue scales 1 2 8 72.7 6.64 7 1.57 1 Agreement consensus*
       Response Use dichotomous yes/no options 4 6 1 9.1 4.18 5 1.78 3 Uncertain
       Recall Ask about the previous 1 week 5 3 3 27.3 4.27 4 2.33 3 Uncertain
       Recall Ask about the previous 2 weeks 3 2 6 54.5 5.82 7 2.27 3 Uncertain
       Recall Ask about the previous 1 month 0 3 8 72.7 6.82 7 1.17 1 Agreement consensus*
       Recall Ask about the previous 3 months 3 8 0 0.0 4.18 4 1.17 2 Intermediate classification‡
      Table 1 Item-level Archived Provenance Classification of the 36-item Draft

      Provenance entries are the best-supported post hoc classifications that can be made from the surviving Delphi tables, final questionnaire, and documented drafting process. They are not a contemporaneous item-level audit trail. “Direct correspondence” indicates clear lexical/conceptual correspondence to a Delphi agreement concept; “related” indicates that a Delphi concept was operationalized or combined during drafting; “terminal intermediate” indicates a concept that was classified in the 4–6 band rather than agreement consensus; and “no direct Delphi symptom label documented” indicates literature/source-text and expert drafting without a defensible direct symptom-concept match. Headache was excluded. Dizziness, hypersomnia, and intelligence reached Delphi agreement but were not retained as standalone final items.

      Table 2 Consensus Classifications for Questionnaire Conceptualization and Construction

      Consensus was defined as ≥ 2/3 of panelists rating a statement in the 7–9 agreement band or the 1–3 disagreement band; with 11 panelists, the minimum integer count was 8. A score of ≥ 8/11 ratings in the 4–6 band was treated as a terminal intermediate classification for carry-forward decisions but not as agreement consensus.

      Threshold-level agreement consensus: 8/11 ratings in the 7–9 band.

      Terminal intermediate-band classification. SD, standard deviation.


      Perspect Integr Med : Perspectives on Integrative Medicine
      TOP