|Year : 2019 | Volume
| Issue : 4 | Page : 1337-1341
Comparison of psychiatric screening Instruments: GHQ-28, BSI and MMPI
Jamileh Jahangirian1, Hossein Akbari2, Ehsan Dadgostar3
1 School of Medicine, Ghom University of Medical Sciences, Ghom, Iran
2 Social Determinants of Health (SDH) Research Center, Kashan University of Medical Sciences, Iran
3 Halal Research Center of IRI, FDA, Tehran, Iran
|Date of Web Publication||25-Apr-2019|
Dr. Hossein Akbari
Social Determinants of Health Research Center (SDH), Kashan
Source of Support: None, Conflict of Interest: None
Background: Clinical interview comprises a method for of psychiatric disorders diagnosis. Given the cost, time, and expertise required for clinical assessment; alternative tools to accurately substitute clinical interviews are having high value. We conduct this study to compare the screening accuracy of GHQ-28, BSI, and MMPI. Materials and Methods: Considering a diagnostic value, this study was conducted on 983 students and 3 psychiatric screening tools; GHQ-28, BSI, and MMPI were completed by students. Among the whole participants, 237 students were interviewed by the clinical psychiatrists on the basis of DSM-IV-IR Criteria. Based on ANOVO and Chi-square, results compare was made. Kappa correlation -coefficient was calculated in a pairwise manner; eventually the diagnostic accuracy of each tool was determined by the means of ROC analysis. Results: The diversity of psychiatric disorders by GHQ-28, was about 39.1, on the basis of BST was 44.8% and 44% for MMPI. The sensitivity and specificity of GHQ-28 was 85.9% and 87.8% considering 21.5 as the cut-off point; respectively. Considering 41/5 as the cut-off point for the BSI test, sensitivity and specificity were 81.2% and 90.8%; respectively, and 88.2% and 91.4% for the MMPI test with the cut-off point of 63.5 compared to clinical interview, the MMPI test was associated with the greatest accurate staging, ranging about 90.3%. Conclusions: The results of this study according to clinical assessment reveal that GHQ-28, BSI, and MMPI psychiatric tools have high sensitivity and specificity and MMPI possessed the greatest efficiency compared to other evaluated tools.
Keywords: BSI, clinical interview, GHQ, MMPI, screening, sensitivity, specificity
|How to cite this article:|
Jahangirian J, Akbari H, Dadgostar E. Comparison of psychiatric screening Instruments: GHQ-28, BSI and MMPI. J Family Med Prim Care 2019;8:1337-41
|How to cite this URL:|
Jahangirian J, Akbari H, Dadgostar E. Comparison of psychiatric screening Instruments: GHQ-28, BSI and MMPI. J Family Med Prim Care [serial online] 2019 [cited 2019 Jul 18];8:1337-41. Available from: http://www.jfmpc.com/text.asp?2019/8/4/1337/257068
| Background|| |
Mental health comprises indispensable aspects of health and plays a major role in the efficiency of the society., A recent report of WHO demonstrates that as many as 450 million people are affected by psychiatric disorders.
Results from a wide variety of investigations reveals the prevalence of psychiatric disorders in Iran, ranging from 14.9% to 26.9% during 1969–2001., And 34.8%–49.8% among the universities students., Furthermore, regarding the studies conducted in 1999, 2008, and 2011, the prevalence of psychiatric disorders was estimated to be 21%, 17.1%, and 23.6%; respectively. Another study with the same study group and tools was carried out in Tehran in 1999, 2008, and 2011. In this study, the prevalence of psychiatric disorders was 21.5%, 34.2%, and 39.6%; respectively. In order to estimate the prevalence of psychiatric disorders, the investigators turned to apply methods other than hospital reports, since World War II.
Assuming the time and cost required for clinical interview performed by psychiatrists and psychologists, disorders may mask as a result of inappropriate referral to a physician. Early and careful detection of psychiatric disorders may avoid the development of its serious complications. Appropriate determination of psychiatric disorders is not only beneficial in the treatment of patients, but also advantageous in avoiding unexpected expenses due to treatment and complications.
Considering the fact that detection of independent tools to evaluate the mental health may play an essential role in the society well-being, a wide variety of tools have been administered to evaluate psychiatric disorders and screening of the high-risk groups of the society and many studies have been conducted worldwide for the screening of psychiatric disorders; among which the diagnostic accuracy varies widely., Up to now, Only a few studies have been aimed to compare the result of these screening tools.
Regarding the high prevalence of psychiatric disorders in the society and the importance of early diagnosis in reducing complications and lack of abundance-related studies, we conduct this study to compare the diagnostic value of GHQ-28, MMPI, and BSI for the diagnosis of psychiatric disorders.
| Materials and Methods|| |
This study carries diagnostic value, in which mental health of students was evaluated by the means of GHQ-28, MMPI, and BSI questionnaire. The results were further compared with the clinical interview.
This research was conducted among 983 students of Kashan university of medical sciences between 2011 and 2012. Furthermore, 237 students underwent clinical interviews based on DSM-IV-TR criteria.
Samples were taken availably style; that is, from each educational degree one class was selected and all the students of the mentioned class entered the study.
GHQ-28 (General Health Questionnaire-28)
This questionnaire was created by Goldberg in 1972 to detect psychiatric disorders in healthcare centers and many various settings. This 28-item questionnaire was firmed by Goldberg and Hiller in 1979 which consists of 4 scales: Somatic symptoms, anxiety and insomnia, social dysfunction and severe depression., This tool involves 28 questions and 4 subscales; each of which contains 7 questions. Scoring of this questionnaire is as follows: 0, 1, 2, and 3 score is given to A-D options; respectively. As a result, the score for each subscale ranges from 0 to 21 and 0 to 84 in the entire questionnaire. The score of 22 has been considered as the cut-off point of this study. Scores higher than 22 are indicative of psychiatric disorders, whereas scores below 22 are considered to be normal. Palahang and Yaghoubi estimated the reliability of this study 91% and 88%, respectively. They also calculated Cronbach's alpha values about 84% for somatic symptoms, 79% for social function, 81% for depression, and 91% for mental health status.,
BSI questionnaire (Brief Symptom Inventory)
This questionnaire is the summarized form of symptom checklist-90-R (SCL-90-R), which was first represented by Derogatis et al. (in 1973). It was further revised with psychometric interpretation and analysis. BSI consists of 53 questions, each of which is scored from 0 to 3. Derogates, Rickles, and Rock considered the intrinsic reliability of BSI as appropriate. The score of 41 is the cut-off point of this questionnaire, meaning that scores greater than 41 are considered to be sick. This questionnaire was first translated and validated by Mirzaee in 1979.
MMPI Questionnaire (Multiphasic Personality Inventory Minnesota)
This questionnaire was first published in 1943 and created by Start Hathaway and Charley McKinley. This questionnaire involves 71 questions and 0/91 is its appropriate reliability coefficient. Besides, subscales exist in this questionnaire and score of 63 has been considered as the cut-off point.
Given the major disadvantages of the original 565-item MMPI questionnaire, for instance being time consuming and boring; the Iranian version of MMPI was developed on the basis of Iranian cultures. This new version was shorter and lesser time required answering. Considering the Iraninan culture, Okhovvat et al. extracted 71 questions from the original MMPI questionnaire and converted them into a short questionnaire. Furthermore, they initiated a series of investigations.,,
After selection of each class, the GHQ-28 questionnaires were distributed among the students. The participants were asked to write their personal details down. After 15 minutes, these questionnaires were collected. The BSI questionnaire was distributed in a same manner 1 week later. MMPI questionnaire was distributed 1 week later in a same manner too, except that the participants had 20 minutes to complete the forms. After the completion of these questionnaires, according to the psychiatric picture of each participant and the attitude of clinical psychiatrist, 237 students were selected on the basis of minimum and maximum scores. After that these students were asked to refer for clinical interview.
In the beginning, demographic characteristics of the study group were described. The participant's scores were determined in different psychometric tools and Chi-squared test was applied to compare these groups. Spearman correlation coefficient and Kappa contingency coefficient were used to compare tools. By the means of clinical interviews, the participant's results were compared (Gold standard). On the basis of ROC analysis, the sensitivity and specificity of each test was compared with the clinical interview. Considering YOUDEN index, the best cut-off point was determined and area under the ROC curve was calculated. Confidence interval was measured for each test. P < 0.05 was represented as a reliable baseline.
| Results|| |
Primary findings: Among the 983 participants, 250 students were male (25.4%) and remaining participants were female. 392 students (39.9%) were 20 years of age or younger; and the remaining participants were older. 862 students (87.7%) were single, and remaining participants being married. As a whole, 371 students (39.1%) were likely to be affected by psychiatric disorders on the basis of GHQ-28 test; whereas on the basis of BSI and MMPI test 388 students (44.8%) and 405 students (44%) were suspicious to be affected by psychiatric disorders; respectively. There were no significant differences between the score of GHQ-28 test with gender, educational degree, and matrimony status of participants (P > 0.05); mean while a significant correlation between age and educational degree and the scores were apparent (P < 0.5). According to the BSI test, there was a significant differences between the mean scores of both sexes (P < 0.05); whereas there was no correlation between other variables and the BSI score (P > 0.1). In addition, results of the MMPI test demonstrate no significant correlation with the other variables, except for the age (P > 0.1) [Table 1].
|Table 1: Frequency of mental disorder in students according screening tests and demographic variables|
Click here to view
By the means of the GHQ-28, BSI, and MMPI tests the mean scores of students were calculated as: 20.7, 44.8, and 63.6, respectively. MMPI and GHQ-28 showed the maximum correlation coefficient of about 0.588 (P < 0.001). In addition, these tests possessed the maximum values of contingency as 0.445 (P < 0.001) [Table 2].
|Table 2: The mean value and standard deviation and contingency and correlation coefficients of the psychometric tests|
Click here to view
The sensitivity and specificity of GHQ-28 test were calculated as 85.9% and 87.7%. The score of 21 was considered as the best cut-off point for this tool and area under the curve of ROC was determined as about 0.926. Furthermore, the corrected classification was measured as 87.3%. BSI sensitivity and specificity were calculated as 81.2% and 90.8%. The remaining values for the BSI test are as follows: 41.5 as the cut-off point, 0.915 for the area under the curve and 87.3 for the corrected classification. The above values for the MMPI test were determined as 88.2%, 91.4%, 63.5, 0.928, and 0.796, respectively [Table 3] and [Diagram 1].
|Table 3: The reliability and validity of psychometric tests in comparison with clinical interviews|
Click here to view
| Discussion|| |
Our findings demonstrate that 39.1% of participants have likely positive scores on the basis of GHQ-28 test, 44.8% participants for the BSI test and 44% for the MMPI test. Compared to other studies conducted in Iran and other parts of the world, these results are comparatively significant. By the means of GHQ-28 test, Montazeri et al. estimated the prevalence of psychiatric disorders 44%. A study of Salaki, from Ilam University of medical sciences and health services, presented the prevalence of psychiatric disorders 42%. Regarding the SCL-90, the prevalence of psychiatric disorders ranges between 16.5-48.5% in another study conducted previously. The prevalence of psychiatric disorders among Iranian female and Bulgarian children ranges between 8.6-39%., Demographic characteristics of the area under study, the method of administration, performance time of study and various cut-off points, altogether; contributes to significant differences between the prevalence of psychiatric disorders.
Results of our study report Spearman correlation coefficient between GHQ-28 and BSI test as 0.588, between GHQ-28 and MMPI as 0/488 and 0.533 for the BSI and MMPI test. In multiple other studies, reported the correlation between MMPI and BSI; ranging between 0.3 and 0.72 and between BSI and SCL-90; ranging between 0.92 and 0.99.,
By the means of CIDI check list, our study aimed to determine the validity of three psychometric tools, the GHQ-28, MMPI, and BSI tests in comparison with clinical interview. Assuming 21.5 as the cut-off point, the sensitivity and specificity of GHQ-28 test were reported as 85.9% and 87.7%, respectively. Area under the curve and Alpha Cronbach's Coefficient Alpha were calculated as 0.926 and 0.942, respectively. In addition, internal consistency coefficient of Spearman-Brown correlation was 0.822. Results from another study shows the sensitivity and specificity of GHQ-28 test as 81% and 58.2%, respectively. Corresponding other related studies, the validity coefficient varies widely through a wide spectrum, in which the sensitivity and specificity of GHQ-28 test ranges between 35.7%–91% and 10%–98%; respectively., Our study demonstrates the values of sensitivity, specificity, area under the ROC curve, and corrected classification for the BSI test as 81.2%, 90.8%, 41.5 and 87.3%; respectively. Furthermore, 0/967 was calculated as its Alpha Cronbach's Coefficient Alpha. Meanwhile, in another study this coefficient was estimated at 0.82 and 0.87 for the quantification depression and anxiety, respectively. According to the results of various studies, the Internal consistency of DSI-98 and BSI-18 were reported to be profitable. Compared to clinical interview, BSI test possessed the greatest accurate categorization, being about 72.4%.
The sensitivity, specificity, area under the ROC curve and Cronbach's Coefficient Alpha of MMPI are as follows: 88.%, 91.4%, 0.928 and 0.875, respectively. The corrected classification was measured about 83.4%; however, this value was reported in another study as about 0.8., In another study, values of corrected classification, sensitivity, and specificity of the MMPI test were reported as 86%, 86% and 100%, respectively., A study of Ali Ghaffari et al. measured the rate of concordance between MMPI and clinical interview for the diagnosis of mental disorders of being about 0.35. Another study represents the sensitivity and specificity of MMPI test for the diagnosis of mood disorders of being 26% and 91% and Kappa correlation coefficient as 0.20, respectively, when it is compared to the clinical interview. Results of another study demonstrate the contingency coefficient of MMPI test and clinical interview of about 0.6.
Considering the results of our study and previous researches, MMPI carries high diagnostic reliability in diagnosis of psychiatric disorders in comparison with GHQ-28 and BSI tests. Several studies revealed similar results. Meanwhile, only a single study was conducted by the authors of this research, which involved smaller study group; The results of which was in favor of MMPI greater validity in comparison to other tests.
| Conclusion|| |
By the mean of GHQ-28, MMPI, and BSI tests, the prevalence of psychiatric disorders were estimated to be relatively high. Significant correlation was observed among psychometric tests. All the tools were of high validity in diagnosis of psychiatric disorders, with the MMPI being the most accurate.
Financial support and sponsorship
Conflicts of interest
There are no conflicts of interest.
| References|| |
Sadock BJ, Sadock VA. Kaplan and Sadock's synopsis of psychiatry: Behavioral sciences/clinical psychiatry. Lippincott Williams & Wilkins; 2011.
Akbari H, Zeraati H, Mohammad K, Farahani MM, Omidi A. The validity of GHQ-28, BSI and MMPI tests in mental heath status of students. Life Sci J 2013;10(Suppl.):314-9.
Tavakolizadeh J, Gahramani M, Hadizadeh TF, Chamanzari H. The Survey of Mental Health Condition on Smoked and Non-Smoked Youths of Gonabad City. QUARTERLY OFOGH-E-DANESH 2003;9:1-9.
Bash K, Bash-Liechti J. Studies on the epidemiology of neuropsychiatric disorders among the population of the city of Shiraz, Iran. Soc Psychiatry Psychiatr Epidemiol 1974;9:163-71.
Noorbala AA, Bagheri Yazdi SA, Yasamy MT, Mohammad K. Mental health survey of the adult population in Iran. Br J Psychiatry 2004;184:70-3.
Shariati M, Yunesian M, Vash JH. Mental health of medical students: A cross-sectional study in Tehran. Psychological Reports 2007;100:346-54.
Adham D, Salem Safi P, Amiri M, Dadkhah B, Mohammadi M, Mozaffari N, et al
. The survey of mental health status in ardabil university of medical sciences students in 2007-2008. J Ardabil Univ Med Sci 2008;8:229-34.
Noorbala AA, Damari B, Riazi-Isfahani S. Evaluation of mental disorders incidence trend in Iran. Daneshvar Med 2014;21:1-10.
Furukawa TA, Kessler RC, Slade T, Andrews G. The performance of the K6 and K10 screening scales for psychological distress in the Australian National Survey of Mental Health and Well-Being. Psychol Med 2003;33:357-62.
Kessler RC, Andrews G, Colpe LJ, Hiripi E, Mroczek DK, Normand SL, et al
. Short screening scales to monitor population prevalences and trends in non-specific psychological distress. Psychol Med 2002;32:959-76.
Cairney J, Veldhuizen S, Wade TJ, Kurdyak P, Streiner DL. Evaluation of 2 measures of psychological distress as screeners for depression in the general population. Canadian J Psychiatry 2007;52:111-20.
Phares EJ. Clinical Psychology: Concepts, Methods, & Profession. Thomson Brooks/Cole Publishing Co.; 1992.
Akbari H, Zeraati H, Mohammad K, Mahmoodi-Farahani M, Omidi A. Evaluating the agreement between the three screening instruments for mental disorder among students of Kashan University of Medical Sciences during 2011-2012. Feyz Journal of Kashan University of Medical Sciences 2014;17:575-81.
Dibajnia P, Bakhtiari M. Mental health status of the students in the faculty of Rehabilitation, Shahid Beheshti University, 2002. J Ardabil Univ Med Sci 2002;2:27-32.
Goldberg DP, Hillier VF. A scaled version of the general health questionnaire. Psychol Med 1979;9:139-45.
Noorbala A, Mohammad K. The validation of general health questionnaire-28 as a psychiatric screening tool. Hakim Res J 2009;11:47-53.
Shayan Z, Pourmovahed Z, Najafipour F, Abdoli AM, Mohebpour F, Najafipour S. Factor structure of the General Health Questionnaire-28 (GHQ-28) from infertile women attending the Yazd Research and Clinical Center for Infertility. Int J Reprod Biomed 2015;13:801-8.
Yaghubi N, Nasr M, Shahmohammadi D. Epidemiology of mental disorders in urabn and rural areas of Sowmaesara-Gillan. Iranian J Psychiatry Clin Psychol 1995;1:55-60.
Derogatis LR, Spencer P. Brief Symptom Inventory. Pearson Upper Saddle River, NJ: BSI; 1993.
Sahin N, Durak BA, Uǧurtaş S. The validity, reliability and factor structure of the Brief Symptom Inventory (BSI). Turk Psikiyatri Derg 2002;13:125-35.
Butcher JN. Minnesota multiphasic personality inventory. The Corsini Encyclopedia of Psychology 2010:1-3.
Fathi-Ashtiani A, Dastani M. Psychological tests: Personality and mental health. Tehran: Besat; 2009. p. 46.
Anderson JL, Sellbom M. The Minnesota Multiphasic Personality Inventory–2. Forensic Uses of Clinical Assessment Instruments, Routledge 2013:37-78.
Montazeri A, Harirchi AM, Shariati M, Garmaroudi G, Ebadi M, Fateh A. The 12-item General Health Questionnaire (GHQ-12): Translation and validation study of the Iranian version. Health Qual Life Outcomes 2003;1:66.
Saki K, Kaikhavani S. Mental health of Ilam medical university students. J Ilam Univ Med Sci 2002;10:34-5.
Hosseini SH, Mousavi S. Mental health status of newly Admitted students of Mazandaran university of medical sciences in 1999-2000 Academic year. J Mazandaran Univ Med Sci 2000;10:23-33.
Makowska Z, Merecz D, Mościcka A, Kolasa W. The validity of general health questionnaires, GHQ-12 and GHQ-28, in mental health studies of working people. Int J Occup Med Environ Health 2002;15:353-62.
Sadeghirad B, Haghdoost AA, Amin-Esmaeili M, Ananloo ES, Ghaeli P, Rahimi-Movaghar A, et al
. Epidemiology of major depressive disorder in Iran: A systematic review and meta-analysis. Int J Prev Med 2010;1:81-91.
Mikolajczyk RT, Maxwell AE, Naydenova V, Meier S, El Ansari W. Depressive symptoms and perceived burdens related to being a student: Survey in three European countries. Clin Pract Epidemiol Ment Health 2008;4:19.
Tran TD, Tran T, La B, Lee D, Rosenthal D, Fisher J. Screening for perinatal common mental disorders in women in the north of Vietnam: A comparison of three psychometric instruments. J Affect Disord 2011;133:281-93.
Mitchell AJ, Rao S, Vaze A. Can general practitioners identify people with distress and mild depression? A meta-analysis of clinical accuracy. J Affect Disord 2011;130:26-36.
Khalil AA, Hall LA, Moser DK, Lennie TA, Frazier SK. The psychometric properties of the brief symptom inventory depression and anxiety subscales in patients with heart failure and with or without renal dysfunction. Arch Psychiatr Nurs 2011;25:419-29.
[Table 1], [Table 2], [Table 3]