Volume 27, Issue 2 (Summer 2021)                   IJPCP 2021, 27(2): 248-263 | Back to browse issues page


XML Persian Abstract Print


Download citation:
BibTeX | RIS | EndNote | Medlars | ProCite | Reference Manager | RefWorks
Send citation to:

Farrahi H, Gharraee B, Oghabian M A, Zare R, Pirmoradi M R, Najibi S M et al . Psychometric Properties of the Persian Version of Patient Health Questionnaire-9. IJPCP 2021; 27 (2) :248-263
URL: http://ijpcp.iums.ac.ir/article-1-3200-en.html
1- Kavosh Cognitive Behavior Sciences and Addiction Research Center, Department of Psychiatry, School of Medicine, Guilan University of Medical Sciences, Rasht, Iran.
2- Department of Clinical Psychology, School of Behavioral Sciences and Mental Health (Tehran Institute of Psychiatry), Iran University of Medical Sciences, Tehran, Iran.
3- Department of Medical Physics and Biomedical Engineering, School of Medicine, Tehran University of Medical Sciences, Tehran, Iran.
4- Neuroscience Research Center, Guilan University of Medical Sciences, Rasht, Iran. , r.zare88@yahoo.com
5- Department of Statistics, School of Sciences, Shiraz University, Shiraz, Iran.
6- Department of Neuroscience and Addiction Studies, School of Advanced Technologies in Medicine, Tehran University of Medical Sciences, Tehran, Iran.
Full-Text [PDF 6516 kb]   (3260 Downloads)     |   Abstract (HTML)  (6158 Views)
Full-Text:   (2193 Views)

1. Introduction

In recent decades, several scales have been developed and validated to measure depression and have been used in clinical and non-clinical settings. One of the most widely used scales of depression in the last two decades is the Patient Health Questionnaire-9 (PHQ-9). This measure is used for screening depression in primary care [15]. One of the advantages of this tool is that it fully complies with the criteria for depression in the fourth edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-IV) [13]. In general, studies that have been conducted to validate PHQ-9 in different populations, medical settings, and different countries have shown that it has good psychometric properties and is a valid measure for evaluation of depressive symptoms. So far, four studies have been conducted to validate the PHQ-9 in Iran, using different target population, sample size, accompanied questionnaires, and methodology. Given the need for access to screening tools for depressive symptoms [9], the present study aimed to evaluate the psychometric properties of Persian version of PHQ-9 in the student population. We used a relatively large sample in order to increase the statistical robustness. We evaluated Convergent Validity (CV) and Discriminant Validity (DV) as well as test-retest reliability and internal consistency at the same time, and assessed the construct validity given the contradictory results of previous study [22] on the factor structure of PHQ-9.

2. Method 

This is a descriptive study. The study population included all students of Guilan University of Medical Sciences in the academic year 2018-19. Samples were selected using a convenience sampling method. After collecting data and excluding incomplete questionnaires, the final sample size was 463. To investigate the reliability of the Persian PHQ-9, both internal consistency and test-retest reliability for a 2-week interval were evaluated. Construct validity of PHQ-9 and its similarity or difference among the samples were evaluated using exploratory and confirmatory factor analyses. The CV and DV were also assessed by Pearson correlation test. To evaluate the convergent validity, the second version of the Beck Depression Inventory (BDI-II), the depression subscale of the 21-item Depression Anxiety Depression Inventory (DASS-21), the neuroticism subscale of NEO Five Factor Inventory (NEO-FFI) and the negative affect subscale of the Positive Affect and Negative Affect Scale (PANAS) were used. According to the study literature, these scales either measure the construct of depression or are in common with PHQ-9 in the basic construct of general psychopathology (neuroticism) and negative mood [9]. The openness subscale of NEO-FFI and the positive affect subscale of PANAS were also used to assess the discriminant validity. The positive affect subscale measures the reversed construct of depression. On the other hand, since people with low levels of openness are often prone to experience negative mood, openness is considered as the reversed construct of depression [9, 36]. In studies on the validation of other measures of depression, the above mentioned questionnaires have also been used to examine convergent validity and discriminant validity [9].

3. Results

The Cronbach’s alpha coefficient of 0.856 and the intraclass correlation coefficient of 0.869 indicated the high test-retest reliability and internal consistency of the Persian PHQ-9, respectively. The Kaiser-Meyer-Olkin (KMO) value of 0.889 indicated that the sample size was adequate, and the results of Bartlett’s test of sphericity (Chi-square= 1468.31, df=36, P<0.0001) showed that the conditions for performing factor analysis were established. The results of exploratory factor analysis indicated that all items were in one factor (Range= 0.39-0.60, Eigenvalue= 4.28) and explained 47.95% of the total variance. The fitting indices of the one-factor model of the Persian PHQ-9 were reported as follows: Chi-square/Degree of Freedom =4.39 (P>0.05), Comparative Fit Index= 0.92, Non-Normed Fit Index= 0.90, Root Mean Square Error of Approximation= 0.03, and Standardized Root Mean Square Residual= 0.065. Standardized coefficients with a range of 0.063-0.68 showed that all items were related to one factor. Table 1 shows the results of CV and DV. Positive correlation of Persian PHQ-9 with BDI-II (r= 0.769), the neuroticism subscale of NEO-FFI (r= 0.508), the depression subscale of DASS-21 (r= 0.647) and the negative affect subscale of PANAS (r= 0.430) showed its acceptable CV, and its negative correlation with the positive affect subscale of PANAS (r= -0.444) indicated its acceptable DV, while it had no significant relationship with the openness subscale of NEO-FFI (r= 0.116)

4. Discussion and Conclusions

The Persian PHQ-9 has acceptable validity and reliability to be used on Iranian student population. Our results can be compared with the findings of previous studies conducted on other countries on the student population [17, 25, 26, 51-54]. The results showed that the Persian version of PHQ-9 had high internal consistency and acceptable test-retest reliability. It had a positive correlation with the constructs of similar questionnaires and a negative correlation or non-correlation with the questionnaires having unrelated constructs. The construct validity assessment showed it the Persian PHQ-9 had a one-factor structure. The results of some studies conducted in other countries on the factor structure of PHQ-9 are somehow not consistent with our results. Some studies reported a single-factor structure [54, 55], while other studies found two- or three-factor structures with a diverse distribution of items in each factor [22, 53, 56]. Due to the consistence of our results with those of previous four studies [27-30] regarding the factor structure of the Persian version of PHQ-9, it can be concluded that it has one-dimensional construct validity to be used in various clinical and non-clinical settings in Iran. It has acceptable psychometric properties to be used on Iranian population, including the student population, and can be used as a short and easy-to-understand tool for screening, diagnosing and monitoring of the depression treatment outcome.

Ethical Considerations

Compliance with ethical guidelines

The study was approved by the Ethics Committee of Tehran University of Medical Sciences (Code: IR.IUMS.REC.1397.132). All ethical principles are considered in this article. The participants were informed about the purpose of the research and its implementation stages. They were also assured about the confidentiality of their information and were free to leave the study whenever they wished, and if desired, the research results would be available to them.

Funding

This study did not receive any specific grant from funding agencies in the public, commercial, or nonprofit sectors.

Authors contributions

Conceptualization, research, editing, and finalization: All Authors; Methodology: Hassan Farhi, Banafsheh Gharaei and Roghayeh Zare; Data analysis, drafting: Hassan Farhi and Roghayeh Zare; Sources: Hassan Farhi; Supervision and coordination: Banafsheh Gharraee.

Conflicts of interest

The authors declare no conflict of interest.
 

References

  1. Sharifi V, Amin-Esmaeili M, Hajebi A, Motevalian A, Radgoodarzi R, Hefazi M, et al. Twelve-month prevalence and correlates of psychiatric disorders in Iran: The Iranian mental health survey, 2011. Archives of Iranian Medicine. 2015; 18(2):76-84. [PMID]
  2. Kessler RC, Berglund P, Demler O, Jin R, Merikangas KR, Walters EE. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the national comorbidity survey replication. Archives of General Psychiatry. 2005; 62(6):593-602. [DOI:10.1001/archpsyc.62.6.593]
  3. Hasin DS, Sarvet AL, Meyers JL, Saha TD, Ruan WJ, Stohl M, et al. Epidemiology of adult DSM-5 major depressive disorder and its specifiers in the United States. JAMA Psychiatry. 2018; 75(4):336-46. [DOI:10.1001/jamapsychiatry.2017.4602]
  4. The ESEMeD/MHEDEA 2000 Investigators, Alonso J, Angermeyer MC, Bernert S, Bruffaerts R, Brugha TS, et al. Prevalence of mental disorders in Europe: Results from the European Study of the Epidemiology of Mental Disorders (ESEMeD) project. Acta Psychiatrica Scandinavica. 2004; 109(s420):21-7. [DOI:10.1111/j.1600-0047.2004.00327.x]
  5. Thornicroft G, Chatterji S, Evans-Lacko S, Gruber M, Sampson N, Aguilar-Gaxiola S, et al. Undertreatment of people with major depressive disorder in 21 countries. The British Journal of Psychiatry. 2017; 210(2):119-24. [DOI:10.1192/bjp.bp.116.188078]
  6. Mojtabai R, Stuart EA, Hwang I, Eaton WW, Sampson N, Kessler RC. Long-term effects of mental disorders on educational attainment in the national comorbidity survey ten-year follow-up. Social Psychiatry and Psychiatric Epidemiology. 2015; 50(10):1577-91. [DOI:10.1007/s00127-015-1083-5]
  7. Mojtabai R, Stuart EA, Hwang I, Susukida R, Eaton WW, Sampson N, et al. Long-term effects of mental disorders on employment in the national comorbidity survey ten-year follow-up. Social Psychiatry and Psychiatric Epidemiology. 2015; 50(11):1657-68. [DOI:10.1007/s00127-015-1097-z]
  8. Wong ST, Manca D, Barber D, Morkem R, Khan Sh, Kotecha J, et al. The diagnosis of depression and its treatment in Canadian primary care practices: An epidemiological study. CMAJ Open. 2014; 2(4):E337-42. [DOI:10.9778/cmajo.20140052]
  9. Bentley KH, Gallagher MW, Carl JR, Barlow DH. Development and validation of the overall depression severity and impairment scale. Psychological Assessment. 2014; 26(3):815-30. [DOI:10.1037/a0036216]
  10. Ito M, Bentley KH, Oe Y, Nakajima Sh, Fujisato H, Kato N, et al. Assessing depression related severity and functional impairment: The Overall Depression Severity and Impairment Scale (ODSIS). PloS One. 2015; 10(4):e0122969. [DOI:10.1371/journal.pone.0122969]
  11. Wu Y, Levis B, Sun Y, Krishnan A, He Ch, Riehm KE, et al. Probability of major depression diagnostic classification based on the SCID, CIDI and MINI diagnostic interviews controlling for hospital anxiety and depression scale - Depression subscale scores: An individual participant data meta-analysis of 73 primary studies. Journal of Psychosomatic Research. 2020; 129:109892. [DOI:10.1016/j.jpsychores.2019.109892]
  12. Spitzer RL, Kroenke K, Williams JBW, The Patient Health Questionnaire Primary Care Study Group. Validation and utility of a self-report version of PRIME-MD: The PHQ primary care study. JAMA. 1999; 282(18):1737-44. [DOI:10.1001/jama.282.18.1737]
  13. Kroenke K, Spitzer RL, Williams JBW. The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine. 2001; 16(9):606-13. [DOI:10.1046/j.1525-1497.2001.016009606.x]
  14. Kroenke K, Spitzer RL. The PHQ-9: A new depression diagnostic and severity measure. Psychiatric Annals. 2002; 32(9):509-15. [DOI:10.3928/0048-5713-20020901-06]
  15. Mitchell AJ, Yadegarfar M, Gill J, Stubbs B. Case finding and screening clinical utility of the Patient Health Questionnaire (PHQ-9 and PHQ-2) for depression in primary care: A diagnostic meta-analysis of 40 studies. BJPsych Open. 2016; 2(2):127-38. [DOI:10.1192/bjpo.bp.115.001685]
  16. American Psychiatric Association Staff, American Psychiatric Association, Frances A, American Psychiatric Association. Task Force on DSM-IV. Diagnostic and statistical manual of mental disorders: DSM-IV. Washington, DC: American Psychiatric Association; 1994. https://books.google.com/books?id=kLdrAAAAMAAJ&dq
  17. Keum BT, Miller MJ, Inkelas KK. Testing the factor structure and measurement invariance of the PHQ-9 across racially diverse U.S. college students. Psychological Assessment. 2018; 30(8):1096-106. [DOI:10.1037/pas0000550]
  18. Beard C, Hsu KJ, Rifkin LS, Busch AB, Björgvinsson T. Validation of the PHQ-9 in a psychiatric sample. Journal of Affective Disorders. 2016; 193:267-73. [DOI:10.1016/j.jad.2015.12.075]
  19. Rathore JS, Jehi LE, Fan Y, Patel SI, Foldvary-Schaefer N, Ramirez MJ, et al. Validation of the Patient Health Questionnaire-9 (PHQ-9) for depression screening in adults with epilepsy. Epilepsy & Behavior. 2014; 37:215-20. [DOI:10.1016/j.yebeh.2014.06.030]
  20. Wang W, Bian Q, Zhao Y, Li X, Wang W, Du J, et al. Reliability and validity of the Chinese version of the Patient Health Questionnaire (PHQ-9) in the general population. General Hospital Psychiatry. 2014; 36(5):539-44. [DOI:10.1016/j.genhosppsych.2014.05.021]
  21. Arrieta J, Aguerrebere M, Raviola G, Flores H, Elliott P, Espinosa A, et al. Validity and utility of the Patient Health Questionnaire (PHQ)-2 and PHQ-9 for screening and diagnosis of depression in Rural Chiapas, Mexico: A cross-sectional study. Journal of Clinical Psychology. 2017; 73(9):1076-90. [DOI:10.1002/jclp.22390]
  22. Ferreira T, Sousa M, Salgado J. Brief assessment of depression: Psychometric properties of the Portuguese version of the Patient Health Questionnaire (PHQ-9). The Psychologist: Practice & Research Journal. 2018; 1(2):1-15. [DOI:10.33525/pprj.v1i2.36]
  23. Reich H, Rief W, Brähler E, Mewes R. Cross-cultural validation of the German and Turkish versions of the PHQ-9: An IRT approach. BMC Psychology. 2018; 6:26. [DOI:10.1186/s40359-018-0238-z]
  24. Muramatsu K, Miyaoka H, Kamijima K, Muramatsu Y, Tanaka Y, Hosaka M, et al. Performance of the Japanese version of the Patient Health Questionnaire-9 (J-PHQ-9) for depression in primary care. General Hospital Psychiatry. 2018; 52:64-9. [DOI:10.1016/j.genhosppsych.2018.03.007]
  25. Shin Ch, Ko YH, An H, Yoon HK, Han Ch. Normative data and psychometric properties of the Patient Health Questionnaire-9 in a nationally representative Korean population. BMC Psychiatry. 2020; 20:194. [DOI:10.1186/s12888-020-02613-0]
  26. Na PJ, Yaramala SR, Kim JA, Kim H, Goes FS, Zandi PP, et al. The PHQ-9 Item 9 based screening for suicide risk: A validation study of the Patient Health Questionnaire (PHQ) 9 Item 9 with the Columbia Suicide Severity Rating Scale (C-SSRS). Journal of Affective Disorders. 2018; 232:34-40. [DOI:10.1016/j.jad.2018.02.045]
  27. Khamseh ME, Baradaran HR, Javanbakht A, Mirghorbani M, Yadollahi Z, Malek M. Comparison of the CES-D and PHQ-9 depression scales in people with type 2 diabetes in Tehran, Iran. BMC Psychiatry. 2011; 11:61. [DOI:10.1186/1471-244X-11-61]
  28. Dadfar M, Kalibatseva Z, Lester D. Reliability and validity of the Farsi version of the Patient Health Questionnaire-9 (PHQ-9) with Iranian psychiatric outpatients. Trends in Psychiatry and Psychotherapy. 2018; 40(2):144-51. [DOI:10.1590/2237-6089-2017-0116]
  29. Rafiey H, Alipour F, LeBeau R, Salimi Y, Ahmadi Sh. Factor structure of Persian translation of the Patient Health Questionnaire in Iranian earthquake survivors. Iranian Journal of Psychiatry and Behavioral Sciences. 2018; 12(4):e59416. [DOI:10.5812/ijpbs.59416]
  30. Samimi Ardestani M, Davari Ashtiani R, Rezaei Z, Vasegh S, Gudarzi SS. Validation of Persian version of PHQ-9 for diagnosis of major depressive episode in psychiatric wards in IRAN. International Journal of Applied Behavioral Sciences. 2018; 5(2):1-8. https://journals.sbmu.ac.ir/ijabs/article/view/21094
  31. Rahimian-Boogar I, Mohajeri-Tehrani MR. [Risk factors associated with depression in type 2 diabetics (Persian)]. Feyz. 2012; 16(3):261-74. http://feyz.kaums.ac.ir/article-1-1499-en.html
  32. Yaghubi H. [Psychometric properties of the 10 questions version of the Kessler psychological distress scale (K-10) (Persian)]. Journal of Applied Psychological Research. 2015; 6(4):45-57. https://japr.ut.ac.ir/article_57963_en.html
  33. Comrey AL, Lee HB. A first course in factor analysis. Hlilsdale: Lawrence Erlbaum Associates; 1992. https://books.google.com/books?id=RSsVAgAAQBAJ&source=gbs_navlinks_s
  34. Kline P. Handbook of psychological testing. London: Routledge; 2013. [DOI:10.4324/9781315812274]
  35. Marsh HW, Hau KT, Wen Zh. In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler’s (1999) findings. Structural Equation Modeling: A Multidisciplinary Journal. 2004; 11(3):320-41. [DOI:10.1207/s15328007sem1103_2]
  36. Takahashi M, Shirayama Y, Muneoka K, Suzuki M, Sato K, Hashimoto K. Low openness on the revised NEO personality inventory as a risk factor for treatment-resistant depression. PloS One. 2013; 8(9):e71964. [DOI:10.1371/journal.pone.0071964]
  37. Kroenke K, Spitzer RL, Williams JBW, Löwe B. The Patient Health Questionnaire somatic, anxiety, and depressive symptom scales: A systematic review. General Hospital Psychiatry. 2010; 32(4):345-59. [DOI:10.1016/j.genhosppsych.2010.03.006]
  38. Beck AT, Epstein N, Brown G, Steer RA. An inventory for measuring clinical anxiety: Psychometric properties. Journal of Consulting and Clinical Psychology. 1988; 56(6):893-7. [DOI:10.1037/0022-006X.56.6.893]
  39. Erford BT, Johnson E, Bardoshi G. Meta-analysis of the English version of the Beck depression inventory-second edition. Measurement and Evaluation in Counseling and Development. 2016; 49(1):3-33. [DOI:10.1177/0748175615596783]
  40. Stefan-Dabson K, Mohammadkhani P, Massah-Choulabi. [Psychometric characteristics of Beck depression inventory-II in patients with major depressive disorder (Persian)]. Archives of Rehabilitation. 2007; 8:80-6. http://rehabilitationj.uswr.ac.ir/article-1-135-en.html
  41. Doos Ali Vand H, Gharraee B, Asgharnejad Farid AA, Rezvanifa Sh. [Psychometric properties of short form Persian version of the dysfunctional beliefs and attitudes about sleep scale (Persian)]. Iranian Journal of Psychiatry and Clinical Psychology. 2014; 20(3):264-75. http://ijpcp.iums.ac.ir/article-1-2235-en.html
  42. Brown TA, Chorpita BF, Korotitsch W, Barlow DH. Psychometric properties of the Depression Anxiety Stress Scales (DASS) in clinical samples. Behaviour Research and Therapy. 1997; 35(1):79-89. [DOI:10.1016/S0005-7967(96)00068-X]
  43. Henry JD, Crawford JR. The short-form version of the Depression Anxiety Stress Scales (DASS-21): Construct validity and normative data in a large non-clinical sample. British Journal of Clinical Psychology. 2005; 44(2):227-39. [DOI:10.1348/014466505X29657] [PMID]
  44. Asghari Moghaddam MA, Saed F, Dibajnia P, Zangeneh J. [A preliminary validation of the Depression, Anxiety and Stress Scales (DASS) in non-clinical sample (Persian)]. Daneshvar Raftar. 2008; 15(31):23-38. https://www.sid.ir/fa/journal/ViewPaper.aspx?ID=119894
  45. Sahebi A, Asghari MJ, Salari RS. [Validation of Depression Anxiety and Stress Scale (DASS-21) for an Iranian population (Persian)]. Developmental Psychology (Journal of Iranian Psychologists). 2005; 1(4):36-54. http://jip.azad.ac.ir/article_512443.html
  46. Costa PT, McCrae RR. Revised NEO Personality Inventory (NEO PI-R) and NEP Five-Factor Inventory (NEO-FFI): Professional manual. Odessa, FL: Psychological Assessment Resources; 1992. https://books.google.com/books?id=H_jXtgAACAAJ&dq
  47. Piedmont RL. The revised NEO personality inventory: Clinical and research applications. New York: Springer; 2013. https://books.google.com/books?id=q7YACAAAQBAJ&dq
  48. Garousi Farshi MT, Mehryar AH, Ghazi Tabatabaei M. [Application of the NEOPI-R test and analytic evaluation of it's characteristics and factorial structure among Iranian university students (Persian)]. Journal of Humanities. 2001; 11(39):173-98. http://ensani.ir/fa/article/264514
  49. Watson D, Clark LA, Tellegen A. Development and validation of brief measures of positive and negative affect: the PANAS scales. Journal of Personality and Social Psychology. 1988; 54(6):1063-70. [DOI:10.1037/0022-3514.54.6.1063]
  50. Bakhshipour A, Dezhkam M. [A confirmatory factor analysis of the Positive Affect and Negative Affect Scales (PANAS) (Persian)]. Journal of Psychology. 2006; 9(4):351-65. https://www.sid.ir/fa/journal/ViewPaper.aspx?ID=49349
  51. Zhang YL, Liang W, Chen ZM, Zhang HM, Zhang JH, Weng XQ, et al. Validity and reliability of Patient Health Questionnaire-9 and Patient Health Questionnaire-2 to screen for depression among college students in China. Asia-Pacific Psychiatry. 2013; 5(4):268-75. [DOI:10.1111/appy.12103]
  52. Lyoo YC, Ju S, Kim E, Kim JE, Lee JH. The patient health questionnaire-15 and its abbreviated version as screening tools for depression in Korean college and graduate students. Comprehensive Psychiatry. 2014; 55(3):743-8. [DOI:10.1016/j.comppsych.2013.11.011]
  53. Miranda CAC, Scoppetta O. Factorial structure of the Patient Health Questionnaire-9 as a depression screening instrument for university students in Cartagena, Colombia. Psychiatry Research. 2018; 269:425-9. [DOI:10.1016/j.psychres.2018.08.071]
  54. Bélanger E, Thomas KS, Jones RN, Epstein-Lubow G, Mor V. Measurement validity of the Patient-Health Questionnaire-9 in US nursing home residents. International Journal of Geriatric Psychiatry. 2019; 34(5):700-8. [DOI:10.1002/gps.5074]
  55. Ryan TA, Bailey A, Fearon P, King J. Factorial invariance of the patient health questionnaire and generalized anxiety disorder questionnaire. British Journal of Clinical Psychology. 2013; 52(4):438-49. [DOI:10.1111/bjc.12028]
  56. Boothroyd L, Dagnan D, Muncer S. PHQ-9: One factor or two? Psychiatry Research. 2019; 271:532-4. [DOI:10.1016/j.psychres.2018.12.048]
  57. McCord DM, Provost RP. Construct validity of the PHQ-9 depression screen: Correlations with substantive scales of the MMPI-2-RF. Journal of Clinical Psychology in Medical Settings. 2019; 27(1):150-7. [DOI:10.1007/s10880-019-09629-z]
  58. Spinhoven P, Elzinga BM, Hovens JGFM, Roelofs K, van Oppen P, Zitman FG, et al. Positive and negative life events and personality traits in predicting course of depression and anxiety. Acta Psychiatrica Scandinavica. 2011; 124(6):462-73. [DOI:10.1111/j.1600-0447.2011.01753.x]
Type of Study: Original Research | Subject: Psychiatry and Psychology
Received: 2020/04/5 | Accepted: 2020/06/16 | Published: 2021/07/1

Add your comments about this article : Your username or Email:
CAPTCHA

Rights and permissions
Creative Commons License This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

© 2024 CC BY-NC 4.0 | Iranian Journal of Psychiatry and Clinical Psychology

Designed & Developed by : Yektaweb