Psychometric properties of the Providers Survey in the Brazilian context of mental health: a validation study
Keywords:
Validation study [publication type], Mental health recovery, Reproducibility of results, Data management, Health professionals, Psychometric properties, Instrument validationAbstract
BACKGROUND: Precisely determining the aspects related to an instrument’s validity and reliability measures allows for greater assurance of the quality of the results.
OBJECTIVES: To analyze the psychometric properties of The Providers Survey in the Brazilian context of mental health services.
DESIGN AND SETTING: The instrument validation study was conducted in Montes Claros, Minas Gerais, Brazil.
METHODS: The validation study was conducted using the Consensus-based Standards for the Selection of Health Measurement Instruments checklist to analyze its validity and reliability.
RESULTS: A committee of expert judges performed content validation after which the Content Validity Index was calculated. Construct validation took place through Exploratory Factor Analysis using the Kaiser-Meyer-Olkin Test criterion and Bartlett’s Sphericity Test. Reliability was verified using test-retest reliability. The significance level adopted for the statistical tests was 5% (P < 0.05). The final instrument comprised 54 questions. The Content Validity Index was 97%. Exploratory Factor Analysis identified a Kaiser-Meyer-Olkin index of 0.901 and Bartlett’s Sphericity Test with P < 0.001. We obtained a Cronbach’s alpha coefficient of 0.95 and an intraclass correlation coefficient of 0.849.
CONCLUSIONS: The Providers Survey, translated and adapted into Portuguese, was named the Work Assessment Instrument for the Recovery of Mental Health. It presented adequate psychometric properties for evaluating work-related practices for the recovery of psychosocial care network users.
Downloads
References
Almeida JMC. Mental health policy in Brazil: what’s at stake in the changes currently under way. Cad Saude Publica. 2019;35(11):e00129519. PMID: 31691781; https://doi.org/10.1590/0102-311X00129519.
Brekke E, Lien E, Davidson L, Biong S. First-person experiences of recovery in co-occurring mental health and substance use conditions. Adv Dual Diagn. 2017;10(1):13-24. Available from: https://core.ac.uk/download/ pdf/225917883.pdf. Accessed in 2023 (Jul 2)
Baccari IO, Campos RT, Stefanello S. Recovery: revisão sistemática de um conceito [Recovery: systematic review of a concept]. Cien Saude Colet. 2015;20(1):125-36. PMID: 25650605; https://doi.org/10.1590/141381232014201.04662013.
Costa M, Baker M, Davidson L, et al. Provider perspectives on employment for people with serious mental illness. Int J Soc Psychiatry. 2017;63(7):632-40. PMID: 28797214; https://doi.org/10.1177/0020764017725769.
Martins RCA. Reformas psiquiátricas e o processo de ressignificação do trabalho na saúde mental. Rev Nufen: Phenom. Interd. 2019;11(2),96116. Available from: http://pepsic.bvsalud.org/pdf/rnufen/v11n2/a07. pdf. Accessed in 2023 (Jun 2).
Araújo AK de, Soares VL. Trabalho e saúde mental: relato de experiência em um Caps AD III na cidade de João Pessoa, PB. Saúde em Debate. Saúde Debate. 2018;42 spe4:275-84. https://doi.org/10.1590/0103-11042018S422.
Suijkerbuijk YB, Schaafsma FG, van Mechelen JC, et al. Interventions for obtaining and maintaining employment in adults with severe mental illness, a network meta-analysis. Cochrane Database Syst Rev. 2017;9(9):CD011867. PMID: 28898402; https://doi.org/10.1002/14651858.CD011867.pub2.
Chatterji P, Alegría M, Lu M, Takeuchi D. Psychiatric disorders and labor market outcomes: evidence from the National Latino and Asian American Study. Health Econ. 2007;16(10):1069-90. PMID: 17294497; https://doi.org/10.1002/hec.1210.
Silva APD, Ferigato SH. Saúde mental e trabalho: diálogos sobre direito, desejo e necessidade de acesso. Cad Bras Ter Ocup. 2017;25(4):803-16. http://dx.doi.org/10.4322/2526-8910.ctoAO0951.
Andersen M. Heterogeneity and the effect of mental health parity mandates on the labor market. J Health Econ. 2015;43:74-84. PMID: 26210944; https://doi.org/10.1016/j.jhealeco.2015.06.008.
Anunciação L. An Overview of the History and Methodological Aspects of Psychometrics. Journal for ReAttach Therapy and Developmental Diversities. 2018;1(1):44-58.
Alves JP, Rocha JFD, Lacerda MKS, et al. Adaptação Transcultural do Instrumento Providers Survey para o seu uso no Brasil. Int J Dev Res.
;10(12):42775-78. Available from: https://www.journalijdr.com/ adapta%C3%A7%C3%A3o-transcultural-do-instrumento-providerssurvey-para-o-seu-uso-no-brasil. Accessed in 2023 (Jun 2).
Mokkink LB, Prinsen CAC, Patrick DL, et al. COSMIN Study Design checklist for Patient-reported outcome measurement instruments. Department of Epidemiology and Biostatistics. 2019. https://www.cosmin.nl/wpcontent/uploads/COSMIN-study-designing-checklist_final.pdf#
Belluci Júnior JA, Matsuda LM. Construção e validação de instrumento para avaliação do acolhimento com classificação de risco [Construction and validation of na instrument to assess the Reception with Risk Rating]. Rev Bras Enferm. 2012;65(5):751-7. PMID: 23338578; https:// doi.org/10.1590/S0034-71672012000500006.
Silva EJ da, Amaral AR, Paiva DM, et al. Elaboração e análise de validade e confiabilidade de um questionário para avaliar o conhecimento de médicos e enfermeiros da atenção primária sobre o tracoma. Rev Bras Oftalmol. 2020;79(6):391-6. https://doi.org/10.5935/0034-7280.20200085.
Souza AC, Alexandre NMC, Guirardello EB. Psychometric properties in instruments evaluation of reliability and validity. Epidemiol Serv Saude. 2017;26(3):649-9. PMID: 28977189; https://doi.org/10.5123/ S1679-49742017000300022.
Rezai M, Kolne K, Bui S, Lindsay S. Measures of Workplace Inclusion: A Systematic Review Using the COSMIN Methodology. J Occup Rehabil. 2020;30(3):420-54. PMID: 31939009; https://doi.org/10.1007/s10926020-09872-4.
Trindade CS, Kato SK, Gurgel LG, Reppold CT. Processo de construção e busca de evidências de validade de conteúdo da equalis-OAS. Aval Psicol. 2018;17(2):271-7. http://dx.doi.org/10.15689/ap.2018.1702.14501.13.
Hongyu K. Análise Fatorial Exploratória: resumo teórico, aplicação e interpretação. Engineering and Science. 2018;7(4):88-103. Available from: https://periodicoscientificos.ufmt.br/ojs/index.php/eng/article/ view/7599/5210. Accessed in 2023 (Jun 2).
Terwee CB, Bot SD, de Boer MR, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42. PMID: 17161752; https://doi.org/10.1016/j. jclinepi.2006.03.012.
Keszei AP, Novak M, Streiner DL. Introduction to health measurement scales. J Psychosom Res. 2010;68(4):319-23. PMID: 20307697; https:// doi.org/10.1016/j.jpsychores.2010.01.006.
Oliveira LB, Soares FA, Silveira MF, et al. Domestic violence on children: development and validation of an instrument to evaluate knowledge of health professionals. Rev Lat Am Enfermagem. 2016;24:e2772. PMID: 27556878; https://doi.org/10.1590/1518-8345.0805.2772.
Lee KM, Lee J, Chung CY, et al. Pitfalls and important issues in testing reliability using intraclass correlation coefficients in orthopaedic research. Clin Orthop Surg. 2012;4(2):149-55. PMID: 22662301; https:// doi.org/10.4055/cios.2012.4.2.149.
Ferreira AA, Hongyu K. Análise Fatorial Exploratória Aplicada no Questionário do Cadastro Único. Biodiversidade. 2018;17(1):28-39. Available from: https://periodicoscientificos.ufmt.br/ojs/index.php/ biodiversidade/article/view/6533. Accessed in 2023 (Jun 2).
Costa ES, Oliveira DS, Silva JAF, Holanda LVM. Greenwashing: pesquisa exploratória para replicar a escala de identificação do fenômeno por meio da técnica de análise fatorial exploratória – AFE. Revista Livre de Sustentabilidade e Empreendedorismo. 2020;5(4):132-46. Available from: http://www.relise.eco.br/index.php/relise/article/view/395/360. Accessed in 2023 (Jun 2).
Erci B, Yildirim H, Isik K. Psychometric evaluation of the patient perspective on care and rehabilitation scale in geriatric patients. Arch Gerontol Geriatr. 2019;81:84-90. Erratum in: Arch Gerontol Geriatr. 2019;103906. PMID: 30529761; https://doi.org/10.1016/j.archger.2018.11.013.
de Souza NCO, van Eyken EBB dell’Orto, Garcia CSNB. Avaliação das propriedades psicométricas do inventário de fatores de risco no ambiente domiciliar para o sistema respiratório da criança - INFRADRECRI/Evaluation of the psychometric properties of the inventory of risk factors in the home environment for the child’s respiratory system – INFRADRECRI. Braz J Develop. 2022;8(1):8162-76. https://doi.org/10.34117/bjdv8n1-549.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 São Paulo Medical Journal
This work is licensed under a Creative Commons Attribution 4.0 International License.
