Validation of a new tool for evaluating subjects’ satisfaction with medicine package leaflets
a cross‑sectional descriptive study
Keywords:
Package leaflets, Package inserts, Medicines, Validation, Likert scale, RegulationAbstract
BACKGROUND: Package leaflets of medicines need to be intelligible, but tools for their evaluation are scarce. OBJECTIVE: To validate a new tool for assessing subjects’ satisfaction with medicine package leaflets (LiS‑RPL). DESIGN AND SETTING: Cross-sectional descriptive study conducted in two regions of Portugal (Lisbon and Centre). METHODS: 503 participants (53.1% male) were selected according to convenience and homogenously distributed into three groups: 1 to 6; 7 to 12; and > 12 years of schooling. LiS-RPL was developed based on international regulation guidelines and was initially composed of 14 items. Twelve package leaflets were tested. Dimensionality calculations included: exploratory factor analysis and minimum rank factor analysis; Kaiser-Meyer-Olkin index and Bartlett’s sphericity test to assess matrix adequacy for exploratory factor analysis; exploratory bifactor analysis with Schmid-Leiman solution to detect possible existence of a broad second-order factor; and Bentler’s Simplicity Index and Loading Simplicity Index to assess factor simplicity. Diverse coefficients were calculated to assess reliability. RESULTS: Minimum rank factor analysis detected a two-factor or single-factor structure. Exploratory factor analysis with 12 items showed a two-factor structure, explaining 69.11% of the variance. These items were strongly correlated with each other (r = 0.80). Schmid-Leiman: all items seemed to represent the general factor (loadings above 0.50), which was 76.4% of the extracted variance. Simplicity indices were good (percentile 99): Bentler’s Simplicity Index of 0.99 and Loading Simplicity Index of 0.48. Internal consistency indexes indicated good reliability. LiS-RPL was shown to be homogenous. CONCLUSION: LiS-RPL is a validated tool for evaluating subjects’ satisfaction with medicine package leaflets.
Downloads
References
European Commission. Guideline on the readability of the labelling and package leaflet of medicinal products for human use. Brussels: European Commission; 2009. Available from: https://ec.europa.eu/health/sites/health/files/files/eudralex/vol-2/c/2009_01_12_readability_guideline_final_en.pdf. Accessed in 2019 (Nov 3).
Heads of Medicines Agencies. Decentralised Procedure. RMS Day 70 Preliminary Assessment report – Overview and list of questions; 2008. Available from: http://www.hma.eu/fileadmin/dateien/Human_Medicines/CMD_h_/Assesment_Reports/docs/Day_70-PrAR-O-DCP-vers2.doc. Accessed in 2019 (Nov 3).
Pires CM, Cavaco AM. Exploring the perspectives of potential consumers and healthcare professionals on the readability of a package insert: a case study of an over-the-counter medicine. Eur J Clin Pharmacol. 2014;70(5):583-8. PMID: 24458540; doi: 10.1007/s00228-014-1645-6.
Pires C, Vigário M, Cavaco A. Readability of medicinal package leaflets: a systematic review. Revista de Saúde Pública. 2015;49:4. PMID: 25741660;doi: 10.1590/s0034-8910.2015049005559.
Pires C, Cavaco A, Vigário M. How sociodemographic features impact subjects’ opinion on packages leaflets of medicines? AMJ.2017;10(9):774-84. doi: 10.21767/AMJ.2017.3110.
Koo M, Krass I, Aslani P. Evaluation of written medicine information: validation of the Consumer Information Rating Form. Ann Pharmacother. 2007;41(6):951-6. PMID: 17488832; doi: 10.1345/aph.1K083.
Ryan M, Scott DA, Reeves C, et al. Eliciting public preferences for healthcare: a systematic review of techniques. Health Technol Assess. 2001;5(5):1-186. PMID: 11262422.
McCool ME, Wahl J, Schlecht I, Apfelbacher C. Evaluating Written Patient Information for Eczema in German: Comparing the Reliability of Two Instruments, DISCERN and EQIP. PLoS One. 2015;10(10):e0139895. PMID: 26440612; doi: 10.1371/journal.pone.0139895.
Logullo P, Torloni MR, de O C Latorraca C, Riera R. The Brazilian Portuguese Version of the DISCERN Instrument: Translation Procedures and Psychometric Properties. Value Health Reg. 2019;20:172-9. PMID: 31622803; doi: 10.1016/j.vhri.2019.09.001.
Pires C, Rosa P, Vigário M, Cavaco A. Short Assessment of Health Literacy (SAHL) in Portugal: development and validation of a self-administered tool. Prim Health Care Res Dev. 2018;1-18. PMID: 29444735; doi: 10.1017/ S1463423618000087.
Pires C, Vigário M, Cavaco A. Factors influencing subjects’ comprehension of a set of medicine package inserts. Int J Clin Pharm. 2016;38(4):888-98. PMID: 27107582; doi: 10.1007/s11096-016-0305-6.
Leporini C, De Sarro G, Russo E. Adherence to therapy and adverse drug reactions: is there a link? Expert Opin Drug Saf. 2014:13 Suppl 1:S41-55. PMID: 25171158; doi: 10.1517/14740338.2014.947260.
Sullivan GM, Artino AR Jr. Analyzing and interpreting data from Likert-type scales. J Grad Med Educ. 2013;5(4):541-2. PMID: 24454995; doi: 10.4300/JGME-5-4-18.
Pires C, Vigário M, Cavaco A. Package leaflets of the most consumed medicines in Portugal: safety and regulatory compliance issues. A descriptive study. Sao Paulo Med J. 2015;133(2):91-100. PMID: 25337666; doi: 10.1590/1516-3180.2013.7860023.
European Medicine Agency. Product-information templates; 2018. Available from: http://www.ema.europa.eu/ema/index.jsp?curl=pages/regulation/document_listing/document_listing_000134.jsp. Accessed in 2019 (Nov 3).
Mardia KV. Measures of multivariate skewness and kurtosis with applications. Biometrika. 1970;57(3):519-30. doi: 10.2307/2334770.
O’Connor BP. SPSS and SAS programs for determining the number of components using parallel analysis and Velicer’s MAP test. Behavior Research Methods, Instruments, & Computers. 2000;32(3):396-402. Available from: https://link.springer.com/article/10.3758/BF03200807. Accessed in 2019 (Nov 3).
Timmerman ME, Lorenzo-Seva U. Dimensionality assessment of ordered polytomous items with parallel analysis. Psychological Methods. 2011;16(2):209-20. PMID: 21500916; doi: 10.1037/a0023353.
Reckase MD. Multidimensional item response theory. New York: Springer; 2009. ISBN: 978-0-387-89976-3.
Ruiz FJ, Suárez-Falcón JC, Barón-Rincón D, et al. Factor structure and psychometric properties of the Dysfunctional Attitude Scale Revised in Colombian undergraduates. Rev Latinoam Psicol. 2016;48(2):81-7. doi: 10.1016/j.rlp.2005.10.002.
Volker MA, Dua EH, Lopata C, et al. Factor Structure, Internal Consistency, and Screening Sensitivity of the GARS-2 in a Developmental Disabilities Sample. Autism Res Treat. 2016;2016:8243079. PMID: 26981279; doi: 10.1155/2016/8243079.
Gorsuch R. Factor analysis. 2nd edition. Hillsdale, NJ: Lawrence Erlbaum Associates; 1983. ISBN-13: 978-0898592023.
Schmid J, Leiman JM. The development of hierarchical factor solutions. Psychometrika. 1957;22(1):53-61. doi: 10.1007/BF02289209.
Brouwer D, Meijer RR, Zevalkink J. On the factor structure of the Beck Depression Inventory-II: G is the key. Psychol Assess. 2013;25(1):136-45. PMID: 22800089; doi: 10.1037/a0029228.
Decker SL, Englund JA, Roberts AM. Higher-order factor structures for the WISC-IV: implications for neuropsychological test interpretation. Appl Neuropsychol Child. 2014;3(2):135-44. PMID: 24716872; doi: 10.1080/21622965.2012.737760.
Wolff HG, Preising K. Exploring item and higher order factor structure with the Schmid-Leiman solution: syntax codes for SPSS and SAS. Behav Res Methods. 2005;37(1):48-58. PMID: 16097343; doi: 10.3758/BF03206397.
Bentler PM. Factor simplicity index and transformations. Psychometrika. 1977;42(2):277-95. doi: 10.1007/BF02294054.
Caballero P, Delgado-García BE, Orts-Cortes I, et al. Validation of the Spanish version of Mackey childbirth satisfaction rating scale. BMC Pregnancy Childbirth. 2016;16:78. PMID: 27084092; doi: 10.1186/s12884-016-0862-7.
Costa C, Tyner K, Rosa PJ, Sousa C, Henriques S. Desenvolvimento e Validação da Escala de Literacia Mediática e Informacional para Alunos dos 2º e 3º Ciclos do Ensino Básico em Portugal. Revista Lusófona de Educação. 2018;41(41):11-28. Available from: http://revistas.ulusofona.pt/index.php/rleducacao/article/view/6487. Accessed in 2019 (Nov 3).
Zumbo BD, Gadermann AM, Zeisser C. Ordinal versions of coefficients alpha and theta for Likert rating scales. Journal of Modern Applied Statistical Methods. 2007;6(1):21-29. doi: 10.22237/jmasm/1177992180.
McDonald RP. Test theory: A unified treatment. New York: Lawrence Erlbaum Associates Publishers; 1999. ISBN-13: 978-0805830750.
Widhiarso W, Ravand H. Estimating reliability coefficient for multidimensional measures: A pedagogical illustration. Review of Psychology. 2014;21(2):111-21.
Cohen J. Statistical power analysis for the behavioral sciences. 2nd edition. New York: Lawrence Erlbaum Associates Publishers; 1988. ISBN: 978-0-12-179060-8.
Lorenzo-Seva U, Ferrando PJ. FACTOR: A computer program to fit the exploratory factor analysis model. Behav Res Methods. 2006;38(1):88-91. PMID: 16817517.
Prati G, Cicognani E, Albanesi C. Psychometric Properties of a Multidimensional Scale of Sense of Community in the School. Front Psychol. 2017;8:1466. PMID: 28900407; doi: 10.3389/fpsyg.2017.01466.
de Jonge T, Veenhoven R, Arends L. Homogenizing Responses to Different Survey Questions on the Same Topic: Proposal of a Scale Homogenization Method Using a Reference Distribution. Social Indicators Research. 2014;117(1):275–300. doi: 10.1007/s11205-013-0335-6.
