Current issue
Archive
About the Journal
About us
Aims and Scope
Indexing and Abstracting
Editorial Office
Open Access Policy
Publication Ethics
Contact
For Authors
Editorial Policy
Peer Review Policy
Manuscript Preparation Guidelines
Copyright & Licensing
Publication Fees
Fast-Track Paper Publication Option
Conflict Interest Guidance
Submit an Article
Special Issues
News & Editorials
“Fake,” “Predatory,” and “Pseudo” Journals: Charlatans Threatening Trust in Science
Shifting the Journal submission-review system to the Editorial System Manuscript December 27, 2017.
ORIGINAL ARTICLE
Validation of the knowledge on the Noor evidence-based medicine questionnaire for healthcare professionals: Rasch analysis
1
Department of Family Medicine, School of Medical Sciences, Health Campus, Universiti Sains Malaysia, Kubang Kerian, Kelantan, MALAYSIA
2
Klinik Kesihatan Putatan, Jalan Pasir Putih, Putatan, Sabah, MALAYSIA
3
Department of Medicine, Faculty of Medicine, Universiti Malaya, Wilayah Persekutuan Kuala Lumpur, MALAYSIA
Online publication date: 2023-08-06
Publication date: 2023-11-01
Electron J Gen Med 2023;20(6):em534
KEYWORDS
ABSTRACT
Aim:
This study aimed to examine the construct verification of the knowledge on the Noor evidence-based medicine (EBM) questionnaire using the Rasch measurement model.
Methods:
A cross-sectional study was conducted among ninety healthcare professionals working in a government hospital. The Rasch model was used to investigate the distribution of statistics, unidimensionality, polarity, misfit, and Wright map.
Results:
The Rasch analysis showed that the 15 items had high reliability of items at 0.96, while reliability for persons were 0.81. Item K15 is a misfit (PtMea Corr=0.22, outfit MnSq=1.95, outfit z-std=5.00, infit MnSq=1.63, infit z-std=3.60); the item does not contribute to the construction of scale but not degrading. Three items (K1, K14, and K9) can easily be answered even by low ability respondents.
Conclusions:
The Noor EBM questionnaire knowledge is robust with excellent psychometric properties that can be used for both research and clinical purposes.
This study aimed to examine the construct verification of the knowledge on the Noor evidence-based medicine (EBM) questionnaire using the Rasch measurement model.
Methods:
A cross-sectional study was conducted among ninety healthcare professionals working in a government hospital. The Rasch model was used to investigate the distribution of statistics, unidimensionality, polarity, misfit, and Wright map.
Results:
The Rasch analysis showed that the 15 items had high reliability of items at 0.96, while reliability for persons were 0.81. Item K15 is a misfit (PtMea Corr=0.22, outfit MnSq=1.95, outfit z-std=5.00, infit MnSq=1.63, infit z-std=3.60); the item does not contribute to the construction of scale but not degrading. Three items (K1, K14, and K9) can easily be answered even by low ability respondents.
Conclusions:
The Noor EBM questionnaire knowledge is robust with excellent psychometric properties that can be used for both research and clinical purposes.
REFERENCES (44)
1.
Sackett DL, Rosenberg WM, Gray JA, Haynes RB, Richardson WS. Evidence based medicine: What it is and what it isn’t. BMJ. 1996;312(7023):71-2. https://doi.org/10.1136/bmj.31... PMid:8555924 PMCid:PMC2349778.
2.
Rosenberg W, Donald A. Evidence based medicine: An approach to clinical problem-solving. BMJ. 1995;310(6987): 1122-6. https://doi.org/10.1136/bmj.31... PMid: 7742682 PMCid:PMC2549505.
3.
Masic I, Miokovic M, Muhamedagic B. Evidence based medicine–New approaches and challenges. Acta Inform Med. 2008;16(4):219-25. https://doi.org/10.5455/aim.20... PMid:24109156 PMCid:PMC3789163.
4.
Tenny S, Gossman WG. Evidence based medicine (EBM). StatPearls. Treasure Island, FL: StatPearls Publishing; 2017.
5.
Ghojazadeh M, Azami-Aghdash S, Pournaghi Azar F, Fardid M, Mohseni M. A systematic review on barriers, facilities, knowledge and attitude toward evidence-based medicine in Iran. J Anal Res Clin Med. 2015;3(1):1-11. https://doi.org/10.15171/jarcm....
6.
Ramos KD, Schafer S, Tracz SM. Validation of the Fresno test of competence in evidence based medicine. British Med J. 2003;326(7384):319-21. https://doi.org/10.1136/bmj.32... PMid:12574047 PMCid:PMC143529.
7.
Ilic D, Nordin RB, Glasziou P, Tilson JK, Villanueva E. Development and validation of the ACE tool: Assessing medical trainees’ competency in evidence based medicine. BMC Med Educ. 2014;14:114. https://doi.org/10.1186/1472-6... PMid:24909434 PMCid:PMC4062508.
8.
Smith AB, Semler L, Rehman EA, et al. A cross-sectional study of medical student knowledge of evidence-based medicine as measured by the Fresno test of evidence-based medicine. J Emerg Med. 2016;50(5):759-64. https://doi.org/10.1016/j.jeme... PMid:26961178.
9.
Buljan I, Jerončić A, Malički M, Marušić M, Marušić A. How to choose an evidence-based medicine knowledge test for medical students? Comparison of three knowledge measures. BMC Med Educ. 2018;18(1):290. https://doi.org/10.1186/s12909... PMid:30514288 PMCid:PMC6278026.
10.
Fritsche L, Greenhalgh T, Falck-Ytter Y, Neumayer HH, Kunz R. Do short courses in evidence based medicine improve knowledge and skills? Validation of Berlin questionnaire and before and after study of courses in evidence based medicine. British Med J. 2002;325(7376):1338-41. https://doi.org/10.1136/bmj.32... PMid:12468485 PMCid:PMC137813.
11.
Zwolsman SE, Wieringa-de Waard M, Hooft L, van Dijk N. Measuring evidence-based medicine knowledge and skills. The Dutch Berlin questionnaire: Translation and validation. J Clin Epidemiol. 2011;64(8):928-30. https://doi.org/10.1016/j.jcli... PMid:21640555.
12.
Lavizeh M, Kouhpayeh Zadeh J. Validity and reliability of the attitudes towards and self-reported ability in evidence-based medicine questionnaire. Int J Med Educ. 2015;14(11):998-1006.
13.
Zwolsman SE, van Dijk N, te Pas E, Wieringa-de Waard M. Barriers to the use of evidence-based medicine: Knowledge and skills, attitude, and external factors. Perspect Med Educ. 2013;2(1):4-13. https://doi.org/10.1007/S40037... PMid:23670651 PMCid:PMC3576485.
14.
Hisham R, Ng CJ, Liew SM, et al. Development and validation of the evidence based medicine questionnaire (EBMQ) to assess doctors’ knowledge, practice and barriers regarding the implementation of evidence-based medicine in primary care. BMC Fam Pract. 2018;19(1):98. https://doi.org/10.1186/s12875... PMid:29935527 PMCid:PMC6015654.
15.
McColl A, Smith H, White P, Field J. General practitioners; perceptions of the route to evidence based medicine: A questionnaire survey. BMJ. 1998;316(7128):361. https://doi.org/10.1136/bmj.31... PMid:9487174 PMCid:PMC2665572.
16.
Barzkar F, Baradaran H, Koohpayehzadeh J. Knowledge, attitude, and practice of evidence-based medicine among physicians: A systematic review. J Evid Based Med. 2018;11(4):246-51. https://doi.org/10.1111/jebm.1... PMid:30430759.
17.
Katsilometes J, Galuska M, Kraus CK, et al. Multisite assessment of emergency medicine resident knowledge of evidence-based medicine as measured by the Fresno test of evidence-based medicine. J Osteopath Med. 2022; 122(10):509-15. https://doi.org/10.1515/jom-20... PMid:35704661.
18.
Huang H-L, Chou C-P, Leu S, You H-L, Tiao M-M, Chen C-H. Effects of a quasi-experimental study of using flipped classroom approach to teach evidence-based medicine to medical technology students. BMC Med Educ. 2020;20(1):31. https://doi.org/10.1186/s12909... PMid:32005227 PMCid:PMC6995213.
19.
Cardoso D, Couto F, Cardoso AF, et al. Fresno test to measure evidence-based practice knowledge and skills for Portuguese undergraduate nursing students: A translation and adaptation study. Nurse Educ Today. 2021;97:104671. https://doi.org/10.1016/j.nedt... PMid:33264737.
20.
Imorde L, Möltner A, Runschke M, Weberschock T, Rüttermann S, Gerhardt-Szép S. Adaptation and validation of the Berlin questionnaire of competence in evidence-based dentistry for dental students: A pilot study. BMC Med Educ. 2020;20(1):136. https://doi.org/10.1186/s12909... PMid:32366287 PMCid:PMC7197120.
21.
Vulpe H, Vanderpuyne V, Yarney J, et al. Design and implementation of a distant-learning clinical research mentorship program: The accra-Toronto collaboration. JCO Glob Oncol. 2020;6:919-28. https://doi.org/10.1200/JGO.19... PMid:32603189 PMCid:PMC7328115.
22.
Mukherjee P, Chaudhary K, Yadav BK, Kumar S, Kekre N, Devasia A. Attitude and perceived barriers towards the practice of evidence-based urology amongst urological trainees in India. Indian J Urol. 2019;35(2):116-9.
23.
Habibi MA, Amini M, Ostovarfar M, Ostovarfar J, Moosavi M, Keshavarzi MH. Reliability and validity of the Persian version of the ACE tool: Assessing medical trainees’ competency in evidence-based medicine. BMC Med Educ. 2022;22(1):468. https://doi.org/10.1186/s12909... PMid:35710410 PMCid:PMC9204903.
24.
Sgarbossa N, Marino S, Aletta L, Vázquez Peña FR, Franco JVA. Validity and reliability of the Spanish version of the ACE tool for assessing competencies in evidence-based medicine in medical students. BMJ Evid Based Med. 2023;28(2):89-94. https://doi.org/10.1136/bmjebm... PMid:36150894.
25.
da Silva Maia FGSS, de Souza AKC, de Simas BCC, Lopes IS, Bezerra MPRD, Diniz RVZ. Brazilian version of the ACE (assessing competencies in evidence-based medicine) tool: A validation study. Rev Bras Educ Med. 2022;46(03):e93. https://doi.org/10.1590/1981-5....
26.
Simons M, Rapport F, Zurynski Y, Stoodley M, Cullis J, Davidson AS. Links between evidence-based medicine and shared decision-making in courses for doctors in training: A scoping review. BMJ Open. 2022;12(4):e057335. https://doi.org/10.1136/bmjope... PMid:35470193 PMCid:PMC9039384.
27.
Simons MR, Zurynski Y, Cullis J, Morgan MK, Davidson AS. Does evidence-based medicine training improve doctors’ knowledge, practice and patient outcomes? A systematic review of the evidence. Med Teach. 2019;41(5):532-8. https://doi.org/10.1080/014215... PMid:30328793.
28.
DeVellis RF. Classical test theory. Med Care. 2006;44(11 Suppl 3):S50-9. https://doi.org/10.1097/01.mlr... PMid:17060836.
29.
Bond TG, Fox CM. Applying the Rasch model: Fundamental measurement in the human sciences. Psychology Press; 2013.
30.
Jamieson S. Likert scales: How to (ab)use them. Med Educ. 2004;38(12):1217-8. https://doi.org/10.1111/j.1365... PMid:15566531.
31.
Ishar NIM, Roslin RM. Customer voice retaliation (CVR) construct verification: A Rasch analysis approach. Procedia Econ Financ. 2016;37:214-20. https://doi.org/10.1016/S2212-....
32.
Müller S, Kohlmann T, Wilke T. Validation of the adherence barriers questionnaire–An instrument for identifying potential risk factors associated with medication-related non-adherence. BMC Health Serv Res. 2015;15:153. https://doi.org/10.1186/s12913... PMid:25884193 PMCid:PMC4422301.
33.
Linacre JM. Sample size and item calibration stability. Rasch Meas Trans. 1994;7:328.
34.
Eubank BH, Mohtadi NG, Lafave MR, et al. Using the modified Delphi method to establish clinical consensus for the diagnosis and treatment of patients with rotator cuff pathology. BMC Med Res Methodol. 2016;16:56. https://doi.org/10.1186/s12874... PMid:27206853 PMCid:PMC4875724.
35.
Linacre J. A user’s guide to Winsteps Rasch model computer programs: Program manual 3.92. 0. Chicago, IL: Mesa-Press; 2016.
36.
Linacre JM. Winsteps® Rasch measurement computer program user’s guide. Beaverton, OR: Winsteps.com; 2020.
37.
Tennant A, Conaghan PG. The Rasch measurement model in rheumatology: What is it and why use it? When should it be applied, and what should one look for in a Rasch paper? Arthritis Rheum. 2007;57(8):1358-62. https://doi.org/10.1002/art.23... PMid:18050173.
38.
Streiner DL, Norman GR, Cairney J. Health measurement scales: A practical guide to their development and use. Oxford: Oxford University Press; 2015. https://doi.org/10.1093/med/97....
39.
Fox CM, Jones JA. Uses of Rasch modeling in counseling psychology research. J Couns Psychol. 1998;45(1):30. https://doi.org/10.1037/0022-0....
40.
Linacre JM. Test validity, and Rasch measurement: Construct, content, etc. Rasch.org; 2004. Avaişable at: https://www.rasch.org/rmt/rmt1... (Accessed: 19 December 2022).
41.
Fisher Jr WP. Rating scale instrument quality criteria. Rasch Meas Trans. 2007;21:1095.
42.
West CP, Jaeger TM, McDonald FS. Extended evaluation of a longitudinal medical school evidence-based medicine curriculum. J gen Intern Med. 2011;26(6):611-5. https://doi.org/10.1007/s11606... PMid:21286836 PMCid:PMC3101983.
44.
Conrad KM, Conrad KJ, Passetti LL, Funk RR, Dennis ML. Validation of the full and short-form self-help involvement scale against the Rasch measurement model. Eval rep. 2015;39(4):395-427. https://doi.org/10.1177/019384... PMid:26275980 PMCid:PMC4591028.
Share
RELATED ARTICLE
| eISSN: | 2516-3507 |
We process personal data collected when visiting the website. The function of obtaining information about users and their behavior is carried out by voluntarily entered information in forms and saving cookies in end devices. Data, including cookies, are used to provide services, improve the user experience and to analyze the traffic in accordance with the Privacy policy. Data are also collected and processed by Google Analytics tool (more).
You can change cookies settings in your browser. Restricted use of cookies in the browser configuration may affect some functionalities of the website.
You can change cookies settings in your browser. Restricted use of cookies in the browser configuration may affect some functionalities of the website.
