Background : Learning how to write a scientific paper is a mandatory part of medical education at many universities. The criteria for passing the exam are not always clear; the grading guidelines are often sparse and sometimes poorly defined. Therefore, the use of rubrics can be appropriate. Purpose : The aim of this study was to test inter-rater reliability and to test agreement for the modified rubrics for the assessment of master’s theses in medical education at a Swedish university. Method : Modified scoring rubrics were used for grading and assessment of the master’s thesis at the medical programme at Lund University. The rubrics include 10 items, graded from 1 to 4. To study the inter-rater reliability and agreement of the rubrics, three teachers included in the management of the course used the rubrics and assessed all projects. Results A total of 37 projects were read by the three raters. Intraclass correlation for the total score was (CI –). Absolute agreement (average) for pass or fail was 90%. Conclusion : In this study, scoring rubrics for assessing master’s theses in medical education showed strong inter-rater reliability and high inter-rater agreement for pass/fail. The rubrics are now available on the university website.
After becoming a teacher it became pretty clear that no one outside of education can understand just how brutal and time-consuming it is to be a teacher — especially when it comes to grading essays. But on the flip-side most teachers don't know how or where technology can help them. Or worse, they're surrounded by all this awful technology that's been forced upon them. My district's attendance system required three separate logins! Three! Argghh! Last year I had four sections of the same Senior English prep. That meant 96 papers would come in all at once. I was super-passionate about getting these regular-level students ready for the rigors of college so I would find myself spending 15, 20, 30 minutes per paper. That multiplied by 96 is insane. That's where came from — as a teacher I felt the same pain you're feeling but my programming background allowed me to see where a little bit of technology could go a long way.