Tag Archives: reliability

The Connection between Analytic and Holistic Approaches to Scoring in the Writing Component of the PROFEX EMP Exam

Hegedűs Anita

Department of Medical Linguistics, Faculty of Medicine, University of Pécs

Introduction: This paper aims at investigating the connection between analytic and holistic approaches to scoring writing in the PROFEX English for Medical Purposes (EMP) exam. The sample for the research consisted of 60 test papers taken at the PROFEX EMP exam in April, 2010.
Material and method: First, the test papers were scored analytically by two raters independently of each other, then they were scored holistically by a third rater. After the scoring had been completed, correlations were calculated between the two methods of scoring and also between writing and other components of the language exam.
Results: The study has detected no significant differences in the correlations between the analytic and holistic scores.
Conclusion: The holistic method was found to be more reliable than the analytic method, but the deviation was not sufficient for discarding the analytic method in the assessment of writing in the PROFEX EMP exam.

Keywords: , , , ,
Full text: PDF

Approaches to Scoring Translation in the PROFEX EMP Exam

Hegedűs Anita

Department of Languages for Specific Purposes, Faculty of Medicine, University of Pécs, Pécs, Hungary

DOI: 10.2478/amma-2013-0025

Introduction: This paper undertakes to investigate the connection between two approaches to scoring translation by examining 115 test papers of the translation component of the C1 level PROFEX English for Medical Purposes (EMP) exam. The main objective of the study is to reveal whether, and to what extent, the method of assessment influences the score.
Material and method: The test papers were scored independently by two experienced raters according to the marking scale of the PROFEX EMP exam, then holistic scoring was carried out by a third rater, who was uninformed of the official scores for the test papers. Correlations were calculated, first between the holistic scores and the official scores based on the combined holistic and discrete point approach, then between other components of the written part of PROFEX EMP exam (reading comprehension and writing) and the holistic scores and the scores reached with the combined method, respectively.
Results: A strong correlation has been revealed between the scores achieved by the purely holistic method and those assessed with the combined holistic and discrete point approach. The holistic method was shown to be slightly more reliable than the combined approach.
Conclusion: The study has revealed that the method of assessment does not significantly influence the score in the evaluation of translation in the PROFEX EMP exam.

Keywords: , , , ,
Full text: PDF

Intra-operator Reliability of a 2D Image Analysing Method for Tooth Dimension Measurements

Kerekes-Máthé Bernadette1, Mártha Krisztina2, Székely Melinda1

1 Department of Morphology of Teeth and Dental Arches, Faculty of Dentistry, University of Medicine and Pharmacy, Tîrgu Mureș, Romania
2 Department of Paediatric Dentistry and Orthodontics, Faculty of Dentistry, University of Medicine and Pharmacy, Tîrgu Mureș, Romania

DOI: 10.2478/amma-2014-0024

Objective: The aim of this study was to evaluate the intra-operator reliability of a 2D image analysis method for tooth dimension measurements.
Methods: Occlusal and vestibular surfaces of teeth from ten study models were captured with a digital camera. Images were transferred on a computer and different tooth dimensions (mesio-distal, occluso-gingival, vestibulo-oral and perimeter) were measured using the Image Pro Insight software. Measurements were repeated after two weeks. Fleiss’ coefficients of reliability were calculated.
Results: A high degree of reliability has been established for every type of measurement: all coefficient values of reliability being not less than 0.95.
Conclusions: The 2D image analyzing system is an adequate alternative for measuring tooth dimensions. All measurements were in the excellent category of reliability. The method allows precise and repeatable measurements, generating an image database as well, available for future studies.

Keywords: , ,
Full text: PDF