Please use this identifier to cite or link to this item:
https://hdl.handle.net/10316/33167
Title: | Training and Interobserver Reliability in Qualitative Scoring of Skeletal Samples | Authors: | Wilczak, C. Mariotti, V. Pany-Kucera, D. Villotte, S. Henderson, Charlotte |
Keywords: | Anthropology; Archaeology | Issue Date: | Nov-2016 | Publisher: | Journal of Archaeological Science: Reports | Project: | Wenner-Gren Foundation (grant number Gr. CONF-632) Fundação para a Ciência e a Tecnologia SFRH/BPD82559/2011 Fundação para a Ciência e a Tecnologia FCT/Pest-OE/SADG/UI0283/20113 |
Volume: | 11 | Place of publication or event: | Journal of Archaeological Science: Reports | Abstract: | This article reports on inter- and intra-observer reliability testing of the Coimbra method for fibrocartilaginous entheseal changes and discusses the results in the context of reliability for other qualitative methods that score skeletal variation. Four tests of interobserver and one test of intraobserver reliability were conducted. Three of the interobserver tests were conducted in person (Geneva, Coimbra A, Coimbra B) and one was conducted on-line. Before each test, the observers trained together and refinements were made to the method. Inter- and intra-observer reliability was assessed using percentage agreement, kappa scores, and Krippendorff’s alpha. On-line testing had the lowest reliability (60% agreement, κ = 0.292, α = 0.369). Final reliability results in the Coimbra B test increased from the initial Geneva test (68.6 to 80.0% agreement, κ = 0.522 to 0.589, α = 0.604 to 0.666). Factors such as training, observation conditions, visual acuity, and differences in interpretation of scoring criteria impact reliability. Suggestions are made to address the general problem of reliability in qualitative methods. | URI: | https://hdl.handle.net/10316/33167 | DOI: | 10.1016/j.jasrep.2016.11.033 | Rights: | closedAccess |
Appears in Collections: | I&D CIAS - Artigos em Revistas Internacionais |
Files in This Item:
File | Description | Size | Format | Login |
---|---|---|---|---|
Wilczak et al 2017 error paper.pdf | 996.44 kB | Adobe PDF | Request a copy |
SCOPUSTM
Citations
33
checked on Apr 15, 2024
WEB OF SCIENCETM
Citations
5
29
checked on Apr 2, 2024
Page view(s)
238
checked on Apr 16, 2024
Download(s) 10
1,346
checked on Apr 16, 2024
Google ScholarTM
Check
Altmetric
Altmetric
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.