Computed inter annotator agreement per class category per file.

ACL ID IAAS IAAA Tech System LR LR-Prod Model Measure(ment) Other
T78-1001 0.87 0.82 0 0 0 0 0 0 0.9
T78-1028 0.86 0.78 0 0 0 0 0 0 0.8
T78-1031 0.94 0.73 1 0 0 0 0 0 0.73
C80-1039 0.53 0.53 0 0 0 0 0 0 0.67
C80-1073 0.75 0.5 0.57 0 0 0 0.67 0 0.57
P80-1004 0.69 0.21 0 0 0 0 0 0 0.33
P80-1019 0.64 0.64 0.91 0 0 0 0 0 0.75
P80-1026 0.6 0.53 0.67 0 0 0 0 0 0.5
C82-1054 1 1 1 0 0 0 0 0 1
J82-3002 0.88 0.85 1 0 0 0 0 0 0.8
P82-1035 0.51 0.51 1 0 0 0 0 0 0.71
P84-1020 1 1 1 0 0 0 0 0 1
P84-1034 0.93 0.93 1 0 0 0 1 0 1
P84-1047 0.8 0.55 0.75 0 0 0 0 0 0.6
P84-1064 0.89 0.79 0.8 0 0 0 0 0 0.84
P84-1078 0.83 0.78 1 0 0 0 0 0 0.88
C86-1081 0.86 0.86 0 0 0 0 0 0 0.95
C86-1132 0.88 0.88 0 0 0 0 0 0 1
J86-1002 0.74 0.64 1 0 0 0 0 0 0.4
J86-3001 0.83 0.82 0.67 0 0 0 0 0 0.88
J86-4002 0.86 0.84 0 0 0 0 0 0 0.97
P86-1011 0.92 0.73 0 0 0 0 0 0 0.8
P86-1038 0.84 0.66 0.67 0 0 0 1 0 0.73
A88-1001 0.76 0.63 1 0 0 0 0 0 0.67
A88-1003 0.53 0.43 0.67 0 0 0 0 0 0
C88-1007 0.59 0.56 0.4 0 0 0 0 0 0.75
C88-1044 0.71 0.71 1 0 0 0 0 0 0.86
C88-1066 0.87 0.69 1 0 0 0 0 0 0.74
C88-2086 0.57 0.57 0 0 0 0 0 0 0.8
C88-2130 1 0.67 0 0 1 0 0 0 0.4
C88-2132 0.55 0.48 1 0 0 0 0 0 0.62
C88-2160 0.43 0.43 0.8 0 0 0 0 0 0.6
C88-2162 0.83 0.45 0.8 0 0 0 0 0 0.44
C88-2166 0.7 0.64 1 0 0.91 0 0 0 0
J88-3002 0.9 0.86 0.91 0 0 0 1 0 0.86
C90-1013 0.91 0.67 1 0 0 0 0 0 0
C90-2032 0.7 0.7 0.8 0 1 0 0 0 1
C90-3014 0.67 0.33 0 0 1 0 0 0 1
C90-3045 0.71 0.67 0 0 0 0 0 0 0.79
C90-3046 0.88 0.62 1 0 0 0 0 0 0.57
C90-3063 0.69 0.36 0 0 0.67 0 0 0 0.53
C90-3072 0.86 0.83 1 0 0.5 0 0 0 0.88
H90-1016 0.5 0.42 0.8 0 0 0 0 0 0.8
H90-1060 0.83 0.74 0.77 0 0.91 1 0 0.8 0.88
J90-3002 0.88 0.83 1 0 1 0 0 0 0.86
P90-1014 0.75 0.46 1 0 0 0 0 0 0.4
A92-1026 0.77 0.77 0.93 0 0 0 0 0 0.5
A92-1027 0.84 0.8 1 0 0 0 0 0 0.87
C92-1052 0.92 0.73 1 0 0 0 0 0 0.75
C92-1055 0.76 0.71 0.86 0 0.67 0 1 1 0.67
C92-2068 0.5 0.5 0.89 0 0 0 0 0 0.8
C92-2115 1 0.91 0.95 0 0 0 0 0 0.67
C92-3165 0.67 0.67 0.86 0 1 0 0 0 1
C92-4199 0.76 0.7 1 0 1 0 0 0 0.86
C92-4207 0.58 0.48 0 0 0 0 0 0 0.67
H92-1003 0.94 0.88 0 0 1 0 0 0 1
H92-1010 0.89 0 0 0 0 0 0 0 0
H92-1016 0.8 0.75 1 0 0.8 0 1 0.67 0
H92-1017 0.67 0.59 1 0 0 0 0 0.67 0
H92-1026 0.74 0.55 0.25 0 0.67 0 0 0 0.9
H92-1036 0.83 0.79 0.87 0 0 0 0 0 1
H92-1045 0.83 0.77 1 0 0 1 0 0 0.78
H92-1060 0.6 0.46 0 0 1 0 0 0 0.88
H92-1074 0.69 0.64 1 0 0 1 0 0 0.33
H92-1095 0.74 0.74 0.88 0 0 0 0 0 0
A94-1007 0.84 0.63 0.67 0 0 0 0 1 0.71
A94-1011 0.77 0.66 0.9 0 1 0 0 0 0.69
A94-1017 0.79 0.68 0.92 0 0 0 0 0 0.57
A94-1026 0.82 0.82 1 0 0 0 0 0 0.85
C94-1026 0.86 0.74 1 0 0 0 0 0 0.67
C94-1030 0.93 0.86 1 0 0 0 0 0 0.87
C94-1052 0.84 0.71 1 0 0 0 0 0 0.73
C94-1061 0.83 0.6 1 0 0 0 0 0 0.62
C94-1077 0.92 0.88 1 0 0 0 0 0 0.89
C94-1079 0.74 0.5 0.67 0 1 0 0 0 0.4
C94-1080 0.84 0.71 0.83 0 0 0 0.67 0 0.77
C94-1082 0.6 0.6 0.67 0 0 0 0 0 0.67
C94-2151 0.75 0.75 0.8 0 0 0 0 0 0.75
H94-1014 0.86 0.81 0 0 0.67 1 0.8 1 1
H94-1034 0.75 0.7 1 0 0 0 0 0 0.75
H94-1084 0.76 0.76 0.92 0 0 0 0 0 1
H01-1001 0.74 0.43 1 0 0 0 1 0 0.5
H01-1017 0.62 0.62 1 0 0 0 0 0 0
H01-1040 0.83 0.67 1 0 0 0 0 0 0.67
H01-1041 0.84 0.82 0.84 0 1 0 0 0 1
H01-1042 0.95 0.95 1 0 0 0 0 0 1
H01-1049 0.9 0.9 1 0 0 0 0 0 0.83
H01-1055 1 1 1 0 0 0 0 0 1
H01-1058 0.98 0.88 1 0 0 0 1 1 0.67
H01-1068 0.67 0.67 1 0 0 0 0 0.8 0
H01-1070 1 1 1 0 0 0 1 1 0
N01-1003 0.84 0.82 1 0 1 0 1 0 0.74
P01-1004 0.91 0.91 1 0 0 0 1 1 1
P01-1007 0.78 0.68 0.91 0 1 0 0 0 0.74
P01-1008 0.95 0.95 0.89 0 1 0 0 0 1
P01-1009 0.69 0.64 0.86 0 0 0 0 1 0.91
P01-1047 0.93 0.93 1 0 0 0 0 0 1
P01-1056 0.93 0.93 1 0 0 0 0 1 1
P01-1070 0.8 0.67 0 0 0 0 1 1 0.75
N03-1001 0.94 0.87 0.91 0 1 0 1 1 0.75
N03-1004 0.76 0.76 0.94 0 1 0 0 0.5 0.86
N03-1012 0.96 0.92 0 0 1 0 0 1 0.93
N03-1017 1 1 1 0 1 0 1 0 1
N03-1018 0.78 0.71 0.73 0 1 0 0.86 1 0.75
N03-1026 0.76 0.63 0.94 0 0 0 1 0 0.6
N03-1033 0.88 0.73 1 0 0 0 1 0.67 0.8
N03-2003 0.92 0.92 0.8 0 1 0 0 0 1
N03-2006 0.67 0.61 1 0 0 0 1 1 0
N03-2015 0.97 0.97 1 0 0 0 0 0 1
N03-2017 1 0.73 1 0 0 0 0 1 0.57
N03-2025 0.84 0.78 1 0 1 0 0.5 0 0.89
N03-2036 0.88 0.85 1 0 0 0 1 0 0.8
N03-3010 0.95 0.95 1 0 0 0 0 0 0
N03-4004 0.67 0.67 1 0 0 0 0 0 1
N03-4010 1 1 1 0 1 0 0 0 1
P03-1002 0.88 0.71 0.67 0 0 0 0 0 0.8
P03-1005 1 0.89 1 0 0 0 0 1 0.73
P03-1009 0.64 0.64 0.8 0 0 0 0 0 0.83
P03-1022 0.95 0.95 1 0 0 0 0 0 1
P03-1030 1 0.95 1 0 1 0 0 1 0
P03-1031 0.83 0.76 0.67 0 1 0 0 1 0.84
P03-1033 0.86 0.86 1 0 1 0 1 1 0.89
P03-1050 0.96 0.96 1 0 0.91 0 1 1 1
P03-1051 0.74 0.72 1 0 0.44 0 1 0.67 0.96
P03-1058 0.81 0.81 1 0 0.89 0 0 0 1
P03-1068 0.8 0.8 0.8 0 1 0 0 0 0.91
P03-1070 0.97 0.97 1 0 0 0 0 0 1
P03-2036 1 0.91 1 0 0 0 0 0 0.89
H05-1005 0.62 0.57 1 0 0 0 0 0 0.92
H05-1012 0.83 0.83 0.89 0 1 0 1 1 1
H05-1095 0.96 0.92 0.75 0 1 0 0 1 1
H05-1101 0.75 0.57 0 0 0 0 1 0 0.5
H05-1117 0.67 0.67 0.86 0 0 0 0 1 0.57
H05-2007 0.67 0.57 0.8 0 0 0 0 0 1
I05-2014 0.73 0.73 1 0 0 0 0 1 0.8
I05-2021 0.77 0.43 0.31 0 0 0 1 0.57 0.86
I05-2048 0.95 0.79 1 0 0 0 0 0 0.57
I05-4010 0.53 0.53 0 0 1 0 0 0 0.67
I05-5003 0.68 0.57 0.89 0 0 0 0 0.22 0.91
I05-5008 0.7 0.59 0 0 0 0 0 0.75 0.78
I05-6011 0.87 0.87 0 0 0 0 0 0 1
J05-1003 0.78 0.66 0.69 0 0 0 0.67 0.67 0.86
J05-4003 0.67 0.62 1 0 0.75 0 0 0 0.67
P05-1032 0.85 0.64 0.67 0 0 0 0 0 0.86
P05-1034 0.95 0.89 0.92 0 1 0 1 0 0.86
P05-1048 0.86 0.67 0.75 0 0 0 0 0.67 1
P05-1067 0.93 0.58 0.71 0 1 0 0 0.5 0.4
P05-1069 0.85 0.64 0.86 0 0 0 1 0 0.5
P05-1074 0.91 0.77 1 0 1 0 0 0 0.75
P05-2016 0.82 0.67 1 0 1 0 0 0 1
P05-3025 0.42 0.42 0.89 0 0 0 0 0 0
E06-1004 0.89 0.85 1 0 0 0 1 0 1
E06-1018 0.69 0.69 0.83 0 1 0 0 0 0.8
E06-1022 0.62 0.62 0.86 0 0 0 0 0 0.88
E06-1031 0.87 0.71 0.5 0 0 0 0 1 0.62
E06-1035 0.73 0.73 1 0 0 0 0 0 0.84
E06-1041 0.75 0.67 0.8 0 0 0 0 0 0.67
N06-2009 0.67 0.67 1 0 0 0 0 1 0.8
N06-2038 0.88 0.88 0.86 0 0 0 0 0 1
N06-4001 0.42 0.42 0.67 0 0 0 0 0 0.5
P06-1013 0.67 0.67 1 0 0 0 0 0 0.5
P06-1018 0.87 0.87 0 0 0 0 0 0 0.96
P06-1052 0.87 0.56 0 0 1 0 0 0 0.53
P06-2001 0.93 0.93 1 0 1 0 0 1 1
P06-2012 0.86 0.86 1 0 0 1 0 0 0.88
P06-2059 0.71 0.62 0 0 1 0 0 0 0.67
P06-2110 0.92 0.67 0 0 0 0 0 0 0.74
P06-3007 0.56 0.47 0.4 0 0 0 0 0 0.75
P06-4007 0.86 0.86 0.86 0 0 0 0 0 1
P06-4011 0.77 0.73 0.67 0 0 0 1 0 0.84
P06-4014 0.77 0.55 0.67 0 0 0 0 0 0

This page last edited on 06 October 2025.




*** ***