VALIDATED. The independent AI coders agree at or above the threshold on every coded variable. The codebook is being applied consistently; human validation (Step 5, Section 3) is still required before the dataset is accepted.
relevance reliable n = 1588
| Coder pair | % agreement | Cohen's κ |
|---|---|---|
| Coder 1 vs Coder 2 | 100.0% | 1.0 |
| Coder 1 vs Coder 3 | 100.0% | 1.0 |
| Coder 2 vs Coder 3 | 100.0% | 1.0 |
Fleiss' κ 1.0 · Krippendorff's α 1.0 · mean κ over all pairs 1.0
sector reliable n = 1492
| Coder pair | % agreement | Cohen's κ |
|---|---|---|
| Coder 1 vs Coder 2 | 99.9% | 0.998 |
| Coder 1 vs Coder 3 | 99.9% | 0.999 |
| Coder 2 vs Coder 3 | 99.9% | 0.999 |
Fleiss' κ 0.998 · Krippendorff's α 0.998 · mean κ over all pairs 0.999
event_type reliable n = 1492
| Coder pair | % agreement | Cohen's κ |
|---|---|---|
| Coder 1 vs Coder 2 | 98.5% | 0.977 |
| Coder 1 vs Coder 3 | 99.0% | 0.985 |
| Coder 2 vs Coder 3 | 98.0% | 0.97 |
Fleiss' κ 0.977 · Krippendorff's α 0.977 · mean κ over all pairs 0.977
leader_visit reliable n = 1492
| Coder pair | % agreement | Cohen's κ |
|---|---|---|
| Coder 1 vs Coder 2 | 99.7% | 0.994 |
| Coder 1 vs Coder 3 | 99.8% | 0.996 |
| Coder 2 vs Coder 3 | 99.7% | 0.993 |
Fleiss' κ 0.994 · Krippendorff's α 0.994 · mean κ over all pairs 0.994
province reliable n = 1492
| Coder pair | % agreement | Cohen's κ |
|---|---|---|
| Coder 1 vs Coder 2 | 99.1% | 0.987 |
| Coder 1 vs Coder 3 | 98.8% | 0.984 |
| Coder 2 vs Coder 3 | 99.1% | 0.987 |
Fleiss' κ 0.986 · Krippendorff's α 0.986 · mean κ over all pairs 0.986