Final-year project, Samuel Kaoma
Paradata feature extraction pipeline: results
Survey platforms such as SurveyCTO and ODK record an audit log of every interview: when each question opened, how long it took, when the enumerator went back. This pipeline turns that log into forty timing features and uses them to flag interviews that look fabricated, rushed or disengaged, naming the features behind every flag.
Each run below was produced by the pipeline itself when this site was built from
commit 4a00cb018b56 on 18 October 2026, 09:45 UTC. Rows shaded red are interviews the pipeline got wrong.
Sample data, both formats
The 24-interview sample that ships with the repository, SurveyCTO and ODK logs processed together in one run.
Input: data/odk.csv, data/surveycto.csv
Precision1.000target 0.8
Recall1.000target 0.75
F11.000
Specificity1.000
Interviews2418 labelled anomalous
Confusion matrix
| Flagged | Not flagged | |
|---|---|---|
| Labelled anomalous | 18 | 0 |
| Labelled normal | 0 | 6 |
Detection by anomaly type
Flagged interviews (18), highest score first
| Interview | Label | Category | Score | Flags raised |
|---|---|---|---|---|
| INT402 | dq_issue | dq_issue | 9 | flag_invalid_ratio, flag_missing_data, flag_too_fast, flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance |
| INT408 | dq_issue | dq_issue | 9 | flag_invalid_ratio, flag_missing_data, flag_too_fast, flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance |
| INT409 | dq_issue | dq_issue | 9 | flag_invalid_ratio, flag_missing_data, flag_too_fast, flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance |
| ODK402 | dq_issue | dq_issue | 9 | flag_invalid_ratio, flag_missing_data, flag_too_fast, flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance |
| ODK408 | dq_issue | dq_issue | 9 | flag_invalid_ratio, flag_missing_data, flag_too_fast, flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance |
| ODK409 | dq_issue | dq_issue | 9 | flag_invalid_ratio, flag_missing_data, flag_too_fast, flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance |
| INT401 | fabricated | anomalous | 6 | flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance |
| INT407 | fabricated | anomalous | 6 | flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance |
| ODK401 | fabricated | anomalous | 6 | flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance |
| ODK407 | fabricated | anomalous | 5 | flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr |
| INT403 | speeding | suspicious | 4 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy |
| INT411 | speeding | suspicious | 4 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy |
| INT404 | disengaged | suspicious | 3 | flag_uniform_timing, flag_moderate_back_nav, flag_long_pause_relative |
| INT410 | disengaged | suspicious | 3 | flag_uniform_timing, flag_moderate_back_nav, flag_long_pause_relative |
| ODK403 | speeding | suspicious | 3 | flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy |
| ODK410 | disengaged | suspicious | 3 | flag_uniform_timing, flag_moderate_back_nav, flag_long_pause_relative |
| ODK411 | speeding | suspicious | 3 | flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy |
| ODK404 | disengaged | suspicious | 2 | flag_uniform_timing, flag_moderate_back_nav |
Download this run
500-interview benchmark, SurveyCTO
The canonical benchmark: 400 normal interviews and 100 with injected fabrication, speeding or disengagement (seed 42).
Input: data/synthetic_datasets/n500/audit_logs_surveycto.csv
Precision1.000target 0.8
Recall1.000target 0.75
F11.000
Specificity1.000
Interviews500100 labelled anomalous
Confusion matrix
| Flagged | Not flagged | |
|---|---|---|
| Labelled anomalous | 100 | 0 |
| Labelled normal | 0 | 400 |
Detection by anomaly type
Flagged interviews (100), highest score first
| Interview | Label | Category | Score | Flags raised |
|---|---|---|---|---|
| INT-00008 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00074 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00079 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00082 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00115 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00129 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00169 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00180 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00184 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00191 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00199 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00205 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00206 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00225 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00240 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00258 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00261 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00269 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00321 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00327 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00329 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00330 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00349 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00355 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00374 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00376 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00393 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00400 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00411 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00421 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00452 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00455 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00466 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00013 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00028 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00036 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00040 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00052 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00070 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00077 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00126 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00147 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00174 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00175 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00185 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00228 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00276 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00283 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00285 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00287 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00288 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00291 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00300 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00304 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00324 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00352 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00359 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00375 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00381 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00403 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00439 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00461 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00471 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00491 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00498 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00499 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00001 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00003 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00041 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00046 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00048 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00051 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00055 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00069 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00085 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00101 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00107 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00124 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00130 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00143 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00145 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00156 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00204 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00226 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00252 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00264 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00265 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00290 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00293 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00356 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00362 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00383 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00406 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00409 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00446 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00023 | disengaged | anomalous | 5 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_iqr_entropy |
| INT-00116 | disengaged | anomalous | 5 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_iqr_entropy |
| INT-00415 | disengaged | anomalous | 5 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_iqr_entropy |
| INT-00480 | disengaged | anomalous | 5 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_iqr_entropy |
| INT-00492 | disengaged | anomalous | 5 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_iqr_entropy |
Download this run
500-interview benchmark, ODK
The same 500 interviews written as ODK audit logs, to show the two parsers agree.
Input: data/synthetic_datasets/n500/audit_logs_odk.csv
Precision1.000target 0.8
Recall1.000target 0.75
F11.000
Specificity1.000
Interviews500100 labelled anomalous
Confusion matrix
| Flagged | Not flagged | |
|---|---|---|
| Labelled anomalous | 100 | 0 |
| Labelled normal | 0 | 400 |
Detection by anomaly type
Flagged interviews (100), highest score first
| Interview | Label | Category | Score | Flags raised |
|---|---|---|---|---|
| INT-00008 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00074 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00079 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00082 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00115 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00129 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00169 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00180 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00184 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00191 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00199 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00205 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00206 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00225 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00240 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00258 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00261 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00269 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00321 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00327 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00329 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00330 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00349 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00355 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00374 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00376 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00393 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00400 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00411 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00421 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00452 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00455 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00466 | fabricated | anomalous | 8 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00013 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00028 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00036 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00040 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00052 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00070 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00077 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00126 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00147 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00174 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00175 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00185 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00228 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00276 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00283 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00285 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00287 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00288 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00291 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00300 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00304 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00324 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00352 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00359 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00375 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00381 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00403 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00439 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00461 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00471 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00491 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00498 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00499 | speeding | anomalous | 7 | flag_short_relative_duration, flag_low_mean_rt, flag_zero_back_nav, flag_low_entropy, flag_low_rt_iqr, flag_low_section_variance, flag_iqr_duration, flag_iqr_rt_mean, flag_iqr_entropy |
| INT-00001 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00003 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00023 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00041 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00046 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00048 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00051 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00055 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00069 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00101 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00107 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00116 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00124 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00143 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00145 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00226 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00252 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00264 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00265 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00290 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00356 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00383 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00406 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00409 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00415 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00446 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00480 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00492 | disengaged | anomalous | 6 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_long_pause_relative, flag_iqr_entropy |
| INT-00085 | disengaged | anomalous | 5 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_iqr_entropy |
| INT-00130 | disengaged | anomalous | 5 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_iqr_entropy |
| INT-00156 | disengaged | anomalous | 5 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_iqr_entropy |
| INT-00204 | disengaged | anomalous | 5 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_iqr_entropy |
| INT-00293 | disengaged | anomalous | 5 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_iqr_entropy |
| INT-00362 | disengaged | anomalous | 5 | flag_uniform_timing, flag_low_rt_iqr, flag_low_section_variance, flag_moderate_back_nav, flag_iqr_entropy |
Download this run
Audit notebook
The system audit notebook recomputes every anomaly score from the exported features, checks it against what the pipeline reported, and plots the score distribution, feature correlations and the separation between normal and anomalous interviews. It was executed on the 500-interview SurveyCTO run when this site was built.
Reproduce it
Every number on this page comes from these commands, run on a fresh copy of the repository:
pip install -r requirements.txt python scripts/build_results_site.py --out build/site
Or one run directly:
python run_pipeline.py --inputs data/synthetic_datasets/n500/audit_logs_surveycto.csv
--ground-truth data/synthetic_datasets/n500/ground_truth_labels.csv --label n500_surveycto