Source document

docs/qa_reports/miami/__outcomes_validation.md

Served verbatim from the project repository. Internal working document conventions apply: documents may reference file paths, branch names, and findings-ledger anchors from the repo.

Validation — outcome metrics

(ii) Base case

metricyearscommonmatchesmismatchessuppressedstatus
pct_ell2018-19, 2021-22, 2022-23, 2023-24, 2024-25, 2025-26307557602499PASS
pct_ell_lower_bound2018-19, 2021-22, 2022-23, 2023-24, 2024-25, 2025-263075307500PASS
pct_ell_upper_bound2018-19, 2021-22, 2022-23, 2023-24, 2024-25, 2025-263075307500PASS
ela_achievement2018-19, 2021-22, 2022-23, 2023-24, 2024-252273227300PASS
math_achievement2024-2546246200PASS
pct_econ_disadv2024-2546946900PASS
chronic_absenteeism_rate2017-18, 2019-20, 2022-23, 2024-2520482037011PASS
absent_21plus_rate2016-17, 2024-251013100508PASS
graduation_rate_4yr2023-24, 2024-25283240043PASS
fast_ela_g3_proficiency2023-2429929207PASS
fast_math_g8_proficiency2024-25198177021PASS
eoc_alg1_proficiency2024-25289273016PASS
science_g5_proficiency2022-2329428905PASS
science_g8_proficiency2022-23188174014PASS
survey_students_safety2019-20, 2021-22, 2024-25144012380202PASS
survey_parents_teaching2018-19, 2021-22, 2023-24134511130232PASS
survey_staff_leadership2020-21, 2021-22, 2022-23139312490144PASS
survey_staff_safety2024-25459410049PASS
survey_staff_teaching2021-22, 2024-25924830094PASS
school_grade_points_pct2022-23, 2024-2593793700PASS
science_achievement2022-2345245200PASS
learning_gains_math_l252023-2444644600PASS

(iii-b) Cross-publisher — FLDOE absent-10%+ vs EDFacts DG814, 2022-23

Verdict: PASS — no-PK schools within ±1: 253/264 (95.8%); PK schools' gap = 0.661 × PK membership (r = 0.86). Detail: __cross_publisher_absenteeism.md.

(iii-b) Cross-publisher — FLDOE race shares vs NCES CCD

Verdict: PASS — pct_black: 90.3% within 2 pp (median Δ +0.00); pct_hispanic: 89.7% within 2 pp (median Δ +0.00); pct_white: 88.1% within 2 pp (median Δ +0.00). Detail: __cross_publisher_race.md.

Residual-z checks

Verdict: PASS — independent N, eligibility and refit: max |Δz| 4.1e-11 over 46 fits; served = committed: 19457 cells, 0 CSV-only, 0 served-only. Detail: __residual_checks.md.

(iv) Served-value invariants

Verdict: REVIEW — range violations 0, identity violations 0, stale rows 0, shift alarms 146 (16 unexplained). Detail: __served_invariants.md.