01 — Inventory (Miami-Dade data landscape)
What is publicly available, in what format, at what cadence, for what
years. Every row marked fetched was downloaded on 2026-09-15 and its
shape inspected (findings.md §F); provenance lives under
data/cities/miami/sources/. Rows marked listed were verified to exist
on an index page but not opened.
A. Publishers
| Publisher | Role | Coverage |
|---|---|---|
| Florida Department of Education (FLDOE) — PK-12 Education Information Services, Accountability, Assessment, Safe Schools, Educational Facilities, Funding & Financial Reporting | The state layer: every school-level outcome, membership, discipline, facilities and spending file | All Florida public schools incl. charters, at district 13 grain |
| M-DCPS Research Services / Assessment, Research & Data Analysis | District layer: climate survey, Statistical Highlights, research briefs, school dashboards | District-run + charter (survey: district-run mostly) |
| M-DCPS School Board / Facilities Planning | Board record: Attendance Zone Recommendations (ABC), budget, strategic plan, DEFP | District-run schools |
| Miami-Dade County Open Data Hub (ArcGIS) | School points with capacity/enrollment, boundaries, board districts | District-run + charter (separate layers) |
| NCES (CCD) | Federal copy of the state's directory, membership, staff, lunch submissions | All schools; ~1.5-year lag |
| US ED — EDFacts (EdDataExpress) and OCR (CRDC) | Independent-publisher absenteeism, discipline, course access, staffing with subgroups | All schools |
Access note: www.fldoe.org blocks cloud egress (Akamai 403); the same
paths on origin.fldoe.org serve every file (findings.md §E).
B. Sources by analytical input
School directory + universe tagging
| Need | Source | Format · years | Notes |
|---|---|---|---|
| All district-13 schools with stable IDs | FLDOE MSID "All schools, all fields" (eds.fldoe.org/EDS/MasterSchoolID/Downloads/All_schools.cfm) — fetched | tab-delimited text · current snapshot | 77 fields: type, grade code, activity (A/C/F), charter status + open year, magnet status/specialty, school choice, Title I, principal, addresses, lat/lng, NCES ids, date opened/closed, current grade. Dade: 756 rows = 542 active, 210 closed, 4 future. Needs a session cookie. No history. |
| Federal ids, status history, charter flag, level | NCES CCD directory ccd_sch_029_{yy}_w_1a_*.zip — fetched 2018-19, 2023-24 | csv · annual to 2023-24 | ST_SCHID = FL-13-NNNN; SY_STATUS, SCH_TYPE, CHARTER_TEXT, LEVEL, grades offered. Dade 556 rows in 2023-24. |
| Longitudinal roster + type flags | FLDOE School Grades SchoolGrades{yy}.xlsx — fetched 2025 | xlsx · 1999 → 2026 (no 2020) | Grade-history columns per school; Charter School, Title I, Alternative/ESE Center, School Type, % economically disadvantaged. |
| Geography, capacity, enrollment snapshot | County GIS "Public School" layer (REST SchoolSite_gdb/FeatureServer/0; CSV item bde2cffe…) and "Charter School" layer (item 04574e57…) — fetched | json/csv · quarterly | ID, TYPE (E/M/S/A/O/PLC/ALT/SPC), GRADES, CAPACITY, ENROLLMNT, REGION, LAT, LON; charter layer has ENROLLMNT only. Plus attendance-boundary polygons and School Board districts. |
Outcomes — test scores
| Need | Source | Format · years | Notes |
|---|---|---|---|
| FAST ELA 3–10, Math 3–8; B.E.S.T. Algebra 1, Geometry; NGSSS Biology, Civics, US History; FSA/FCAT before | FLDOE State Report of Schools (SRS) files, one per subject × grade × administration, linked from fldoe.org/accountability/assessments/k-12-student-assessment/results/{year}.stml — fetched 11ELA03SRSSpring25.xls, 35Spring25Alg1SRS.xls, 54G5SRSSpring23.xls | xls · 2015 → 2026 (no spring 2020); FCAT 2.0 2011–2014 in archive | Header row 5; District Number, School Number (0-padded), Grade, Number of Students, Mean Scale Score, % Level 3+, % levels 1–5. All students only. * n<10. File-name prefixes change yearly — scrape each year page. Dade: 299 ELA-3 rows, 289 Alg 1 rows. |
| Learning gains (growth) | FLDOE ELAGains{yy}.xls, MathGains{yy}.xls — fetched ELA 2025 | xls · 2017 → 2025 | Sheets all / highest-25% / lowest-25%, by school × grade. |
| School Grade components (achievement, gains, L25 gains, science, social studies, MS acceleration, grad, CCR) | School Grades file (above) | xlsx · 1999 → | The (iii-a) reference for proficiency; achievement = % level 3+ across grades. |
| Subgroup assessment results | Florida Report Cards / Know Your Data (edudata.fldoe.org, Tableau) | interactive | Out of scope for v1 loaders (M.6). SIP PDFs carry ESSA subgroup tables (cims2.floridacims.org/public_access/13/schools/{NNNN}). |
Outcomes — graduation, attendance, discipline
| Need | Source | Format · years | Notes |
|---|---|---|---|
| Federal 4-year cohort graduation rate | FLDOE FedGradRateRace{yy}.xls, FedGradRateCategory{yy}.xls — fetched 2425 | xls · 2014-15 → 2024-25 | Header row 6; by 7 races and by ESE / FRL / ELL / migrant / at-risk / sex; Virtual Provider Number column; Dade 146 school rows; *. Completers by diploma type: {yy}CompletersSchool.xlsx (2013-14 →). |
| Chronic absenteeism (state) | FLDOE {yy}ABS21Days10Comparison.xlsx — fetched 2425, 2324; {yy}ABS21DAYSTDistSchl.xlsx — fetched 1617 | xlsx · 10% def. 2017-18 → 2024-25; 21+ days 2010-11 → | Header row 3; annual unduplicated enrollment denominator; Dade 518 rows; *. 2016-17 file flagged inaccurate by FLDOE. |
| Daily attendance | FLDOE ADAADMSchl{yy}.xlsx — fetched 2425 | xlsx · 2010-11 → | Days present/absent, % present, ADA, ADM; no suppression. Stability rate {yy}-STABRATE-Schl.xlsx. |
| Chronic absenteeism (federal, with subgroups) | EdDataExpress EDFacts FS195 DG814 school file (SY2223 Chronic Absenteeism EDE 110724.zip) — listed | csv · 2020-21 → 2022-23 | ESSA 10% definition; race × sex, ECODIS, LEP, SWD, HOM, 504; perturbed counts; Dade 508 schools; 2022-23 district 31.5%. |
| Absenteeism 15+ days, discipline, course access, staffing with subgroups | CRDC national zips civilrightsdata.ed.gov/assets/ocr/docs/{year}-crdc-data.zip — listed (sizes 32 MB–832 MB) | csv · 2011-12, 13-14, 15-16, 17-18, 20-21, 21-22, 23-24 | Join on COMBOKEY → CCD ST_SCHID. |
| Safety incidents | FLDOE SESIR SESIR{yy}a-h.xlsx (older sesir{yy}a-h.xls) — fetched 2425 | xlsx/xls · 2005-06 → 2024-25 | Sheet Schools: ~550 Dade schools × 27 incident types with law-enforcement, substance, bullying, weapon flags; no suppression; definitions change (vaping, opioids). |
| Suspensions / expulsions | FLDOE {yy}DisciplineReport.xlsx — fetched 2425 | xlsx · 2009-10 → 2024-25 | By action × race × sex; very heavy *; use CRDC for subgroup discipline. |
Climate survey
| Need | Source | Format · years | Notes |
|---|---|---|---|
| M-DCPS School Climate Survey — students (grades 4–12), parents, staff | api.dadeschools.net/WMSFiles/244/Survey_Results_Excels/{yy}/…DashBoard_in_Excell….xlsx — fetched 2025 Students | xlsx · 2018-19 → 2024-25 (xlsx); 2001-02 → 2019-20 per-school HTML/PDF | Long table per (school, item): agree / disagree / don't-know shares, N, Less_10 flag; ~32 items in Safety / Resources / Teaching / Leadership; respondent demographics; "grade the school" and "recommend" items. 493 schools. Parent and staff workbooks alongside. Power BI dashboards 2023 →. |
Accountability composites — to validate against
| Need | Source | Notes |
|---|---|---|
| School Grades (A–F) with components and points | FLDOE School Grades file | The Florida analogue of NYC's Snapshot and Philly's SPREE; file-based, so (iii-a) can run on every school. Also SIR (alternative/ESE-center ratings), PLP (persistently low-performing), Schools of Excellence lists. |
| Florida Report Cards | edudata.fldoe.org/ReportCards/Schools.html?district=13&school=NNNN | Interactive; per-school population, achievement by subgroup, ESSA absenteeism, PPE, educator quality. Presentation reference only. |
| M-DCPS school dashboards | pdfs.dadeschools.net/guidek12schooldashboards/{NNNN}.pdf | Per-school PDF: October enrollment by grade × ethnicity, ELL/ESE, staff by category, grade components, ADA. |
Enrollment, demographics, staffing, spending
| Need | Source | Format · years | Notes |
|---|---|---|---|
| Membership by school × grade (October) | FLDOE {yy}MembBySchoolByGrade.xlsx — fetched 2526, 2425, 1819 | xlsx · 2016-17 → 2025-26 | Header row and sheet order vary by year (findings.md F.3); */**. |
| Membership by school × grade × race | {yy}MembBySchoolByGradeByRace.xlsx — fetched 2526 | xlsx · 2014-15 → | No total column; heavy *. |
| Independent membership copy | NCES CCD membership ccd_sch_052_{yy}_l_1a_*.zip — fetched 2018-19, 2023-24 | csv (200 MB) · to 2023-24 | School × grade × race × sex. |
| ELL | {yy}ELLCodeMemb.xlsx — fetched 2526 | xlsx · 2012-13 → | By school × race. |
| Economic disadvantage | {yy}FS3-Lunch-Status-School.xlsx (and FS2) — fetched 2526; CCD lunch file — fetched 2023-24 | xlsx · 2014-15 → | Free / reduced / direct-cert / CEP × 1.6 columns; see M.8. |
| SWD | MPES{yy}.xlsx — fetched 2526 | district only | School-level SWD from CRDC / EDFacts / graduation cohorts. |
| Teachers | CCD staff ccd_sch_059_* — fetched 2023-24; FLDOE IFOFFTeach{yy}.xlsx (in-field / out-of-field classes) — fetched 2526; FLDOE staff files are district-level | csv / xlsx | School-level teacher FTE from CCD only. |
| Per-pupil expenditure | FLDOE ESSA ESSA-{yyyy}-School-Per-Pupil-Expenditures.xlsx (older ESSA{yy}School-PerPupil-Expend.xlsx) — fetched 2025, 2023 | xlsx · 2018-19 → 2024-25 | School costs and district indirect costs per pupil, state+local / federal / total. |
| District totals, 10-year trend | M-DCPS Statistical Highlights SH{yy}.pdf — fetched 2425, 2526 | pdf · 1974-75 → | Schools / pupils / teachers / salary; charter vs traditional counts; by grade × race; by region and Board district. |
| Course access (AP / IB / AICE / dual enrollment) | FLDOE course enrollment Schl{yy}S3Dade-Highlands.xlsx — fetched 2526 | xlsx · 2019-20 → | 80,906 rows of school × course × enrollment; derive the access index. |
Facilities, projections, closures (the 06 track)
| Need | Source | Format · years | Notes |
|---|---|---|---|
| Per-school capacity and utilization, all facilities | FLDOE FISH Level of Service report 2425Dade.pdf — fetched 2223, 2324, 2425 | pdf (20 pp) · 2022-23 → 2024-25 | School / permanent / dining / year-round capacity, utilization factor, % utilization (= COFTE ÷ school capacity), primary use, COFTE, available capacity. Parse with pdfplumber; validate with a second parser. |
| 5-year projections per school, plant survey | DEFP / Work Plan DADE2025.pdf (/core/fileparse.php/9948/urlt/) — fetched | Prior years DADE2024.pdf etc. | |
| District COFTE projections | FLDOE COFTE 2324COFTE-PFP.pdf — fetched | pdf · annual | District × grade, 10-year horizon. |
| Targeted schools: capacity, utilization, 2-year projection; the closure/consolidation record | M-DCPS ABC book pdfs.dadeschools.net/Bdarch/2026/Bd061726/agenda/ATTENDANCE-ZONE-…-2026-2027-FINAL-READING.pdf — fetched; 2024-25 and 2019-20 editions listed | pdf (78 pp) · ≥ 2019-20 → 2026-27 | Regex-parseable blocks per school (findings.md F.7). Board policy 5120 factors. |
| District utilization baseline and target; deferred maintenance | Strategic Plan 2026-31 (pdfs.dadeschools.net/Bdarch/2026/Bd051326/agenda/Strat-Plan-Landscape_2026-2031.pdf) — listed | 66% baseline → 80% by 2031; $3.69B backlog. | |
| Budget FTE incl. charter and voucher FTE | 2026-27 Budget Executive Summary — fetched (331 pp) | pdf · annual | uwFTE trends: charter 86,432, FES 82,470 projected. |
| Concurrency standard | County CDMP Educational Element; interlocal agreement — listed | LOS = 100% of FISH incl. relocatables per concurrency service area. | |
| Voucher (FES) counts | District budget; press; OADA Evaluation Matters v12 n4 (ERIC ED659180) — listed | County-level only; 2023 study has per-school resident shares. |
C. Open-data infrastructure
Weaker than Philly's, comparable to NYC's: FLDOE distributes Excel with
stable-ish URLs (two URL forms, yearly file-name drift for assessments) and
no API; M-DCPS distributes PDFs and Excel through a CMS (api.dadeschools.net/WMSFiles/…)
whose page JSON (/api/wms/getPageData/{id}) is scrapeable; the county
hub is a proper ArcGIS API. Federal copies (CCD, EDFacts, CRDC) are the
machine-readable backstop.
D. Things Miami-Dade has that NYC and Philly don't
- A per-facility capacity inventory (FISH) published by the state, plus the district's own utilization blocks in the board record — the closure question is answerable from public files.
- School-level per-pupil expenditure (ESSA) since 2018-19.
- A–F school grades with component scores back to 1999 — a long, file-based accountability series.
- Federal copies with subgroups (EDFacts absenteeism, CRDC discipline) reachable on day one.
E. Things NYC and Philly have that Miami doesn't
- Subgroup assessment results in bulk files — Florida's are all-students only.
- A public per-school time series from the district (NYC InfoHub, Philly OpenDataPhilly); M-DCPS publishes district totals and per-school PDFs.
- Admission-category taxonomy — Miami's is magnet / choice / neighborhood / charter lottery.
- A neighborhood civic-data ecosystem; Miami has the Herald, WLRN, Axios Miami and the Pineapple Report.
F. Things that genuinely require new work
- PDF-table parsing with a second-parser agreement gate (FISH LOS, ABC book, DEFP).
- Per-year assessment file discovery (scrape the year page; map prefixes).
- The
MiamiSchoolEventtable built from board documents. - Three-way charter-flag agreement and the virtual-provider key.
- The
origin.fldoe.orgrewrite and MSID session-cookie fetch indiscover.py.