# 01 — Inventory (Miami-Dade data landscape)

What is publicly available, in what format, at what cadence, for what
years. Every row marked **fetched** was downloaded on 2026-09-15 and its
shape inspected (`findings.md §F`); provenance lives under
`data/cities/miami/sources/`. Rows marked *listed* were verified to exist
on an index page but not opened.

## A. Publishers

| Publisher | Role | Coverage |
|---|---|---|
| **Florida Department of Education (FLDOE)** — PK-12 Education Information Services, Accountability, Assessment, Safe Schools, Educational Facilities, Funding & Financial Reporting | The state layer: every school-level outcome, membership, discipline, facilities and spending file | All Florida public schools incl. charters, at district 13 grain |
| **M-DCPS Research Services / Assessment, Research & Data Analysis** | District layer: climate survey, Statistical Highlights, research briefs, school dashboards | District-run + charter (survey: district-run mostly) |
| **M-DCPS School Board / Facilities Planning** | Board record: Attendance Zone Recommendations (ABC), budget, strategic plan, DEFP | District-run schools |
| **Miami-Dade County Open Data Hub (ArcGIS)** | School points with capacity/enrollment, boundaries, board districts | District-run + charter (separate layers) |
| **NCES (CCD)** | Federal copy of the state's directory, membership, staff, lunch submissions | All schools; ~1.5-year lag |
| **US ED — EDFacts (EdDataExpress) and OCR (CRDC)** | Independent-publisher absenteeism, discipline, course access, staffing with subgroups | All schools |

Access note: `www.fldoe.org` blocks cloud egress (Akamai 403); the same
paths on `origin.fldoe.org` serve every file (`findings.md §E`).

## B. Sources by analytical input

### School directory + universe tagging

| Need | Source | Format · years | Notes |
|---|---|---|---|
| All district-13 schools with stable IDs | **FLDOE MSID** "All schools, all fields" (`eds.fldoe.org/EDS/MasterSchoolID/Downloads/All_schools.cfm`) — **fetched** | tab-delimited text · current snapshot | 77 fields: type, grade code, activity (A/C/F), charter status + open year, magnet status/specialty, school choice, Title I, principal, addresses, lat/lng, NCES ids, date opened/closed, current grade. Dade: 756 rows = 542 active, 210 closed, 4 future. Needs a session cookie. No history. |
| Federal ids, status history, charter flag, level | **NCES CCD directory** `ccd_sch_029_{yy}_w_1a_*.zip` — **fetched 2018-19, 2023-24** | csv · annual to 2023-24 | `ST_SCHID = FL-13-NNNN`; `SY_STATUS`, `SCH_TYPE`, `CHARTER_TEXT`, `LEVEL`, grades offered. Dade 556 rows in 2023-24. |
| Longitudinal roster + type flags | **FLDOE School Grades** `SchoolGrades{yy}.xlsx` — **fetched 2025** | xlsx · 1999 → 2026 (no 2020) | Grade-history columns per school; `Charter School`, `Title I`, `Alternative/ESE Center`, `School Type`, `% economically disadvantaged`. |
| Geography, capacity, enrollment snapshot | **County GIS "Public School"** layer (REST `SchoolSite_gdb/FeatureServer/0`; CSV item `bde2cffe…`) and **"Charter School"** layer (item `04574e57…`) — **fetched** | json/csv · quarterly | `ID, TYPE (E/M/S/A/O/PLC/ALT/SPC), GRADES, CAPACITY, ENROLLMNT, REGION, LAT, LON`; charter layer has `ENROLLMNT` only. Plus attendance-boundary polygons and School Board districts. |

### Outcomes — test scores

| Need | Source | Format · years | Notes |
|---|---|---|---|
| FAST ELA 3–10, Math 3–8; B.E.S.T. Algebra 1, Geometry; NGSSS Biology, Civics, US History; FSA/FCAT before | **FLDOE State Report of Schools (SRS)** files, one per subject × grade × administration, linked from `fldoe.org/accountability/assessments/k-12-student-assessment/results/{year}.stml` — **fetched** `11ELA03SRSSpring25.xls`, `35Spring25Alg1SRS.xls`, `54G5SRSSpring23.xls` | xls · 2015 → 2026 (no spring 2020); FCAT 2.0 2011–2014 in archive | Header row 5; `District Number, School Number (0-padded), Grade, Number of Students, Mean Scale Score, % Level 3+, % levels 1–5`. **All students only.** `*` n<10. File-name prefixes change yearly — scrape each year page. Dade: 299 ELA-3 rows, 289 Alg 1 rows. |
| Learning gains (growth) | **FLDOE** `ELAGains{yy}.xls`, `MathGains{yy}.xls` — **fetched** ELA 2025 | xls · 2017 → 2025 | Sheets all / highest-25% / lowest-25%, by school × grade. |
| School Grade components (achievement, gains, L25 gains, science, social studies, MS acceleration, grad, CCR) | School Grades file (above) | xlsx · 1999 → | The (iii-a) reference for proficiency; achievement = % level 3+ across grades. |
| Subgroup assessment results | Florida Report Cards / Know Your Data (`edudata.fldoe.org`, Tableau) | interactive | Out of scope for v1 loaders (M.6). SIP PDFs carry ESSA subgroup tables (`cims2.floridacims.org/public_access/13/schools/{NNNN}`). |

### Outcomes — graduation, attendance, discipline

| Need | Source | Format · years | Notes |
|---|---|---|---|
| Federal 4-year cohort graduation rate | **FLDOE** `FedGradRateRace{yy}.xls`, `FedGradRateCategory{yy}.xls` — **fetched 2425** | xls · 2014-15 → 2024-25 | Header row 6; by 7 races and by ESE / FRL / ELL / migrant / at-risk / sex; `Virtual Provider Number` column; Dade 146 school rows; `*`. Completers by diploma type: `{yy}CompletersSchool.xlsx` (2013-14 →). |
| Chronic absenteeism (state) | **FLDOE** `{yy}ABS21Days10Comparison.xlsx` — **fetched 2425, 2324**; `{yy}ABS21DAYSTDistSchl.xlsx` — **fetched 1617** | xlsx · 10% def. 2017-18 → 2024-25; 21+ days 2010-11 → | Header row 3; annual unduplicated enrollment denominator; Dade 518 rows; `*`. 2016-17 file flagged inaccurate by FLDOE. |
| Daily attendance | **FLDOE** `ADAADMSchl{yy}.xlsx` — **fetched 2425** | xlsx · 2010-11 → | Days present/absent, % present, ADA, ADM; no suppression. Stability rate `{yy}-STABRATE-Schl.xlsx`. |
| Chronic absenteeism (federal, with subgroups) | **EdDataExpress** EDFacts FS195 DG814 school file (`SY2223 Chronic Absenteeism EDE 110724.zip`) — *listed* | csv · 2020-21 → 2022-23 | ESSA 10% definition; race × sex, ECODIS, LEP, SWD, HOM, 504; perturbed counts; Dade 508 schools; 2022-23 district 31.5%. |
| Absenteeism 15+ days, discipline, course access, staffing with subgroups | **CRDC** national zips `civilrightsdata.ed.gov/assets/ocr/docs/{year}-crdc-data.zip` — *listed* (sizes 32 MB–832 MB) | csv · 2011-12, 13-14, 15-16, 17-18, 20-21, 21-22, 23-24 | Join on `COMBOKEY` → CCD `ST_SCHID`. |
| Safety incidents | **FLDOE SESIR** `SESIR{yy}a-h.xlsx` (older `sesir{yy}a-h.xls`) — **fetched 2425** | xlsx/xls · 2005-06 → 2024-25 | Sheet `Schools`: ~550 Dade schools × 27 incident types with law-enforcement, substance, bullying, weapon flags; no suppression; definitions change (vaping, opioids). |
| Suspensions / expulsions | **FLDOE** `{yy}DisciplineReport.xlsx` — **fetched 2425** | xlsx · 2009-10 → 2024-25 | By action × race × sex; very heavy `*`; use CRDC for subgroup discipline. |

### Climate survey

| Need | Source | Format · years | Notes |
|---|---|---|---|
| **M-DCPS School Climate Survey** — students (grades 4–12), parents, staff | `api.dadeschools.net/WMSFiles/244/Survey_Results_Excels/{yy}/…DashBoard_in_Excell….xlsx` — **fetched** 2025 Students | xlsx · 2018-19 → 2024-25 (xlsx); 2001-02 → 2019-20 per-school HTML/PDF | Long table per (school, item): agree / disagree / don't-know shares, N, `Less_10` flag; ~32 items in Safety / Resources / Teaching / Leadership; respondent demographics; "grade the school" and "recommend" items. 493 schools. Parent and staff workbooks alongside. Power BI dashboards 2023 →. |

### Accountability composites — to validate against

| Need | Source | Notes |
|---|---|---|
| **School Grades (A–F)** with components and points | FLDOE School Grades file | The Florida analogue of NYC's Snapshot and Philly's SPREE; file-based, so (iii-a) can run on every school. Also SIR (alternative/ESE-center ratings), PLP (persistently low-performing), Schools of Excellence lists. |
| **Florida Report Cards** | `edudata.fldoe.org/ReportCards/Schools.html?district=13&school=NNNN` | Interactive; per-school population, achievement by subgroup, ESSA absenteeism, PPE, educator quality. Presentation reference only. |
| **M-DCPS school dashboards** | `pdfs.dadeschools.net/guidek12schooldashboards/{NNNN}.pdf` | Per-school PDF: October enrollment by grade × ethnicity, ELL/ESE, staff by category, grade components, ADA. |

### Enrollment, demographics, staffing, spending

| Need | Source | Format · years | Notes |
|---|---|---|---|
| Membership by school × grade (October) | **FLDOE** `{yy}MembBySchoolByGrade.xlsx` — **fetched 2526, 2425, 1819** | xlsx · 2016-17 → 2025-26 | Header row and sheet order vary by year (`findings.md F.3`); `*`/`**`. |
| Membership by school × grade × race | `{yy}MembBySchoolByGradeByRace.xlsx` — **fetched 2526** | xlsx · 2014-15 → | No total column; heavy `*`. |
| Independent membership copy | **NCES CCD** membership `ccd_sch_052_{yy}_l_1a_*.zip` — **fetched 2018-19, 2023-24** | csv (200 MB) · to 2023-24 | School × grade × race × sex. |
| ELL | `{yy}ELLCodeMemb.xlsx` — **fetched 2526** | xlsx · 2012-13 → | By school × race. |
| Economic disadvantage | `{yy}FS3-Lunch-Status-School.xlsx` (and FS2) — **fetched 2526**; CCD lunch file — **fetched 2023-24** | xlsx · 2014-15 → | Free / reduced / direct-cert / CEP × 1.6 columns; see M.8. |
| SWD | `MPES{yy}.xlsx` — **fetched 2526** | district only | School-level SWD from CRDC / EDFacts / graduation cohorts. |
| Teachers | **CCD staff** `ccd_sch_059_*` — **fetched 2023-24**; FLDOE `IFOFFTeach{yy}.xlsx` (in-field / out-of-field classes) — **fetched 2526**; FLDOE staff files are district-level | csv / xlsx | School-level teacher FTE from CCD only. |
| Per-pupil expenditure | **FLDOE ESSA** `ESSA-{yyyy}-School-Per-Pupil-Expenditures.xlsx` (older `ESSA{yy}School-PerPupil-Expend.xlsx`) — **fetched 2025, 2023** | xlsx · 2018-19 → 2024-25 | School costs and district indirect costs per pupil, state+local / federal / total. |
| District totals, 10-year trend | **M-DCPS Statistical Highlights** `SH{yy}.pdf` — **fetched 2425, 2526** | pdf · 1974-75 → | Schools / pupils / teachers / salary; charter vs traditional counts; by grade × race; by region and Board district. |
| Course access (AP / IB / AICE / dual enrollment) | **FLDOE course enrollment** `Schl{yy}S3Dade-Highlands.xlsx` — **fetched 2526** | xlsx · 2019-20 → | 80,906 rows of school × course × enrollment; derive the access index. |

### Facilities, projections, closures (the `06` track)

| Need | Source | Format · years | Notes |
|---|---|---|---|
| Per-school capacity and utilization, all facilities | **FLDOE FISH Level of Service report** `2425Dade.pdf` — **fetched 2223, 2324, 2425** | pdf (20 pp) · 2022-23 → 2024-25 | School / permanent / dining / year-round capacity, utilization factor, % utilization (= COFTE ÷ school capacity), primary use, COFTE, available capacity. Parse with pdfplumber; validate with a second parser. |
| 5-year projections per school, plant survey | **DEFP / Work Plan** `DADE2025.pdf` (`/core/fileparse.php/9948/urlt/`) — **fetched** | pdf | Prior years `DADE2024.pdf` etc. |
| District COFTE projections | **FLDOE COFTE** `2324COFTE-PFP.pdf` — **fetched** | pdf · annual | District × grade, 10-year horizon. |
| Targeted schools: capacity, utilization, 2-year projection; the closure/consolidation record | **M-DCPS ABC book** `pdfs.dadeschools.net/Bdarch/2026/Bd061726/agenda/ATTENDANCE-ZONE-…-2026-2027-FINAL-READING.pdf` — **fetched**; 2024-25 and 2019-20 editions *listed* | pdf (78 pp) · ≥ 2019-20 → 2026-27 | Regex-parseable blocks per school (`findings.md F.7`). Board policy 5120 factors. |
| District utilization baseline and target; deferred maintenance | Strategic Plan 2026-31 (`pdfs.dadeschools.net/Bdarch/2026/Bd051326/agenda/Strat-Plan-Landscape_2026-2031.pdf`) — *listed* | pdf | 66% baseline → 80% by 2031; $3.69B backlog. |
| Budget FTE incl. charter and voucher FTE | **2026-27 Budget Executive Summary** — **fetched** (331 pp) | pdf · annual | uwFTE trends: charter 86,432, FES 82,470 projected. |
| Concurrency standard | County CDMP Educational Element; interlocal agreement — *listed* | pdf | LOS = 100% of FISH incl. relocatables per concurrency service area. |
| Voucher (FES) counts | District budget; press; OADA *Evaluation Matters* v12 n4 (ERIC ED659180) — *listed* | pdf | County-level only; 2023 study has per-school resident shares. |

## C. Open-data infrastructure

Weaker than Philly's, comparable to NYC's: FLDOE distributes Excel with
stable-ish URLs (two URL forms, yearly file-name drift for assessments) and
no API; M-DCPS distributes PDFs and Excel through a CMS (`api.dadeschools.net/WMSFiles/…`)
whose page JSON (`/api/wms/getPageData/{id}`) is scrapeable; the county
hub is a proper ArcGIS API. Federal copies (CCD, EDFacts, CRDC) are the
machine-readable backstop.

## D. Things Miami-Dade has that NYC and Philly don't

1. A per-facility **capacity inventory (FISH)** published by the state, plus the district's own utilization blocks in the board record — the closure question is answerable from public files.
2. **School-level per-pupil expenditure** (ESSA) since 2018-19.
3. **A–F school grades with component scores back to 1999** — a long, file-based accountability series.
4. **Federal copies with subgroups** (EDFacts absenteeism, CRDC discipline) reachable on day one.

## E. Things NYC and Philly have that Miami doesn't

1. **Subgroup assessment results in bulk files** — Florida's are all-students only.
2. **A public per-school time series from the district** (NYC InfoHub, Philly OpenDataPhilly); M-DCPS publishes district totals and per-school PDFs.
3. **Admission-category taxonomy** — Miami's is magnet / choice / neighborhood / charter lottery.
4. **A neighborhood civic-data ecosystem**; Miami has the Herald, WLRN, Axios Miami and the Pineapple Report.

## F. Things that genuinely require new work

- PDF-table parsing with a second-parser agreement gate (FISH LOS, ABC book, DEFP).
- Per-year assessment file discovery (scrape the year page; map prefixes).
- The `MiamiSchoolEvent` table built from board documents.
- Three-way charter-flag agreement and the virtual-provider key.
- The `origin.fldoe.org` rewrite and MSID session-cookie fetch in `discover.py`.