diff --git a/README.md b/README.md index dbbf1dae53..99fafd89ed 100644 --- a/README.md +++ b/README.md @@ -8,17 +8,17 @@ Government is already software: statutes are code, agencies are processes, elect ## What's in here today -37,667 markdown records, every one schema-validated: +57,185 markdown records, every one schema-validated: | Entity | Count | What it is | |---|---:|---| | **Person** | 13,329 | Current officeholders — federal, all 50 state legislatures, and Florida down to the municipal level. Federal members carry their bioguide ID, leadership roles, and committee seats. | | **Body** | 233 | The institutions themselves — the U.S. House, the Senate, 49 committees, 181 subcommittees, each with its leadership. | | **Candidate** | 2,494 | Everyone running for federal office in 2026, from FEC filings. | -| **Jurisdiction** | 10,390 | Every U.S. county (3,131), all 435 congressional districts (Census demographics on 363), and every state legislative district — 4,927 house, 1,897 senate — the nationwide skeleton, filled with data. | +| **Jurisdiction** | 29,908 | Every U.S. county (3,131), all 435 congressional districts (Census demographics on 363), every state legislative district (4,927 house, 1,897 senate), and **every incorporated municipality in the country — 19,513 cities, towns, villages, and boroughs** — keyed by Census place GEOID, with officeholders attached where the mirror has them. | | **LegalText** | 11,221 | U.S. Code Titles 1–11 and 52 — General Provisions through Bankruptcy, plus Voting and Elections — mirrored section-by-section from the official OLRC XML release current through Public Law 119-100. | -The mirror answers, with receipts: *who holds power, who runs the institution, who's running, what each place is made of,* and *what the law says* — and, through git, *what changed.* +The mirror answers, with receipts: *who holds power, who runs the institution, who's running, what each place is made of — down to the city,* and *what the law says* — and, through git, *what changed.* ## How it works diff --git a/docs/data-model.md b/docs/data-model.md index 85d8db0131..bffd80491d 100644 --- a/docs/data-model.md +++ b/docs/data-model.md @@ -45,15 +45,17 @@ The format conforms to the [Open Knowledge Format (OKF)](https://github.com/Goog | `type` | Count | Home | Schema | |---|---:|---|---| -| **Person** | 11,285 | `us/people/`, `us/states//…/people/` | [person.schema.json](../schemas/person.schema.json) | +| **Person** | 13,329 | `us/people/`, `us/states//…/people/` | [person.schema.json](../schemas/person.schema.json) | | **Body** | 233 | `us/bodies/…` | [body.schema.json](../schemas/body.schema.json) | | **Candidate** | 2,494 | `us/states//candidates/` | [candidate.schema.json](../schemas/candidate.schema.json) | -| **Jurisdiction** | 3,494 | county `index.md`, `us/states//districts/` | [jurisdiction.schema.json](../schemas/jurisdiction.schema.json) | +| **Jurisdiction** | 29,908 | county / city `index.md`, `us/states//districts/` | [jurisdiction.schema.json](../schemas/jurisdiction.schema.json) | +| **LegalText** | 11,221 | `legal/us/code/title-/…` | [legal_text.schema.json](../schemas/legal_text.schema.json) | - **Person** — an officeholder, filed by the jurisdiction they serve. Federal members are enriched with their bioguide ID, leadership roles, and committee seats. - **Body** — an institution: a chamber, committee, or subcommittee. The "repos" of the government-as-code model. Each lists its leadership; subcommittees name their parent. - **Candidate** — someone running for office, distinct from a current officeholder. Sourced from FEC filings. -- **Jurisdiction** — a place with a government, carrying Census demographics. A county's node is its directory `index.md`; a district's is a file under `districts/`. +- **Jurisdiction** — a place with a government, carrying Census demographics and/or district edges. A county's node is its directory `index.md`; a **city's** is likewise an `index.md` under `municipalities/`, keyed by Census place GEOID and modelled exactly like a county (place + government fused, officeholders nested beneath); a district's is a file under `districts/`. +- **LegalText** — a single section of statute, filed under its title and chapter. See the [legal corpus](legal-corpus.md). ## The jurisdiction tree @@ -77,10 +79,11 @@ data/jurisdictions/ people/ county officeholders municipalities/ port-st-lucie/ + index.md the city as a Jurisdiction node (GEOID) people/ city officeholders ``` -The tree is **complete on the map, uneven on the ground**: every U.S. county exists as a node (from Census data), but officeholder depth currently reaches the municipal level only in Florida. An empty directory is not a failure — it is the frontier. +The tree is **complete on the map, uneven on the ground**: every U.S. county *and* every incorporated municipality (19,513 of them) exists as a node, but officeholder depth is deepest in Florida and thins out elsewhere. A city node with no `people/` yet is a truthful skeleton stub — "governed, not yet mirrored." An empty directory is not a failure — it is the frontier. A second axis — cross-cutting **issues** that link entities across the tree — is designed but not yet built. See the [roadmap](roadmap.md). diff --git a/docs/roadmap.md b/docs/roadmap.md index dcdfed5bab..a60eb3199a 100644 --- a/docs/roadmap.md +++ b/docs/roadmap.md @@ -5,10 +5,11 @@ An honest account of what exists, what's next, and what's further out. This repo ## Done - **The substrate** — repo-canonical, OKF markdown + YAML frontmatter, JSON-Schema validated, deterministic build (byte-identical on rerun). -- **Five entity types, 37,667 files** — Person (13,329), Body (233), Candidate (2,494), Jurisdiction (10,390), LegalText (11,221). +- **Five entity types, 57,185 files** — Person (13,329), Body (233), Candidate (2,494), Jurisdiction (29,908), LegalText (11,221). - **The federal government, structurally** — every member of Congress, the chambers, 49 committees and 181 subcommittees with their leadership, and every member's committee seats. - **The nationwide county skeleton** — all 3,131 U.S. counties as demographic nodes, plus all 435 congressional districts (Census ACS demographics on 363). - **The authority layer** — every state legislative district (4,927 house, 1,897 senate) linked county↔district↔legislator, nationwide. +- **The municipal layer** — every incorporated place in the country (19,513 cities, towns, villages, boroughs) as a first-class Jurisdiction node keyed by Census place GEOID, modelled like a county (place + government fused). 2,229 are filled with their officeholders today (2,217 GEOID-resolved off a 98.8% name→GEOID join); the rest are truthful skeleton stubs — "governed, not yet mirrored" — waiting for depth, the same discipline as the county skeleton. - **The legal corpus, seeded wide** — U.S. Code Titles 1–11 and 52 as 11,221 per-section records, mirrored from pinned OLRC XML (release 119-100) with manifests and checksums. Titles 12–54 pending an OLRC XML retry (the GovInfo HTML fallback is not source-quality). - **The 2026 federal candidate field** — every FEC filing as a Candidate. - **Florida to the ground** — officeholders down to the municipal level across all 67 counties. @@ -21,7 +22,8 @@ An honest account of what exists, what's next, and what's further out. This repo - **Self-updating mirror** — the `make check` GitHub Action now guards every push; next is the scheduled job that pulls a fresh Atlas export, rebuilds, and commits the changelog automatically. That is the point where the mirror maintains itself and the daily civic changelog becomes real (the first *re-sync* diff, where only genuine government changes surface). - **The full U.S. Code** — titles 12–54 as OLRC USLM XML at the same release point (retry in progress on Atlas; the WAF-blocked titles currently exist only as GovInfo HTML, which stays a secondary snapshot). - **The demographic choropleth** — the Board already has ACS data for every county; shade the map by population, income, and poverty, turning it from a coverage indicator into an instrument. -- **State and local bodies** — Bodies currently exist only at the federal level. Mint them for state legislatures and, following the Florida depth, county commissions and city councils. +- **Fill the municipal skeleton** — the 19,513 city nodes exist; 2,229 carry officeholders. The work now is depth: pull municipal officeholders for the next states (Texas, California, Ohio all have a spine already), each a diff against a node that's waiting. Municipal ACS demographics would enrich every city node the way ACS already enriches counties. +- **State and local bodies** — Bodies (as distinct institution files) currently exist only at the federal level. Mint them for state legislatures and, following the municipal layer, county commissions where they warrant a Body of their own. - **Graph export** — a loader that walks the tree and builds the relationship graph (Memgraph) as a materialized view, so the repo can rehydrate the graph rather than the reverse. ## Later