Files
Fabio 7764501bcf Legislation axis: Bill schema, OpenStates ingest, validator + provenance
The legislative-process corpus, parallel to the U.S. Code statute corpus.
schemas/bill.schema.json + scripts/ingest_legislation.py (deterministic,
stdlib-only, reads per-state JSONL from the depot); validate.py gains
legislation/ as a third tree; Makefile 'legislation' target. Raw JSONL stays
off-repo on the depot (gitignored); the per-state SHA-256 manifest is the
committed provenance anchor. Vintage 2026-07-01.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-07-06 17:24:31 -04:00

128 lines
4.7 KiB
YAML

# Republic OS — source registry.
# Machine-readable index of the public sources feeding the mirror.
# Prose companion: docs/sources.md
sources:
- id: atlas
name: Atlas / influence.tools
url: https://influence.tools
type: aggregator
authority_level: aggregator
requires_api_key: false
refresh_frequency: on-demand
feeds: [Person]
raw: [officeholders-v2.jsonl]
notes: >
Draws from official upstreams (House Clerk XML, Senate.gov XML,
OpenStates, Census TIGER/Line, FL Cities partner API) and records the
specific upstream per field. Officeholders at federal, state, and
Florida county/municipal levels.
- id: congress-legislators
name: unitedstates/congress-legislators
url: https://github.com/unitedstates/congress-legislators
type: dataset
authority_level: authoritative-community
requires_api_key: false
refresh_frequency: continuous
feeds: [Body, Person]
raw: [bodies.jsonl, leadership.jsonl, committee_memberships.jsonl]
notes: >
Structured YAML for chambers, committees, subcommittees, current
leadership, and committee membership. Keyed by bioguide ID.
- id: fec
name: Federal Election Commission
url: https://www.fec.gov/data/
type: api
authority_level: official
requires_api_key: true
refresh_frequency: daily
feeds: [Candidate]
raw: [fec_candidates.jsonl]
notes: 2026 federal candidate filings; keyed by fec_id and committee_id.
- id: census-acs
name: Census American Community Survey (2023)
url: https://www.census.gov/programs-surveys/acs
type: dataset
authority_level: official
requires_api_key: false
refresh_frequency: annual
feeds: [Jurisdiction]
raw: [acs_county.jsonl, acs_cd.jsonl]
notes: County and congressional-district demographics; keyed by FIPS.
- id: place-county-crosswalk
name: Census place → county crosswalk (Atlas PostGIS)
url: https://www.census.gov/geographies/mapping-files.html
type: dataset
authority_level: official
requires_api_key: false
refresh_frequency: on-demand
feeds: [Person]
raw: [place_county_crosswalk.jsonl]
notes: >
Atlas PostGIS spatial join of Census TIGER 2024 places against county
geometries — 32,041 places, one primary county each. Resolves municipal
officeholders to their county. Join key is county_geoid (5-digit FIPS);
the sibling county_fips column is the 3-digit county code only.
- id: county-district-overlap
name: County → district area overlap (PostGIS)
url: https://www.census.gov/geographies/mapping-files.html
type: dataset
authority_level: official
requires_api_key: false
refresh_frequency: on-demand
feeds: [Jurisdiction]
raw: [county_district_edges.jsonl]
notes: >
PostGIS area-intersection of Census TIGER 2024 county boundaries against
congressional / state-senate / state-house district boundaries —
ST_Area(ST_Intersection(county, district)) / ST_Area(county), computed on
ST_MakeValid geometries, overlaps below 0.5% dropped. 16,328 weighted
county→district edges. Also seeds the state-legislative district nodes
(which have no ACS demographics — geometry only).
- id: openstates
name: OpenStates bulk snapshot
url: https://data.openstates.org/
type: dataset
authority_level: authoritative-community
requires_api_key: false
refresh_frequency: daily
feeds: [Bill]
raw: [depot:/exports/legislation/2026-07-01/enacted_{st}_2026-07-01.jsonl]
notes: >
Enacted state legislation, all 50 states, vintage 2026-07-01 —
197,131 records (bills AND joint/concurrent resolutions; the
classification field records which; e.g. TN is 8,785 bills +
13,388 joint resolutions). Raw JSONL lives on the depot; the
per-state SHA-256 manifest is committed at
data/sources/legislation_manifest_2026-07-01.json. Aggregated
from official legislature sites; confidence: reported.
# Prepared but not yet ingested — see docs/roadmap.md
planned:
- id: govinfo
name: GovInfo
url: https://www.govinfo.gov/
authority_level: official
- id: federal-register
name: Federal Register
url: https://www.federalregister.gov/
authority_level: official
- id: usaspending
name: USAspending.gov
url: https://www.usaspending.gov/
authority_level: official
- id: legistar
name: Legistar / Granicus / CivicPlus (local agenda portals)
url: https://webapi.legistar.com/
authority_level: official
- id: census-tiger
name: Census TIGER/Line (geometry)
url: https://www.census.gov/geographies/mapping-files.html
authority_level: official