Files
republic-os/data/sources/sources.yaml
T
Fabio 199d8b37d3 Municipals: nest 1,823 city officeholders under their real counties
Pull Atlas's place→county crosswalk (Census TIGER 2024 places × county
geometries, 32,041 places) into the build as a committed raw input, and
use it to resolve municipal officeholders whose county was unknown.

- data/place_county_crosswalk.jsonl — new raw input (place_geoid → county_geoid)
- build.py — place-name+state → county_geoid → ACS county slug as a fallback
  in county_slug(); city_slug() generalized to non-FL bare place labels
- data/sources/sources.yaml — provenance entry for the crosswalk

_unresolved municipals: 1919 → 58. The remainder are genuine: CT planning
regions (post-county), county-level rows mislabeled municipal upstream,
consolidated city-counties (null label), Wikidata-QID placeholder names,
and ambiguous same-name places — left unresolved rather than guessed.

Join key is county_geoid (5-digit FIPS); the directory slug is taken from
the ACS county node so municipals nest under the exact existing county dir.
Deterministic (byte-identical rebuild); validate.py passes 19,721 records.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-07-04 20:23:57 -04:00

93 lines
3.1 KiB
YAML

# Republic OS — source registry.
# Machine-readable index of the public sources feeding the mirror.
# Prose companion: docs/sources.md
sources:
- id: atlas
name: Atlas / influence.tools
url: https://influence.tools
type: aggregator
authority_level: aggregator
requires_api_key: false
refresh_frequency: on-demand
feeds: [Person]
raw: [officeholders-v2.jsonl]
notes: >
Draws from official upstreams (House Clerk XML, Senate.gov XML,
OpenStates, Census TIGER/Line, FL Cities partner API) and records the
specific upstream per field. Officeholders at federal, state, and
Florida county/municipal levels.
- id: congress-legislators
name: unitedstates/congress-legislators
url: https://github.com/unitedstates/congress-legislators
type: dataset
authority_level: authoritative-community
requires_api_key: false
refresh_frequency: continuous
feeds: [Body, Person]
raw: [bodies.jsonl, leadership.jsonl, committee_memberships.jsonl]
notes: >
Structured YAML for chambers, committees, subcommittees, current
leadership, and committee membership. Keyed by bioguide ID.
- id: fec
name: Federal Election Commission
url: https://www.fec.gov/data/
type: api
authority_level: official
requires_api_key: true
refresh_frequency: daily
feeds: [Candidate]
raw: [fec_candidates.jsonl]
notes: 2026 federal candidate filings; keyed by fec_id and committee_id.
- id: census-acs
name: Census American Community Survey (2023)
url: https://www.census.gov/programs-surveys/acs
type: dataset
authority_level: official
requires_api_key: false
refresh_frequency: annual
feeds: [Jurisdiction]
raw: [acs_county.jsonl, acs_cd.jsonl]
notes: County and congressional-district demographics; keyed by FIPS.
- id: place-county-crosswalk
name: Census place → county crosswalk (Atlas PostGIS)
url: https://www.census.gov/geographies/mapping-files.html
type: dataset
authority_level: official
requires_api_key: false
refresh_frequency: on-demand
feeds: [Person]
raw: [place_county_crosswalk.jsonl]
notes: >
Atlas PostGIS spatial join of Census TIGER 2024 places against county
geometries — 32,041 places, one primary county each. Resolves municipal
officeholders to their county. Join key is county_geoid (5-digit FIPS);
the sibling county_fips column is the 3-digit county code only.
# Prepared but not yet ingested — see docs/roadmap.md
planned:
- id: govinfo
name: GovInfo
url: https://www.govinfo.gov/
authority_level: official
- id: federal-register
name: Federal Register
url: https://www.federalregister.gov/
authority_level: official
- id: usaspending
name: USAspending.gov
url: https://www.usaspending.gov/
authority_level: official
- id: legistar
name: Legistar / Granicus / CivicPlus (local agenda portals)
url: https://webapi.legistar.com/
authority_level: official
- id: census-tiger
name: Census TIGER/Line (geometry)
url: https://www.census.gov/geographies/mapping-files.html
authority_level: official