{"id":1293,"slug":"schema-drift-31pct-maintenance-fivetran-2026","title":"Schema drift is the single largest data-pipeline maintenance category — ~31% of maintenance time per Fivetran 2026 benchmark","kind":"reference","scope":"business","status":"current","audiences":["kevin","smb-owner","candid-team"],"topics":["data-infrastructure","data-pipeline-maintenance"],"reference_body":"**Claim:** Pipelines break on upstream schema changes — **schema drift is the single largest maintenance category, ~31% of maintenance time** per Fivetran 2026. (Government feeds also have publication lags — Census ACS lags; BTOS is biweekly; the Bank of Canada notes brief processing delays in Valet.)\n\n**Source:** Fivetran 2026 benchmark (above); estuary.dev; rudderstack.com (vendor framing, consistent across sources).\n\n**Confidence:** Industry-consensus (vendor sources align).\n\n**Why this matters for Candid:** Concrete mechanism behind [[fivetran-2026-benchmark-53pct-maintenance]] — when upstream changes a column type, every dependent pipeline breaks. The SMB-relevant counter-pattern is \"use stable APIs (FRED, Valet, GTFS, BoC) and don't over-engineer.\"","rationale_body":null,"metadata":null,"links":{"outgoing":[{"slug":"fivetran-2026-benchmark-53pct-maintenance","title":"Fivetran 2026 Enterprise Data Infrastructure Benchmark — data teams spend 53% of engineering time on maintenance; $2.2M/yr/team on pipeline upkeep at enterprise scale","kind":"reference","scope":"business","link_type":"depends-on"}],"incoming":[{"slug":"research-brief-data-driven-tools-smb-june-2026","title":"Research brief: live data and data-driven tools for SMBs — when it's an edge, when it's overkill (June 2026)","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"rule-budget-for-pipeline-maintenance-from-day-one","title":"R5 — Budget for pipeline maintenance from day one; if the client can't commit to upkeep, rent the managed version instead of building one","kind":"rule","scope":"business","link_type":"depends-on"},{"slug":"dashboard-rot-schema-drift-maintenance","title":"Dashboard rot: data sources change schemas, metric definitions drift across departments, organizational attention wanes; custom/embedded builds carry the heaviest ~20-30%/yr maintenance burden","kind":"reference","scope":"business","link_type":"relates-to"}]},"created_at":"2026-06-20T16:57:38.961Z","updated_at":"2026-06-20T16:57:38.961Z"}