{"id":1297,"slug":"caveats-data-driven-tools-vendor-self-reported-and-large-enterprise","title":"Caveats for the data-driven-tools brief: vendor self-reporting on conversion; enterprise-scale benchmarks; named-user quotes; macro projections","kind":"reference","scope":"business","status":"current","audiences":["kevin","smb-owner","candid-team"],"topics":["data-infrastructure","editorial-discipline","citation-practices"],"reference_body":"**The honest summary of source quality across this brief:**\n\n- **Vendor self-reporting** dominates the \"data = advantage\" side: pricing-intelligence vendors on Amazon repricing ([[amazon-25m-price-changes-daily-profitero]]), Snowflake on its own marketplace counts ([[snowflake-marketplace-data-as-a-service-listings]]), Fivetran on data-pipeline maintenance ([[fivetran-2026-benchmark-53pct-maintenance]]).\n- **Enterprise-scale benchmarks** (Fivetran 2026; Wakefield) are *directionally* relevant to SMBs but do not literally apply at SMB scale.\n- **Named-user quotes** ([[gallo-winery-openet-20pct-water-reduction]]) are the best-available source but remain single-source for the specific number.\n- **Macro projections** ([[odi-lateral-economics-open-data-gdp-0-5pct]], [[mckinsey-open-data-1-1-5pct-gdp-2030-projection]]) are context, not per-SMB evidence.\n- The **a16z piece** ([[a16z-empty-promise-data-moats-2019]]) is the cleanest *independent* voice — and notable precisely because the source incentive cuts against the position taken.\n- The **peer-reviewed Canadian retailer weather study** ([[weather-data-canadian-retailer-47pct-56pct]]) is the closest thing to academic causal evidence in the brief.\n\n**Practical posture for Candid:** treat every \"data converts\" / \"data wins\" figure as **vendor-self-reported** until proven otherwise. The defensibility case stands on a16z + the synthesis ([[data-as-asset-vs-byproduct-synthesis]]) — *not* on the conversion-lift stats.\n\n**Cross-brief:** This is the data-tools sibling of [[caveats-customer-facing-calculators-vendor-marketing-base]]. The two share the same skeptical posture and the same independent / vendor source-incentive asymmetry.","rationale_body":null,"metadata":null,"links":{"outgoing":[{"slug":"caveats-customer-facing-calculators-vendor-marketing-base","title":"Caveats for the customer-facing-calculators brief: every conversion-lift figure is unproven; nearly all are vendor-self-reported","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"weather-data-canadian-retailer-47pct-56pct","title":"Peer-reviewed Canadian retailer study — adding weather data explained up to +47% of variance for individual products, +56% for product categories","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"gallo-winery-openet-20pct-water-reduction","title":"E. & J. Gallo Winery — reported using OpenET ET data to \"reduce applied water by up to 20%\"","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"amazon-25m-price-changes-daily-profitero","title":"Amazon changes prices ~2.5 million times a day — roughly once every 10 minutes per product, ~50× more often than Walmart (Profitero)","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"snowflake-marketplace-data-as-a-service-listings","title":"Data-as-a-service marketplaces: Snowflake Marketplace 3,000-3,400+ listings; AWS Data Exchange — vendor self-reported","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"a16z-empty-promise-data-moats-2019","title":"Andreessen Horowitz, \"The Empty Promise of Data Moats\" (Casado & Lauten, 2019) — most \"data network effects\" are really scale effects that diminish","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"fivetran-2026-benchmark-53pct-maintenance","title":"Fivetran 2026 Enterprise Data Infrastructure Benchmark — data teams spend 53% of engineering time on maintenance; $2.2M/yr/team on pipeline upkeep at enterprise scale","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"odi-lateral-economics-open-data-gdp-0-5pct","title":"ODI / Lateral Economics — open data adds ~0.5% of GDP/yr more value than equivalent paid data (range 0.4-1.4% across studies)","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"mckinsey-open-data-1-1-5pct-gdp-2030-projection","title":"McKinsey — broad open-data ecosystems could add ~1-1.5% of GDP by 2030 in EU/UK/US (4-5% in India); forward-looking projection","kind":"reference","scope":"business","link_type":"relates-to"}],"incoming":[{"slug":"research-brief-data-driven-tools-smb-june-2026","title":"Research brief: live data and data-driven tools for SMBs — when it's an edge, when it's overkill (June 2026)","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"caveats-client-portals-vendor-marketing-base","title":"Caveats for the client-portals brief: source-incentives are pervasive; the independent anchors are McKinsey and Gartner; market-size figures unreliable; the viral 42% stat is misattributed","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"caveats-dashboards-vendor-marketing-base","title":"Caveats for the dashboards brief: pervasive BI/embedded-analytics vendor sourcing; the viral \"60-70%\" stat is folklore; SMB data thin; retention claims unproven","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"caveats-interactive-tool-mechanisms-vendor-outcome-stats","title":"Caveats for the interactive-tool-mechanisms brief: lead on mechanism evidence (peer-reviewed, independent); treat vendor outcome stats (52.6% / 88% / 47.3%) as marketing","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"caveats-information-asymmetry-decision-edge-vendor-recycled-and-modeled-projections","title":"Caveats: information-asymmetry decision-edge brief (June 2026) — vendor-recycled magnitudes + modeled projections","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"caveats-mls-data-inside-the-box-untested-clauses-and-self-reported-metrics","title":"Caveats: MLS-data inside-the-box brief (June 2026) — untested clauses, self-reported metrics, contested copyright status","kind":"reference","scope":"business","link_type":"relates-to"}]},"created_at":"2026-06-20T16:57:38.974Z","updated_at":"2026-06-20T16:57:38.974Z"}