{"id":1259,"slug":"caveats-customer-facing-calculators-vendor-marketing-base","title":"Caveats for the customer-facing-calculators brief: every conversion-lift figure is unproven; nearly all are vendor-self-reported","kind":"reference","scope":"business","status":"current","audiences":["kevin","smb-owner","candid-team"],"topics":["editorial-discipline","citation-practices","customer-facing-tools"],"reference_body":"**The honest summary of source quality across this brief:**\n\n- **No independent, peer-reviewed, vendor-neutral benchmark** proving website calculators/configurators convert better than static pages appears to exist.\n- The closest legitimate academic work — Häubl & Trifts 2000 ([[haubl-trifts-2000-marketing-science]]) — measures decision *quality*, not real-world website conversion.\n- The famous \"2× engagement\" figure ([[demand-metric-2014-interactive-content-survey]]) is a 2014 marketer-opinion survey sponsored by an interactive-content vendor.\n- The 47.3% vs 2.8% figure ([[outgrow-47-3pct-conversion-vendor]]) is the vendor's analysis of its own platform's forms.\n- The form-friction percentages ([[form-friction-conversion-claim]]) are a single-source practitioner A/B claim.\n- The contractor 20-40% close-rate claim is single-source / vendor.\n- The HubSpot 88% bad-experience figure ([[hubspot-88pct-bad-experience-stat]]) is a single vendor stat that has been laundered through maintenance-vendor blogs.\n- The McKinsey 83% transparency stat ([[mckinsey-83pct-b2b-transparency-untraceable]]) is **not traceable to McKinsey at all**.\n- The Label Insight 94% stat ([[label-insight-94pct-transparency-loyalty]]) is real but narrower than usually rendered (food-category).\n- The Busso-Galiani \"race to the bottom\" framing in Kinsta's blog ([[busso-galiani-2014-competition-improves-quality]]) reverses the study's actual finding.\n\n**Practical posture for Candid:** treat every conversion-lift figure in this space as **unproven**. The case for or against a calculator should be made from the *mechanisms* (anchoring, qualification, upkeep cost, legal exposure) — not from borrowed stats. See [[rule-disregard-vendor-conversion-stats-for-interactive-content]].","rationale_body":null,"metadata":null,"links":{"outgoing":[{"slug":"form-friction-conversion-claim","title":"Practitioner claim: single-field forms ~30-40% conversion, seven-field forms ~5-15% — A/B observation, not controlled study","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"outgrow-47-3pct-conversion-vendor","title":"Outgrow's \"interactive forms 47.3% vs static 2.8%, a 16.9× improvement\" is the vendor's analysis of its own customers' 50,000+ forms — not an independent benchmark","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"demand-metric-2014-interactive-content-survey","title":"Demand Metric 2014 Content & the Buyer's Journey Benchmark Study — vendor-sponsored online opinion survey of 185 marketers; the \"2× engagement\" headline rounds 70%/36%","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"cmi-2x-interactive-content-misattribution","title":"The \"2× engagement / conversion\" interactive-content stat is widely (mis)attributed to \"Content Marketing Institute\" — no original CMI dataset producing it exists","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"haubl-trifts-2000-marketing-science","title":"Häubl & Trifts 2000 (Marketing Science 19(1):4-21) — controlled lab experiment showing interactive decision aids improve decision quality and reduce search effort","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"hubspot-88pct-bad-experience-stat","title":"\"88% of online consumers are less likely to return after a bad experience\" — originates with HubSpot, often laundered through web-maintenance vendors","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"busso-galiani-2014-competition-improves-quality","title":"Correction: Busso & Galiani NBER WP 20054 (2014) actually found competition *improved* service quality — the popular \"race to the bottom\" blog reading reverses the finding","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"mckinsey-83pct-b2b-transparency-untraceable","title":"The \"McKinsey: 83% of B2B customers value transparency over brand reputation\" stat is not verifiable to any primary McKinsey publication","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"label-insight-94pct-transparency-loyalty","title":"Label Insight 2016 Transparency ROI Study — 94% of consumers say they'd be loyal to a brand offering complete transparency (food-category specific, US, 2,000+ consumers)","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"source-incentive-meta-finding-calculators","title":"Source-incentive meta-finding: nearly every \"calculators convert\" source SELLS calculators; independent material clusters on the risks","kind":"reference","scope":"business","link_type":"relates-to"}],"incoming":[{"slug":"research-brief-customer-facing-calculators-smb-june-2026","title":"Research brief: customer-facing calculators & tools for SMBs — the honest case (June 2026)","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"rule-disregard-vendor-conversion-stats-for-interactive-content","title":"R5 — Disregard vendor-sourced \"interactive content converts better\" statistics in client conversations","kind":"rule","scope":"business","link_type":"depends-on"},{"slug":"caveats-data-driven-tools-vendor-self-reported-and-large-enterprise","title":"Caveats for the data-driven-tools brief: vendor self-reporting on conversion; enterprise-scale benchmarks; named-user quotes; macro projections","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"portal-market-size-7x-spread-vendor","title":"Portal \"market size\" projections range ~7× between sources (US$1.47B - $10.47B for the same period) — the spread itself is the finding","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"caveats-client-portals-vendor-marketing-base","title":"Caveats for the client-portals brief: source-incentives are pervasive; the independent anchors are McKinsey and Gartner; market-size figures unreliable; the viral 42% stat is misattributed","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"caveats-dashboards-vendor-marketing-base","title":"Caveats for the dashboards brief: pervasive BI/embedded-analytics vendor sourcing; the viral \"60-70%\" stat is folklore; SMB data thin; retention claims unproven","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"caveats-interactive-tool-mechanisms-vendor-outcome-stats","title":"Caveats for the interactive-tool-mechanisms brief: lead on mechanism evidence (peer-reviewed, independent); treat vendor outcome stats (52.6% / 88% / 47.3%) as marketing","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"caveats-engagement-mechanisms-top-up-mechanism-vs-business-outcome","title":"Caveats for the engagement-mechanisms top-up: strong independent evidence sits at the MECHANISM level not the business-outcome level; nearly every effect is moderated","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"caveats-information-asymmetry-decision-edge-vendor-recycled-and-modeled-projections","title":"Caveats: information-asymmetry decision-edge brief (June 2026) — vendor-recycled magnitudes + modeled projections","kind":"reference","scope":"business","link_type":"relates-to"}]},"created_at":"2026-06-20T16:50:09.672Z","updated_at":"2026-06-20T16:50:09.672Z"}