{"id":1447,"slug":"caveats-engagement-mechanisms-top-up-mechanism-vs-business-outcome","title":"Caveats for the engagement-mechanisms top-up: strong independent evidence sits at the MECHANISM level not the business-outcome level; nearly every effect is moderated","kind":"reference","scope":"business","status":"current","audiences":["kevin","smb-owner","candid-team"],"topics":["editorial-discipline","citation-practices","interactive-tool-mechanisms"],"reference_body":"**The honest summary of source quality across this brief:**\n\n- **Where the strong independent evidence sits:** at the **MECHANISM level** — cognition, memory, motivation, communication/HCI lab and field studies. Curiosity ([[kang-2009-wick-candle-curiosity-caudate-fmri]], [[gruber-gelman-ranganath-2014-curiosity-hippocampus-dopamine]]); generation effect (d ≈ 0.40 — [[bertsch-2007-generation-effect-meta-d-0-40]]); active learning (+0.47 SD — [[freeman-2014-pnas-active-learning-meta-225-studies]]); choice → intrinsic motivation ([[patall-cooper-robinson-2008-choice-intrinsic-motivation-meta]]); agency in customization ([[sundar-marathe-2010-personalization-vs-customization-agency]]); modality-interactivity absorption ([[oh-sundar-2015-modality-interactivity-cognitive-absorption-167-factorial]]); motivating-uncertainty ([[shen-fishbach-hsee-2015-motivating-uncertainty-effect-jcr]]).\n- **Independent evidence for specific *business outcomes* of interactive tools** (conversion lifts, time-on-tool) **is weak and largely vendor-sourced** — do **not** lean on it. The vendor stats ([[mediafly-52pct-engagement-vendor-stat]], [[outgrow-47-3pct-conversion-vendor]], [[demand-metric-2014-interactive-content-survey]]) remain as un-defended as the calculator brief found them.\n- **Convergence:** Mechanisms 1-5 reinforce each other. This convergence, drawn from **multiple independent literatures**, is the robust core.\n- **Recurring limit:** nearly every effect is moderated — **inverted-U for curiosity** ([[curiosity-inverted-u-moderate-knowledge-finding]]); unstable challenge-skill for flow ([[lovoll-vittersoe-2014-challenge-skill-balance-shaky]]); choice-overload and cultural caveats for SDT ([[patall-cooper-robinson-2008-choice-intrinsic-motivation-meta]], [[sdt-cultural-universality-critique-hagger-2013]]); material-complexity ceiling for generation ([[text-generation-eg-2023-no-effect-beyond-900-words]], [[2025-replication-generation-effect-doesnt-transfer-to-expository]]); too-much-interactivity cost ([[oh-sundar-interactivity-reduces-message-thoughts-too-much-cost]]); strong conditionality for variable reward ([[shen-fishbach-hsee-2015-motivating-uncertainty-effect-jcr]]).\n- **None is an unconditional \"more = better\" lever.**\n- **Settled items NOT re-derived:** Kivetz 2006 goal-gradient ([[kivetz-2006-goal-gradient-coffee-stamps]]); Ainslie 1975 present bias ([[ainslie-1975-present-bias-temporal-discounting]]); discredited vendor stats ([[mediafly-52pct-engagement-vendor-stat]], [[demand-metric-2014-interactive-content-survey]]).\n\n**Capture-layer status:** these are sourced research notes only — Deliverable 1 only. The brief author explicitly declined to produce a Deliverable 2 (KB entry), Deliverable 3 (article), or Deliverable 4 (slug) for this top-up.\n\n**Cross-brief:** sibling of [[caveats-interactive-tool-mechanisms-vendor-outcome-stats]] (Brief E), [[caveats-customer-facing-calculators-vendor-marketing-base]] (Brief A), [[caveats-data-driven-tools-vendor-self-reported-and-large-enterprise]], [[caveats-client-portals-vendor-marketing-base]], [[caveats-dashboards-vendor-marketing-base]].","rationale_body":null,"metadata":null,"links":{"outgoing":[{"slug":"outgrow-47-3pct-conversion-vendor","title":"Outgrow's \"interactive forms 47.3% vs static 2.8%, a 16.9× improvement\" is the vendor's analysis of its own customers' 50,000+ forms — not an independent benchmark","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"demand-metric-2014-interactive-content-survey","title":"Demand Metric 2014 Content & the Buyer's Journey Benchmark Study — vendor-sponsored online opinion survey of 185 marketers; the \"2× engagement\" headline rounds 70%/36%","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"caveats-customer-facing-calculators-vendor-marketing-base","title":"Caveats for the customer-facing-calculators brief: every conversion-lift figure is unproven; nearly all are vendor-self-reported","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"mediafly-52pct-engagement-vendor-stat","title":"Mediafly / Demand Metric: \"Interactive content shows 52.6% higher engagement than static; buyers spend 13 vs 8.5 minutes\" — vendor sources, treat as marketing not fact","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"caveats-interactive-tool-mechanisms-vendor-outcome-stats","title":"Caveats for the interactive-tool-mechanisms brief: lead on mechanism evidence (peer-reviewed, independent); treat vendor outcome stats (52.6% / 88% / 47.3%) as marketing","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"kang-2009-wick-candle-curiosity-caudate-fmri","title":"Kang, Camerer, Loewenstein et al. (2009), Psychological Science 20(8) — \"Wick in the Candle of Learning\": fMRI shows curiosity → caudate (reward) activity; better recall 1-2 weeks later; people spend tokens to satisfy curiosity","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"gruber-gelman-ranganath-2014-curiosity-hippocampus-dopamine","title":"Gruber, Gelman & Ranganath (2014), Neuron 84(2) — high-curiosity states enhanced midbrain (SN/VTA) + nucleus accumbens activity; improved memory for target AND incidental information","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"curiosity-inverted-u-moderate-knowledge-finding","title":"Curiosity follows an INVERTED-U over prior knowledge/confidence — peaks at MODERATE knowing, falls when one knows nearly nothing or nearly everything (Kang 2009, Dubey-Griffiths 2020, Lee 2024)","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"lovoll-vittersoe-2014-challenge-skill-balance-shaky","title":"Løvoll & Vittersø (2014), Social Indicators Research — neither flow indicator peaked at balance; supports an IMBALANCE model; Engeser-Rheinberg 2008 also found balance not always optimal","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"patall-cooper-robinson-2008-choice-intrinsic-motivation-meta","title":"Patall, Cooper & Robinson (2008), Psychological Bulletin (41 studies meta) — choice enhances intrinsic motivation, effort, performance, perceived competence; moderated (2-4 choices, no extrinsic reward, children > adults)","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"sdt-cultural-universality-critique-hagger-2013","title":"SDT cultural-universality critique (Hagger et al. 2013) — autonomy's primacy may reflect Western individualism; collectivist participants sometimes show higher intrinsic motivation under authority direction; SDT defenders reply autonomy ≠ independence","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"bertsch-2007-generation-effect-meta-d-0-40","title":"Bertsch, Pesta, Wiscott & McDaniel (2007), Memory & Cognition 35(2) — 86-study generation-effect meta: d ≈ 0.40 (\"almost half a standard deviation\"); LARGER at longer retention (d ≈ 0.64 for >1 day)","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"text-generation-eg-2023-no-effect-beyond-900-words","title":"Text-generation meta-analysis (Educational Psychology Review 2023) — Hedges g ≈ .41; LARGEST for 301-600 word texts; NO EFFECT beyond ~900 words","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"2025-replication-generation-effect-doesnt-transfer-to-expository","title":"CAVEAT — 2025 conceptual replication (Cognitive Research: Principles and Implications) — generation effect did NOT reliably transfer to learning from expository text; some experiments showed disadvantage","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"freeman-2014-pnas-active-learning-meta-225-studies","title":"Freeman et al. (2014), PNAS 111(23) — 225-study meta on active learning: exam performance +0.47 SD; odds of failing 1.95× higher under passive lecturing; robust to publication-bias checks","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"oh-sundar-2015-modality-interactivity-cognitive-absorption-167-factorial","title":"Oh & Sundar (2015), Journal of Communication 65(2) — N=167 factorial experiment: modality interactivity (slider) produced more positive interface assessment, greater cognitive absorption, more favourable attitudes","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"oh-sundar-interactivity-reduces-message-thoughts-too-much-cost","title":"COUNTER-finding: Oh & Sundar 2015 also showed modality interactivity REDUCED the number of message-related thoughts — absorption can come at the cost of deep elaboration; Sundar warns of \"too much interactivity\"","kind":"reference","scope":"business","link_type":"relates-to"},{"slug":"shen-fishbach-hsee-2015-motivating-uncertainty-effect-jcr","title":"Shen, Fishbach & Hsee (2015), JCR 41(5) — Motivating-Uncertainty Effect: people invest MORE effort for an uncertain reward (50% $2 / 50% $1) than for certain HIGHER-expected-value reward — but ONLY under PROCESS focus","kind":"reference","scope":"business","link_type":"relates-to"}],"incoming":[{"slug":"research-brief-engagement-mechanisms-top-up-smb-june-2026","title":"Research notes (capture-layer top-up): why interactive online tools are psychologically engaging — six additional mechanisms (June 2026)","kind":"research-notes","scope":"business","link_type":"relates-to"}]},"created_at":"2026-06-20T19:24:16.011Z","updated_at":"2026-06-20T19:24:16.011Z"}