Net effect of the AI era on indexing timelines — discovery/crawling is NOT the bottleneck it once was, but the indexing QUALITY THRESHOLD and post-indexing DE-INDEXING risk have intensified

Claim: The 2024–2026 environment is not "Google crawls less because of AI" — Cloudflare's data shows the opposite (Cloudflare July 2025 ("From Googlebot to GPTBot") — Googlebot up 96% May 2024–May 2025; peaked April 2025 at 145% above May 2024; >25% of verified bot traffic; ~4.5% of all HTML requests in 2025). What changed is the quality bar to stay indexed.

• IndexCheckr observed a surge in unindexed pages in 2022–2023 (post-ChatGPT content flood), partial recovery in 2024–2025.
• Google's own statement at the March 2024 update: "45% less low-quality, unoriginal content in search results vs the 40% improvement we expected" (Google March 2024 core update — Google's own statement: "45% less low-quality, unoriginal content in search results vs the 40% improvement we expected").
• The May 2025 de-indexing purge dropped ~25% of monitored pages (Indexing Insight May 2025 de-indexing purge — ~25% of 2M monitored pages removed (highest-ever); sites lost 15–75%; broke the "130-day rule" of thumb).

Net effect on timelines: discovery/crawling is not the bottleneck it once was, but the indexing quality threshold and post-indexing de-indexing risk have intensified. Pre-2024 "most content indexed within a week" optimism should be revised downward at the tail — getting indexed fast is easier than staying indexed and ranking.

Source: Synthesis of Cloudflare 2025, IndexCheckr 2025, Google 2024 statement, Indexing Insight 2025.

Confidence: Industry-consensus on direction; specific numbers each carry their own single-source flags.

Caveat: This is the most important contextual update to any pre-2024 timing benchmark. When citing older studies, append "in a 2024–2026 environment that has gotten stricter at the indexing-quality and de-indexing layer."