Simulated decision case · 07 / 07

When Retention, Not Ad Tuning, Is the Real LTV Lever

This simulated case examines a mobile-games portfolio that keeps tuning advertising while player lifetime value remains flat. Intake can reveal sharp early churn, inconsistent experiment results and several AI ideas competing for attention. Those signals do not prove that retention is the binding constraint. Stage 2 would test the hypothesis using level funnels, churn patterns, consent-aware measurement, stability data and controlled simulations. The directional decision is FIX measurement first, SCALE the proven retention playbook, and conditionally START AI-assisted sequencing on one title. Generative content remains at proof of concept until format and quality controls are demonstrated.

What does this case show? The highest-value AI opportunity may sit in early retention and content sequencing rather than in another round of ad tuning.

01 · Organisation and value

Business context and management question

Organisation and value proposition

A mid-sized free-to-play mobile game developer operating a portfolio of casual puzzle titles. Revenue is mainly advertising-based, with an underdeveloped in-app purchase component. Organic growth has slowed, making lifetime value the constraint on profitable acquisition.

Management question

How should the studio increase lifetime value across the portfolio, and which AI initiative should receive the next investment?

Relevant value-chain context

The studio sits between content creation upstream and ad demand plus platform distribution downstream. The levers most under its control are content sequencing, first-party measurement and portfolio-level player flow.

02 · Approaching the real problem

From symptom to a testable problem hypothesis

Early signals visible through intake

The following items may be reported during the initial intake or interviews. They are not treated as measured performance values.

  • A large share of new players leave within the first week.
  • Drop-off clusters around a small number of early levels.
  • Ad-rate and consent data are incomplete or inconsistent.
  • Some titles sit close to platform stability thresholds.
  • An external optimisation test cannot be reconciled fully.
  • Multiple AI initiatives compete for investment without a common decision framework.

Priority problem hypothesis

Initial intake, interviews and limited document signals may make the following hypothesis a priority. It is not presented as a confirmed root cause until it is tested against operational evidence.

The working hypothesis is that early retention and fragmented measurement may be the binding constraints on lifetime value, while monetisation tuning is the visible symptom. Difficulty walls may push players out before they build attachment, and weak event and consent data may prevent the studio from verifying any intervention. The priority may therefore be to make measurement trustworthy, industrialise level rebalancing and only then test AI-assisted sequencing.

Customer and internal value to be validated

The following are value hypotheses, not achieved or validated outcomes.

Customer value: Players receive a smoother early experience with fewer artificial frustration spikes. Ad load and content difficulty can be managed around long-term experience rather than short-term extraction.

Internal value: Every point of retained audience compounds into more content exposure, more ad opportunities, more purchase eligibility and a larger profitable acquisition envelope.

03 · AI alignment

From the first AI reflex to a value-aligned design

01 · First reflex

Proposed technology

Treat ad-frequency optimisation, AI level sequencing and generative level creation as one broad innovation programme.

02 · Alignment gap

Why should it be reconsidered?

  • The initiatives solve different problems and have different evidence requirements.
  • Consent and event pipelines are not reliable enough to attribute outcomes.
  • Retention may have more leverage than ad-side optimisation.
  • Generative content quality and format compatibility are unproven.
  • Platform stability risk can erase gains from any LTV initiative.
03 · Priority direction

Retention-First AI Portfolio

The AI role, human decision boundary, data readiness and measurement logic are designed together. No scale decision is made without pilot evidence.

Public boundary: This page shows the decision logic. It does not publish MoreSight’s detailed question architecture, scoring rules or project analysis templates.
04 · Opportunity map

AI options derived from the real problem

This table is not an investment decision or a definitive ranking. Priority and evidence readiness are reassessed during Stage 2.

Opportunity hypothesisAI roleValue connectionEvidence readinessDirectional priority
AI-assisted difficulty sequencingPredict + Recommend + SimulateImprove early retention and lifetime valueLevel funnel, cohort and experiment data requiredHigh; conditional pilot
Early churn-risk detectionPredict + ExplainTarget onboarding and difficulty interventionsReliable player-event data requiredHigh; analytical foundation
Portfolio cross-promotion optimisationRecommendImprove player flow across titlesIdentity and consent constraints must be addressedMedium-high; after measurement fix
Generative level creationGenerateIncrease content supplyFormat and quality control unprovenHold at proof of concept
AI ad-frequency capsPredict + RecommendPotential ad-yield improvementRequires clean controlled experimentRe-test separately

Priority initiative to test if evidence supports it

The design below is not a solution commitment. It is a pilot hypothesis to be validated.

Retention-First AI Portfolio

  • Business decision: Can AI-assisted level sequencing improve early retention on one title without harming player experience or technical stability?
  • Primary users: Product, level design, analytics, engineering and portfolio management.
  • Inputs: Level-by-level funnels, churn cohorts, session and progression data, content attributes, consent state, stability and experiment history.
  • AI functions: Identify difficulty walls, predict churn risk, simulate alternative sequences and recommend a bounded reordering test.
  • Outputs: Ranked intervention opportunities, proposed level sequence, expected risk, holdout design and explicit kill criteria.
  • Human decision boundary: Designers approve all content and sequence changes. The AI does not publish or alter live levels autonomously.
  • Measurement logic: Track day-7 retention, survival to a defined level, lifetime-value index, stability and experiment integrity together.
05 · Evidence and claim boundary

What can intake show, and which claims require data?

Areas the intake can direct

  • Reports of early churn and flat lifetime value.
  • Signals of sharp drop-off at specific content points.
  • A hypothesis that ad monetisation may be a symptom rather than the binding constraint.
  • An early indication that multiple AI initiatives lack common prioritisation criteria.

Evidence required for Stage 2

  • Level-by-level funnel, retention and churn data.
  • Consent-state coverage and event-schema documentation.
  • Stability, crash and platform-quality dashboards.
  • Ad-test design, vendor output and change history.
  • Content attributes, level order and rebalancing history.
  • Portfolio cross-promotion and monetisation records.

Analyses possible when evidence is available

  • Identify concentration of early churn by level and cohort.
  • Simulate alternative sequencing and estimate potential retention sensitivity.
  • Audit consent completeness and event consistency across titles.
  • Compare ad-side and retention-side opportunities on a common lifetime-value basis.
  • Evaluate a controlled level-resequencing test against a clean holdout.

Claims we will not make without evidence

  • That retention is definitively the binding constraint before the funnel is analysed.
  • That a specific level change will improve lifetime value by a stated amount.
  • That an AI sequencing model should scale across the portfolio from one test.
  • That generative content is production-ready without format and quality evidence.

Readiness gaps and risks

The following are readiness hypotheses that require document and process review.

  • Event schemas differ across titles.
  • Consent state is unresolved for part of the traffic.
  • No single owner governs experimentation standards.
  • Analytics capacity is concentrated in a small number of people.
  • Stability work competes with optimisation for engineering capacity.

Decision language by evidence level

  • Stage 1: Provisional FIX / prioritise. Separate the AI bets and repair measurement before scaling any of them.
  • Stage 2: If funnel analysis supports the retention hypothesis, issue an evidence-supported SCALE for the rebalancing playbook and a conditional START for AI sequencing.
  • After the pilot: Scale only if retention and lifetime-value indicators improve without stability or experience guardrail breaches.
06 · Validation plan

Move to the next defensible decision in 90 days

This plan is adapted to data access and client scope. Stage 1 alone does not include implementation or outcome validation.

PeriodPurposeMain actions
Days 1–30Measurement and stability foundationAssign the experiment owner, audit consent and event coverage, define the test standard and stabilise titles near platform thresholds.
Days 31–60First validated retention interventionRun a pre-registered early-level resequencing test on one flagship title and re-test the ad initiative under the same standard.
Days 61–90Playbook and AI pilotCodify the rebalancing playbook, apply it to a second title and launch a bounded AI-assisted sequencing pilot with explicit kill criteria.

Recommended validation measures

  • Day-7 retention for new cohorts.
  • Cumulative survival to the selected progression point.
  • Lifetime-value index per new install.
  • Consent-resolved sessions and event completeness.
  • Stability incidents above platform thresholds.
  • Share of experiments using a pre-registered design.
07 · Decision gate

When should management Scale, Iterate or Stop?

Scale

The bounded sequencing test improves retention and lifetime-value indicators while stability and experience guardrails hold.

Iterate

The model finds the right problem areas, but the recommended sequence or experiment design needs refinement.

Stop

Measurement remains unreliable, stability risk is unresolved or the pilot does not beat the manual rebalancing baseline.

Decisions management must make

  1. Will the company fund measurement and stability before additional AI features?
  2. Which title and level range should be used for the first bounded pilot?
  3. What day-90 result earns the right to expand to a second title?
  4. How much design capacity will be reserved for rebalancing versus new content?

Transferable lesson: The best AI investment is not necessarily the most visible feature. It is the intervention tied most directly to the constraint that governs lifetime value.

Disclosure: This is a simulated composite case. Organisation characteristics, circumstances, data and outcomes have been altered, combined or synthetically generated. It does not represent a specific organisation or client engagement. Numerical examples are not achieved client results.
Your initiative

Which decision does your AI project deserve?

Assess the available evidence, business value and implementation conditions together.

Start a Business Value Review