Creative testing

Creative testing, end to end

Screen larger batches on install signal when useful, validate on purchases, then scale. Smaller batches can start with purchase testing. Part 1 is live, the rest follow.

Stage 1Read

Elimination

Install campaign, new
  • Close versions of the same concept compete here
  • Signal arrives within days: CPI and early behavior
  • Goal: nominate variants for purchase validation
the ads that pull away advance, usually 1 to 2
Stage 2Coming

Validation

Purchase campaign
  • Screened candidates or a small batch of new ads enter
  • Set a budget, evaluation window and purchase cost target
  • Judge evidence against the decision, not a universal event count
sufficient purchase evidence + cost below your target
Stage 3Coming

Scaling

Main campaign
  • Ads below the cost line move to the main campaign
  • Set the cost line separately for your campaign

Sources and operating assumptions are distinguished in the guide.