A/B Test

Design → run → verdict, all on one page — the math is code, the AI narrates

  1. Listen
  2. Brief
  3. Variants
  4. A/B Test
  5. Budget
Design
power calc in code · α .05 · power .8

Ứng dụng hay bị đơ khi thanh toán? Chúng tôi đã nghe và đã sửa.

Metric
install rate (installs/clicks)
Sample / arm
14,732
Duration
~6 days
Variants in test
1
Run
◌ Simulated demo data
Arm A · control
8.45%
1,245 / 14,732 converted
Arm B · variant · winner
9.56%
1,409 / 14,732 converted
Readout
p = <0.001
SHIP ✓

We tested the fix-forward app-update creative against the current baseline on Facebook. The variant lifted install rate from 8.45% to 9.56% — a 1.11pt absolute lift at p=0.0004, well past significance at the designed sample size. Ship it to the main campaign and keep the apology-free framing. (Simulated arms — disclosed demo data.)

Reallocate budget →All tests