K
K
kudz02015-08-24 16:46:59
Software testing
kudz0, 2015-08-24 16:46:59

Are the results significant?

Colleagues, please help me understand the results of A / B testing of the site
Statistical significance 95%
Option A:
Sample of 15314 people.
Conversion 1.91% (293 people)
Confidence interval 1.70 - 2.13
Option B:
Sample 16191 people
Conversion 2.33% (378 people)
Confidence interval 2.10 - 2.57
P-value 0.004%
Z- score 2.59% The
question is:
Confidence intervals overlap by 0.03%
Are the results significant? Can we say that option B won?

Answer the question

In order to leave comments, you need to log in

2 answer(s)
P
Puma Thailand, 2015-08-24
@opium

It seems that you are solving a problem book and do not understand at all what these values ​​mean.
Here is a simple example of how to get a reliable result
liraltd.com/raschet-dlinyi-vyiborki-dlya-testirovaniya

D
Denis Ineshin, 2015-08-24
@IonDen

IMHO: drpete.co/split-test-calculator and that's it.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question