How to carry out an A/B test

A four step process on carrying out A/B tests.

Oscar de la Hera Gomez
Written by Oscar de la Hera Gomez
First published on 01/15/2024 at 16:56
Last Updated on 01/24/2024 at 12:48
<p>A flower that represents Strategy with the text “A/B Testing” beneath it.</p>

A four step process on carrying out A/B tests.

SubscribeWhat is A/B Testing?

Step One: Create two things to test

A/B testing is about determining which of two different directions or options is better.

For examples of A/B tests, consult this link.

We recommend that you write a hypothesis and define a target audience as part of the process of creating your A/B test.

How to write a HypothesisHow to define a Target Audience

Step Two: Find the participants

Find the individuals that you are going to test your creation on.

The number of participants can range from 10 individual to 5000+.

Step Three: Carry out the A/B test

Invite the participants to your test site or invite them to a video conference with screen sharing.

For half of them place the "A" version of the product and for the other half, place the "B" version of the product, service, experience or feature and observe their behavior.

It is important that you do not help, assist or interrupt them as these tests are meant to tell you what works and what does not.

Additionally, you may want to use this opportunity to test the usability of the two products, services, experiences or features.

How to carry out usability testing

Step Four: Evaluate the Results

Carry out qualitative and statistical analysis on the results, draw conclusions and evaluate the outcome.

To learn more about statistical analysis consult this link.

Additionally, we recommend that you consult our Methods for Synthesizing User Research article linked below to learn about design thinking products that could come out of the research that you have conducted.

These products are created using popular design research methodologies which are intended to help you and your organization innovate effectively.

What is Synthesis in Research?

Always remember, the work is never done

A visual that demonstrates a circular iterative process that goes from define, which is symbolized as a document, to clarify, which is symbolized as a geometric alignment, through creation which is symbolized as a nucleus.

delasign's process

When carrying out A/B tests, it is important to note that they are neither a start nor an end.

They should serve as a means to learn more about what works and what does not.

They are also capable of demonstrating that you should not pursue a feature or a product, service or experience - and that's OK.

Learn more about our process

Looking to learn more about Research and Strategy?

Search our blog to find educational content on research and strategy.

Search our Blog

Any Questions?

We are actively looking for feedback on how to improve this resource. Please send us a note to inquiries@delasign.com with any thoughts or feedback you may have.
SubscribeContact UsVisit our BlogView our ServicesView our Work

Partner with us

We would love to get to know you and see how we can help your organization with its goals and needs.
Let's Talk

Stay Informed

Get occasional updates about our company, research, and product launches.
Subscribe