Categories / Inspiration

The Best Tools For A/B Testing Your Designs

Creative Market Last updated: March 28, 2024 · 4 min read

It’s 3 a.m. You’re staring at the glowing monitor across the desk. You can’t stop clicking back and forth between #3cff00 and #336666, which is better for the font color on your website’s splash page? The choice of button style on your store section has been haunting you in your sleep. How do you know what will work better with your visitors?

Well, there’s no need to worry.

Getting statistics on the changes to your website is easy through a process called A/B testing. To explain it in simple terms, your website’s URL will actually lead to two different web pages. Some users will arrive at your usual site; others will see your website with a few changes–something as small as a different font or as large as an entirely new layout. Statistics are then gathered to show which site has more favorable interactions with your guests. This way you can make an informed decision about what to change. Whichever page gets more clicks on the offer is more favorable to the visitor and will lead to a better customer experience.

Unless you have a lot of spare time and an advanced knowledge of coding, it’s going to be hard to set up A/B tests yourself. Here are some great websites that will help get your test off the ground.

Optimizely

optimizely2

This website is a tried and true A/B testing tool. Optimizely has an amazing team of designers, technicians, engineers, and customer care staff who give the most extensive support in web testing. It does come at a bit of a steep price compared to others, but there are plans available for any level of website or designer.

Optimizely is an easy way to see testing in action. You can insert a link to any website in existence and play with its content to create a sample A and B model. It’s also compatible with iOS, so you can change it up on your mobile site as well.

Apptimize

apptimize

This service is a great A/B tester for iOS and Android apps. It was founded by a team leader from Google, and it’s been built to make the app market the best that it can be. The basic version is also completely free, allowing you to test your app designs on up to 25,000 users a month. If you’re in the market to make a new app or update one with a solid user base, Apptimize is a must-use tool.

Five Second Test

usabilityhub-fivesecondtest

Today, almost everything is crowdsourced. From Kickstarter to Urbandictionary, people are giving a voice to the masses, and they are loving it. Five Second Test allows you to post screenshots or mock-ups of your website, then turn it over to a test audience. Users get five seconds to look over your screen shot. They then answer the questions you want to know to get the valuable feedback you need to make your site better. Two advantages to this method are that you can work your way to getting your website tested for free by taking tests on other members’ content. The other advantage comes from the screenshot/mock-up. You aren’t showing off your actual site, just a model of it, so the testing won’t affect your traffic.

And last but not least…

The Scientific Method

science

That this is an old-school method (like Aristotle old school,) but it’s an important tool to remember when you’re testing. You don’t want to test your site at random. You need to have a specific goal in mind or a hypothesis that you want to test. You should also focus on keeping your variables simple and isolated. If you change multiple things at once, you don’t really know what your results are coming from. No matter what service you use, you have to make sure your test is scientific.

How Do You A/B Test?

I’d love to hear your thoughts on A/B testing. Have you done much for your own projects? What tools and resources did you find to be helpful?
Header image created with Kansas Casual and Process Of Fixing Bugs

Lettering Worksheets
Getting started with hand lettering?
Free lettering worksheets

Download these worksheets and start practicing with simple instructions and tracing exercises.

Download now!
About the Author
Author
Creative Market

Making beautiful design simple & accessible to all.

View More Posts
Go to My Shop
Related Articles
9 Comments
  • One of my prior jobs I was in charge of the entire digital department. We did A/B and Multivariate testing on a regular basis for automotive dealerships. It strikes me odd that Google Content Experiments didn't make the list here, as it's probably the best method to use if you are a startup, as it is free and integrates seamlessly with Google Analytics. Only advice I can give every here is before you venture off into doing split testing, you need to know exactly what your end goal is. Are you looking to optimize conversions? Are you looking to increase engagement? Depending on your end goal, you need to make sure that your tests are setup to accommodate goals. If you are simply doing split testing without knowing exactly what you are optimizing for, you could be creating a worst user experience and will be making decisions with bad data / poor results. I also suggest not looking at results for 2 weeks. Let the experiments run without having anyone look at the results, this way you are able to compile results before removing pages from the experiments. Lastly, Five Second Test is just not ideal for getting true results because there is a rewards system in place for users who are not on a paid plan. So they just sit there and do their daily's just to get their points. Plus, you are getting results from a non targeted audience, in result, you will be working with data that is not true in nature to your business model. Hope this helps and great article, I love this stuff! 12 years ago
  • I love the intro to this article! Been there : ) I spent a year of my life doing a LOT of A/B testing. I'm not an expert. But I've seen the increases in revenue. Plus, it's pretty fun to do A/B tests : ) My team used Visual Website Optimizer. What I loved about it was that it was dead simple to use. Literally just click on anything your your site and create variations. The biggest thing I took away from doing A/B testing was knowing what to test. Testing headlines and CTA buttons made the biggest difference for our business. Very useful article! 12 years ago
  • @Dustin Lee how many conversions did you guys test with? Sounds like you were actually doing multivariate testing since you were testing out headlines and buttons. 12 years ago
  • @Derek Stevenson You're right, it was multivariate testing. : ) 12 years ago
  • @Dustin Lee I figured that's what you guys were doing, of course the end result is basically the same. Anyways, I've done this for roughly around 8 years so if anyone has any questions, please feel free to message me, I'd be more than happy to help anyone out that is looking for a boost. 12 years ago
  • I really like your blog, You need to have a specific goal in mind or a hypothesis that you want to test. It is very useful article, thanks for sharing. http://www.trimurtyinfotech.com 12 years ago
  • A very well-written post mate, and nice list of testing tools! For people just getting their feet wet with testing, it's great to start with the simple tests like a call-to-action or headlines. There's an easy little tool called SplitButton that lets you test button text for free on your website. It's a cool way to get started in testing. https://www.splitbutton.com/ 12 years ago
  • In this list should be added Changeagain.me - the easiest tool for making A/B and split-testing. This service is using Google Experiments API, so it's fully integrated with your Google Analytics account and you shouldn't make any manual configuration. Due to this full integration all statistic data are gathered with maximum accuracy, so you will not be misled with the results of testing. Also you shouldn't use many different services every day, because all the information will be one place. Also Changeagain.me has easy-to-use visual editor and 'democratic' pricing model. You shouldn't pay for impressions of you test. You pay only for number of experiments and accounts. 12 years ago
  • Thanks for sharing article. I would recommend you should also try MockingFish A/B testing tool too. They provide 1 year free service. https://www.mockingfish.com/resources/ab-testing 10 years ago