A/B Testing Offers Great Value, Especially During Turbulent Times

Consider redoing all A/B tests. The Coronavirus pandemic has changed the needs of both companies and their customers. Therefore, companies must rethink their methods of marketing to customers. A/B testing is a valuable way for businesses to improve their customer reach. A/B testing occurs when a company changes one variable on an outlet of theirs, such as a page on their website, and compares the customer responses they receive with and without the variable change (1).

RightWave recently conducted internal A/B testing by sending out the same email campaign regarding the registration for an upcoming webinar at two different times, Friday afternoon and Monday morning, and compared the results. Both the number of recipients who opened the email and the number of recipients who registered for the webinar from this email were higher on Friday afternoon. These results were surprising, but due to the widespread change in the work environment due to the pandemic, it is probable that people may have more availability on Fridays now than they had before. The timing of emails is only one example of a variable that can benefit from A/B testing. Any variable that a company suspects may cause a difference in customer acquisition can be tested.

The methods of testing are highly important for ensuring that the results are optimal. Only one variable should be tested at a time so that only the effects of that variable are observed (1). The variable in question should be tested to see whether the existing form performs better than the next best form (1). Additionally, the two samples being tested should be assigned to two random groups of subjects of the same size (2). The length of time over which the A/B testing occurs depends on the reach of the product being tested, so the test should occur until a sufficiently large number of people are sampled (2). If the proper methods are not employed, then the results will not be completely reliable.

If previous testing was completed before the pandemic, then it may be time to conduct more testing. Implementing this method may cause companies to regain customers who they would have otherwise lost.

RightWave provides expertise and guidance to its customers for marketing strategies and tactics. For more information, contact RightWave.



  1. The Daily Egg, May 14, 2020, “How to do A/B Testing and Improve Your Conversions Quickly”, https://www.crazyegg.com/blog/ab-testing/
  2. Optimizely, “A/B Testing”, https://www.optimizely.com/optimization-glossary/ab-testing/ 

More articles

Bot Submissions: Solution Options & Recommendations

Hackers use bots to submit forms on a website for many reasons that include Distributed Denial of Service (DDoS) attacks, content spamming, Data Scraping, testing to identify vulnerable websites for future attacks, and conducting cyber attacks, all of which can cause nuisance and fill a database with junk records that may result in wasted time…

Project Portfolio Management as a Model for B2B Digital Marketing

Project Portfolio Management (PPM) applies to multiple projects running in parallel that share resources but are not part of a common program. An important part of PPM is prioritizing the projects that make up the portfolio. The criteria for prioritizing are alignment with business goals and expected ROI. This model can be applied to various…