Marketo Tips
Marketo Tip #11 - Optimize your emailing engagement with AB test
14 views
View transcript
But basically, here we see that Marketo did an A/B test on three different emails or subjects. Hey everyone. Today we'll see how simple it is to create an A/B test in Marketo. I'm Sylvain Davril, founder of Merlin/Leonard, and certainly the Leonard's team, and this is a new Marketo Tip. The easiest way to create an A/B testing in Marketo is to create an emailing programme, the American mailbox here, and in the control panel here you have the possibility to add this A/B test. Let's do that. We arrive at a new screen where we can choose between four different A/B tests: the subject line, the whole email, the From address, and date and time. So let's try a subject line first. I have to choose one of the emails I have approved in my email programme. Let's take test 1 and here I can type as many subjects as I want. I can also type a third subject, it just depends on the sample size. So I have decided to test the three subjects. Here, Marketo will ask what's the size of the sample. So for instance, if I have 1,000 emails to send and I choose a 10% sample size, the test will run on 100 emails, so 33, 33, and 34. Marketo will test the three subjects on the 100 emails. How do they decide the winner? That's for me to decide between all those criteria. So whether it's the open rate, the click rate, the click-to-open rate, the engagement score, or a custom conversion, for instance, the fact that a visitor has filled out a form or viewed a video, or visited the page, whatever is gathered by Marketo. So, if I click here, I will open a new page where I will have to get a trigger dedicated to the winner criteria. I choose here whether I want to declare the winner automatically or manually. And here I will get an alert and I will have to come back to the programme to declare the winner. Let's choose Automatic. And in the next step, I choose when I want to run the test. So here, by default, Marketo chooses two days, which is a good idea. It will shoot the first 100 sample emails tomorrow morning, on the 26th, at 09:42 am. It will wait for two days and after two days it will look at the criteria. So here, let's take the click to open and send automatically the 900 remaining emails for the winner. We can, for instance, choose the whole email type. And here I will have to prepare the complete emails I want to test. I just have two emails, and the rest is exactly the same. I just have to click on Add to add those emails to the test. And if we take the From address, basically it's the same. I can choose my email here and type the From email and add another one if I want to. For the date and time, it's a bit different because I will not be able to declare automatically who is the winner. I will have to choose manually the winner after the time I decide because the departure time of the different emails will be different. So here, it's up to me to decide when I want to stop the test. When the test is over, I will have in Marketo, in the dashboard part, a second dashboard dedicated to my A/B testing results that will look like this. Here I took a sample because I don't have so many emails in my database. But basically, here we see that Marketo did an AB test on three different emails or subjects or From, we don't know exactly. And we have different KPIs regarding the deliverability, the click, the click to open, and the summary here. So I think it chose the clicks as the winner. So the winner will be the C because the C has the most clicks. That's a pretty simple and practical way to create an A/B testing in Marketo. Obviously, you need 48 hours to do the test, so if you're in a rush that's not very useful. You have to plan ahead. But I hope this will be useful to you. Bye-bye, talk to you soon!