Split Test Result – Timing Of Lightbox Webform
October 21st, 2009
·
by BobTheTeacher · Filed Under: Autoresponders · Business Building · List Building · Split Testing · Teleseminars
If you’re not split testing parts of your webpages, you may be growing your email list slower and earning less money than you could be.
I’d like to share a quick case study of a recent split test I did with a teleseminar.
The Test
For my 30 Day Autoresponder Challenge, I interviewed Justin Premick of Aweber, and invited people to listen in. Before I sent out the invitation to the 30 DAC participants, I created 3 different versions of a web form in Aweber.
All 3 forms were exactly the same except for one thing: how much time did it take for the form to show up?
I was using the “lightbox” form on my Instant Teleseminar page, and wanted to see if it made a difference how fast the form popped in.
The 3 versions were set to pop up after 7 seconds, 15 seconds, and 22 seconds, respectively.
Care to guess which one would be the best?
Results
Here’s the report from Aweber:
(note: the form it-pop was set for 15 seconds)
Initially, I thought the 7 second one would be the best, but it was actually the worst.
As you can see, the 15 second form was the winner in this test, and was actually a 22% improvement over the one I thought would win.
Conclusions
First, the number of displays is not high enough to say for sure that 15 seconds is the best choice of the 3. Ideally, I’d have at least 500 displays of each form. But since this was a private invitation sort of teleseminar, I didn’t have that much traffic to test with.
However, assuming those rates hold true over longer time, it tells me that 7 seconds is too much of an interruption from reading the page. My visitors who could take the initial 10 seconds to read the original headline of the page to know this teleseminar was for them could make a better decision about opting in for the replay.
Waiting too long (22 seconds), and they may have already been out the door, so to speak.
What I take away from this test is I’ll use 15 seconds as my starting point, and expect that I’ll get more people to register for my teleseminars in the future!
Bob Jenkins
p.s. Want to learn how to get more subscribers and make more sales by split testing? Check out Discover Split Testing to learn how to do it!
5 Responses to “Split Test Result – Timing Of Lightbox Webform”
Leave a Reply
| Bob Jenkins is an internet business marketing teacher, with ten years experience teaching teenagers and teachers. He is the creator of several online training courses that teach you how to get better customers and increase your profits. Specializing in social networking strategies for business and creating information products from teleseminars, Bob can help you use internet marketing tools and strategies to promote your business online. |
|
|
Thanks for the great tip Bob, I will give the 15 seconds a go. Seeing that I am currently setting my auto responder up and doing your thirty day challenge.
Cheerr Adam Bean
From random polling, nearly everyone I talk to always say they “hate those popups” because they haven’t even had a chance to decide if they like the content enough to opt-in and they find them annoying and intrusive. Yet, all the Internet markers I talk to say they work great and get them lots of subscribers. Why do you think this is? If people hate them why do they opt-in so often?
Thanks,
Michelle Schoen
Michelle – with this particular test, I’m offering a reminder of the call and the replay, which is 100% directly related to the info on the page. Most popups you see are not as congruent, so I usually don’t use them. I use it on the homepage of my blog, but not on the individual posts.
The question is also how often do you see them. I think having the pop up every time the page is loaded is a nuisance. Once per visit/per day is what I usually go with, or every few days. I’d love for Aweber to eventually turn them off if someone already subscribed to that form.
Anyway, the key is people hate them if they serve no real purpose other than to the benefit of the list owner.
Bob
Thanks Bob. This really helps clarify a key issue for many of us, and makes sense as you outline. Like catching walleyes, you need to let them take some line for a while, but then you want to set the hook before they spit it out.
Bob, I was really excited to see your results-I love this stuff. Why? Because results leave no room for opinions. It either worked or it didn’t. Great stuff!
The testing of offers is one thing that has driven me mad. It seems that it is quite easy to create winning offers for others while my own offers are hit and miss.
This humbles me of course-I’ve tried graphics, no graphics, split testing headline colors, etc. I’ll let you know what works.
P.S- I told my list about your blog this AM. I know they’ll flip for it.