Sign in
9

Can you split test subject lines with only 600 subscribers?

I send a fortnightly email for my small bakery with about 600 people on the list. I tried two subject lines on 300 each and one got 31 percent opens and the other 27. Is that difference real or just noise?

localseojessu/localseojessLv 2· 1w

Different view, I wouldn't test at that size at all. Just write the subject line you would open yourself.

4
bounceratebenu/bounceratebenLv 3· 1w

600 is too few for a real split test, but the 31 percent one is still probably the better line, so just use it

2
organicollyu/organicollyLv 3· 1w

Test it across several sends rather than one. I did that over 6 emails and a shorter subject won 5 times, which told me more than any single test.

1
landingpagelouu/landingpagelouLv 4· 1w

4 points on 300 people is like 12 opens

1
cpcgrumbleu/cpcgrumbleLv 4· 1w

Huh, so it means almost nothing, I was about to rewrite everything

5
retargetritau/retargetritaLv 3· 1w

With groups that small, a four point gap is probably noise, you would need to repeat it a few times and see if the same style keeps winning 👍

1
edited
carakeywordu/carakeywordLv 1· 1w

Not enough people to say, a 4 point gap on 300 each could easily be luck, run it a few more sends

0