Typefully

The Truth About YouTube A/B Testing

Avatar

Share

 • 

2 years ago

 • 

View on X

I created the second most popular A/B thumbnail testing tool in the world Yesterday, YouTube announced their upcoming A/B testing feature So, I think it's time I told you all the truth about A/B testing
Myself, Tubebuddy, and every other tool like us have been misusing the word "A/B Testing" for years Until now, it didn't matter But now you need to know the difference, so you can understand the weight of this announcement
Tubebuddy changes your thumbnail every 12-24 hours ThumbnailTest changes your thumbnail every 1+ hours But YouTube's new feature is different It changes the thumbnail shown on EVERY IMPRESSION
So within the same 1 minute, if 99 people see your video... 33 will see Thumbnail A 33 will see Thumbnail B 33 will see Thumbnail C I also believe, based on some insider info, that if Thumbnail A begins to look better than B/C, that thumbnail A will slowly be shown more
This is true A/B Testing This is, 100%, without question, 100x better than every tool that exists For years we have been scraping partial data from youtube with chrome extensions fighting dozens of limitations to try to bring you all a fraction of this functionality
why? because youtube has been building A/B testing for years but they have always shut it down before full release (see these 3 year old videos) youtu.be/AqsIS3qzq5k?t=567
but again, insider info, the team working on A/B testing this time is a lot of new people, and they are valiantly pushing to get this out the door which is a really positive step for the community when I built ThumbnailTest, I had one goal:
Make a cheaper alternative to Tubebuddy's A/B testing, so that more people could benefit from it If I had more money, honestly I'd just make it free, but sadly I'm not rich So what happens to ThumbnailTest now? What happens to TubeBuddy?
We still have a full year before YouTube puts out their A/B testing globally So for 99.9% of creators, these tools will still be the best bet I will keep ThumbnailTest running for as long as I can, to continue helping the community be more powerful, until the last moment
But, in the meantime, I have a request Please, if you know any large creators, people making cool/big moves in this space... Reach out to me Connect me with them I want to build something amazing for this industry, and you've all seen what I can do now My DMs are open <3
Avatar

Rox

@RoxCodes

Built tools for @MrBeast, now I build software with creators Creator of ThumbnailTest.com (acquired) Currently: buildin a video-first podcast hosting platform