# Why 90% of their paid traffic goes to a quiz, not the App Store

Channel: Sub Club by RevenueCat
Video: https://www.youtube.com/watch?v=EyoYQU6JyV8
Duration: 60 min
Language: English
Words: 10987
Transcript page: https://viewrankai.com/tools/youtube-transcript/EyoYQU6JyV8

---

[0:00] About 90% of our traffic is actually going to our website and we have a really long personalized quiz that we send all leads to on our website. And we've also tested the running traffic to the App Store versus the quiz and we've noticed that the quiz just has a much higher conversion. Hello, I'm your host David Barnard. My guest today is Ethan Etier, head of growth and operations at Built With Science, the science-based fitness company he runs with his brother, YouTuber Jeremy Ethier. On the podcast I talk with Ethan about the myth that influencer apps market themselves, scaling meta from zero to a hundred thousand dollars a month, and why they

[0:41] waited a full year before running a single ad. Hey Ethan, thanks so much for joining me on the podcast today. Hey David, great to be here. Big time fan of the podcast. Oh, thanks man. Um, so I'm excited to have you on. Big fan of the YouTube channel, big fan of the the app and everything y'all been doing at Built With Science. So, I'm personally super curious about the growth of the YouTube channel because you know, we are you know, working on YouTube stuff here at Sub Club, but I think our audience will be way more interested in the growth of the app. So, as a quick summary, Ethan's brother

[1:16] Jeremy started a fitness YouTube channel. Ethan joined the next year uh to kind of build the business and um now they've got over 7 million subscribers on YouTube, but I I wanted to kind of skip ahead from the early days to when you decided to actually build an app, why you decided to build an app, you know, how big the audience was at that time, and kind of you know, get more into the nuts and bolts of what our audience is going to be most interested

[1:43] in. We started the channel back in 2018 and throughout that process we eventually decided to launch these web-based courses which about a hundred thousand people joined over the course of the years. And this was just a program that they would take on the web and then they would be spreadsheets that they'd use to

[2:04] track their workouts and nutrition. And the reason we decided to eventually pivot that course into an app was because one, it was requested by our users a ton. They were tired of using spreadsheets on their phone just to track their workouts and then a separate tool to measure their nutrition. So, that was the first reason. And then secondly, and more importantly, we knew from our end that in order for us to create a more personalized product, we needed to pivot in that direction. So, ultimately it came down

[2:41] to those two things. I mean, it's so cool when when people beg you for a product. I mean, it is it's a nice position to be in. I mean, so many folks are are building apps just, you know, they're trying to create the audience for the app. It's like you already had the audience and they were begging for an app. So, that's such a great place to be. How how big was the audience at that point? Like how big was the channel? And you said 100,000 people had used the web product. That was at the time you decided to build the app or that was like lifetime. I'm just trying

[3:11] to kind of get a sense for like where where the you know, the business and the YouTube channel was at that point where you decided to to pivot to an app. Yeah, so at that point I think there was around a million or so subscribers. And it slowly grew over time. I think we're growing around a million or so subscribers per year. But at that point we had enough members and the demand was strong enough that they wouldn't stop bothering us when it came to building an app. So, yeah, we finally decided to make that as

[3:41] a key key goal for us. That's really cool. So, part of why I wanted to have you on is that I think there is a little bit of a of a kind of myth that, you know, if you're a big influencer, you've got, you know, 3 million subscribers, now 7 million subscribers, oh, growth is so easy. You just you just pitch pitch the app at the end of every YouTube video or work it into the to the video in the middle somewhere and you're just going to like get millions of downloads and make hundreds of millions of dollars and everything's gravy. But that's not been the case. You all are doing meta ads,

[4:14] you know, you are growing the app in a more traditional way than I think a lot of people would expect for a influencer built app. Uh, so I'd love for you to kind of talk through some of that with me. Like, you know, even even when you launch it with 3 million subscribers, was it like just a massive spike? That's a great point and when we did launch the app, we had hyped it up, obviously, to our members and also to

[4:39] just our email list and and publicly. So, we did see a spike when we officially launched it. That was about 2 years ago, but when it comes to actually marketing the app, like you mentioned, we've been slowly adding on new channels such as meta, such as SEO, AEO. But for us, the core piece of content has really just been on education and building trust. It's been less of something that we try and pitch all the time. It's more of, okay, we're creating this piece of content, how can we position the app so it complements the the piece of content that we're putting out. So, it's not necessarily we're

[5:18] thinking about, okay, we have this app, we want to create a piece of content that pitches the app. So, it's kind of a different framing and for us, that trust has been a key mode for us and I think with the age of AI, when you can build pretty much anything, that's going to be something we're definitely doubling down

[5:35] on. When you do pitch the app in a video and the video does really well cuz, you know, I mean, YouTube, it's like you can get even with 7 million subscribers, I haven't looked at Jeremy's channel recently. Though I though I have seen a lot of Jeremy's videos. I was telling you before we started recording, you know, I I saw Jeremy's videos way before the app, way before you and I met. Like

[5:55] I saw his videos years and years ago. But, I would imagine there's there's like when a video does go viral and like it's tens of millions of views versus like, you know, maybe a million views or whatever, do you see that in the numbers? Do you see a big spike in revenue? Is big spike in downloads? Or or maybe just like is it more people just kind of checking things out? Where you see a big spike in download, but your conversion actually dropped. Kind of curious what the mechanics of that

[6:18] are for a big YouTube channel. Yeah, that's a great question. And it's definitely what you mentioned. There is a big spike when we do release a video in terms of we'll see a bunch of new trials come in. But, what we notice is since we track pretty much every click coming from YouTube, both on the video and also in our description link, you can actually tell what types of videos lead to a higher trial conversion. So, for example, if it's more of a educational broad type of content where maybe we're sharing a specific diet or a workout program, a program that reaches a higher audience, larger audience, then that

[7:00] might not necessarily get the same amount of trial activations as to a video that where maybe we're telling a story about someone who started on the app, this is how they transformed their body. So, when we create content nowadays, we're really also thinking about how can we tell a story that seamlessly ties into the product pitch

[7:20] again. How does that work as far as evergreen? I mean, you know, I mean for me again, because I'm kind of a health and fitness nerd and I've watched his videos before and I think I'm now subscribed even. His videos are popping up in my feed pretty regularly. Do some of those older videos that perform really well, do they does it kind of provide a solid base of subscription revenue and installs, or is it pretty spiky with like the release of a video really you see it big time and then it just resets to like a much

[7:50] smaller baseline? Yeah, so for us it's been pretty baseline. Like we'll see the spikes when the video comes out, but throughout that we've built a pretty solid bank of videos where we have a consistent number of trials coming in every single month. And I think with long-form content, that's more or less the way things go where people are searching things up using YouTube as their own SEO, and eventually these older videos are still getting traffic

[8:16] to this day. As a YouTuber, I I'm curious whether Jeremy leans on like other YouTubers in the space or other influencers. I imagine you know, he's got friends and probably goes to some of the YouTube events and things like that. Do you all lean on other influencers as well, or is it just the the Built With Science

[8:36] channel? Right now we're mainly focused on actually just expanding our internal content team, but Jeremy, I know he does have plans to collab with a few others in the space. I think he's actually going to Texas in about a month to do a big collab. Nice. I mean, I guess I'd imagine it's like it feels like every big fitness influencer already does have an app, so I guess it's maybe tough from that perspective, like Renaissance Periodization, MacroFactor. There's a bunch of other apps in the space that are that were

[9:07] built by YouTube influencers. And one thing I think that Jeremy does differently is he'll actually reach out to maybe they're not as known, but he'll reach out to some of the expert researchers and coaches and dietitians to collab with for videos in terms of promoting some of the research that they find. So, that's been something that has added a lot of the credibility for the

[9:30] videos. Yeah, I want I want to dig into that a little bit more about the like building trust and being more kind of science-based approaches and things like that. But you mentioned earlier, you really think a lot about how the app could fit into the content. Dig deeper into that. Like, you know, are you creating a whole video because

[9:50] you think it's a good pitch for the app? And then, how do you You were talking too about, you know, audience trust and audience engagement and things like that. Where you you want to create a video just cuz you think it's a great video. Do you sometimes even leave off like you launch videos that don't even mention the app? Or how do How do you kind of process all of that balancing the app business with the the YouTube

[10:12] business? I think for us it still comes down to just focusing on our core and and where we got started. So, that's just the content itself and making sure that it's educational. It's We don't want to sound like a sales pitch on every video. And much of it is we're creating this piece of content and okay, maybe at this point in the middle of the video, there's a smooth transition, not a hard pitch, a smooth transition. So, for most of the time it's it's very soft CTAs throughout the video, but we never really fully pitch a video unless it's maybe something on Instagram, like an Instagram short or

[10:50] something. So then, what percentage of his kind of main videos that go out, like the full YouTube video, have a mention? All of them? Or or is it still a percent? Most of them now will have something in there, either in the middle or near the end. It's got to be tough balancing all those different factors though of of you know, wanting to maintain the quality and the audience and then I mean, do you feel like the audience does get saturated too? I mean, this has been one of the things we've talked about on the podcast before is like, okay, there's 7 million people subscribed and he's got plenty of videos

[11:23] that do tens of millions of views. And I guess that's the thing with the YouTube algorithm now is that it does kind of expand beyond just the subscription base, but does it seem like over time the the kind of peaks are a little lower or like that that the core audience who watches every video, like they've already seen it pitched and maybe they they just don't think it's the right app for them, or are people like getting convinced over time the more times they

[11:48] see it? Yeah, so in terms of saturation, I think it ultimately still comes down to the content. You could have one person watch maybe a diet based video and maybe they're not as interested in it. But then we post maybe another video that's more on the workout side of things and that hooks them in. So, I think it really depends on the content that really attracts to them. And we've seen it time and again where if we really dig deep into creating an incredible piece of content, that will not only increase trials from some of our existing viewers, but also just expand our reach to to reaching more and more people. And

[12:24] then once someone sees one video, the algorithm again like will show a bunch of our other videos and it kind of creates its own mini funnel inside of YouTube. Right. Yeah, that makes sense. And then how how do you think about like shorts and reels and TikTok and UGC? Are are you working with any like UGC creators? I mean, you mentioned you're not really doing like other influencers, but are you clipping from the main videos to create more kind of ad-like

[12:56] UGC? Yeah, so for the most part right now, one thing we've learned from the past few years of uh going through business is focus is key and for Jeremy right now and for the business as well, YouTube long form is the highest ROI thing that we can do and we just want to focus on doubling down on not only increasing the output, but also the quality of the content that we put out. That said, we are working on a few other projects where someone, you know, maybe a a third party or another person that we hire can do independently. So, for example, we just onboarded a few

[13:37] clippers who are taking some of our existing long form and posting that across Instagram Reels and TikToks. And that's actually been quite helpful because when they're posting, some of these videos will go viral and we're able to see see what sort of hooks that they use in those videos to inform some of our future videos. So, it's kind

[13:58] of been a two-way feedback loop for us. And then, how does that play into ads? Cuz I know this is like one of the main topics I wanted to talk to you about today. You've all scaled up from nothing to $100,000 a month in ad spend and profitably and are really making a big push in in that side of things. So, how how do you think about the the pipeline of ad creation? Are you using a ton of Jeremy's videos as source for that or is it totally different or like what does

[14:25] that look like? Yeah, so for us, actually, we're not relying on Jeremy at all for ads. I mean, besides maybe a few pieces of old content and he's done, old short-form content that he's done, we're really just trying to focus on how we can scale without relying on Jeremy. And in addition to our goal of just expanding our reach, we wanted to kind of solve the the bus problem where everything was reliant on Jeremy's YouTube channel for our growth. And by focusing on Meta and not relying on Jeremy, we're kind of building a new channel that can scale on its own. So, everything we've done from

[15:05] that end is mainly through like B-roll style videos, we've used some testimonial content, a lot of statics now with AI. So, that's kind of the approach that we've taken with Meta. That's fascinating. And like again, I would have expected and I I actually didn't look through your ad library in preparation for this podcast. It's I should have known that coming in, but I would have guessed it would be way more Jeremy focused because he is that kind of like celebrity YouTuber, and there's so much opportunity to use him, but it makes a ton of sense when And this is an interesting part, too, for an influencer

[15:38] with an app if the main business of creating content on YouTube is so is very profitable and doing really well, that that whole focus element of like how much time can you dedicate? And I even love the way you're saying it is like, you know, trying to make it so that they aren't the limiting factor on anything cuz, you know, as the kind of star of the channel, there's only so much content he can do, so much bandwidth he personally has, and everything like that. So, it's interesting that And And again, I think, you know, a lot of people who just assume like, oh, yeah, you know,

[16:14] influencers like that you can just do video all day and everything, but it's it's a lot of work and a lot of mental energy and everything else. And so, I love that y'all are really trying to diversify away from him kind of being the center of everything. Don't get me wrong. I would love to get more of Jeremy's time to make some ads cuz I know they would perform quite well with the trust that he has, but for him right now, he's already stretched to the max. So, yeah, it's all about focus

[16:40] for us. Yeah. And I mean, it's a really good perspective, too, for anyone pitching influencers to like really understand and internalize that [laughter] the the influencer you think, you know, is just sitting around or [laughter] or should be really excited about, it's like even an influencer where it's their own app, you have to make really hard

[16:59] decisions about how to prioritize time. So, as I mentioned, you started from like nothing and scaled up Meta this year. Why Meta? You know, talk me through the the that whole process, too. Yeah, so we actually launched the app in early 20 January 2025, and we didn't launch any meta ads until this year in January. And the reason for that year gap was mainly because we wanted to double down on improving the product. We got a lot of feedback from our launch, and we know from just looking at some of the numbers that as long as we're constantly improving our trial-to-paid and retention, that lifts the floor for everything else. And

[17:45] considering that our organic traffic is already converting at a healthy rate, we know that any paid traffic that we send will be much lower. So, we wanted to improve the floor for all traffic coming in. So, we spent that full year just putting our heads down, improving the product. And once we felt like the numbers were right in terms of our trial-to-paid, our retention, and our churn, then we slowly started investing into these additional

[18:15] acquisition channels. So, I love that perspective that that product really is key. And And you know, so many people think if I can just scale up on that, you know, if I just had $100,000 a month of blowing ads, of course I could be as successful. But But the reality is like it it's still really comes down to like people actually believing in the product, people using the product,

[18:38] people staying retained to the product. Like that's how you build a great business. Um so, how how how do you think about that part of of the the product versus growth balance of like how you put time into it, how you allocate resources, and things? Yeah, no, I 100% agree. For us, product is everything. A great product will lift the floor more than any growth hacker tactic will do. So, that's always been the core for

[19:03] us. Yeah, that's amazing. So, starting from zero this year, what's your experience been like scaling meta? You know, what what kind of attribution are you using? How you know, how are you determining whether the that spend is profitable? Did you Like everybody talks about, you know, burn 50k, just kind of learning the ropes, or what was that process like

[19:23] going from zero to 100? Yeah, so there was a lot, for sure. We've never tapped into Meta before, let alone myself. I mean, I had a I have quite a bit of experience in marketing and in copywriting, but the Meta world was definitely new for us. And I think one of the biggest things that we needed to figure out right away was just getting more data, especially when it came to trial to paid, because like I mentioned earlier, organic, you have a certain trial to paid threshold or baseline, because these users are generally a lot warmer. Whereas trial to paid, you're essentially tapping net new cold users who've never really

[20:03] seen the brand before. So, we knew trial to paid was going to be lower, but we just needed to get a baseline of what that number would be in order for us to calculate how much we could actually spend to acquire a customer. So, that took around a month to do, and once we had a good set of numbers to work with, then it was all about testing different angles and different avatars who'd resonate well with the product. And how our product can uniquely solve their pain points. So, we had a lot of learnings from surveys from past customers coming in, from warm traffic, and we pretty much just doubled down on

[20:43] finding specific avatars that work well. And right now we're in a process of constantly iterating on what's winning, while also slowly adding on new new avatars. So, we're just trying to create a proper iterative and testing loop that allows this engine to keep on running. Yeah, you mentioned earlier the the trust side of things and how important trust is, and the research that that Jeremy's involved in that that lends trust to the the YouTube channel and to the app ultimately. But how how do you think about the creatives and kind of the the way they shape the perspective of people coming into the app as far as

[21:20] like over-promising or you know, things that are going to get people to convert, but then maybe quickly churn or whatever? That's a big reason why we decided to actually do meta in-house rather than choose an agency is because we felt like we needed someone who really understood the product and was very passionate about of the product and ultimately could promote the app in a way that isn't faking anything. So, we wanted to make sure that whatever we put out there actually relates with what the product actually does. I'm sure you've probably seen a lot of companies that over-promise what we can actually deliver, and for us, we

[22:01] just wanted to make that experience from marketing to the the product handoff as seamless as possible. And have you seen certain ads perform poorly based on that hypothesis or or have you sometimes seen the opposite where you see an ad really take off, and then you're kind of like, "Uh, it's doing really well, but I'm not sure that's the the message we want to

[22:24] send." Yeah, definitely. We've tested a lot of ads that are more like I guess click-baity style or or encourage a click and encourage someone to start a trial, but we quickly like we we can quickly see from the trial to paid that this is not the user that resonates the best with the app. So, we'll see a huge drop in trial to paid, whereas maybe we think a lot deeper about who this person we're trying to target is, what their pain points are, and then how the app uniquely solves those pain points. That brings in a much higher quality of traffic. So, it's definitely a balance

[22:59] of, "Okay, we want people to start the trial at the cheapest cost, but also we don't want just anyone to start the trial. What what are you targeting against and what what kind of data are you sending back to Facebook meta for the targeting? Yeah, so for the targeting it's we have a custom one of our engineers built a custom dashboard where basically we can see and validate that every single new trial is coming specifically from meta just because with all our organic reach right now meta can often blend who's coming from where. So we have that specifically set up for just meta conversions and basically anytime a

[23:38] trial comes in we feed the data we're able to see the trial to paid numbers and we're feeding the highest intent users back to meta. Gotcha. And you wrote a post earlier I think earlier this year the biggest unlock to scaling your meta ads spend less time in ads manager. What what did you mean by that and then how do you balance that against what you just said about you do still want to have like the right targeting and the right data coming back

[24:03] and everything. Yeah, no it's a great question. I think I think that must have been on Twitter. I I recently started using Twitter and I just share any thoughts that come to my mind kind of like a personal diary. But I think my my point with that was it it's super easy to get obsessed with setting up the right campaign setting up all these different bid targeting strategies and all that. But at the end of the day I think what will really move the needle is just creating better content same as same as on YouTube. As long as you create content that people actually enjoy then

[24:37] you're you're going to make a much greater improvement than tinkering around with different targeting styles especially now with not sure if you've heard of the whole Andromeda update but a lot of the targeting on meta is specifically done through the creatives. So for me that was just a reminder to focus on creating better creatives rather than tinker around and mess around with the targeting that's

[25:01] really out of your control. Yeah, we we've been talking through the scaling up on Meta, but one thing we haven't discussed is that you send most of your traffic to the web or all your traffic to the web not not to the App Store. Why why do you do that? Yeah, so about 90% of our traffic is actually going to our website and we have a really long personalized quiz that we send all leads to on our website. The reason we do that is because it educates this this quiz that we have we've tested multiple times, but it educates the user on the actual product. It overcomes

[25:39] objections and it increases the perceived value of the product while also helping them understand how personalized the the product actually will be for them. So, for one it increases the overall perceived value, but secondly, we actually use a lot of their questions in the quiz to build their personalized plan in the app. So, it's kind of a twofold. And we've also tested the running traffic to the App Store versus the quiz and we've noticed that the quiz just has a much higher conversion likely because of some of the users right now who are going directly onto the App Store have a lot of a higher intent. So,

[26:21] maybe they don't need to take that quiz right away, but down the road it is something we're considering on retesting. You basically matched the quiz almost one-for-one in the app compared to the web, but you saw way better traffic on the web versus the app. Exactly. way better conversion. Right. I've talked to a few people about this recently and you know, one of the hypotheses around this is that when you open an app, you're kind of just trying to like get to a solution

[26:50] quickly. Like give me my workout plan. I'm going to go work out or whatever or like yeah, you're just more kind of solution-focused where on the on the web you're maybe a little more like researching and open to kind of reading a little more. You're You're maybe not like you know, checking out at a grocery store or whatever where your attention is split. Um you know, you're maybe even I mean, do you even track like the difference between being on mobile versus being like in a desktop

[27:18] environment or anything like that? Yeah, so the majority of our traffic is definitely on mobile. So, we're just tracking conversions separately. And funny enough though, we ran that same experiment with setting up the quiz on Android and that actually is converting equivalent to our conversions on the web. It's just not the Apple Store

[27:40] users. Let's dive into pricing and I love the gym buddy two-person plans. I'm curious about that. So, what what what is your pricing and and how do you think about pricing especially with running ads and thinking about you know, conversion? Did you change your pricing once you started doing ads or had you dialed in your pricing and feel like that's actually been pretty effective once you started

[28:03] running paid up ads? So, yeah. So, for pricing we are slightly on the premium side. So, about $189 for the year or $30 a month. And we actually just launched with that through when we launched the app back in 2025 through YouTube. And we pretty much kept the pricing the exact same the entire time. And the reason for that is because the way we position our product is is not as an app but as a tracking app that most workout and nutrition nutrition apps out there are, but it's more of like a personal trainer in your pocket. So, the positioning of it is you're comparing costs of a personal

[28:44] trainer versus a trainer in your pocket. So, that way we can charge a little bit more premium. Also, we do have that added benefit of all the trust that's been built through the YouTube. And when it comes to approaching Meta with this pricing, it's it's kind of the same thing. We we don't mention that the app is a tracker at all. It's more of a coach who's going to guide you on your journey. So, I think with that positioning, we're able to actually do

[29:11] well with this pricing. Yeah, and you have one really cool pricing thing that I I don't see a lot of people do is a gym buddy plan where you get two for you bundle two together, almost like a family plan, but a gym buddy plan. How how how do you do that? Yeah, so this was actually an idea brought up by one of our product managers, but we got a lot of requests from existing members saying, "Hey, do you guys have a family plan? I want to bring my husband, my wife." And this came up often enough that, "Okay, maybe we wanted to test something." So, what

[29:45] we simply did was on our web quiz, we offered users the option to add a gym buddy, we call it, to their plan and get their plan at a discounted discounted rate. And that actually has been quite successful for us. Around 15% of anyone who starts a trial will actually add on a gym buddy. So, not only has that increased just overall AOV, but also we found that when someone does select a gym buddy, then they're more likely to stay on the app. So, that's also increased some of

[30:20] our retention. Yeah, that's fascinating. I was talking to Life360 about this, and that's one of the things they said was that their highest retaining cohorts are the are the family units. And you know, that's very much a family app, but there for them and I don't imagine for a lot of folks, if you can get multiple people committed, and then it it's a little bit like, "Well, maybe one's using it and the other isn't, but then you don't want to cancel because and don't want to switch to the single plan because well I'll start working out, you know, in the future or whatever. A little bit like a

[30:51] gym membership maybe. But how how much are you all actually discounting to kind of incentivize that? Just 15%. Both users will get 15% off. Yeah, so it's not like a massive incentive. So you you I mean that's that's pretty amazing if 15% of your users are selecting that and so you're almost doubling your LTV per conversion. Yeah, exactly. I mean when you think about it too, there aren't many workout related apps either that offer the ability to, you know, workout with a friend or or connect in that way such as like Strava might do. So not only from like a uh growth perspective has this been

[31:32] valuable, but it's also helped us think more about strategy when it comes to the product and how we can maybe double down on this idea of creating more of a community within the app. Does the app do that currently? So what once you add a gym buddy, do you see their workouts? Do you like what what what aspects of community have you

[31:52] already brought into the app? Yeah, so we actually just rolled this out, but for gym buddies right now you're able to see what your partner see when your partner works out, see what your partner eats, and you can send them a few nudges here and there. So there is that collaboration in there. That's awesome. I don't I don't think

[32:10] that would work for my wife and I. [laughter] But I could see I'm actually in a group group text with my two brothers and we we kind of hassle each other and, you know, talk about like our our fitness goals and stuff like that. So I should I should get them on a a gym buddy plan and and then we'll we'll move our

[32:29] text thread into the app. [laughter] You'd see what they eat every day. Yeah. [gasps] Uh that's awesome. Yeah, and how do you think about that premium pricing? I mean you mentioned, you know, $189 a year is a lot. Do you Do you feel like that's a barrier? Have you done any price testing or considering doing some price testing to see if lowering that barrier does improve things or has conversion been good enough that like it's not You don't feel like it's super

[32:55] low-hanging fruit right now. Yeah, so I think for us right now it just hasn't been a focus. We've been trying to double down on just improving the metrics given our current pricing. And maybe down the road we'll experiment with pricing. I know pricing can have a major impact, but a lot of it right now is when you do change pricing, you can influence a lot of the product metrics. So we'd rather stick with, "Okay, let's let's focus on improving retention and trial to paid." And once we're at a point where we feel like that's healthy, then we're going to start experimenting on these other

[33:31] things. With that high of a price and having looked probably at at uh state of subscription apps report, are you in the ballpark of the median or higher than the median on conversion with that that high of a price? Yeah, so for our warm traffic, our organic traffic coming from YouTube, we are around the 35 to 40% range. And trial to trial to paid for meta is

[33:58] slightly lower around 25%. Got you. Which is super impressive at a at $190 a year. And what percentage of that does jump all the way to the annual versus like what percentage end up picking the monthly plan? So right now, it's about 75 to 80% choose the annual. Wow. And that was actually part of a recent experiment we did on the pricing page,

[34:24] which was a big one for us. Yeah. And and speaking of the pricing page and and going back to the gym buddy thing, so you asked that question in onboarding so that you don't have to confuse the paywall for people who don't have a gym buddy. So like a person who doesn't get a gym buddy doesn't even ever see that they can get that discount. So so your pricing page is very focused on just the annual

[34:48] and and monthly, right? Correct. Well, on the quiz actually is where we ask a do you have a do you have a gym buddy? Would you like to add them on to your plan? They can say yes, they can say no, but if they say no on the pricing page we actually have just a really small toggle that says a little bit about the gym buddy. So they have that option as well if they opted out on

[35:08] the quiz. Yeah, cuz I mean I could see it becoming one of those like you know paywalls that just has way too many options and and makes it confusing. So it makes sense to like ask it in the quiz and then not make it super prominent on the paywall itself. We've been talking about meta growth and then the YouTube channel as a base, but I know you've also been working on SEO and now AEO and getting more and more people saying that chat

[35:32] GPT sent them to the app. How's that going? It's been good. It's an investment that we decided to do earlier this year as another channel for us to expand on. The reason why is because traditionally we've had really strong traffic coming in from SEO from all our old blog posts. So about about 30% 30 to 40% of our traffic coming in was from SEO, but ever since the the rise of AI and people using AI search a lot more, we slowly started seeing that decrease. So we decided to invest in hiring an external consultant to help us with some of this AI search. And basically what it is is we just optimize

[36:18] a lot of our existing content, but also we doubled down on creating online tools. So for example, a calorie calculator, a macro calculator, a bunch of these tools that users could use in the web that not only added value, for example, they they are able to figure out what calories they need to eat per day to lose fat, but also seamlessly transition into the quiz. So, that's been working really well for us, and also tools just tend to rank quite well with AI search. So, that's something we're going to continue to double down on. Although it does take a bit more time to actually see results

[36:58] just like SEO, it's something that we are going to keep on investing in. And do you do you see a difference in intent and conversion from the tools versus the like blog posts or is it fairly similar or dependent on the blog post? I would say it's dependent on the tool and the blog post, but for the most part, the tools have a slightly higher

[37:21] conversion. Interesting. We've talked a bit about your thoughts on experimentation, but I did want to dig a little bit deeper into how you think about experimenting, what kind of experiments you've run, and what kind of results you've seen. So, so how do you think about experimentation? Yeah, so I think one of the biggest shifts we've had over the last few years of experimentation is we're obsessed

[37:46] with the problem and not the solution. And what I mean by that is rather than going ahead and just simply testing out ideas for experiments, we take our time to really truly understand like what actually is the problem we're trying to solve. And the way we do that is like through three main steps. So, first, we'll look at the data. We track everything on Amplitude, and we know where the drop-offs are on our web, on the app onboarding, and [snorts] we'll look at what certain areas have the biggest drop-off, but also that we feel have the biggest area to improve. And once we have an idea of

[38:23] what we actually want to experiment on, for example, maybe let's say it's a pricing page, then we'll go ahead and look at that pricing page and we'll list out as many problems as to why that pricing page isn't converting before anything else. So, maybe it's a lack of trust on that page. Maybe the value proposition isn't clear. We'll list out as many problems as possible and as a team we'll decide on what we think the the biggest problem is. And then only only once we have that problem locked in, then we'll start listing out solutions. So, if it's trust, then maybe we need testimonials, we need more

[39:00] credibility and based off of the solution, then we'll just go and roll out an experiment. So, yeah, that's been that's been the main process and I think the biggest thing from all of that is making sure you document down everything. Just because it's it's it's easy to send a message to your engineer on Slack and say, "Hey, like let's let's roll this out." But, once you actually take the time to write things down, you understand the problem so much deeper and not only that, but if an experiment fails, you can go back to the drawing board and understand what exactly you tested, why it failed and how you can

[39:39] iterate iterate on it because there's been I mean, probably 70% of the experiments that we run fail in the first go and that doesn't mean it's a failure. It it just means that maybe there's something wrong with the execution. Maybe we covered the wrong problem. So, often we're iterating on these failures to uncover a winner. So, that's been a

[40:01] really helpful process for us. Yeah, I really like that that problem-focused approach cuz it I mean, it's it's so much more kind of natural and easy in some ways to just just brainstorm solutions. Like, "Oh, it's not converting well. Let's make this prettier, or let's add this testimonial, or whatever. But, I love that approach of like really deeply thinking through all the potential problems first, and then brainstorming solutions. And then, it I mean, it just gives you such a clearer understanding of what you're testing, and then helps you interpret the results better because you had a hypothesis around exactly what the problem was, then you had a hypothesis

[40:41] around what would solve it, and then you can test both sides of that equation instead of just a complete failure. So, I love that. Exactly. And And just to add on that, so when you do find a winner, for example, one thing that's been really impactful for us is taking those learnings and applying what worked to other parts of the funnel. So, say for example, a messaging really worked on our quiz. Maybe we want to we want to test applying that on somewhere in the app. So, taking those learnings and across and applying it across all points within your your product and and

[41:14] your your web. How granular do you do you get with testing? I know this is kind of a a controversial topic. You know, some people are like, "Oh, yeah, I changed my, you know, CTA button from yellow to blue, and the conversion skyrocketed." Are you doing super granular experiments, or are you testing like kind of bigger swings? For us, we're definitely testing bigger swings. Again, it's about focus, and we'd rather just focus on what we think, based on the data, can move the biggest needle, and I don't think, for the most part, it'll be with changing colors and changing a a small

[41:50] piece of text. Yeah. And I mean, it does work It does work sometimes. And maybe some people have seen it work, and then over-index on that, but sometimes those kind of things can move the needle. Some little things can be dramatically I mean, especially when you when it does come to like CTA tags and things like that. Like the the subtle aspects of of how people are thinking about what action happens after they tap a button. Like I can see some of these like really high leverage points

[42:22] being able to test more granular stuff. But yeah, it's like if you can test a big swing it and and and try more dramatically new stuff. You just get clearer results, too. Yeah. No, no, I agree. Not to say that a little text change won't make a difference. I think for us it's just been when we have a problem that we're trying to solve and we have these different hypotheses for why, we'll usually test it as a batch just because again, it also depends on how much traffic you have coming in. We won't have enough to do a bunch of mini tests. So we'd rather focus on a bigger

[42:54] swing. If that doesn't work, okay, maybe we'll strip things down a little bit, but that's usually how we've been approaching the experimentation. Yeah. And then and then because you as you said earlier have kind of looked through the funnel and kind of estimated the the likely impact, you're also like looking for those high leverage places anyways, like places where people drop off the funnel, places where you feel like conversion should be dramatically higher than it is and not testing as much the places where you're already

[43:23] seeing really good results. Exactly. Yeah, so it's like picking picking the test is leverage and then what you what you test is leverage. Or picking where to test and then what to test are both leverage points that it's easy to like yeah, want to test a million different things, but like realistically even with AI and moving quicker, it's it's

[43:41] honestly more about traffic these days. It's like can you like if you if it takes a week to get to statistical significance, that's a very different flow of experimentation than if it took an hour to get to statistical significance. You're not getting many as many at bats, so you got to you got to be really careful about where you take

[44:00] the swings, right? Yeah, I mean if we had as much traffic as Netflix or Spotify, I think we would be definitely testing a lot more. Yeah, that makes sense. One thing you do that really love is I think what you called quiet launches. What is that and why do you do that? Yes, so this is more on the product side, but what we've noticed is in the past what we would do is anytime we had a new feature that we wanted to release, we'd release it on the app and then we would send an email to all our members, get them excited about it. As a

[44:32] marketer, I'm sure you would want everybody to see this new thing that you're building, but what we've noticed is that this often inflates a lot of the engagement metrics that you obviously want to measure when you launch a new feature. So, we've actually taken the opposite approach where we'll roll out a new feature, we won't say anything, and we'll just we'll

[44:53] just see how the metrics do on its own. And if there's some signal that, okay, this this product is working well, it's adding value, then we'll feel confident enough to launch that out to the public. So, it's mainly a choice of how we can learn the best from some of these new releases. Do you also have a pretty good beta tester pool where you're you're even rolling out some of these experiments in beta before they even go out to the main

[45:21] app? Yep. So, we have a group of about 100 people who were actually our previous web-based course members. So, they've been with us for years, and we also have a slightly bigger pool with about I think a thousand or so beta testers. So, we have a we have a pretty good base to test before we actually release it to

[45:41] the public. So, with those quiet launches, how how often are those quiet launches just to the the beta pool, or do you tell the beta pool, make sure the feature actually works and doesn't have bugs and stuff like that, and then the quiet launch is actually public, or how do you how do you do

[45:56] that? Yeah, so the the beta pool is what we're telling them about the feature. We want them to test it. We want feedback. Then we're iterating on that feedback. Then we're quietly launching it to see if that cuz cuz the beta pool are the most engaged users. They probably use whatever we put out, but we we just want to refine it from there. We'll release

[46:17] it to the public quietly. Well, and speaking of product launches, I know this year you launched something called Jeremy AI. What is that and how did it go? Yeah, so Jeremy AI has actually been one of our customers' favorite features. Which is surprising because a lot of people screw up their AI. Yeah. [laughter] I mean, during the whole whole launch of the app and and the growth of all our features, we've never really promoted or done much with AI besides some of the back end stuff, but Jeremy AI is essentially an AI chat that's trained off of all of Jeremy's past YouTube videos, his blog history,

[47:04] and it's a source for users to get any fitness nutrition based questions answered just like Jeremy would be talking to them on the phone. But I think what we've done to really increase the value of this is not only is it trained off of Jeremy's research and content, but it's also able to read the users' workout, nutrition, and progress data. So, it could actually give like really really personalized answers based

[47:35] off where they're at. That's really cool. I I mean, if you don't mind digging a little bit into that, like what are you what are you using on the back end for that? Just one of the the off-the-shelf AI provider, like big models? We we actually have some incredible engineers, so they all built it in-house. I'm not exa- exactly sure. I think it was one of our I think you've met him, but his name is Kevin. He's one of our engineers and I think he just spent a weekend he had this idea, he spent a weekend, he rolled it out, and we just never looked

[48:06] back. [laughter] That's incredible. Yeah. Uh so, we've talked about it a few times here, but I did I did want to dive into the the research angle. So, for a health and fitness app, that kind of trust and authority and, you know, even the name, Built With Science, kind of and that may be part of why you're able to charge a premium is because you established that trust, but you are actually doing legit science and collaborating with researchers and things like that. So, walk me through

[48:38] how all that works. Yeah, so it's it's rooted in all of our videos, as well, but a lot of the content is informed by the research that comes out. So, Jeremy does a lot of investing in finding some of this new content and research that comes out. He has a team of dietitians and coaches and researchers who will look out for that sort of content, but he's also started to work a lot with releasing his own studies. So, he'll work with there's a university where we live, and it's called UBC, but he's done self partner studies, and we've actually started to do a few studies within the app with

[49:19] some of our customers. So, an example of this in the app is we had a three versus six-day experiment, and we invited our users to join, where half of them would do three days a week working out, half would do six days a week working out, and we used their data within the app to measure some of those results. So, that that's just another tool for us to continuously get data and

[49:41] run it by with some of the researchers. So, it's science and the research and and being on the leading front of it has definitely been something that has been core for us. Yeah, and it and it seems like it does play across the the entire, you know, mission of the company across the app, the content, and everything else y'all do. And you one of my favorite videos recently was one that Jeremy did on um

[50:06] body fat percentage and calorie intake. That was so fascinating. I I I I I told Ethan before that I I didn't want to turn this into like a health and fitness podcast cuz I'm a health and fitness nerd and could easily have turned that we could we could be talking lifting this whole time and all the different uh we actually were before we hit the record button talking about different like lifting techniques and stuff. But anyways, I love this video he did where he actually took like what, six or seven like real people, like measured their body fat, measured their like total caloric expenditure, measured how much

[50:40] they were actually eating, and it was just it was fascinating. It was done in a very like scientific way and like a very informative way. Uh I believe that's like probably one of his better performing videos in the last year, right? With that kind of a video, it's more about the trust and the science and stuff, but but did that one perform well? How do you think about the those kind of experiments and that kind of science and that kind of content

[51:03] actually impacting the app business? Yes, so I think for that piece of content, that was definitely a big bet that just Jeremy wanted to take. It definitely was one of our highest performing videos this year, and it was honestly very fun to do. We rented out a full studio, brought in all these participants, but I think for us it was just we wanted to take a shot at trying something completely new. It did have a decent conversion to the app, but it was more for just educational and also

[51:34] entertaining purposes. I imagine that was pretty expensive, too. So, I mean, that that's another thing I think a lot of people don't think about with these influencers is is that some of these videos end up being very very expensive and very very time-consuming to produce because it's not just, you know, you see a polished 20-minute final video, but there's hours and hours of recordings and planning sessions and scripting and like so much goes into that. So, I imagine that one specifically with all the like DEXA scans and everything else like really

[52:05] was a massive effort to pull it off. Yeah, that that one was over months of work for sure. And and this is what we were talking about earlier, too. It's like you probably have what, three or four big videos going at any one time and you're having to manage It's like a massive like project management nightmare [laughter] of these like long-running multi-month experiments and research and shots and all that kind of stuff. So, it's You've got You've got your hands full, huh? And that's why, you know, the the whole thing you were saying earlier about focus, I think is is just so

[52:35] important. Yeah, I agree. I I think in the past we've just tried to do too much and we've gotten nowhere and now it's like, "Okay, what are the one to two things that are really going to move the needle?" And let's just stay hyper focused on that. So, that's that's what's worked the best for us.

[52:53] Nice. Well, as we wrap up, I did want to ask the the three questions I ask every guest now. Over the past year, what was your biggest win? The biggest like experiment or change that you implemented? So, as I mentioned earlier, I think the biggest change was an experiment we ran on our pricing page where it heavily changed the shift from people choosing monthly to annual. And all we did was change the layout so that it presented the annual up front and reduced risk of actually starting the free trial. So, we didn't change the price, we didn't change the positioning. It was simply a a UI shift which had a massive impact

[53:31] for us. So, for those listening on the podcast, just walk us through verbally like some of the things that you think had the biggest impact on that change. Yes, so prior to the experiment, we had a pricing page where monthly was shown on one side and annual was shown on the other. And then after the experiment, we rolled out the variant, which

[53:51] essentially just showed only the annual. And on top of the annual, we had kind of a Blinkist-style layout where we showed day one, you'll get your personalized plan. Day seven, your your plan This is how your plan will adjust and adapt with you. And then day 12, right before the free trial ended, we made it clear that we're going to send you a reminder and that you can end your trial whenever you like. So, we made the risk of actually starting the trial a

[54:20] lot more clear. But also gave them the annual as that upfront choice. And then there is an option to, you know, look at the monthly plan as well. But for the most part, reducing the actual perceived risk and choices that they had to make had a big impact. Yeah, so what was the monthly like just kind of a view all plans and then they

[54:41] showed you the monthly? Yeah. Yeah. Yeah. That makes sense. And so, you throwing back to like the very early part of the podcast, you were saying that something like 85% of people choose the annual plan. That's since you rolled this experiment out, right? Correct. Man, such a huge win, especially at $190 a year. Yeah. Yeah. I think it was around 60/40

[55:03] before that. Okay. Wow. Yeah, that's a big That's a big increase in dollar dollar-wise and LTV-wise. That's a big shift. So, what's your biggest fail of the past year? We recently added more context to one of our pricing pages as an experiment just because the problem we're trying to solve is increasing the making the value proposition a lot clearer. And what we noticed was that actually had an opposite effect. Adding more context onto this page seemed to actually hurt the conversions a lot more than not having anything at all. And I think our learning for that was it just reinforced how adding too much context, especially at a state where a

[55:46] user might be already, you know, excited and motivated to buy, might just overwhelm them than actually get them to start. Yeah, that makes sense. And then you you had another one. I really like this one, so I don't want to uh leave it off uh around the no trial offer. Yeah, so we're we are also testing a no trial offer compared to the 14-day free trial. We thought it'd be a big win just because a lot of our traffic right now is organic and they're already warm and trust the brand, but we're seeing it's quite negative just because it does, of course, add a little more friction even with a 30-day

[56:25] money-back guarantee. To be more specific, the trial is actually a toggle, right? Where they get 20% off for not doing a trial and paying up front? Exactly. Yeah, so you could pay up front and get 20% off or you could toggle off and just take the 14-day free trial. Uh that you know, I mean yeah, at $190, maybe that's part of why it's not working for you, but that's an experiment I think more people should should do. Had you seen that in another app or did y'all just come up with that

[56:54] idea? It was it was a mix of both. We always knew we wanted to test no trial, and we took inspiration from some of the other in-app paywalls. We haven't seen it anywhere on the web, but what's funny enough is going back to my point about documenting everything. So, this experiment hasn't been winning, so we went back to the drawing board and looked at, you know, why we think it's not winning. And one of the core hypothesis for why it wasn't working is because the copy on the toggle, the no trial option as being like way better and you're kind of losing out if you just start the free

[57:32] trial. So, that was our hypothesis. So, we actually have been rolling out another arm. It's been a few weeks now where we make both options seem pleasant. So, it's not one framed as good or bad. It's more of like, "Okay, they're both good." And that actually has been a very strong lift. Nice. Nice. So, So, yeah, it may end up winning. And then back to our conversation earlier, like you got to understand what you're testing, why, and then know what to change when it didn't work because it might not be that it was a bad idea. Maybe you just didn't quite execute it the way that's going to make

[58:06] it work. Exactly. Yeah. All right, last question is to fill in the blank. Growth would be easier if you build a product people genuinely love and tell their friends about. That's my favorite thing to talk about on the podcast. You know, at heart, I've always been a a product guy. So, I love that that we're wrapping up on that topic. Like, I mean, it really does just it makes everything easier. Like, if you're struggling with conversions, you're struggling with uh just struggling to scale, like having a product that people care about that I mean, it's it's just night and day. And And people talk about this like PMF and and, you know, once

[58:45] you hit product market fit that the market is pulling you forward. You're not pushing against the wall. So, yeah, I love that I love that that was your your answer for this. All right, as we wrap up, anything else you want to share with the audience? Any roles you want to shout out or anything our audience could

[58:59] do for you? Not that I can think of. I mean, if you want to reach out, I'm on LinkedIn. I'm recently on Twitter. So, we're always looking for new roles, people who get obsessed and are passionate about solving hard problems. We're always looking to bring people on the team. Awesome. Ethan, it was so much fun having you on the podcast. Thanks for

[59:17] joining me. Likewise, thank you. Thanks so much for listening. If you have a minute, please leave a review in your favorite podcast player. You can also stop by chat.subclub.com to join our private community. [music]

---

About this transcript
Read from YouTube's own caption track and laid out by ViewRank AI (https://viewrankai.com).
ViewRank AI finds the videos already beating a creator's own average on Instagram, TikTok and YouTube Shorts, transcribes them from the audio itself in more than 60 languages, and turns what worked into new ideas and scripts.
Free transcript tools, no account needed: https://viewrankai.com/tools
How to read any video this way: https://viewrankai.com/llms.txt