# Google AI studio replaces your AI tech stack (full demo)

Channel: Greg Isenberg
Video: https://www.youtube.com/watch?v=6h9y1rLem4c
Duration: 30 min
Language: English
Words: 5572
Transcript page: https://viewrankai.com/tools/youtube-transcript/6h9y1rLem4c

---

[0:00] this episode is with Logan killpatrick this is the guy that leads up product for Google's AI studio and he just walks us right through it and this is going to be super super relevant to anyone who wants to build a business using AI who who are who want to leverage the multi-trillion dollar uh technology that Google has built uh you're not going to want to miss this one uh watch it to the end um because there's a demo at the end that really blew my [Music] mind welcome to the startup ideas podcast Logan kill Patrick on the show this guy it's the lead PM for Google's AI Studio was

[0:54] at open AI one of the earliest hires at open AI but we're not talk we're not here to talk about open AI what are we here to talk about Logan yeah Greg thanks for having me on we're here to talk about Gemini we're here to talk about AI studio um and we'll sort of go through the the demo of AI studio for folks who haven't used it before um talk about the Gemini models which are sort of the thing that is is actually bringing the experience in AI Studio to life and what do you think people will get by the end of this episode yeah I'm I'm hopeful you'll walk away with like a

[1:25] an appreciation for one the differentiated things that you can build with Gemini and like I think AI Studio like brings a lot of those capabilities to life that just like aren't possible with other AI models or other AI Services um but also like a little bit of like exploratory stuff like we have some like hints of of early experiences like early product experiences which I don't think like fully work today um but like is the direction that we're heading in and I'm hopeful this will plant the seeds for folks who who want to like think about AI cope presence in the future and how that product experience might exist uh etc etc and just to be clear it's not like Google wrote me

[2:05] a check so that you can come on I just think that there's a huge opportunity in leveraging these tools for people to build businesses I wanted you to teach us so thanks for coming on yeah of course I'm excited about this uh do you want to dive in or what's next awesome this is a add crowd so they they want they want to see it yeah I love that let's look at um AI studio so you join sign into AI Studio use your Google account and this is like the default experience that you're dropped into um again the intent of AI studio is like how do we showcase the model's capabilities

[2:45] to their fullest um so you can like for free there's no cost involved with using AI studio um really start to like find the differentiated pieces I think one of the big ones is long context uh we'll talk about that in a sec but you know left-and nav basic prompting experience you can say hey to the models it'll respond and give you something back um we have a prompt Gallery which sort of has this like massive breadth of stuff from like really silly things like coming up with trip ideas to optimizing code to like really trying to Showcase um the the full extent of what you might be able to do with the models um here we're looking at like the image of a hurricane

[3:28] and it's uh extracting a bunch of information uh sort of doing uh OCR if you will of looking at the image and like pulling out some some context um which is super interesting I think the the M the most like mindblowing experiences for me um using the Gemini models are like long long context stuff so if you go click this little plus button in the bottom rightand corner and then you go to sample media this is just like the fastest version of this but you can take something like a uh 30 minute video of this in this case it's a tour of the Natural History Museum um in the US

[4:07] and you add this in and you say uh write me a list of all the museum and folks will see how bad I am at spelling during this uh demo all the museum uh exhibits uh throughout this video um and like a really good example of like something that would be if you think about like how would you do this in today's world without these models like it's basically impossible like maybe you could like break down a bunch of images and and put those through and do that but it's a lot of work there's a lot of extra processing steps involved um and with AI studio and with the Gemini models

[4:48] like they just literally take in this capability and this is the cool thing you can see underneath the video 531 th000 tokens um for this 30 minute video and we'll see how long it ends up actually taking but I think the long context use cases are the ones that that usually blow my mind the most yeah and I think what's really interesting to Startup Builders here is once you get this data I could see for example creating you know a directory uh you know this is you know we've talked about on on uh on the podcast around the opportunities in creating online directories I'll I'll link a couple old episodes about that and how to do it but there's so much data trapped in this

[5:30] media that you can go extract using some of these prompts yeah and I I think it would also just be like really hard to do some of this uh like it's like a non-trivial amount of like scaffolding work that you would have to do but like this is a great example and you know somebody will have to we're not going to watch the 30 minute uh movie of the video of the natural H Museum somebody should go and validate that all these things really exist and the model's not hallucinating but um the model is really good at at being able to pull some of this context out of um out of a bunch

[6:01] of these different videos and images Etc it's audio as well like really long audio could be something where like podcast platforms uh you can extract a lot of intelligence out of things like that quick break in the Pod to tell you a little bit about startup Empire so startup Empire is my private membership where it's a bunch of people like me like you who want to build out their startup ideas now they're looking for content to help accelerate that they're looking for potential co-founders they're looking for uh tutorials from people like me to come in and tell them how do you do email marketing how do you build an audience how do you go viral on Twitter all these different

[6:46] things that's exactly what startup Empire is and it's for people who want to start a startup but are looking for ideas or it's for people who have a startup but just they're not seeing the traction uh that they need so you can check out the link to Startup empire.co in the description one uh I made this comment before about just like the you know the core thing powering the the AI Studio experience is the models and like really at the most basic level you get a view of like all the different models that you can build with and they're all Gemini models uh there's some Gemma

[7:21] which is our open source version of the models for folks who need open source models we have those available as well um but you can just go and try all the different models and find out which one is best for you and there's a bunch of different you know for folks who have built with AI before there's all these different trade-offs between different models the 2.0 flash model is a little bit more powerful it's a little bit more expensive than the flashlight model for example which has higher rate limits is a little bit uh a little bit less intelligent but can do a lot of the same core things you have the pro model which is an experimental variant today and

[7:54] like the most intelligent model we have available um and then we also have things like our reason model and the reasoning models can do this is like where the New Frontier capabilities are coming from um we have a reasoning model available for free for developers you can use it in AI Studio you can go and get an API key and use it as well um lots of cool and we can look at some like good reasoning examples uh as well if if uh if you think that'd be interesting Greg you yeah let's let's go and and you know for for folks who don't know like you know why why is a reasoning model

[8:32] even interesting yeah I think the the reality is you can get the model to like really think about different things that it wouldn't be able to do before um and what it isn't able to do before is usually uh sort of rooted in having to just like kind of give this first uh first answer that comes to the model's head and like we we can showcase a good example of this and all just make up like a bad this is probably like not the most optimized version of The Prompt but I'm going to take in a code snippet that I had in my IDE which is sending a request to the Gemini API and I'm going

[9:10] to say uh turn this code [Music] snippet into a fully fledged website plus Landing Page Plus SAS app that is called by the way just just just to be clear you can get a job at Google in a senior position leading their AI efforts even if you can't spell very well I I cannot spell very and this is I think I can spell decently well but it's just maybe I'm actually just bad at typing that might be my real that might be my real problem um so we'll we'll see how for like and again the The Prompt iteration process matters a lot just in using AI in general so we we'll see

[10:02] where this gets us but we're going to try to turn this line of code which is a basic python snippet um into a fully-fledged website landing page and a SAS app and we'll call it AI studio um and we'll go and run this and the cool thing that's happening and you sort of see this affordance in the UI which is this thoughts category so here the model is doing all of this thinking before it actually starts like generating the final output so we're showing these thoughts in the UI if you were using the API you actually wouldn't see these thoughts it's sort of abstracted behind the scenes

[10:32] but we showcase it in the UI just to sort of give you an intuition of what's happening and it talks about like again if you were to give me as someone who was formerly a software engineer the task of making a website calling it AI Studio having it giving it a landing page and a s and making it a sass app like I would probably write out something that looks like this which is like you know what are the desired outcomes what is the code that I should be using you know what are some different concepts um what does the structure look like what should the technology stack be how do I make a

[11:04] sort of optimized landing page with subheaders and feature sections and a CTA and visuals um you know what is the actual MVP for the SAS functionality it's calling out things like user authentication a dashboard different image generation tools um Etc and this goes on for like a long time it like kind of belabors the thinking process which is uh really great if folks remember um you know in in like Early Education whenever you were supposed to you know write essays you would have to like do these long like outlines and like I remember in some of my like Java programming classes like my professors would be like you have to do this like outline of what your code structure is going

[11:44] to look like and I feel like that's like kind of represented now with the thoughts um which is really cool so you can see those in the UI and then you actually go into again a bunch of like more fully fledged content and it starts to give you the code to do this um in some cases it's omitting some of the actual details which we could ask the model to follow up and and give us the actual details uh the HTML to make it happen the CSS etc etc um and the total runtime for this was 23 seconds um so a lot a lot more thought and processing compute went into actually generating

[12:23] this answer um which is awesome so I think this is sort of an early look at like what the reting models are capable of and this is this is where a lot of the value is being created today and again my prompt was probably not well optimized to get like depending on what you want like you could set this up to like really just get the code as the output um as an example or like the 10 files that you would need to make this website work you could probably get those out um and you can use this uh model for free inside of things like cursor as an example um with your if you go into AI Studio

[12:56] click get API key and then create a new key um you can actually just do this uh and yeah have a free working version of the uh the reasoning model inside of something like cursor beautiful I didn't know that yeah it's fun uh you can same thing with like all the models actually so like cursor as an example has like the bring your own API key feature you can go you know get any of the Gemini models and go power your experience in cursor which is um which is a lot of fun the second thing that I'll show is the starter app so like through this same lens of like we want AI Studio to be the

[13:32] place where we sort of show you the art of the possible we show you what you can actually do um we have these three really simple starter apps that showcase different model capabilities um I'll start with this um perhaps we'll do the spatial understanding um spatial understanding is really cool so this is a capability that is like baked into the model itself where it's like really able to deeply understand um different objects and the way in which they're sort of visually represented so we have this basic UI experience um and it's asking the prompt is asking for the position of the items that are in this picture um and in this example we're going to have it give us 2D bounding

[14:14] boxes um and I can send this prompt the model does the magic behind the scenes and then it actually dynamically overlays the uh the bounding boxes for these for these images and like this is a really great example of like um what's being unlocked with these like multimodal capabilities where you have like generic object detection where you can like have you know if you were building a website to sell furniture and you wanted to identify like hey what are the images that are in the picture of someone's room and you want to like find those those items on the internet and like how do you crop the images like really dynamically using AI in real time to then go and like do reverse image

[14:55] search or something or something like that this 2D bounding box works really well and then you can basically get the coordinates of the objects in the image uh and be able to Showcase those and and do some searches on those how much does this fire you up because you know it fires me up when I see how powerful this is to me there's like probably a thousand business ideas that you can build on top of this could you just because you know the platform more intimately than I do what's an example of applying this technology to potential business idea that someone can go and start tomorrow yeah that's a great question I I think that like um the pulling like that like Furniture

[15:40] shopping example I like a lot where it's like you have images you have images that have like a lot of like really busy content and like how do you break them up into like the right things um there's like I mean a bunch of like boring stuff but I've worked with a bunch of companies that are maybe not boring for for everyone but I worked with a bunch of companies that do like Inventory management and like this type of bounding box example like matters a lot for them so that like they can just literally like Snap pictures or have real-time video feeds to like you know how

[16:10] much of the thing is being utilized like another boring example is like uh parking garages like you can have this like realtime look at like the utilization of parking garages you can sort of do a very similar thing um there's probably a lot of like meta stuff with like satellite analysis being able to like really explicitly bound different areas uh based on certain criteria of like find me you know the corn fields and like make those you know in and if you're trying to do some like meta analyses um those are all very random examples I'm not sure how useful those are for people well I

[16:46] think it's good it gets a creative juices flowing um I think one way I think about it is there's a lot of service-based businesses that you know they agencies consulting firms that do a service a painful task for a business you don't have to have humans do that anymore you can now use technology to go and automate a lot of that stuff um and they might seem like boring businesses but you know these are businesses that could be $1 million a year five million 10 1520 million a year businesses yeah I think there's a huge and to me like the thing that gets me excited is there's

[17:27] all of the like I like the models like the model story to me is incredibly interesting but it's like the model story in service of these like new differentiated capabilities that enable you to go build this stuff and the reality is like the line between building products and like doing almost like doing like research as like even just a user like historically research has meant you had to be a scientist or something and I think the cool thing about llms is like research means like you just go like play with models and like figure out what these things can do and like those those that actually unlocks all of these like new businesses that you could go

[18:02] and build um and I think like the bounding box example is like a very shallow but like also a very real reality of like the product experiences that you could build um with something like that and I'll I'll show just a couple of U of other um examples like this is just showing the like native function calling capabilities so here we hooked up um uh AI studio and Gemini to the Google Maps API and and sort of built this like kind of like really uh thin geoguesser experience where you can like basically have the the um have the maps API like show you all different types of locations around the world and the promp here is like take me somewhere in ancient history

[18:46] and it takes you to this isolated island um and talks about it's a place of unique biodiversity with Crossroads of ancient trade routs the islands isolation yada y yada archaeological remains Etc um so there's like lots of cool interesting experiences that you can build just like connecting existing Pro like the combination of two products that like historically lived separate with function calling with AI brings this experience to life and like you get this combinatorial explosion of different like what happens if you take five random different products and you bring them all together and you put AI in the middle like that's actually like a real business all of a sudden um and the amount of work to do that is like actually pretty uh pretty small

[19:31] relative to like historical SAS product Solutions um and the cool thing about this starter apps experience is all of the code is on GitHub so you can literally just like click up in the top right hand corner and then go on to GitHub and like download and like it the endtoend product experience for some of these things is already working so you can go and use these hack on them um take them in whatever Direction you want get a free API key power the entire experience it's all on GitHub it's all free to use uh which is awesome crazy yeah what a what a time to be alive what a

[20:05] time to be alive the last thing that I'll show in AI studio is this realtime streaming um so we released the multimodal live API which is what powers this experience that we're about to look at um but it brings to life like this and we uh we were talking about this before but like this like AI co-presence of AI being able to see uh the things that you see and actually get the right context in order to help you all right so we're looking at the real time live experience right now I'm sharing my screen um we're looking inside of this real-time console and right now everything

[20:40] that I'm saying the model is actually listening to uh model can you say hi to us right now okay so it sounds like you're getting ready to do something fresh is there something that you will apply it to yes I'm sharing my screen can you see the code editor that I have open yes I can see the code code editor it looks like you have a python file open named f. py and it is using the Gemini API is that correct yes and if I was going to get this code to actually run uh what's your suggestion of what I need to change like I think there's maybe some placeholder stuff in here any ideas on what

[21:18] needs to change for this code to work okay you want to get the code working and are looking for suggestions on what to change specifically regarding possible placeholder elements have you already tried to run the code and if so what output did you get yeah that's a good suggestion I can try and run the code right now Python 3 f. py and we'll see what it says um okay it seems that when you tried to run the code you got an error message that says no such file or directory this means the file path you entered is not valid are you sure that the file name and the location

[21:53] are correct yeah I was in the wrong directory I'm running it now but I'm getting a different error okay it seems that you are now getting a different error which says AP I key not valid this error means that the API key you're using is either incorrect or missing have you made sure to correctly input the correct Gemini API key into your code yeah it looks like that's the problem I need to change this it's just some placeholder text right now okay it looks like the issue is indeed with the placeholder text for the API key so now you should input the correct API key in that place to get get the program to work properly so this is I I have a couple of reactions

[22:35] from this experience one like I think uh this is really like an early look and feel of what's possible um I think like we you know the Cadence of the conversation can be sort of rough in some contexts uh but it is it is showcasing like what the sort of raw capabilities are um we're building a bunch of like extra fine-tune controls on the API side to like let the conversation flow like for example you see the model as like very excited to jump into the conversation as one example and like maybe you'd want to instruct the model to like be a little bit less passive and like only

[23:08] jump in you know at the right time um so but like an early look at I think the future that we're going to see with the multimodal live API is really the ability for the model to uh or just like generally for models to be co-present in the experiences that you are and like you could imagine your IDE is the best experience of this like you do a single button click and instead of having like code autocomplete uh you actually have like someone pair programming there right with you like a senior developer or whatever it is in the IDE with you seeing the exact things that you

[23:40] see like understanding the whole and like you can share your entire screen you could see the browser and like literally in real time seeing the same stuff that you're seeing and I think this unlocks like a huge new array of product experiences um and specifically for people building stuff like one of the um one of the big challenges I think with with AI and just like technology software in general is like there's this really steep curve and like there's this wide distribution of like what people's capabilities are and like I imagine this for like you know my mom as an example who's like you know not you know she's not technology illiterate but like she's definitely like early

[24:19] on the technology uh sort of familiarization curve and like is not is not the best person with technology so like I imagine this is like helping her as she like Works through you know how to learn to code which she has which is really cool or like how to edit a video and an Adobe Premiere or something like that yeah for me when first of all this is like the most this is probably one of the more mindblowing AI demos I've seen as of late um I when I see this I see this is the future of work you're going to have it it makes sense that you would have this AI partner you know see what

[25:00] you're seeing and provide value and intelligence to to whatever it is you're working on at any given moment and you you're happy to sacrifice some screen sharing uh because you know if you can get your work done 1.5x 2x 3x faster of course you're going to do it yeah and I I I'm not showing it in this example but uh you can also do things and this is visible on the right hand side like we have a bunch of like native Tool uh integration so like you can set up like sort of pseudo function calls you can set up uh code execution which like actually like spins up a python virtual

[25:46] environment and like runs code for you and shows you the outputs of those things you can enable grounding which lets you like browse the internet and like actually find results so like you could imagine this coding example like this would really work work if I was getting an error um that was saying you know 400 API key not valid um I could have the model you know browse to generative language. googleapis.com and like give me you know whatever the information is that's on that page and like you can do all that without like actually leaving the bounds of the product experience that you're in um so it creates this like really unique way of like Bridging the outside world into this

[26:23] into this unified uh experience so I'm I'm super excited I agree with you this is the demo that continues to blow my mind as I as I see and play with it yeah and I know there's going to be people listening to this are gonna be like yeah but this is so limited or the voice the intonations on this on The Voice are kind of crappy and it's it's like well well okay hey you can change the voice but I think the the point of all this stuff is you know even if it's 93% there 87% there 80% there 95% there it doesn't matter when you start playing with the tools

[26:58] it it it lights off certain you know it gives your Connections in your brain that you wouldn't otherwise have thought you're like oh you know what this this I can see this working for my mom like I never thought of that use Case by the way yeah I think my uh as someone who you know shout out and credit to my mom who's learned to code as like you know like later in her life and like the amount of time that I spent like literally par programming with her like learning python learning JavaScript helping like there's so many um and like independent of my mom use case like there's

[27:33] so many people who like don't actually have someone to help them learn whatever the thing is and like that's one of the biggest like I remember for myself learning in code like yeah sometimes there was like a tutor around or something or I could go on stack Overflow and get yelled at by people on the internet but like that wasn't always the case and like there was times where it would be great when I'm late at night hacking on something to like really have someone to help me um and I think this sort of democratizes that access which is which is really cool so for folks

[28:01] who want to try this audio. Google.com it's the stream real time on the leth hand side of the nav um you can play around with the experience it's free um send us feedback we'll make it better there's voices you could change the output formats uh and we're we're sort of pushing on on trying to make this a really cool experience for people I'll include the link in the show notes that people can go and click um I'm like always I'm I'm always in the the YouTube comments so comment away say what's up Logan thanks for coming on till uh anything anything else you want to say before

[28:37] we head out yeah I think my last comment is just like this experience of you know getting you know a really hopefully a cool experience in AI studio for free um the API Keys actually by default are also free so you can get like 1.5 billion tokens uh using Gemini across a bunch of different models um for free today the entire multimodal live experience you can set this up in your API and like start prototyping that experience for free today um which is really cool so like I'm super happy like the the L the angle of all this is we want to remove the economic burden for for

[29:12] Developers for startups to start building really cool AI products um and we're doing that with AI studio and we're doing that with the API and like when you want to go and scale the production we have that path for you as well um so please yeah send us feedback uh we we'll keep making it Studio better and the API better all right I'd love to see it later dude thanks Greg [Music]

---

About this transcript
Read from YouTube's own caption track and laid out by ViewRank AI (https://viewrankai.com).
ViewRank AI finds the videos already beating a creator's own average on Instagram, TikTok and YouTube Shorts, transcribes them from the audio itself in more than 60 languages, and turns what worked into new ideas and scripts.
Free transcript tools, no account needed: https://viewrankai.com/tools
How to read any video this way: https://viewrankai.com/llms.txt