OpenAI's NEW AI Agent Builder Replaces n8n & Zapier

0:00Amir, by the end of this pod, what are we going to learn? I'm going to first talk through what OpenAI came out of yesterday with the agent builder, the chat kit, the widgets, and we're going to build a demo chatbot using the chat kit SDK on a website, and we're going to essentially have it pull data from our vector store, our multi-agent workflows, and have it answer questions. This chatbot is going to let you know whether you're actually a customer or a lead, and then get the information from you to pass it on to your sales team or answer a support ticket. So, Amir, are people

0:30going to understand how to use agent builder by the end of this? That's exactly what we're going to cover. I'm going to try my best to show them what it takes to actually build your own agent workflow using the new agent builder, how it's different from the other kind of tools out there, and how you can get started as well. Okay, let's

0:48start. [Music] Cool. All right, let's jump into it. So, the key things that came out of the dev day yesterday was agent builder, chat kit, and the widgets. And I'm going to talk through what each individual one actually is and what it means. So, typically, you know, anytime we've been wanting to build multi-agent workflows, we've had to use custom code to actually kind of create a parallel sequence or a multi-agent orchestration using code and say, "Okay, this assistant one, talk to assistant two, and then pass through

1:25data or set of instructions." What OpenAI has done with their new update is they've created a visual interface for you to actually build workflows using agents and actually create parallel agents if you wanted to or sequential like steps in an agent workflow, and have it call tools, do web search, or file all visually instead of using code. So, it's really interesting because you can essentially now pull data as context from our vector store, so it's like a storage file, and then also evaluate the responses, refine it, and then create even guardrails for safety and quality of the agent responses. The key takeaway here is that it's essentially reducing the barrier

2:03for non-technical people to get started with building multi-agent workflows. And what this all means and how it ties in together is essentially goes into chat kit and widgets. So, what chat kit is is now a new capability where it's essentially an SDK, and you can connect your um agent builder workflow into chat kit and then serve it on a front end. So, in simple terms, you know, anytime you've seen a chatbot on a website, um that's typically connected to a third-party service that is pulling data and you've kind of

2:37created these responses. In this demo today, we're going to recreate our own that's trained on our own data and has a set of instructions, and we're going to use chat kit for it. So, what we're going to do is we're going to build a workflow in the agent builder, and then we're going to take that workflow ID or that kind of template, put it into chat kit UI, set up a server, add it to our website, and then essentially have customers interact with the chatbot to get the information to learn more about our product or

3:03answer a specific support ticket. The last thing is the widgets. Widgets are essentially a new set of dynamic components that you can add into chat interfaces and conversations that can display data. So, say for example, if you have um uh uh your agent connected to a Shopify store and you're pulling through the MCP, you're pulling Shopify information, you can create a custom component that displays it to the user that says, "Oh, here's like what you ordered, um here's the you know, estimated delivery time, and here's how it was sold, and you know, you have your details." It's like a dynamic UI essentially as part of the chat

3:37interface. God bless you, Amir. Yeah. Yeah. All right, great. Let's jump into it. Okay, so, we covered all three big major updates. Obviously, Sora 2 in the API, uh GPT-5 thrown in the API, but I think what's really interesting is just the door and opportunities this opens up for a lot of people that want to start building multi-agent workflows. So, the first thing that we're going to get into is jumping into actually the OpenAI

4:02agent builder. And how it works is you have a set of nodes that you can connect. So, each node is representative of specific set of actions. So, you can collect um you can add tools. So, for example, if you want to pull relevant information or you want to add guardrails, and I'll show what that looks like and what that means, or MCPs. And you can also add logic, so you can determine how you want the agent to proceed based on logic and conditions that you set. And then you

4:28can also transform data as well. In this specific demo, what we want to do is we build want to build a build build a workflow that achieves two things. It receives a customer it receives a user input and it determines whether or not this user is an existing customer or a new lead. It classifies it, and then based on that logic, passes on to two separate agents. Agent number one is if it's a existing customer, answer the support ticket using existing knowledge-based data. So, I've actually scraped our entire knowledge base and data pertaining to our product and gave it as a vector store, so it's referencing that as context. Or agent

5:10number two, if the agent is determines and classifies this as a lead, it then um uh asks for information about the customer to then, you know, as a next step, pass it on to our you know, to our database or message us on Slack, for example, if we have a Slack MCP. And it's meant to capture that data and then play back to the customer and say, "Hey, we'll follow up for a demo, and let's book book you for a demo." So, what we've done here is essentially we have a start input here, which is input as text, which is a message that

5:42you get. Next is the classifier. This classifier agent essentially we've we've named it and we gave it a prompt. And we basically say, "Hey, you know, we want you to look at the inquiry and tell us if this is an existing customer with a support ticket or a new lead. And we want you to analyze the message and determine whether or not how you get to that conclusion." And we gave some examples as well. So, like, here's an example of what a new lead would look like, or here's an example of someone

6:08that is um an existing customer. Once Once it's done that, we have a logic in place that says, "Classify that inquiry as an existing customer with a support question or a new user" based on that data, and essentially um if once it's once it's been classified, from here, if it's an existing customer, cuz the response here is essentially um like we're saying, the response is new customer. Oh, I got my cat in front of you right here. If uh if if it's um if it's a new customer, uh pass it on to the lead agent. If it's an existing customer uh pass it on to support agent. And how

6:49it works is essentially um based on this logic here, we say if the input is an existing customer, pass it on to the customer support agent. And this customer support agent essentially it's trained on our data, and it has a set of rules that it follows and helps them troubleshoot any questions they may have. Okay, how did you How did you come up with those

7:10instructions? Um so, you can actually write the instructions yourself, but what's really cool is you can actually either use ChatGPT to say, "I want you to act as a prompt generator or a helpful assistant that can help me generate prompts. I want to achieve X. Tell me how we can get there." So, I usually most of the time use ChatGPT or just from putting so many prompts, I know how to get there. Um you can use it to give a prompt back to you. You're essentially it's very meta, you're using an agent to create agents agent prompts. And um what you can also do as well as if you

7:43ever write a simple prompt, so say for example, um you want to enhance this. So, you can say, use the enhance button here to say, "Enhance this and enhance this prompt and provide a better better uh structure format." You know, this is kind of more um like a styling change that we're making here, but if you wanted to kind of say, "I want you to enhance this to you know, respond this way or have this tone," then you can automatically do

8:09that in here as well. So, we've now essentially have capabilities to create these separate agents within the builder and connect it to different tools and settings. So, what that means is you can determine the level of reasoning. So, like for example, one agent you want it to do high-level thinking, you want your solving a very specific problem, and the other you want it to be very minimal and just execute on the task at hand. Um you can connect different tools. So, if there's specific functions, MCPs, or

8:43vector stores, you can do that as well. And you can also transform how you want the output format of the text to be. So, in this instance, for example, I can change this to say, "I want this to be in a JSON format." And I can add a schema to say, "In your response, just this is how you should respond. Do not even respond in regular text." But for now, we're just going to do regular text

9:02just cuz it's easier. And at the same time, you can also connect it to um different tools. In this case, I connect it to a vector store, which is a set of documents I've created um as context for the agent to reference. Um and then from there, if it's not existing customer and it's a new lead, I have a sales agent lead. And this sales agent lead right here, again, is helpful and knowledgeable in capturing data about this lead. It'll ask them around kind of "What's your website URL? What's your

9:36company name? What's your email? How many visits do you get per per month?" Like let's say we're building an analytics tool here. "And what are you currently using?" It'll gather that and structure the data so that next step, you can pass it on to let's say your database or a Slack notification or add

9:51it to your CRM. Any uh questions so far? No, tak- taking it all in. well I mean actually one quick question. The reason why you'd want minimal reasoning versus advanced reasoning is that just from a speed and cost perspective? Exactly. So the criteria around minimal or high reasoning is entirely dependent on the task at hand and what you want the actual agent to do. So do you want the

10:19agent to solve a very complex problem? Then you probably want high reasoning. Or do you want the agent to just execute knowing that's going to be a very simple task at hand? Because you know maybe in this instance because of the support agent I would probably maybe do medium, but if it's a sales agent it's pretty simple it's like just take the data and ask them questions like what's your company name? There's no

10:41thinking really required for that. Cool. Yeah. Cool. My cat is just wants to be in the spot. And then basically if you wanted to use as the next step just for the for this demo just as a lot of configuration I'm not going to do that, but you can actually add an MCP. So say for example if you wanted to add HubSpot and update your CRM, you can add that here, you can authenticate, add your token, and then connect that so that this agent for example can pull contacts from your HubSpot or push data as well to update

11:12your leads list in there if I wanted to. Yeah, and if you don't know what an MCP is I have a whole video with Ross Mike I'll include it in the show notes clearly explain what an MCP is, but in in layman's terms like what is it quickly? In layman's terms an MCP is essentially a new interface for LLMs to interact with with external tools. Typically web apps use APIs to pull and push data, in this instance LLMs use MCP model context protocol to actually push and pull data with an LLM. And the MCPs that are available at launch are the ones that

11:45you showed? Yeah, so right now we have kind of the existing open AI connectors that are like the official ones and then there's some third-party services as well. Hopefully over time we can get more of the official MCPs in there. Right. Intercom, customer service, Shopify e-com. Yeah. Yeah. And at the end of this I'll talk about kind of how this compares to Claude and kind of where where there's opportunities for improvement as well and and kind of how this differentiates. Okay, you'll keep

12:14it real for us at the end of it. Yeah, I'll keep it very real. I think what's really interesting here as well is you know typically when it comes to AI and workflows especially for people that are just have their like on the they're just getting started with AI adoption and they're just getting started with AI fluency. And AI fluency I think is determined around kind of do you understand how to prompt? Do you understand how to give the right amount of context? Can you take responsibility for the output and understand that you need to refine this agent constantly because I think from experience working with a lot of

12:46companies I've seen that people that have still early AI adopters or like they're still like not they're late adopters, but early in their AI fluency stage they have issues with building trust with agents with the inputs and with the outputs that they get. And what that means is if the agent gets a wrong once they immediately lose trust. And that comes down to you know understanding how to prompt, how to give the right amount of context, and knowing that you have to iterate on this and you can't get it right. Why I'm sharing this is because this agent builder has guardrails in place to help you kind

13:27of refine this process. So you can actually preview it in here if you wanted to and we'll show what a preview of that looks like, but you can also build guardrails to say okay like I want you to hide personal information if this comes through or I want you to moderate this if there's anything that harmful coming in or if someone tries to

13:42jailbreak this or if it hallucinates. Hallucination is a big big big part of this where you know as you use more context agents performance degrade over time. So you can actually implement guardrails to ensure that your input and your output is actually structured the way you want it to be. So let's run an example of what this actual workflow looks like. So we're going to click on preview and you can actually test the preview in here and say hi I'm interested in Humboltics

14:10demo. So this is just an example app that I have and the classifier is now going to determine if this is an existing user or a new lead. And then the it's reasoning is saying oh this is uh and you know this is the new lead. And it's now asking me can you first share a few details about your business? So I'll say my website is called the mirror mxc.com, company is a mirror co, email is a mirror example whatever example.com, and I'm doing about 10k

14:43monthly visits. Uh and I'm using Google Analytics for basic traffic. And what it's doing now it's it's pulling information around the vector store that we added, the files, and saying okay cool. I'm going to recommend a plan based on their needs and then also prompt them to book a demo if they wanted to. So it says okay cool we got your details based on 10k visits and interest in heat maps and funnels I recommend your our plus plan to get started with. You can also book a demo right here or get started with a free

15:16trial. And if we wanted to we can have an MCP that pushes all this data to our database or to a slack or sets a demo automatically or even just like in through here creates an account if we wanted to. That's cool. Now that we have this builder workflow built out, what's interesting is that we can actually get this incorporated into a chat UI window. You can either use chat kit which I talked about earlier which is a new interface for you to actually embed chatbots into your website or you can build your own custom agent SDK if you wanted to. So you just have to pay paste

15:50over the workflow ID and the API keys that you have and you can build yeah build the your own chatbot. So what does that actually look like? Let's just infer make sure that we have everything set up properly. We publish this. And what's really cool is we're now removing a lot of the developer dependency. What does that mean? So if for example in a setting you have a customer support team that has built this agentic workflow, they can get the chatbot installed in their site and make changes and not have to rely on engineering team to actually deploy that for them. It's all happening live on the front end. So what that

16:28actually means is say for example you have a website we've now used chat kit to integrate this on the front end. It's just a script we've installed. And now we have a fully working chatbot trained on our data and the multi-agent workflow. If I wanted to come back and change this workflow to add more agents or add more tools, we can just publish directly through it from agent builder and I don't have to go to the engineering team say hey can

16:54you deploy this for me? And the cost of running this is just the amount of tokens, right? Exactly. You hook up your open AI open AI API keys and just your servers associated with it. Cool. So we essentially now have kind of like a chatbot that can now accept leads on our website so I can just say I'm interested in a demo. I have uh Google Analytics but I want

17:25Humboltics. 10k monthly visits. And this will now determine that I'm actually a lead and respond and essentially say hey let's let's get you booked in for a demo. We got your information. Let's proceed. And you can you know the the agent builder has logs so you can track all that. Perfect. Yep. Crazy. So it's pretty interesting. You can also yeah if you wanted to have this completely as this customer support bot so that if you have issues you can just say actually you know I'm an existing customer I'm an existing customer

18:03actually or let's just start a new chat. I'm an existing customer help me add a workflow site to track. And hopefully it determines that I'm actually an existing customer and it'll give me insight on how to actually add it to how to start tracking it. There you go. So we have essentially built a fully working chatbot using context and rag to first determine if you're a new customer or a lead if you're an existing customer or a lead and then either solve your inquiry if you have an issue with the product or get information and get you set up. Um yeah. So it's fully working and what's

18:51really interesting is that you can actually customize um the the widget as well using the playground. So if you want to kind of have disclaimers or composers it's fully customizable and it's really simple to get set up with. You can just either use an embed code on your website you just have to stand up a server to get this working or you can kind of build a very custom agent fully working within your app if you have an app experience you want to have where you have a chatbot working with

19:19it. Um yeah. So any what do you think so far? I mean someone's going to ask like okay well why is this better than Intercom or a SaaS product I can go and use? Like why do I need to create this myself? I think it's a good question. So I mean so first of all there's there's two use cases here. If you want to build use this internally I think the multi-agent builder right here is still there's still a lot of value out here right? Where if you wanted to have a multi-agent orchestration and say you want to connect an MCP like Slack where

19:53it sends information. That's still like useful in a sense where you have these back-end automations with multiple agents working together to get a task done for you. Um Now, if, you know, I'd say you are a startup, mid-size company, and you want to save on costs, and you have the engineering engineering capabilities, then using these agent builders to then integrate with chat chat kit to get it on your app on your website could be a huge time-saver in the in the future or a cost-saver as well. Like, there is a learning curve and a um investment initially, but over time I think you can have a lot of time savings

20:30and cost savings as well. I also think it's a little more a little more custom. You can really really fine-tune it exactly how you want it, right? Exactly. Yeah, you have full control over it. Um you own it in a way. Like, you essentially own the workflow in the system. Um there's a lot of great tools. Like, if you're looking for something out of the box, like, you know, Lindy and Gum Loop, they're all great tools, but if you want to build something more custom for yourself, then this is this

20:55is the way to go. Cool. Anything else? Um and then yeah, I think the the you know, obviously the key the key takeaway here is, okay, like, you know, what one of the key takeaways here. Yeah. It's a visual drag-and-drop tool. It's a low barrier entry for non-technical people. I think there's still some dependency where you got to have some technical knowledge, but I think the multi-agent workflow is very interesting. You know, in common times you you see people using one chat window for like a multiple tasks, and you know, that's not the right way to do it. You

21:25want to break up tasks into subtasks. Um I do think the Claude code SDK is still capable um based on the model and the sub-agent orchestration. The only challenging thing is to get non-technical people playing with this, they can't use a CLI. Like, that scares them, you know? So, what's interesting is we've taken the capabilities of what these agent agents workflows look like, and we've built an interface on top. People that are already familiar with an A an A N or

21:51Zapier. Um You know, Claude app is very similar like in terms of the projects and MCP tools you can build in it. Same thing with like the projects in ChatGPT. Um I'm curious to see how kind of this evolves over time where we have more MCP capabilities. Right. Um just a quick note on that. So, this you you are right. Like, the CLI,

22:12the terminal, is daunting for people. And it's the equivalent I'm old enough to to remember using MS-DOS to access a computer, which was basically a terminal. And computers didn't hit, you know, mainstream adoption until there was some graphical user interface on top of it. Microsoft Windows uh or you know, Windows XP I think it was or or Windows 3.1. So, I think it's

22:38that's this moment in in AI, right? We're putting We're putting canvases on top of uh you know, sort of the hardcore technical hood. Like, the average person doesn't want to be chilling in a terminal. Exactly. Yeah, yeah, exactly. And I think, you know, as we think about the models, like, there there's so much emphasis on using LLMs and agent workflows for engineering and coding that the the knowledge workers, the non-technical people, have been kind of left behind. The experience is great for coding, but it's like but how do we cater this for non-people that actually want this kind of use case, which I think is a broader use case as well. Um so, you

23:21know, a lot of people the common questions they have is like, how do I actually get started with this? How do I get started with agent builder? So, it's available in platform.openai.com's um It's not to ChatGPT, it's in in the platform side of things. Um I would say to get started, think about the use case and what it is that you actually want to achieve here. You know, for me it was like, it'd be really cool to just have my own custom support agent so I don't have to pay $150 a month and have it do exactly what it's currently doing right now, but also be

23:51able to actually capture leads, and I own it, I control it, and I can build more, you know, um integrations afterwards. Then you work backwards. You say, okay, what does this existing workflow look like, and how do we actually build multiple agents that can play a part in this, and have them be very specialized? The next step is I think

24:08building your data context, right? Capture your data, figure out what structure your data should look like, where you want to store it, what should the context be, clean up your data, and then add it as a vector store, as a as a file for your agent to reference. And I show it in the in the agent builder how

24:22you can actually uh reference that. Then, you know, the goal is to try to use as little context as possible to get the most out of it. Context has a huge impact on performance, and it degrades it over time. And then if you need to, use multiple agent workflows like we like you saw. Classifier, then we have the sales sales lead, then we have the customer support bot. Specify the roles, and then from there determine if you need external tools and MC you know, like MCPs or web search. Um I would say Claude is definitely ahead of the game when it comes to MCPs. Um They're the

24:54ones that invented that whole process. Yeah, they invented it, right? So, there's a lot more directory and uh the directory is a lot more capable, and there's a lot more features available when it comes to MCPs in Claude. You know, OpenAI's got to step it up. They got to they got they got to They got to make it easier to to get more MCP capabilities in there cuz

25:11that's the most important thing. Um and yeah, I uh I hope I hope it was helpful in terms of just kind of what came out and how you can get started. So, uh yeah, so this is like super clear, and that's why I wanted to have you on to just break this down. Um for the average founder who's listening to this, like, where are the opportunities? Like, what should they be

25:31thinking about? So, the average founder that is uh listening to this, where are the opportunities? Two parts. I think the unrelated, but OpenAI's app capabilities that are still available in ChatGPT is huge, right? It's like, we're now seeing ChatGPT as a new distribution and new, to your point, interface layer to have it interact with your app. So, that's I would say from a growth standpoint, use

25:58apps as a distribution channel. Specifically with agent builder and the chat kit UI, get this in front of your non-technical team members. Give this to your product managers. Give this to your customer support team. Give this to your go-to-market sales team. Give them an engineer to support them with building out the MCPs and workflows and standing up a server, and see what they can create with this. Enable them to save

26:24time. And tell them to share this video and like and comment so that it spreads to the world. Yes, exactly. Amir, thanks for coming on and breaking it down so clearly. I'll include links to follow Amir uh where he shares knowledge on all all this sort of stuff in the show notes. Uh appreciate you being generous with your

26:45sauce and uh so clear in your thinking. I've been help. Later. Thank you Thank you, sir.