How to Run Local AI on ANY Computer (in 1 click)

0:00Local AI allows you to get unlimited free AI usage with no guardrails all on your home computer. But what people don't realize is it has never been easier or cheaper to get into. You can now load local AI models even on like the lowest end Mac Mini in just one click. I have found a new way for anyone, even if you're really untechnical with really bad computers, to load up local AI models. It is the future and if you haven't gone into it

0:28yet, you need to watch this video now. In this video, I'm going to cover why you need to get into local AI models no matter which computer you have, how to set it up super easy in just a couple clicks, and when you should be using cloud models versus local models. Whether you're a local model beginner or expert, you're going to learn so much in this video. Let's lock in and get into it. By the way, before we get into all the fun stuff, here is a local model Qwen 3 8 27B running completely locally, free, off-the-grid, no internet, researching stocks for me around 24/7, watching prices, recommending stocks to

1:03buy. This is all happening real time completely for free. I'm going to show you how to do all this in a second. So, local AI is absolutely blowing up right now. If you haven't gone into it yet, you're going to be an expert by the end of this. The main thing I'm going to focus on in this is this new feature inside Hermes Agent, which is a completely free open-source tool anyone can use that makes it like one click to download and load local models no matter

1:27what computer you're on, even Mac Minis. But real quick, and feel free to jump around down below if you're already an expert, jump to that section if you want, but I'm going to quickly go over why it's so important to get into local AI right now. Number one, it might be banned soon. Like, this is like the talk of the town in AI at the moment, which is how all the CEOs of AI companies are coming together and they're like pushing to slow down local AI pushes on on all AI because they are really scared that

1:53local models are catching up to them. Why are they scared of local AI? Well, if everyone has free AI models running on their computer unlimited, why would they pay for cloud models? There is still reason to pay for cloud models, and I'll go over that a little bit later, too. But, a lot of people are pushing to ban local AI, and so it's super important you get into it now so that if it gets banned, you're good to

2:14go. They can't take it away from you. Local AI models are actually like really good now. They're like Opus 48 quality, which is really high quality. You can run high quality Opus 48 on your local computers now unlimited for free. They're really good. As I said a billion times, it's unlimited and free. A lot of

2:31people complain about the price of AI. Well, is free a better price? I think so. It's unlimited and free. There's no guardrails. There's a lot of models out there that are like completely unhinged. You can ask it to do whatever you want, whatever you need, you can find those, and I'll show you that, too.

2:46Sovereignty. This is super important. It's just sovereignty, right? You have models and intelligence working on your computer, on your desk that no one can take away from you, that no one can control. You control it yourself. You do whatever you want with it. You're free from the grid. You're free from the shackles that bind you. You're sovereign, and that's a really cool feeling. And just overall, it's the future. I believe the future is local AI. I believe everyone will have their own local models running on their desk they control, that they determine how it works, how it thinks, what it does for you. And so, I think it's important to

3:21prepare for that future now. Which computers do you need? Well, as I said at the beginning of the video, you can use any computer for this. Even if you have like a 16 GB Mac Mini, whatever you have, we can find a local model for it very, very easily. Again, we'll show you that in a second. But just from a high level to set expectations on what kind of performance you're going to get, if you just have like kind of a general computer, like a cheap old computer, you'll get lower intelligence at a lower speed. I think it's still worth setting up, so stick with me here. But, you got

3:50to set your expectations. You're not going to get GPT-6 Astra level intelligence on like a really old 10-year-old Lenovo computer, right? If you have an AI computer like a DGX Spark, you'll get decent speeds and decent intelligence. A lot of what I'm going to show you here is off of a DGX Spark. You're going to get good performance out of it. Then you have like the good Nvidia chips like the you know, the RTX 4090s, the 5090s. Well, they have lower VRAM. It's not going to be able to support like super big intelligence. You'll get ridiculously good speeds, which are really really amazing. And then the Mac Studios. Mac's

4:22strength is it has like tons of room on it, tons of RAM. So, you'll be able to load really smart models. You'll just get a little bit lower speeds cuz Apple's hardware at the moment is just not as fast as like the Nvidia chips. But the point I want to make here is you can use any computer you have to run local intelligence. And even if you have a crap computer, you should load it. You should get into it. You should learn it so that as these models get more efficient, you can upgrade and use better intelligence and know how to use those models. It's important for

4:53everyone to be getting into this. So, next I want to show you how to actually set this up, this new feature I found in Hermes Agent that makes it super easy, so super free, super simple to set up. We're going to go through that now. After that, we're going to go through use cases, so what use cases you want to do with local models. And then we'll wrap with local versus cloud, when you should be using like ChatGPT and Tropic and when you should be using your local models. So, this is Hermes Agent. If you haven't got it set up yet, it's completely free. It's completely open

5:22source. I'm not sponsored by them. It is just a great free open source tool. It is an AI agent that does work for you. And what they now included in one of their latest updates is like the easiest way to set up local AI ever, no matter which computer you want. So, you get installed, get the desktop app. This is the desktop app. It is great. Here's what you need to do once you have this set up. And by the way, I have like tons

5:45of Hermes set up videos in my catalog. So, feel free to look and look at my Hermes setup videos if you'd like. But once you're in, go to settings up here, then we're going to go over here to providers. Once you're in providers, click run models locally. This is like the sneaky most underrated feature of all time of Hermes agent. You click this, and what it's going to do, you're probably not going to get the screen you see here. It's going to give you a name of a model. What Hermes is doing is looking at your computer, looking at your hardware, and determining what the

6:14best local model is for your hardware. For me, I'm on a Mac Studio right now. It recommended Qwen 38 Flash Next. This is an excellent, excellent model. It is very smart, it's very fast, it's very efficient. And then all you need to do is there'll be a button next to that that says like download and load. It's one button, I think it's blue. You click it, and what will happen is Hermes agent will download the model, load it onto your computer, and attach it to an AI agent for you. So as you can see here, here's my Hermes agent, and in it is loaded Qwen 38 Flash Next. Whatever

6:47model you had selected there and you click download and load, that should now be in your drop down right here, which is the model that's powering this bot for you. And by the way, I'm in bot mode. I like to use it in bot mode. So just if you if your view looks different than this, just click bots up here. I

7:02like this view a little bit better. That's it. One click, you have the model loaded, you have it connected to your bot. Now you have unlimited free intelligence on your computer. But what should you be doing with this local model? You have it loaded, what should you be doing with it? How do you get the most value out of it? And when should you be using cloud models instead? My favorite thing to do with local models is constant research, right? That's the advantage of local models is you get unlimited usage of it, so you want to do high volume activities. For me, I'm big into investing. I like investing in AI

7:37companies. I have it constantly doing research into AI companies, what their latest news is, what gives them motes. I want to invest in AI companies with motes. And so, I have my Hermes agent using the local model constantly doing research for me. For you, if you're super into the news, you can have it checking the news constantly, updating you the moment something breaks. If you're into vibe coding, you can have it checking code you write all the time, right? So, maybe you vibe code with another tool, and then you have your local model checking the code, looking for issues, things like that. You also want to use it for quick, easy tasks,

8:11right? You don't want the highest intelligence task going to your local model. You want like the quick, easy, efficient task. Hermes agent is great at controlling your computer. So, doing things like moving files around, sometimes when I'm on the go, I like text my Hermes agent that has the local model, like, "Hey, can you email me or send me this file?" Quick, simple things like that, it's fantastic at. I was on the go yesterday and the World of Warcraft Forever beta just dropped. I texted my local model Hermes agent. I said, "Hey, can you download World of Warcraft Forever beta so I can play it when I get home?" It downloaded it. I

8:44got home. I was good to go. Simple tasks like that, it is really, really good at. By the way, if you learned anything so far, if this has been helpful so far, leave a like down below. Subscribe, turn on notifications, cuz all I do is make super helpful, amazing videos about this technology that I love, AI. And let me know down in the replies, are you newer to local AI models or are you an expert and you're just looking for different ways to install them? Let me know your kind of expert level on local models down below. Also, I have the number one free AI newsletter on planet Earth. Link

9:13for that down below as well. Sign up for that, you will love it. So, the best use cases are high volume, low intelligence use cases that your local models can just churn through over and over and over again all day, like doing research and like doing simple things on your computer, moving things around, sending things to people, setting things up, installing, downloading, whatever you need, it can do that. Checking email, looking at your email, letting you you when you get important emails, that is absolutely great for local models. So, when should you be using cloud models instead? When should you be using chat GPT, Claude, all those? There's still

9:45room for those models. You still want to be using those models. That is the frontier. That is the most cutting-edge intelligence. And there's a lot of use cases where you do need cutting-edge intelligence. For instance, vibe coding. If I'm building something that needs to be cutting-edge, right? If I'm building like a really cutting-edge video game or building a complex app, you want to use cutting-edge intelligence for that. And while you certainly can use your local model, right? It's Opus 48 level a lot of these models. And Opus 48 was great at vibe coding. You can do that. But a lot of time, I just want the

10:17cutting-edge intelligence for vibe coding so I can have an edge over my competition. So, if you're looking to save money, you certainly can do it. I just personally look for the frontier models, the cloud models for vibe coding, for building cutting-edge apps. For more advanced knowledge work stuff, for things I would use like chat GPT work or Claude co-work for, I'm still leaning on those. Like mult- complex multi-step knowledge work, I don't know if I want to use the local AI models just yet. I still want to learn lean on the cloud models for that. But this is something everyone should be doing. And Hermes agent made it like super super

10:50simple to get this set up as I just showed you. One click, it downloads the best model for your computer, loads it up, gets it going, which is really amazing. It's Friday when I'm posting this. You have a whole weekend ahead of you to kind of experiment and tinker. I promise It's like these types of things where it's just so much fun. It's so much fun looking down at your desk, seeing a computer, and knowing

11:11intelligence is running on it locally. No internet needed, nothing. You can unplug it and it still works. Have fun with it, right? This is one of those things where it's fun even if for you personally you don't have a ton of use cases around it. Like it's still just fun and you should be having fun with

11:25technology. You should be enjoying it. Not everything has to be like an ROI equation. That's the number one question. Oh, but what's the ROI of me buying a Mac Studio or buying this? Like I might When am I going to get the return on? Not everything is an exercise around ROI. Not everything is an accounting spreadsheet. Sometimes you're allowed to just have fun, believe it or not. Sometimes you're allowed to do things for like the joy of it. Not everything has to be Um what's the exact ROI calculation I'm getting from buying this Mac mini? Shut up. Have fun. Enjoy it. I promise you this is the type

11:56activity you will get immense amounts of joy out of. It just is awesome like having your own personal AI agent powered by local intelligence. It's just fun. I hope this was helpful. Thanks for watching. I truly appreciate it. See you in the next video.