Hacker Newsnew | past | comments | ask | show | jobs | submit | more AbsurdCensor's commentslogin

You could say that same exact thing for the entire Industrial Revolution, but that doesn't mean we are going to destroy the looms even though some tried unsuccessfully.


Ok and? We can do better this time but let’s just not so the capitalists can crush normal people yet again?


You think you would be better off if the industrial revolution were stopped in its tracks?


That’s not at all what I said…


Strix Halo for me. If I am running something on my laptop, it's a much smaller usually around 12b model, but those are a bit less functional. I mean I think there is a a ROG FLow Z that has the Strix Halo setup, but that thing was super expensive.


Strix Halo as well. Bought it for $1,800 new on sale and shoved an extra 4tb drive into it. Been amazing for local AI. Maybe not the absolute fastest thing (usually around 30t/s depending on the task) but has been awesome for a local AI box that I can solar power.


Nice. Mind sharing the solar side of your setup?


Couple of rack mount batteries and roughly 5kw of solar panels. Feeds into a subpanel so I can flip it when I want a couple rooms of solar on the house, or hook a generator up if needed. Can't power the entire house, but works well for thinks like computers, lighting, etc. And if I want to expand, just throw on more panels, or realistically, just throw on more batteries to store the juice.


Thanks - that’s what I want to do!


Depends on how you are doing it. LM Studio and tool calling models can use the web, or you could go for something like Perplexica, or if you want to go real crazy, something like Hermes or OpenClaw.


Takes even less depending on your system. LM Studio or Lemonade and you are set up in minutes and now they can even tell you what models will fit with the memory you have.


And it would be in seconds if models weren’t that large and slow-ish to download! LM studio is such a noob friendly experience, pretty neat first experience!


At least for the most part, if you are downloading from huggingface, you should be able to saturate your connection. I know I usually can pretty easily even with a 5gig connection at home.


Hmm, let’s not talk about my German poor internet connection please :)


You don't need a 5090 to run local AI. A whole lot of people out there are doing it with Macs. Unified ram is the biggest thing.


Maybe not '0 investment and 0 commitment', but incredibly little depending on what you have laying around. It takes less than 5 minutes to download say LM Studio and an Open Model and as long as you have the hardware to support it, you start moving along. If you are on AMD in some ways it's even 'easier', you can download Lemonade and it will tell you exactly what will fit and best options based on what you are trying to do.

For me at least the local AI stuff, powered with solar has been pretty great. Would that scale to a large business? Goodness no, but for my tinkering and learning, it works great.


Not OP, but I use it for a ton of smaller things. I have it hooked into Hermes and have been using it to help bulk rename my media folders so they all follow a common format, add titles that sort of thing which wouldn't be easy to 'script'. Another thing I use it for is comparing data sets, looking at my exported Spotify artists and compare to what I have locally, and letting me know where there are missing artists, or albums, and recommendations based on similar artists that I may not have locally.

Sure a lot of this could be done without AI, but it's certainly quicker and easier, and since my AI box is on solar, it's just the power of the sun to keep it going.


Yeah, seems like the problem is alcohol + caffeine, and at least in the US, those combinations in a single drink have been banned (ie Four Loko)


Glad to know you uncritically will sign up for the moral panic of the times.


Nah, no moral panic here. I don't see the reason to combine stimulants with depressants, you then just mask the underlying issues with both. Hence often the regulation of the combination.


So do you want to outlaw espresso martinis? Or rum and cokes?


Sure. Realistically you simply regulate them. Espresso martinis are already long a popular 'after dinner' cocktail with the assumption that you'll be buzzed from the caffeine and able to drive better.


Meh, some people’s politics have very little to do with humanity and how society should be. In general, best approach is to avoid GRAPE topics in general.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: