Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

This is why I feel really uneasy about LLM/AI stuff. It feels like cooking now requires commercial quality equipment only available to the Michelin star restaurants.

It used to be possible like showHN posts go on to become smashing success. But Dropbox like posts seem like an impossibility now.

I've been having serious mental crisis from this realization.



> It feels like cooking now requires commercial quality equipment only available to the Michelin star restaurants.

Why does AI make you feel this way? It feels the opposite to me — like meals that formerly required a master chef to make, but soon anyone can make for themselves at an acceptable level of quality with meal prep kits


A few months ago there was a post on HN about catching up to the current state of LLM dev and learning how to use it. In it there were recommendations for hardware - the lowest tier being a 3090/4090. When looking at the decision tree for even cheaper options, it basically said to find another hobby.

Not sure if that's changed but ever since seeing that line, I've been put off of that world. I still occasionally click on HN links advertising new methods which can be run on "consumer" cards and every time it's just a 3090/4090...

I don't have that much money.


For training or inference?

The p40 was on the inference side of the tree and you can get one on eBay for $200 or less.


If we're still entertaining the above analogy, a home kitchen costs more than a PC with a 3090/4090.

But when I got into software in the 90s, it was about $4000 for just a run of the mill desktop PC, which is about $8000 in today's money. And it didn't even have 3d acceleration.

In the grand scheme of things, a 3090/4090 is not expensive.


A gas camping stove is like $50. A toaster oven is another $50-100. The best reviewed chefs knife on the market for commercial kitchens is $30.

You don’t need thousands of dollars to start cooking.

I have friends in the who cook on this stuff at home all the time. We in the west have elevated our kitchens into something luxurious. Nothing wrong with that, but it’s overkill for many people.


You can get started with cooking on a gas camping stove like you can get started with AI projects on a Coral Edge TPU accelerator.


My feeling is that only big tech can now create any good apps since they all require massive compute now.

Yes writing a todo list app is now faster with copilot and stuff but thats now what i meant.


Please don't be discouraged by whatever "Big Tech" is doing.

Products that we build today represent many millions of decisions and trade-offs.

If you believe something should exist, please build it and don't worry about what anyone else is doing or saying.

I was working on an application in the early 2000's and learned that Gigantic Inc. launched something to solve the same problem. I immediately bowed out, and they immediately let that first-launched beta languish for more than 10 years with less staff than we had.

In the intervening years, another startup built a similar competitor and sold for hundreds of millions of dollars.

As another example, I eventually worked at Gigantic Inc, and the org that I was part of had been failing to deliver a useful product to the public for about 7 years, and continued to fail for many more. This was an organization with hundreds of people and many hundreds of millions of dollars of budget, and they were being absolutely clobbered by a combination of their own unbelievable incompetence and the brutality of the market around them.

One of the biggest lessons I've learned in my career, is to never assume that just because Big Tech has some budget, that they also have attention or competence.


> since they all require massive compute now.

They do? How so? I can only think of a small subset of applications that require large amounts of compute.


Interesting, I actually feel the opposite. The scale at which big tech apps have to operate leads to a lot of bad UX and more bugs due to complexity. For example you can typically get much lower latency hosting a web app at or near your home than Google can provide.


And yet, the vast majority of cooking is still done at home on relatively cheap equipment. Go build things that interest you using the tech stack you have and ignore the hype.

Try to satisfy yourself, and maybe that will lead you to a commercial kitchen with a Michelin star. I know nothing else will.


Don't fall for the apocalyptic doomsday narrative. It is in the interests /of/ the 900 lb gorillas in the space to make it seem like it requires so much investment that you may as well not bother.

But there's a thriving community on HuggingFace and Reddit showing what you can do with the lo-fi versions. In particular, the evolution of lower bit inference (and I believe training as well even) has reduced memory requirements and because of that hardware requirements considerably. There is a lot you can do with your own local gen AI model running on your personal machine.


For me it's the opposite. Taking on a personal project like this one would be incredibly frustrating, because some relatively small steps would be huge time sinks. Now with LLM's, I am much faster, I just focus on the aspects I want or that I am good at.


Same for me. I just launched my first full stack side project (I'm a mobile dev by day.) I was always technically capable of it...but using LLM's I basically was able to skip the "how do I do X in node" steps and significantly speed up the backend side of things, while I still learned a ton in the process.

Now it feels like I have these incredible capabilities to apply LLMs in novel ways. I've had a personal project (an expense tracking app) where now I can see a path to easily do things like scanning receipts accurately, automatically categorizing CSV imports, etc. They were always within the realm of possibility - but would have taken so much more time to build as a one man shop. And we are just at the tip of the iceberg right now.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: