Hacker Newsnew | past | comments | ask | show | jobs | submit | twampss's commentslogin

Is this just llmfit but a web version of it?

https://github.com/AlexsJones/llmfit


Yes. But llmfit is far more useful as it detects your system resources.

I feel like they both solve different issues well:

- If you already HAVE a computer and are looking for models: LLMFit

- If you are looking to BUY a computer/hardware, and want to compare/contrast for local LLM usage: This

You cannot exactly run LLMFit on hardware you don't have.


Yes, but you can get LLMFit to recommend hardware requirements with `llmfit plan --context <TOKENS> <MODEL>`.

Honestly I was surprised about this. It accurately got my GPU and specs without asking for any permissions. I didnt realize I was exposing this info.

Why were you surprised?

You can check out here how it does that: https://github.com/AlexsJones/llmfit/blob/main/llmfit-core/s...

To detect NVIDIA GPUs, for example: https://github.com/AlexsJones/llmfit/blob/main/llmfit-core/s...

In this case it just runs the command "nvidia-smi".

Note: llmfit is not web-based.


I run LibreWolf, which is configured to ask me before a site can use WebGL, which is commonly used for fingerprinting. I got the popup on this site, so I assume that's how they're doing it.

How could it not? That information is always available to userspace.

"Available to userspace" is a much different thing than "available to every website that wants it, even in private mode".

I too was a little surprised by this. My browser (Vivladi) makes a big deal about how privacy-conscious they are, but apparently browser fingerprinting is not on their radar.


We switched to talking about llmfit in this subthread, it runs as native code.

It's pretty hard to avoid GPU fingerprinting if you have webgl/webgpu enabled

Do you mean the OPs website? Mine's way off.

> Estimates based on browser APIs. Actual specs may vary


That's super handy, thanks for sharing the link. Way more useful than the web site this post is about, to be honest.

It looks like I can run more local LLMs than I thought, I'll have to give some of those a try. I have decent memory (96GB) but my M2 Max MBP is a few years old now and I figured it would be getting inadequate for the latest models. But llmfit thinks it's a really good fit for the vast majority of them. Interesting!


Your hardware can run a good range of local models, but keep an eye on quantization since 4-bit models trade off some accuracy, especially with longer context or tougher tasks. Thermal throttling is also an issue, since even Apple silicon can slow down when all cores are pushed for a while, so sustained performance might not match benchmark numbers.

For anyone looking for a video/demo on this, here's a great presentation by Tim Berglund - https://www.youtube.com/watch?v=MYP56QJpDr4


I'm already a fan because of @ericflo.


[Disclosure - I work at YesGraph] What are some lessons learned from Tipjoy (YC W08) that you're applying here or doing differently with running YesGraph?


I got into growth because my first startup didn't grow. I became obsessed. So there is that.

Overall the core advice is the same. I just listen to it and apply it better. This post gets it right: http://blog.samaltman.com/startup-advice-briefly

I also find myself giving this advice to others, including YC batchmates. The hard part is being diligent in applying it.

The first TechCrunch launch for Tipjoy was when we turned the product on. And were were traveling, so we were fixing bugs in the airport. Don't couple your press launch with your product launch, kids

So, yeah, not making that mistake this time :)


+1 and well said. When I had legal issues with a client irrationally withholding payment, my lawyer suggested to wait four days to respond. Seems like an eternity, especially considering it's double from what you tend to follow (48 hours), it's amazing how much more reasonable your response can be juxtaposed to responding immediately.


So did I, it's from here - http://thingsthatarebrown.com/blog/2009/05/sample-resume-tem...

All modesty aside, he should mention where he got the template from.


Very good point, I think the footer got lost in some git stash. I've re-added it now.


And since this IS a technical community, here's some other points of interest:

- Built with Django, jQuery, and Git (hosted on CodebaseHQ)

- MySQL

- Served up by Apache on Ubuntu Karmic

- Hosted on AWS

- Fabric for deployment



Check out Startups Hiring: http://www.startupshiring.com/


Thanks for posting a link. I just added a number of startups from this thread to my company list and will continue to expand coverage.


Did you do this for your first client? If so, how did it all go?

I did something similar - I offered to build the foundation of their website (a social networking site) for free as a trial. It only took a few nights and they liked what they saw. Shortly after, we negotiated and agreed upon a rate to continue development.


My story went like this:

I left development to start consulting, and in the beginning I still had no idea of a competitive but profitable price stack. However I was very business minded, a week prior to leaving my field I just finished reading Dale Carnegie's book "How to Win Friends and Influence People".

Before I go further, let's stop and take a pause: this is a book that everyone needs to read, especially freelancers. I say especially these individuals because your livelihood is predicated not on a parent company managing image and taking a considerable chunk of the impact if you mess up. That being said, it is vital that freelancers read this book page for page, front and back to get a firm grasp of how to interact with people beyond "Do you need a website? Here's your website. Here's an invoice, alright have a good one". I read this book four times, and I'm reading it once more because in addition to being incredibly insightful: Dale Carnegie has a very conversational way of writing that makes this book an absolute joy to read.

Alright, ready for part two?

I had no idea of a profitable price stack, but after reading this book I had a good idea of how to approach people, propose ideas, listen to their needs and collaborate on a service that I could provide them. Still, I was stuck on what to charge. An idea came into my head, an old one that I'm sure is all over the web, debated from both sides, but an idea none the less. And this is what I told my first client:

"Before I quote you on this project that we're working on, I want to know what you think of the idea of free".

He was hooked, I had his attention. Free is an incredibly powerful word provided your ulterior motive is just. We worked together for three weeks as I helped him build his business, and as the time grew near for my involvement to end I gave him another incentive.

I offered him 5% on the next sale if he recommended a client that signed a contract to procure my services. By this point, I figured out that working on a retainer after concluding a 'sale' and ending a contract with a very happy client would be easier to secure than a rate structure that was predicated on the idea that I might end up having to bill more hours than was anticipated. The caveat was that he give no indication to whoever he would refer to me that he got free services, that was up to his discretion. I did not give him a line, a pitch or any sort of script. He ended up with $375 in his pocket, and a new customer.

He ended up becoming my personal accountant.


Wow, your first client experience sounds ideal! Not only did he end up as your personal accountant, but you had him working for YOU as he looked for potential clients. That's a great use of resources and definitely sounds like it was worth your time investment for those few weeks.

Thanks for sharing and for the Dale Carnegie recommendation!


I'm actually looking to start out like this myself, and I found a small, poorly organized nonprofit that has a less than stellar website. They're dying to make a change, but they don't really want to put the time into it.

I suspect there are lots of nonprofits like this. Or smaller nonprofits that simply don't have websites. Soup kitchens and stuff might not be into the 21st century.


I'm actually looking to start out like this myself, and I found a small, poorly organized nonprofit that has a less than stellar website. They're dying to make a change, but they don't really want to put the time into it.

I suspect there are lots of nonprofits like this.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: