Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Not sure, I haven't run it, I've just been running DS V4 Flash non-stop since it came out, and that's replaced a lot of my Claude Code usage. People seem very impressed, though, it seems like it trades vram/world knowledge for extra thinking time, which I think is a good trade for local. tbf, I've heard luna's not great at coding. Fast and good for things like classifiers, summarization, though.

A friend and I were actually discussing today how benches show Luna Max at about par on coding with Sol Medium, but how it's nowhere near in reality. We were speculating that maybe it's because a lot of benches are best-of-n, and should probably be worst-of-n, because variance in performance is killer with large coding projects. Consistency is what lets you actually build on this stuff.

 help



> We were speculating that maybe it's because a lot of benches are best-of-n, and should probably be worst-of-n.

Thank you. I just changed my opinion on this thanks to you. I agree now, since we tend to execute LLM tasks once instead of N times anyway.

I suspect models like Fable executes the same task N times in parallel and picks best answer or merges them to for a better answer.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: