Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
oompydoompy74
3 months ago
|
parent
|
context
|
favorite
| on:
Quantization from the Ground Up
Remaining dependent on proprietary frontier models that you can only access via an API makes no sense whatsoever. My hope is that the future is open weight models running on local hardware.
naasking
3 months ago
[–]
Eventually, yes. ParoQuant is hopefully the future here, 4-bit weights with no real degradation from FP16:
https://github.com/z-lab/paroquant
Consider applying for YC's Fall 2026 batch!
Applications
are open till July 27.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: