My joke was more along the lines of entropy. Entropy is information and you can'... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		oblio on Dec 17, 2024 \| parent \| context \| favorite \| on: New LLM optimization technique slashes memory cost... My joke was more along the lines of entropy. Entropy is information and you can't throw away all of it, otherwise you have nothing useful left.

vlovich123 on Dec 17, 2024 | [–]

Modern LLMs are still quite inefficient in their representation of information. We're at like the DEFLATE era and we've still yet to invent zstd where there's only marginal incremental gains; so right now there's a lot of waste to prune away.

lxgr on Dec 17, 2024 | [–]

Hence the idea to only throw away almost all of it.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact