> a very optimized stitching of code it previously saw. I have seen this line re... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		Siira on Oct 18, 2022 \| parent \| context \| favorite \| on: GitHub Copilot investigation > a very optimized stitching of code it previously saw. I have seen this line repeated many times, but I never saw it actually explained. A lookup table is dumb and easy to understand/interpret. Deep models are not that. They are also not a linear interpolation of … something. What exactly is the claim being made here? Yes, deep models don’t generalize too well on ood data. How does this make them a “very optimized” lookup table?

nightski on Oct 18, 2022 [–]

I mean an NN is, almost by definition, a weighted lookup table. The process to generate that table is not relevant.

Siira on Oct 18, 2022 | [–]

Not at all. That would only be true if there weren't nonlinearities between the layers.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact