According to OP: > Why this test? Because pelicans are hard to draw, bicycles ar... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

swed420 18 days ago | parent | context | favorite | on: The last six months in LLMs in five minutes

According to OP:

> Why this test? Because pelicans are hard to draw, bicycles are hard to draw, pelicans can’t ride bicycles... and there’s zero chance any AI lab would train a model for such a ridiculous task.

At this juncture I'm left wondering why competing AI labs wouldn't train for this now well known "test".

nijave 18 days ago [–]

Given their proclivity to scrape the entire contents of the internet, it's only a matter of time intentional or otherwise.

I've heard the same has happened with common benchmarks (they've ingested solutions into training data)

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact