Everytime I look at S3/Glue/Athena I can’t help but feeling like the Glue layer ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		hipadev23 on Aug 11, 2024 \| parent \| context \| favorite \| on: Building data infrastructure that will last Everytime I look at S3/Glue/Athena I can’t help but feeling like the Glue layer shouldn’t be necessary and it’s instead just part of athena’s ddl

ianburrell on Aug 11, 2024 | [–]

Athena is query engine and can use multiple catalogs. It forwards DDL queries to the catalog. Glue is the default catalog.

mulmen on Aug 13, 2024 | [–]

Glue catalogs can be used by other query engines as well. Separating schema from compute is the foundational concept behind a data lake.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact