I just spun up a AWS EC2 g6.xlarge instance to do some llm work. The GPU is NVID... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		nodesocket 7 months ago \| parent \| context \| favorite \| on: Show HN: We made our own inference engine for Appl... I just spun up a AWS EC2 g6.xlarge instance to do some llm work. The GPU is NVIDIA L4 24GB and costs $0.8048/per hour. Starting to think about switching to an Apple mac2-m2.metal instance for $0.878/ per hour. Big question is the Mac instance only has 24GB of unified memory.

khurs 7 months ago [–]

Unified memory doesn't compare to a Nvidia GPU, the latter is much better.

Just depends on what performance level you need.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact