It sounds like you aren’t batching efficiently if you are being bound by memory ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

supermatt on July 15, 2025 | parent | context | favorite | on: Apple's MLX adding CUDA support

It sounds like you aren’t batching efficiently if you are being bound by memory bandwidth.

zargon on July 15, 2025 [–]

That’s right, in the context of Apple silicon and Halo Strix, these use cases don’t involve much batching.

Consider applying for YC's Fall 2026 batch! Applications are open till July 27.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact