I use PocketPal. Can run any gguf model off hf. | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		lemonish97 5 months ago \| parent \| context \| favorite \| on: Gemma 3 270M: Compact model for hyper-efficient AI I use PocketPal. Can run any gguf model off hf.

rshemet 5 months ago [–]

you can also run it on Cactus - either in Cactus Chat from the App/Play Store or by using the Cactus framework to integrate it into your own app

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact