Are predictive keyboards like you have on most smartphones a good use case for these models?

It certainly would fit. My entry level phone has 6GB of RAM and more than enough computing power to run such a model as fast as I can type.

Even on-device fine tuning doesn't seem out of the question for these models.