You'd need to spend a long time training it on something other than English... at which point it's not an LLM. I definitely agree that the LLM architecture is useful for a lot more than just language per se assuming you can appropriately tokenize your inputs.