Apple’s financing option for their hardware, at least the one in the US based on the Apple Card, does pay the 3% cashback.

You even get the full cashback amount after making just the down payment, which I found quite nice.

I’m not even sure if you can use Apple Pay Later for most Apple hardware, since the maximum loan amount seems to be $1000.