Well okay. If you really feel that being able to take a trip to a less accessible location at a few seconds notice at peak times is vitally important to you, then you're still free to own your own self-driving car.
But I think most people would much rather wait a few minutes on those occasions and save their money.
(And FWIW, I think it could be fairly quick, since you don't have to pay a self-driving car to sit around in a small town in case someone needs it.)
And self-driving taxis mean you can use them for those journeys, and rely on more efficient public transport for everything else.
> in a conveyance that doesn't smell like urine
This is not an inherent issue with public transport. I take the bus to work every day and it's never smelled of urine.