The main issue with safari, for me at least, is extensions. I use vim-like shortcuts on chrome/firefox and I feel awfully slow without them. Safari has very few extensions, and the few that exist don't really work well.
Try Wipr, it's super simple and minimal and it works very well, but it costs $2.
If you want something free with more customization options (and open source) there's Adguard
With how good reader view is on both Safari and Firefox, I tend to rely on the ad-blocker less and simply use reader view when the page is finished rendering.