Ironically, it was their own success that made the XUL stack die off. Mozilla’s work on making browsers better enabled developers to write ever more complex webapps, and we’ve never looked back.
A long time ago, Mozilla had a choice between making XUL an open standard or investing in HTML5 and decided very consciously to invest in HTML5, rather than fragmenting the web.