> you can qite easily lose track of which direction is the prow

If you don't where the prow is, how do you know where starboard is? I guess if the sailing direction is backwards, it might be confusing if you say "to your left", but if you say "left side", it should still be clear I think, maybe not.