You can put pillows on the side to make it harder for you to roll on your side or stomach while asleep. It can also help alleviate some tension in the arms if you put them on top of it.

Depending on the mattress, you might have to put a pillow under your knees. Sometimes I don't and my legs begin to feel uncomfortable, and sometimes I can sleep just fine without support for my legs.