True, a french press tends to leave sediment at the bottom of your mug. Easily solved by leaving the last tiny sip behind.

What do you mean by clean in this context?

Filters remove sediment and oils, which gives the coffee a 'clean' mouth feel. A little hard to describe, but easy to observe if you make a french press and a v60/aeropress using the same beans and grind and compare.