Yeah pretty much just that:

    rm @{g *.bak}

`g` returns a JSON array of file names and the @{} tells the shell to expand the array into parameters.

This way you don't need to worry about spaces in file names or other problems with escaping.