I heard somewhere it can be counterproductive to learn stick and rudder skills in sim, that sim time is better spent learning how to use instruments, automation, fly complex procedures like DME arc, etc. So maybe the fidelity of aircraft system models (vs aerodynamics) is also really important?
There's some amount of the physical feedback you get in a real plane (from resistance in flight controls to actual physical sensation of the movement) is not something you can get without a lot more sophisticated sim setup than most people will have at home and then also as you mention the model of the flight characteristics not matching the real airplane