Yes, this is common, due to lack of use. Though you should notice that you have much less trouble reading and listening than writing and speaking.

I immigrated right around the "easy"-language-acquisition barrier age and frustratingly can't speak either of my languages fully right - one because of leftover accent, one because of out-of-use vocab and grammar atrophy.