No. More accurately: with very large heaps the default performance characteristics of the GC might be different than what you’d like it to be. For example you might get huge throughput but occasional long GC pauses.
This very much depends on the GC you're using. But yes, a full GC will take longer the more memory you have. Therefore you want to avoid full GCs like the plague.