Personally, it took me a long time to realize that time was not wasted. Mostly because it doesn't feel directly productive.

Also, having your mind actively on and turning over a problem defeats the purpose of letting your mind wander freely in search of serendipitous solutions. Having it actively "on" is the same as keeping busy.