If you're at all interested in actually doing deep learning, then do the course! It's by far my favorite resource for actually learning to do deep learning.
Of course it won't give you the math background, but you can abd should pick it up after.
Wait till January when they will release version 2 of this course which teaches DL with pytorch. I was one of the international fellows for that course, and it is so good you would want to do the updated one.