Yoshua Bengio, Ian Goodfellow and Aaron Courville are writing a deep learning book for MIT Press. The book is not yet complete, but the drafts of the chapters are all available online. The authors are also collecting comments about the chapters before the book goes to press.

The book is broken into 3 sections:

1. Math and Machine Learning Fundamentals
2. Modern Deep Neural Networks
3. Current Research in Deep Learning

The book is very technical and probably suitable for a graduate level course. However, if you have the time and interest, resources such as this are highly valuable.