Deep Learning – A Term To Know

Deep Learning is a new term that is starting to appear in the data science/machine learning news.

What is Deep Learning?

According to DeepLearning.net, the definition goes like this:

Deep Learning is a new area of Machine Learning research, which has been introduced with the objective of moving Machine Learning closer to one of its original goals: Artificial Intelligence.

Wikipedia provides the following defintion:

Deep learning is set of algorithms in machine learning that attempt to learn layered models of inputs, commonly neural networks. The layers in such models correspond to distinct levels of concepts, where higher-level concepts are defined from lower-level ones, and the same lower-level concepts can help to define many higher-level concepts.

Deep Learning is sometimes referred to as deep neural networks since much of deep learning focuses on artificial neural networks. Artificial neural networks are a technique in computer science modelled after the connections (synapses) of neurons in the brain. Artificial neural networks, sometimes just called neural nets, have been around for about 50 years, but advances in computer processing power and storage are finally allowing neural nets to improve solutions for complex problems such as speech recognition, computer vision, and Natural Language Processing (NLP).

Hopefully, this blog post provides some inspiration and useful links to help you learn more about deep learning.

How is Deep Learning being applied?

The following talk, Tera-scale Deep Learning, by Quoc V. Le of Stanford gives some indication of the size of problems to be tackled. The talk discusses work being done on a cluster of 2000 machines and more than 1,000,000,000 parameters.

Comments

6 responses to “Deep Learning – A Term To Know”

  1. airborne Avatar

    This is the longest article I’ve seen on this blog. 🙂 Keep going.

    1. Ryan Swanstrom Avatar

      Ha, yes most of the posts are not very long. Would you prefer more longer posts?

      Thanks for the comment; it made me smile.
      Ryan

      1. airborne Avatar

        🙂 Am not much of a reader. But I really like the content that you put out. Big thanks for that!

      2. Ryan Swanstrom Avatar

        You are welcome. Thanks for reading.

  2. gshguru Avatar

    Hey Ryan,

    you may like to add this video too: “O’Reilly Webcast: Deep Learning – The Biggest Data Science Breakthrough of the Decade” (http://www.youtube.com/watch?v=GrugzF0-V3I )

    1. Ryan Swanstrom Avatar

      Thank you, I will definitely take a look.

      Ryan

Leave a Reply