Deep Learning: Intelligence from Big Data
Sep 16, 2014
Stanford Graduate School of Business
A machine learning approach inspired by the human brain, Deep Learning is taking many industries by storm. Empowered by the latest generation of commodity computing, Deep Learning begins to derive significant value from Big Data. It has already radically improved the computer’s ability to recognize speech and identify objects in images, two fundamental hallmarks of human intelligence.
Industry giants such as Google, Facebook, and Baidu have acquired most of the dominant players in this space to improve their product offerings. At the same time, startup entrepreneurs are creating a new paradigm, Intelligence as a Service, by providing APIs that democratize access to Deep Learning algorithms.
Steve Jurvetson, Partner, DFJ Ventures
Adam Berenzweig, Co-founder and CTO, Clarifai
Naveen Rao, Co-founder and CEO, Nervana Systems
Elliot Turner, Founder and CEO, AlchemyAPI
Ilya Sutskever, Research Scientist, Google Brain
19:24 Subsystem inscrutability. Black box.
20:04 Beyond Engineering
Danny Hillis, The Pattern on the Stone: “The greatest achievement of our technology may well be the creation of tools that allow us to go beyond engineering–that allow us to create more than we can understand”
33:40 Convolutional Neural Networds
34:10 current deep learning model: recognizes 10,000 categories (classes).
average adult: 90,000 words (in English, not counting personal names)
1:09:00 we can propagate a signal with almost 0 loss. Biology can’t.
Will AI look like human intelligence? The underlying structure is different (substrate: silicon vs. neurons). With constraints, AI’s behavior will look however we want.
state of the art in reverse image search (01/01/2015):
the original (and only) source of the following image is placed low in results: