Deep Learning: Intelligence from Big Data
Sep 16, 2014
Stanford Graduate School of Business
A machine learning approach inspired by the human brain, Deep Learning is taking many industries by storm. Empowered by the latest generation of commodity computing, Deep Learning begins to derive significant value from Big Data. It has already radically improved the computer’s ability to recognize speech and identify objects in images, two fundamental hallmarks of human intelligence.
Industry giants such as Google, Facebook, and Baidu have acquired most of the dominant players in this space to improve their product offerings. At the same time, startup entrepreneurs are creating a new paradigm, Intelligence as a Service, by providing APIs that democratize access to Deep Learning algorithms.
Steve Jurvetson, Partner, DFJ Ventures
Adam Berenzweig, Co-founder and CTO, Clarifai
Naveen Rao, Co-founder and CEO, Nervana Systems
Elliot Turner, Founder and CEO, AlchemyAPI
Ilya Sutskever, Research Scientist, Google Brain
19:24 Subsystem inscrutability. Black box.
20:04 Beyond Engineering
Danny Hillis, The Pattern on the Stone: “The greatest achievement of our technology may well be the creation of tools that allow us to go beyond engineering–that allow us to create more than we can understand”
33:40 Convolutional Neural Networds
34:10 current deep learning model: recognizes 10,000 categories (classes).
average adult: 90,000 words (in English, not counting personal names)
1:09:00 we can propagate a signal with almost 0 loss. Biology can’t.
Will AI look like human intelligence? The underlying structure is different (substrate: silicon vs. neurons). With constraints, AI’s behavior will look however we want.
state of the art in reverse image search (01/01/2015):
the original (and only) source of the following image is placed low in results:
train of thought
5:14 AADD: Acquired Attention Deficit Disorder
Gerard J. Puccio, Ph.D.
Gerard is chair and professor of the International Center for Studies in Creativity at Buffalo State, a unique academic department that offers the world’s only Master of Science degree in Creativity and Change Leadership.
In the face of a fast changing and increasingly more complex world, many argue that creativity and innovation are crucial 21st century skills. Unfortunately schools and organizations seem to be ill equipped to promote this critical skill. Discover what you can do to reclaim and sustain this life skill.
Dr. Pamela Peeke is an internationally renowned physician, scientist and exper t in the fields of nutrition, metabolism, stress and fitness. Triathlete and marathoner, Dr. Peeke is nationally known as the “doc who walks the talk” inspiring through example. Dr. Peeke is the lifestyle exper t for WebMD’s 90 million members, and a regular blogger on cutting edge science in health and wellness. Presently, Dr. Peeke is Senior Science Advisor to Elements Behavioral Health, the nation’s most preeminent network of eating disorders and addiction centers. Her current research focuses on how addictive behaviors have subtly and often profoundly penetrated daily lifestyle habits.
brain plasticity: after 20 pounds your biomechanics are different yet you still have to walk gracefully
MEMORY: your ability to reconstruct the whole from a degraded fragment
Defy Impossible. Steve Ilardi is a clinical researcher with a passionate interest in improving treatment for mental illness. Steve is also the author of “The Depression Cure: The Six-Step Program to Beat Depression Without Drugs.”
Together with his research team, he has developed a novel program for clinical depression based on the premise that humans were not designed for modern life.
This treatment program – Therapeutic Lifestyle Change – has proven to be highly promising in preliminary trials, and has already been adopted by clinicians in over a dozen countries.
Steve also does statistical analysis for the NBA (most recently with the Phoenix Suns).
What is it that you actually do?
Prof. Elizabeth Stokoe takes a run on what she terms the “conversational racetrack”—the daily race to understand each other when we speak—and explains how to avoid hurdles that trip us up and cause conflict.
Elizabeth Stokoe is a British scientist. She studies conversation analysis. She is a professor at Loughborough University. She graduated from the University of Central Lancashire (Preston Poly) in 1993 with a traditional psychology degree. Then Stokoe completed three years PhD research at Nene College (Leicester University) with Dr. Eunice Fisher.
Her research included videotaping interaction in university tutorials, and conducting conversation analyses of topic production, topic management, academic identity, and the relevance of gender. She developed these and other interests while working at the Institute of Behavioural Sciences (University of Derby, 1997-2000) and University College Worcester (2000-2002).
Stokoe joined the Department of Social Sciences at Loughborough in October 2002 and was promoted to Reader (2007) and Chair (2009). She teaches on the BSc Social Psychology programme, covering modules in relationships, qualitative methods and forensic psychology.
Stokoe developed the Conversation Analytic Role-play Method (CARM), an approach based on evidence about what sorts of problems and roadblocks can occur in conversation, as well as the techniques and strategies that best resolve these problems. CARM won Loughborough University’s Social Enterprise award (2013).