Steve Jurvetson: Deep Learning

black_boxbeyond_engineeringDeep Learning: Intelligence from Big Data
Sep 16, 2014
Stanford Graduate School of Business
vlabvideos
https://www.youtube.com/watch?v=czLI3oLDe8M

A machine learning approach inspired by the human brain, Deep Learning is taking many industries by storm. Empowered by the latest generation of commodity computing, Deep Learning begins to derive significant value from Big Data. It has already radically improved the computer’s ability to recognize speech and identify objects in images, two fundamental hallmarks of human intelligence.

Industry giants such as Google, Facebook, and Baidu have acquired most of the dominant players in this space to improve their product offerings. At the same time, startup entrepreneurs are creating a new paradigm, Intelligence as a Service, by providing APIs that democratize access to Deep Learning algorithms.

Moderator
Steve Jurvetson, Partner, DFJ Ventures

Panelists
Adam Berenzweig, Co-founder and CTO, Clarifai
Naveen Rao, Co-founder and CEO, Nervana Systems
Elliot Turner, Founder and CEO, AlchemyAPI
Ilya Sutskever, Research Scientist, Google Brain

19:24 Subsystem inscrutability. Black box.

20:04 Beyond Engineering
Danny Hillis, The Pattern on the Stone: “The greatest achievement of our technology may well be the creation of tools that allow us to go beyond engineering–that allow us to create more than we can understand”

33:40 Convolutional Neural Networds

34:10 current deep learning model: recognizes 10,000 categories (classes).
average adult: 90,000 words (in English, not counting personal names)

1:09:00 we can propagate a signal with almost 0 loss. Biology can’t.
Will AI look like human intelligence? The underlying structure is different (substrate: silicon vs. neurons). With constraints, AI’s behavior will look however we want.

==========

http://www.npr.org/sections/alltechconsidered/2014/02/20/280232074/deep-learning-teaching-computers-to-tell-things-apart

state of the art in reverse image search (01/01/2015):
the original (and only) source of the following image is placed low in results:
https://1-ps.googleusercontent.com/sxk/rMkKc5ekI1lndxMkjJEGNPjM35/www.edsurge.com/d3e7x39d4i7wbe.cloudfront.net/uploads/photo/image/1878/x1-1419622484.jpg.pagespeed.ic.z4DSB56envp7OAryUx7p.png

Train of thought

Living with ADHD in the age of information and social media
Theo Siggelakis
TEDxQuinnipiacU
https://www.youtube.com/watch?v=y0hY5TYVv_s

train of thought
5:14 AADD: Acquired Attention Deficit Disorder

related:

ADHD As A Difference In Cognition, Not A Disorder
Stephen Tonti
TEDxCMU

ADHD sucks, but not really
Salif Mahamane | TEDxUSU
December 2015

another instance:
https://franzcalvo.wordpress.com/2013/05/29/scott-mccloud-on-comics

Creativity as a Life Skill

Creativity as a Life Skill
Gerard Puccio at TEDxGramercy
Dec 23, 2012

Gerard J. Puccio, Ph.D.

Gerard is chair and professor of the International Center for Studies in Creativity at Buffalo State, a unique academic department that offers the world’s only Master of Science degree in Creativity and Change Leadership.

In the face of a fast changing and increasingly more complex world, many argue that creativity and innovation are crucial 21st century skills. Unfortunately schools and organizations seem to be ill equipped to promote this critical skill. Discover what you can do to reclaim and sustain this life skill.

conformity bias

The Real Wealth is Health

Hooked, Hacked, Hijacked: Reclaim Your Brain from Addictive Living
Dr. Pam Peeke at TEDxWallStreet
http://tedxwallstreet.com
Nov 26, 2013

Dr. Pamela Peeke is an internationally renowned physician, scientist and exper t in the fields of nutrition, metabolism, stress and fitness. Triathlete and marathoner, Dr. Peeke is nationally known as the “doc who walks the talk” inspiring through example. Dr. Peeke is the lifestyle exper t for WebMD’s 90 million members, and a regular blogger on cutting edge science in health and wellness. Presently, Dr. Peeke is Senior Science Advisor to Elements Behavioral Health, the nation’s most preeminent network of eating disorders and addiction centers. Her current research focuses on how addictive behaviors have subtly and often profoundly penetrated daily lifestyle habits.