Creative Commons 3

Creative Commons 3
David Hemmings
public domain
public domain
neuron
neural network
neural network
neural network
Purkinje cells
granule cells
cerebellum
Santiago Ramón y Cajal

Public domain
axon

soma

dendrites
axon

soma

dendrites
+
+
+
synapse
.5 .8 .3 .2 .9
.5 .8 .3 .2 .9
 am
pm pm

am pm
 am
pm pm

am pm
 am
pm pm

1 0 0 1 0 1 1 0

am pm
 am am
pm pm

.3 .8 .9 .9 .6 .2 .1 .4

am pm
 am am
pm pm

.3 .8 .9 .9 .6 .2 .1 .4

pm am pm
 (.3+.1)/2=.2 am
am
pm pm

.3 .8 .9 .9 .6 .2 .1 .4

pm pm
 am am (.8+.4)/2=.6
.2
pm pm

.3 .8 .9 .9 .6 .2 .1 .4

pm pm
 am am .6
.2
pm pm
Error=1-.6
=.4

.3 .8 .9 .9 .6 .2 .1 .4

pm pm
 am am .6
.2
pm pm
Error=.4

.3 .8 .9 .9 .6 .2 .1 .4

pm pm
error weight
error weight
 am am .6
.2
pm pm

adjustment = error * gradient * delta

.3 .8 .9 .9 .6 .2 .1 .4

pm pm
 am am .6
.2
pm pm

adjustment = error * gradient * delta

.3 .9 .9 .9 .6 .2 .1 .4

pm pm
 am am .6
.2
pm pm

adjustment = error * gradient * delta

.3 .9 .9 .8 .6 .2 .1 .4

pm pm
 am am .6
.2
pm pm

adjustment = error * gradient * delta

.3 .9 .9 .8 .6 .1 .1 .4

pm pm
 am am .6
.2
pm pm

adjustment = error * gradient * delta

.3 .9 .9 .8 .6 .1 .1 .5

pm pm
 am am(.9 + .5)/2=.7
.2
pm pm

adjustment = error * gradient * delta

.3 .9 .9 .8 .6 .1 .1 .5

pm pm
 am am .7
.2
pm pm
error=1-.7
=.3

.3 .9 .9 .8 .6 .1 .1 .5

pm pm
 am am
pm pm

.2 .9 1 .8 .7 .1 0 .5
am
pm am pm pm
 am am
pm pm

.1 .9 1 .8 .8 .1 0 .5
am
pm am pm pm
 am am
pm pm

.1 1 1 .8 .8 .0 0 .6

am pm pm
pm
 am am
pm pm

.1 1 1 .7 .8 0 0 .7

am pm pm
pm
 am am
pm pm

.1 1 1 .6 .8 0 0 .8

am pm pm
pm
 am am
pm pm

0 1 1 0 1 0 0 1

am pm pm
Convolutional Deep Belief Networks for Scalable
Unsupervised Learning of Hierarchical Representations
Honglak Lee, Roger Grosse, Rajesh Ranganath,
Andrew Y. Ng
Understanding Neural Networks
Through Deep Visualization.
Jason Yosinski, Jeff Clune, Anh Nguyen,
Thomas Fuchs, Hod Lipson
Recommending Music on Spotify with Deep Learning.
Sander Dieleman
Playing Atari with Deep Reinforcement Learning.
Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Alex Graves,
Ioannis Antonoglou, Daan Wierstra, Martin Riedmiller
Robot Learning ManipulationAction Plans by “Watching” Unconstrained Videos from
the World Wide Web.
Yezhou Yang, Cornelia Fermuller, Yiannis Aloimonos
brohrer@microsoft.com

Also, check out the writings of

Christopher Olah