doc20160224 Computer Vision Meetup Deep Learning 2
download 
Plainte Transcription
20160224 Computer Vision Meetup Deep Learning 2
Deep Learning – Part II René Donner Visual Computing – Data Analysis – Consulting [email protected] Overview Deep Learning recap How to classify images Convolutional Neural Networks (CNNs) Classifying MNIST with CNNs René Donner 2 Deep Learning Image recognition Google Research Blog René Donner 3 Deep Learning Scene labeling http://www.purdue.edu/newsroom/releases/2014/Q1/smartphone-to-become-smarter-with-deep-learning-innovation.html René Donner 4 Deep Learning Text recognition http://www.pyimagesearch.com/2014/09/22/ getting-started-deep-learning-python/ Large-Scale Deep Learning for Intelligent Computer Systems, Jeff Dean, Google, BayLearn 2015 René Donner 5 Deep Learning How does it work? Deep learning http://theanalyticsstore.ie/deep-learning/ René Donner 7 Deep Learning Visualization 1. Layer higher Layers Emergence of Object-Selective Features in Unsupervised Feature Learning, Adam Coates, NIPS 2012 René Donner 8 Deep Learning Deep learning How does it work? http://theanalyticsstore.ie/deep-learning/ René Donner http://stats.stackexchange.com/questions/114385/ what-is-the-difference-between-convolutional-neural-networks-restricted-boltzma 9 Deep Learning Getting started with DL Frameworks Caffe http://caffe.berkeleyvision.org/ Plain text files Fastest CNN, GPU Keras Slide from caffe tutorial https://github.com/fchollet/keras Python, on top of Theano TensorFlow http://tensorflow.org/ Python, by Google MXNet https://github.com/dmlc/mxnet Python, R, Julia René Donner 11 Deep Learning Tensorflow General optimization framework C++ / Python CPU / GPU / (Multi-GPU) Construct / Execution René Donner 12 Deep Learning MNIST René Donner 13 Deep Learning MNIST https://www.tensorflow.org/versions/r0.7/tutorials/mnist/beginners/index.html#mnist-for-ml-beginners René Donner 14 Deep Learning http://gforge.se/2015/06/benchmarking-relu-and-prelu/ Activation functions http://blog.otoro.net/2015/03/28/neural-slime-volleyball/ Rectified linear unit Tanh René Donner 15 Deep Learning MNIST - Demo René Donner 16 Deep Learning MNIST http://deeplearning4j.org/rbm-mnist-tutorial.html René Donner 17 Deep Learning Accuracy: 91% Convolutional NN https://devblogs.nvidia.com/parallelforall/accelerate-machine-learning-cudnn-deep-neural-network-library/ https://developer.apple.com/library/ios/documentation/Performance/Conceptual/vImage/ConvolutionOperations/ConvolutionOperations.html Convolution René Donner 20 Deep Learning https://sites.google.com/site/shahriarinia/home/ai/machine-learning/neural-networks/deep-learning/theano-mnist/3-convolutional-neural-netwo Convolution René Donner 21 Deep Learning Accuracy: ~99.2% Deep Learning – Part II René Donner Visual Computing – Data Analysis – Consulting [email protected]
