Awesome Deep Vision
A curated list of deep learning resources for computer vision, inspired by awesome-php andawesome-computer-vision.
Maintainers-jiwon Kim, Heesoo myeong, Myungsub Choi, Janghoonchoi, Jung Kwon Lee
Contributing
Please feel the free-to-pull requests or email [e- Mail protected] to add links.
Sharing
- Share on Twitter
- Share on Facebook
- Share on Google Plus
- Share on LinkedIn
Table of Contents
- Papers
- ImageNet classification
- Object Detection
- Low-level Vision
- Edge Detection
- Semantic segmentation
- Visual Attention and Saliency
- Object recognition
- Understanding CNN
- Image captioning
- Video captioning
- Question Answering
- Other Topics
- Courses
- Books
- Videos
- Software
- Tutorials
- Blogs
Papersimagenet classification
(from Alex Krizhevsky, Ilya sutskever, Geoffrey E. Hinton, ImageNet classification with deep convolutional neural Networks , NIPS, 2012.)
- Microsoft (prelu/weight initialization) [Paper]
- Kaiming He, Xiangyu Zhang, shaoqing Ren, Jian Sun, delving deep to rectifiers:surpassing human-level performance on Ima GeNet classification, arxiv:1502.01852.
- Batch Normalization [Paper]
- Sergey Ioffe, Christian szegedy, Batch normalization:accelerating deep Network Training by reducing Internal covariate Sh IFT, arxiv:1502.03167.
- googlenet [Paper]
- Christian Szegedy, Wei Liu, yangqing Jia, Pierre sermanet, Scott Reed, Dragomir Anguelov, Dumitru Erhan, Vincent Vanhoucke , Andrew Rabinovich, CVPR, 2015.
- vgg-net [Web] [Paper]
- Karen Simonyan and Andrew Zisserman, Very deep convolutional Networks for large-scale Visual recognition, ICLR, 2015.
- AlexNet [Paper]
- Alex Krizhevsky, Ilya sutskever, Geoffrey E. Hinton, ImageNet classification with deep convolutional neural Networks, NIPS , 2012.
Object Detection
(from Shaoqing Ren, kaiming He, Ross Girshick, Jian Sun, Faster r-cnn:towards real-time Object Detection with region Prop Osal Networks, arxiv:1506.01497.)
- Overfeat, NYU [Paper]
- Matthrew Zeiler, Rob Fergus, visualizing and understanding convolutional Networks, ECCV, 2014.
- R-CNN, UC Berkeley [Paper-cvpr14] [PAPER-ARXIV14]
- Ross Girshick, Jeff Donahue, Trevor Darrell, Jitendra Malik, Rich feature hierarchies for accurate object detection and SE Mantic segmentation, CVPR, 2014.
- SPP, Microsoft [Paper]
- Kaiming He, Xiangyu Zhang, shaoqing Ren, Jian Sun, Spatial Pyramid Pooling in deep convolutional Networks for Visual recog Nition, ECCV, 2014.
- Fast r-cnn, Microsoft [Paper]
- Ross Girshick, Fast r-cnn, arxiv:1504.08083.
- Faster r-cnn, Microsoft [Paper]
- Shaoqing Ren, kaiming He, Ross Girshick, Jian Sun, Faster r-cnn:towards real-time Object Detection with region proposal N Etworks, arxiv:1506.01497.
- R-cnn minus R, Oxford [Paper]
- Karel Lenc, Andrea Vedaldi, r-cnn minus R, arxiv:1506.06981.
Low-level Vision
- Optical Flow (flownet) [Paper]
- Philipp Fischer, Alexey Dosovitskiy, Eddy Ilg, Philip häusser, Caner Haz?rba?, Vladimir Golkov, Patrick van der Smagt, Dan Iel Cremers, Thomas Brox, flownet:learning Optical Flow with convolutional Networks, arxiv:1504.06852.
- Super-resolution (SRCNN) [Web] [paper-eccv14] [Paper-arxiv15][paper ICONIP-2014]
- Chao dong, Chen change Loy, kaiming He, Xiaoou Tang, learning a deep convolutional Network for Image super-resolution, ECC V, 2014.
- Chao dong, Chen change Loy, kaiming He, Xiaoou Tang, Image super-resolution Using deep convolutional Networks, arxiv:1501. 00092.
- Osendorfer, Christian, Hubert Soyer, and Patrick van der Smagt, Image super-resolution with Fast approximate convolutional Sparse Coding, Iconip, 2014.
- Compression artifacts Reduction [paper-arxiv15]
- Chao Dong, Yubin Deng, Chen change Loy, Xiaoou Tang, Compression artifacts Reduction by a deep convolutional Network, Arxi v:1504.06993.
- Non-uniform Motion Blur removal [Paper]
- Jian Sun, Wenfei Cao, Zongben Xu, Jean Ponce, learning a convolutional neural Network for non-uniform Motion Blur removal, CVPR, 2015.
- Image deconvolution [Web] [Paper]
- Li Xu, Jimmy SJ. Ren, Ce Liu, Jiaya Jia, deep convolutional neural Network for Image deconvolution, NIPS, 2014.
- Deep Edge-aware Filter [Paper]
- Li Xu, Jimmy SJ. Ren, Qiong Yan, Renjie Liao, Jiaya Jia, deep edge-aware Filters, ICML, 2015.
- Computing the Stereo Matching cost with a convolutional neural Network [Paper]
- Jure Bontar, Yann LeCun, Computing the Stereo Matching cost with a convolutional neural Network, CVPR, 2015.
Edge Detection
(from Gedas Bertasius, Jianbo Shi, Lorenzo Torresani, deepedge:a multi-scale bifurcated deep Network for Top-down Contour Detection, CVPR, 2015.)
- holistically-nested Edge Detection [Paper]
- Saining Xie, Zhuowen Tu, holistically-nested Edge Detection, arxiv:1504.06375.
- Deepedge [Paper]
- Gedas Bertasius, Jianbo Shi, Lorenzo Torresani, deepedge:a multi-scale bifurcated deep Network for Top-down Contour Detec tion, CVPR, 2015.
- Deepcontour [Paper]
- Wei Shen, Xinggang Wang, Yan Wang, Xiang Bai, Zhijiang Zhang, deepcontour:a deep convolutional Feature learned by Positiv E-sharing Loss for Contour Detection, CVPR, 2015.
Semantic segmentation
(from Jifeng Dai, kaiming He, Jian Sun, boxsup:exploiting bounding Boxes to supervise convolutional Networks for Semantic segmentation, arxiv:1503.01640.)
- Boxsup [Paper]
- Jifeng Dai, kaiming He, Jian Sun, boxsup:exploiting bounding Boxes to supervise convolutional Networks for Semantic Segme Ntation, arxiv:1503.01640.
- Conditional Random fields as recurrent neural Networks [Paper]
- Shuai Zheng, Sadeep Jayasumana, Bernardino romera-paredes, Vibhav Vineet, Zhizhong Su, Dalong Du, Chang Huang, Philip H. S . Torr, Conditional Random fields as recurrent neural Networks, arxiv:1502.03240.
- Fully convolutional Networks for Semantic segmentation [PAPER-CVPR15] [paper-arxiv15]
- Jonathan Long, Evan Shelhamer, Trevor Darrell, Fully convolutional Networks for Semantic segmentation, CVPR, 2015.
- Learning hierarchical Features for Scene labeling [paper-icml12] [paper-pami13]
- Clement Farabet, Camille Couprie, Laurent Najman, Yann LeCun, Scene parsing with multiscale Feature learning, Purity Trees , and Optimal covers, ICML, 2012.
- Clement Farabet, Camille Couprie, Laurent Najman, Yann lecun, learning hierarchical Features for Scene labeling, Pami, 201 3.
Visual Attention and Saliency
(from Nian Liu, Junwei Han, Dingwen Zhang, Shifeng Wen, tianming Liu, predicting eye fixations using convolutional neural Networks, CVPR, 2015.)
- MR-CNN [Paper]
- Nian Liu, Junwei Han, Dingwen Zhang, Shifeng Wen, Tianming Liu, predicting eye fixations using convolutional neural networ KS, CVPR, 2015.
- Learning a sequential Search for landmarks [Paper]
- Saurabh Singh, Derek hoiem, David Forsyth, learning a sequential Search for landmarks, CVPR, 2015.
- Multiple Object recognition with Visual Attention [Paper]
- Jimmy Lei Ba, Volodymyr Mnih, Koray Kavukcuoglu, multiple Object recognition with Visual Attention, ICLR, 2015.
- Recurrent Models of Visual Attention [Paper]
- Volodymyr Mnih, Nicolas heess, Alex Graves, Koray Kavukcuoglu, recurrent Models of Visual Attention, NIPS, 2014.
Object recognition
- Weakly-supervised Learning with convolutional neural networks [Paper]
- Maxime oquab, Leon Bottou, Ivan Laptev, Josef Sivic, is object localization for free? –weakly-supervised Learning with convolutional neural networks, CVPR, 2015.
- FV-CNN [Paper]
- Mircea Cimpoi, Subhransu Maji, Andrea vedaldi, deep Filter Banks for Texture recognition and segmentation, CVPR, 2015.
Understanding CNN
(from Aravindh Mahendran, Andrea Vedaldi, Understanding deep Image representations by inverting them, CVPR, 2015.)
- Equivariance and equivalence of representations [Paper]
- Karel Lenc, Andrea Vedaldi, understanding image representations by measuring their equivariance and equivalence, CVPR, 201 5.
- Deep neural Networks is easily fooled [Paper]
- Anh Nguyen, Jason Yosinski, Jeff clune, deep neural Networks is easily fooled:high Confidence predictions for Unrecogniza Ble Images, CVPR, 2015.
- Understanding deep Image representations by inverting them [Paper]
- Aravindh Mahendran, Andrea Vedaldi, Understanding deep Image representations by inverting them, CVPR, 2015.
Image captioning
(from Andrej karpathy, Li Fei-fei, deep visual-semantic alignments for generating Image Description, CVPR, 2015.)
- BAIDU/UCLA [Paper]
- Junhua Mao, Wei Xu, Yi Yang, Jiang Wang, Alan L. Yuille, Explain Images with multimodal recurrent neural Networks, arxiv:1 410.1090.
- Toronto [Paper]
- Ryan Kiros, Ruslan Salakhutdinov, Richard S. Zemel, Unifying visual-semantic embeddings with multimodal neural Language Mo Dels, arxiv:1411.2539.
- Berkeley [Paper]
- Jeff Donahue, Lisa Anne Hendricks, Sergio Guadarrama, Marcus Rohrbach, Subhashini Venugopalan, Kate Saenko, Trevor Darrell , long-term recurrent convolutional Networks for Visual recognition and Description, arxiv:1411.4389.
- Google [Paper]
- Oriol vinyals, Alexander Toshev, Samy Bengio, Dumitru Erhan, Show and tell:a neural Image Caption Generator, arxiv:1411.4 555.
- Stanford [Web] [Paper]
- Andrej karpathy, Li Fei-fei, deep visual-semantic alignments for generating Image Description, CVPR, 2015.
- Uml/ut [Paper]
- Subhashini Venugopalan, Huijuan Xu, Jeff Donahue, Marcus Rohrbach, Raymond Mooney, Kate Saenko, translating Videos to Natu RAL Language Using Deep Recurrent neural Networks, naacl-hlt, 2015.
- MICROSOFT/CMU [Paper]
- Xinlei Chen, C. Lawrence zitnick, learning a recurrent Visual representation for Image Caption Generation, arxiv:1411.5654 .
- Microsoft [Paper]
- Hao Fang, Saurabh Gupta, Forrest Iandola, Rupesh Srivastava, Li Deng, Piotr Dollár, Jianfeng Gao, Xiaodong He, Margaret Mi Tchell, John c. Platt, C. Lawrence Zitnick, Geoffrey Zweig, from captions to Visual concepts and back, CVPR, 2015.
Video captioning
- Berkeley [web] [paper]
- Jeff Donahue, Lisa Anne Hendricks, Sergio Guadarrama, Marcus Rohr Bach, Subhashini Venugopalan, Kate Saenko, Trevor Darrell, long-term recurrent convolutional Networks for Visual Recogniti On and Description, CVPR.
- Ut/uml/berkeley [paper]
- subhashini Venugopalan, Huijuan Xu, Jeff Donahue, Marcus Ro Hrbach, Raymond Mooney, Kate Saenko, translating Videos to Natural Language Using deep Recurrent neural Networks, arxiv:14 12.4729.
- microsoft [paper]
- yingwei Pan, Tao Mei, Ting Yao, Houqiang Li, Yong Rui , Joint Modeling embedding and translation to Bridge Video and Language, arxiv:1505.01861.
- Ut/berkeley/uml [paper]
- subhashini Venugopalan, Marcus Rohrbach, Jeff Donahue, Raym Ond Mooney, Trevor Darrell, Kate Saenko, Sequence to Sequence--video to Text, arxiv:1505.00487.
Question Answering
(from Stanislaw Antol, Aishwarya Agrawal, Jiasen Lu, Margaret Mitchell, Dhruv Batra, C. Lawrence Zitnick, Devi Parikh, VQA : Visual Question Answering, CVPR, Sunw:scene Understanding Workshop)
- Msr/virginia Tech. [Web] [Paper]
- Stanislaw Antol, Aishwarya Agrawal, Jiasen Lu, Margaret Mitchell, Dhruv Batra, C. Lawrence Zitnick, Devi Parikh, Vqa:visu Al Question answering, CVPR, sunw:scene Understanding Workshop.
- Mpi/berkeley [Web] [Paper]
- Mateusz Malinowski, Marcus Rohrbach, Mario Fritz, Ask Your neurons:a neural-based approach to answering Questions about I Mages, arxiv:1505.01121.
- Toronto [Paper] [Dataset]
- Mengye Ren, Ryan Kiros, Richard Zemel, Image Question answering:a Visual Semantic embedding Model and A New Dataset, Arxi V:1505.02074/ICML Deep Learning Workshop.
- BAIDU/UCLA [Paper] [Dataset]
- Hauyuan Gao, Junhua Mao, Jie Zhou, Zhiheng Huang, Lei Wang, Wei Xu, is you talking to a machine? Dataset and Methods for multilingual Image Question Answering, arxiv:1505.05612.
Other Topics
- Surface Normal estimation [Paper]
- Xiaolong Wang, David f. Fouhey, Abhinav Gupta, Designing deep Networks for Surface Normal estimation, CVPR, 2015.
- Action Detection [Paper]
- Georgia Gkioxari, Jitendra Malik, finding Action tubes, CVPR, 2015.
- Crowd counting [Paper]
- Cong Zhang, Hongsheng Li, Xiaogang Wang, Xiaokang Yang, Cross-scene Crowd counting via deep convolutional neural Networks, CVPR, 2015.
- 3D Shape retrieval [Paper]
- Fang Wang, Le Kang, Yi Li, sketch-based 3D Shape retrieval using convolutional neural Networks, CVPR, 2015.
- Generate Image [Paper]
- Alexey Dosovitskiy, Jost Tobias Springenberg, Thomas brox, learning to Generate chairs with convolutional neural Networks, CVPR, 2015.
Courses
- Deep Vision
- [Stanford] Cs231n:convolutional Neural Networks for Visual recognition
- [CUHK] Eleg 5040:advanced Topics in Signal processing (Introduction to deep learning)
- More deep learning
- [Stanford] Cs224d:deep Learning for Natural Language processing
- [Oxford] Deep learning by Prof Nando de Freitas
- [NYU] Deep learning by Prof. Yann LeCun
Books
- Free Online Books
- Deep learning by Yoshua Bengio, Ian Goodfellow and Aaron Courville
- Neural Networks and deep learning by Michael Nielsen
- Deep learning Tutorial by LISA Lab, University of Montreal
Videos
- Talks
- Deep learning, self-taught learning and unsupervised Feature learning by Andrew Ng
- Recent developments in deep learning by Geoff Hinton
- The unreasonable effectiveness of deep learning by Yann LeCun
- Deep learning of representations by Yoshua Bengio
- Courses
- Deep learning Course–nando de [email protected]
Softwareframework
- Torch7:deep Learning Library in Lua, used by Facebook and Google Deepmind [Web]
- Caffe:deep Learning Framework by the BVLC [Web]
- Matconvnet:cnns for MATLAB [Web]
Applications
- Adversarial Training
- Code and Hyperparameters for the paper "generative adversarial Networks" [Web]
- Understanding and Visualizing
- Source code for "Understanding deep Image representations by inverting them," CVPR, 2015. [Web]
- Semantic segmentation
- Source code for the paper "Rich feature hierarchies for accurate object detection and semantic segmentation," CVPR, 2014. [Web]
- Source code for the paper "Fully convolutional Networks for Semantic segmentation," CVPR, 2015. [Web]
- Super-resolution
- Image super-resolution for Anime-style-art [Web]
- Edge Detection
- Source code for the paper ' Deepcontour:a deep convolutional Feature learned by positive-sharing Loss for Contour detectio N, "CVPR, 2015. [Web]
Tutorials
- [CVPR 2014] Tutorial on deep learning in computer Vision
- [CVPR 2015] Applied deep Learning for computer Vision with Torch
Blogs
- Deep down the rabbit hole:cvpr and [email protected]' s computer Vision Blog
- CVPR recap and where we ' re [email protected] bylinskii (MIT PhD Student) ' s Blog
- Facebook ' s AI [email protected]
- Inceptionism:going deeper into neural [email protected]
Awesome Deep Vision
