計算機視覺論文整理
經典論文
- ImageNet分類
- 物體檢測
- 物體跟蹤
- 低階視覺
- 邊緣檢測
- 語義分割
- 視覺注意力和顯著性
- 物體識別
- 人體姿態估計
- CNN原理和性質(Understanding CNN)
- 影象和語言
- 影象解說
- 視訊解說
- 影象生成
微軟ResNet
論文:用於影象識別的深度殘差網路
作者:何愷明、張祥雨、任少卿和孫劍
微軟PRelu(隨機糾正線性單元/權重初始化)
論文:深入學習整流器:在ImageNet分類上超越人類水平
作者:何愷明、張祥雨、任少卿和孫劍
谷歌Batch Normalization
論文:批量歸一化:通過減少內部協變數來加速深度網路訓練
作者:Sergey Ioffe, Christian Szegedy
谷歌GoogLeNet
論文:更深的卷積,CVPR 2015
作者:Christian Szegedy, Wei Liu, Yangqing Jia, Pierre Sermanet, Scott Reed, Dragomir Anguelov, Dumitru Erhan, Vincent Vanhoucke, Andrew Rabinovich
牛津VGG-Net
論文:大規模視覺識別中的極深卷積網路,ICLR 2015
作者:Karen Simonyan & Andrew Zisserman
AlexNet
論文:使用深度卷積神經網路進行ImageNet分類
作者:Alex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton
物體檢測
PVANET
論文:用於實時物體檢測的深度輕量神經網路(PVANET:Deep but Lightweight Neural Networks for Real-time Object Detection)
作者:Kye-Hyeon Kim, Sanghoon Hong, Byungseok Roh, Yeongjae Cheon, Minje Park
紐約大學OverFeat
論文:使用卷積網路進行識別、定位和檢測(OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks),ICLR 2014
作者:Pierre Sermanet, David Eigen, Xiang Zhang, Michael Mathieu, Rob Fergus, Yann LeCun
伯克利R-CNN
論文:精確物體檢測和語義分割的豐富特徵層次結構(Rich feature hierarchies for accurate object detection and semantic segmentation),CVPR 2014
作者:Ross Girshick, Jeff Donahue, Trevor Darrell, Jitendra Malik
微軟SPP
論文:視覺識別深度卷積網路中的空間金字塔池化(Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition),ECCV 2014
作者:何愷明、張祥雨、任少卿和孫劍
微軟Fast R-CNN
論文:Fast R-CNN
作者:Ross Girshick
微軟Faster R-CNN
論文:使用RPN走向實時物體檢測(Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks)
作者:任少卿、何愷明、Ross Girshick、孫劍
牛津大學R-CNN minus R
論文:R-CNN minus R
作者:Karel Lenc, Andrea Vedaldi
端到端行人檢測
論文:密集場景中端到端的行人檢測(End-to-end People Detection in Crowded Scenes)
作者:Russell Stewart, Mykhaylo Andriluka
實時物體檢測
論文:你只看一次:統一實時物體檢測(You Only Look Once: Unified, Real-Time Object Detection)
作者:Joseph Redmon, Santosh Divvala, Ross Girshick, Ali Farhadi
Inside-Outside Net
論文:使用跳躍池化和RNN在場景中檢測物體(Inside-Outside Net: Detecting Objects in Context with Skip Pooling and Recurrent Neural Networks)
作者:Sean Bell, C. Lawrence Zitnick, Kavita Bala, Ross Girshick
微軟ResNet
論文:用於影象識別的深度殘差網路
作者:何愷明、張祥雨、任少卿和孫劍
R-FCN
論文:通過區域全卷積網路進行物體識別(R-FCN: Object Detection via Region-based Fully Convolutional Networks)
作者:代季峰,李益,何愷明,孫劍
SSD
論文:單次多框檢測器(SSD: Single Shot MultiBox Detector)
作者:Wei Liu, Dragomir Anguelov, Dumitru Erhan, Christian Szegedy, Scott Reed, Cheng-Yang Fu, Alexander C. Berg
速度/精度權衡
論文:現代卷積物體檢測器的速度/精度權衡(Speed/accuracy trade-offs for modern convolutional object detectors)
作者:Jonathan Huang, Vivek Rathod, Chen Sun, Menglong Zhu, Anoop Korattikara, Alireza Fathi, Ian Fischer, Zbigniew Wojna, Yang Song, Sergio Guadarrama, Kevin Murphy
物體跟蹤
- 論文:用卷積神經網路通過學習可區分的顯著性地圖實現線上跟蹤(Online Tracking by Learning Discriminative Saliency Map with Convolutional Neural Network)
作者:Seunghoon Hong, Tackgeun You, Suha Kwak, Bohyung Han
地址:arXiv:1502.06796.
- 論文:DeepTrack:通過視覺跟蹤的卷積神經網路學習辨別特徵表徵(DeepTrack: Learning Discriminative Feature Representations by Convolutional Neural Networks for Visual Tracking)
作者:Hanxi Li, Yi Li and Fatih Porikli
發表: BMVC, 2014.
- 論文:視覺跟蹤中,學習深度緊湊影象表示(Learning a Deep Compact Image Representation for Visual Tracking)
作者:N Wang, DY Yeung
發表:NIPS, 2013.
- 論文:視覺跟蹤的分層卷積特徵(Hierarchical Convolutional Features for Visual Tracking)
作者:Chao Ma, Jia-Bin Huang, Xiaokang Yang and Ming-Hsuan Yang
發表: ICCV 2015
- 論文:完全卷積網路的視覺跟蹤(Visual Tracking with fully Convolutional Networks)
作者:Lijun Wang, Wanli Ouyang, Xiaogang Wang, and Huchuan Lu,
發表:ICCV 2015
- 論文:學習多域卷積神經網路進行視覺跟蹤(Learning Multi-Domain Convolutional Neural Networks for Visual Tracking)
作者:Hyeonseob Namand Bohyung Han
物件識別(Object Recognition)
論文:卷積神經網路弱監督學習(Weakly-supervised learning with convolutional neural networks)
作者:Maxime Oquab,Leon Bottou,Ivan Laptev,Josef Sivic,CVPR,2015
FV-CNN
論文:深度濾波器組用於紋理識別和分割(Deep Filter Banks for Texture Recognition and Segmentation)
作者:Mircea Cimpoi, Subhransu Maji, Andrea Vedaldi, CVPR, 2015.
人體姿態估計(Human Pose Estimation)
- 論文:使用 Part Affinity Field的實時多人2D姿態估計(Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields)
作者:Zhe Cao, Tomas Simon, Shih-En Wei, and Yaser Sheikh, CVPR, 2017.
- 論文:Deepcut:多人姿態估計的聯合子集分割和標籤(Deepcut: Joint subset partition and labeling for multi person pose estimation)
作者:Leonid Pishchulin, Eldar Insafutdinov, Siyu Tang, Bjoern Andres, Mykhaylo Andriluka, Peter Gehler, and Bernt Schiele, CVPR, 2016.
- 論文:Convolutional pose machines
作者:Shih-En Wei, Varun Ramakrishna, Takeo Kanade, and Yaser Sheikh, CVPR, 2016.
- 論文:人體姿態估計的 Stacked hourglass networks(Stacked hourglass networks for human pose estimation)
作者:Alejandro Newell, Kaiyu Yang, and Jia Deng, ECCV, 2016.
- 論文:用於視訊中人體姿態估計的Flowing convnets(Flowing convnets for human pose estimation in videos)
作者:Tomas Pfister, James Charles, and Andrew Zisserman, ICCV, 2015.
- 論文:卷積網路和人類姿態估計圖模型的聯合訓練(Joint training of a convolutional network and a graphical model for human pose estimation)
作者:Jonathan J. Tompson, Arjun Jain, Yann LeCun, Christoph Bregler, NIPS, 2014.
理解CNN
- 論文:通過測量同變性和等價性來理解影象表示(Understanding image representations by measuring their equivariance and equivalence)
作者:Karel Lenc, Andrea Vedaldi, CVPR, 2015.
- 論文:深度神經網路容易被愚弄:無法識別的影象的高置信度預測(Deep Neural Networks are Easily Fooled:High Confidence Predictions for Unrecognizable Images)
作者:Anh Nguyen, Jason Yosinski, Jeff Clune, CVPR, 2015.
- 論文:通過反演理解深度影象表示(Understanding Deep Image Representations by Inverting Them)
作者:Aravindh Mahendran, Andrea Vedaldi, CVPR, 2015
- 論文:深度場景CNN中的物件檢測器(Object Detectors Emerge in Deep Scene CNNs)
作者:Bolei Zhou, Aditya Khosla, Agata Lapedriza, Aude Oliva, Antonio Torralba, ICLR, 2015.
- 論文:用卷積網路反演視覺表示(Inverting Visual Representations with Convolutional Networks)
作者:Alexey Dosovitskiy, Thomas Brox, arXiv, 2015.
- 論文:視覺化和理解卷積網路(Visualizing and Understanding Convolutional Networks)
作者:Matthrew Zeiler, Rob Fergus, ECCV, 2014.
影象與語言
影象說明(Image Captioning)
UCLA / Baidu
用多模型迴圈神經網路解釋影象(Explain Images with Multimodal Recurrent Neural Networks)
Junhua Mao, Wei Xu, Yi Yang, Jiang Wang, Alan L. Yuille, arXiv:1410.1090
Toronto
使用多模型神經語言模型統一視覺語義嵌入(Unifying Visual-Semantic Embeddings with Multimodal Neural Language Models)
Ryan Kiros, Ruslan Salakhutdinov, Richard S. Zemel, arXiv:1411.2539.
Berkeley
用於視覺識別和描述的長期迴圈卷積網路(Long-term Recurrent Convolutional Networks for Visual Recognition and Description)
Jeff Donahue, Lisa Anne Hendricks, Sergio Guadarrama, Marcus Rohrbach, Subhashini Venugopalan, Kate Saenko, Trevor Darrell, arXiv:1411.4389.
看圖寫字:神經影象說明生成器(Show and Tell: A Neural Image Caption Generator)
Oriol Vinyals, Alexander Toshev, Samy Bengio, Dumitru Erhan, arXiv:1411.4555.
Stanford
用於生成影象描述的深度視覺語義對齊(Deep Visual-Semantic Alignments for Generating Image Description)
Andrej Karpathy, Li Fei-Fei, CVPR, 2015.
UML / UT
使用深度迴圈神經網路將視訊轉換為自然語言(Translating Videos to Natural Language Using Deep Recurrent Neural Networks)
Subhashini Venugopalan, Huijuan Xu, Jeff Donahue, Marcus Rohrbach, Raymond Mooney, Kate Saenko, NAACL-HLT, 2015.
CMU / Microsoft
學習影象說明生成的迴圈視覺表示(Learning a Recurrent Visual Representation for Image Caption Generation)
Xinlei Chen, C. Lawrence Zitnick, arXiv:1411.5654.
Xinlei Chen, C. Lawrence Zitnick, Mind’s Eye: A Recurrent Visual Representation for Image Caption Generation, CVPR 2015
Microsoft
從影象說明到視覺概念(From Captions to Visual Concepts and Back)
Hao Fang, Saurabh Gupta, Forrest Iandola, Rupesh Srivastava, Li Deng, Piotr Dollár, Jianfeng Gao, Xiaodong He, Margaret Mitchell, John C. Platt, C. Lawrence Zitnick, Geoffrey Zweig, CVPR, 2015.
Univ. Montreal / Univ. Toronto
Show, Attend, and Tell:視覺注意力與神經影象標題生成(Show, Attend, and Tell: Neural Image Caption Generation with Visual Attention)
Kelvin Xu, Jimmy Lei Ba, Ryan Kiros, Kyunghyun Cho, Aaron Courville, Ruslan Salakhutdinov, Richard S. Zemel, Yoshua Bengio, arXiv:1502.03044 / ICML 2015
Idiap / EPFL / Facebook
基於短語的影象說明(Phrase-based Image Captioning)
Remi Lebret, Pedro O. Pinheiro, Ronan Collobert, arXiv:1502.03671 / ICML 2015
UCLA / Baidu
像孩子一樣學習:從影象句子描述快速學習視覺的新概念(Learning like a Child: Fast Novel Visual Concept Learning from Sentence Descriptions of Images)
Junhua Mao, Wei Xu, Yi Yang, Jiang Wang, Zhiheng Huang, Alan L. Yuille, arXiv:1504.06692
MS + Berkeley
探索影象說明的最近鄰方法( Exploring Nearest Neighbor Approaches for Image Captioning)
Jacob Devlin, Saurabh Gupta, Ross Girshick, Margaret Mitchell, C. Lawrence Zitnick, arXiv:1505.04467
影象說明的語言模型(Language Models for Image Captioning: The Quirks and What Works)
Jacob Devlin, Hao Cheng, Hao Fang, Saurabh Gupta, Li Deng, Xiaodong He, Geoffrey Zweig, Margaret Mitchell, arXiv:1505.01809
阿德萊德
具有中間屬性層的影象說明( Image Captioning with an Intermediate Attributes Layer)
Qi Wu, Chunhua Shen, Anton van den Hengel, Lingqiao Liu, Anthony Dick, arXiv:1506.01144
蒂爾堡
通過圖片學習語言(Learning language through pictures)
Grzegorz Chrupala, Akos Kadar, Afra Alishahi, arXiv:1506.03694
蒙特利爾大學
使用基於注意力的編碼器-解碼器網路描述多媒體內容(Describing Multimedia Content using Attention-based Encoder-Decoder Networks)
Kyunghyun Cho, Aaron Courville, Yoshua Bengio, arXiv:1507.01053
康奈爾
影象表示和神經影象說明的新領域(Image Representations and New Domains in Neural Image Captioning)
Jack Hessel, Nicolas Savva, Michael J. Wilber, arXiv:1508.02091
MS + City Univ. of HongKong
Learning Query and Image Similarities with Ranking Canonical Correlation Analysis
Ting Yao, Tao Mei, and Chong-Wah Ngo, ICCV, 2015
視訊字幕(Video Captioning)
伯克利
Jeff Donahue, Lisa Anne Hendricks, Sergio Guadarrama, Marcus Rohrbach, Subhashini Venugopalan, Kate Saenko, Trevor Darrell, Long-term Recurrent Convolutional Networks for Visual Recognition and Description, CVPR, 2015.
猶他州/ UML / 伯克利
Subhashini Venugopalan, Huijuan Xu, Jeff Donahue, Marcus Rohrbach, Raymond Mooney, Kate Saenko, Translating Videos to Natural Language Using Deep Recurrent Neural Networks, arXiv:1412.4729.
微軟
Yingwei Pan, Tao Mei, Ting Yao, Houqiang Li, Yong Rui, Joint Modeling Embedding and Translation to Bridge Video and Language, arXiv:1505.01861.
猶他州/ UML / 伯克利
Subhashini Venugopalan, Marcus Rohrbach, Jeff Donahue, Raymond Mooney, Trevor Darrell, Kate Saenko, Sequence to Sequence–Video to Text, arXiv:1505.00487.
蒙特利爾大學/ 舍布魯克
Li Yao, Atousa Torabi, Kyunghyun Cho, Nicolas Ballas, Christopher Pal, Hugo Larochelle, Aaron Courville, Describing Videos by Exploiting Temporal Structure, arXiv:1502.08029
MPI / 伯克利
Anna Rohrbach, Marcus Rohrbach, Bernt Schiele, The Long-Short Story of Movie Description, arXiv:1506.01698
多倫多大學 / MIT
Yukun Zhu, Ryan Kiros, Richard Zemel, Ruslan Salakhutdinov, Raquel Urtasun, Antonio Torralba, Sanja Fidler, Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Books, arXiv:1506.06724
蒙特利爾大學
Kyunghyun Cho, Aaron Courville, Yoshua Bengio, Describing Multimedia Content using Attention-based Encoder-Decoder Networks, arXiv:1507.01053
TAU / 美國南加州大學
Dotan Kaufman, Gil Levi, Tal Hassner, Lior Wolf, Temporal Tessellation for Video Annotation and Summarization, arXiv:1612.06950.
影象生成
卷積/迴圈網路
- 論文:Conditional Image Generation with PixelCNN Decoders”
作者:Aäron van den Oord, Nal Kalchbrenner, Oriol Vinyals, Lasse Espeholt, Alex Graves, Koray Kavukcuoglu
- 論文:Learning to Generate Chairs with Convolutional Neural Networks
作者:Alexey Dosovitskiy, Jost Tobias Springenberg, Thomas Brox
發表:CVPR, 2015.
- 論文:DRAW: A Recurrent Neural Network For Image Generation
作者:Karol Gregor, Ivo Danihelka, Alex Graves, Danilo Jimenez Rezende, Daan Wierstra
發表:ICML, 2015.
對抗網路
- 論文:生成對抗網路(Generative Adversarial Networks)
作者:Ian J. Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, Yoshua Bengio
發表:NIPS, 2014.
- 論文:使用對抗網路Laplacian Pyramid 的深度生成影象模型(Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks)
作者:Emily Denton, Soumith Chintala, Arthur Szlam, Rob Fergus
發表:NIPS, 2015.
- 論文:生成模型演講概述 (A note on the evaluation of generative models)
作者:Lucas Theis, Aäron van den Oord, Matthias Bethge
發表:ICLR 2016.
- 論文:變分自動編碼深度高斯過程(Variationally Auto-Encoded Deep Gaussian Processes)
作者:Zhenwen Dai, Andreas Damianou, Javier Gonzalez, Neil Lawrence
發表:ICLR 2016.
- 論文:用注意力機制從字幕生成影象 (Generating Images from Captions with Attention)
作者:Elman Mansimov, Emilio Parisotto, Jimmy Ba, Ruslan Salakhutdinov
發表: ICLR 2016
- 論文:分類生成對抗網路的無監督和半監督學習(Unsupervised and Semi-supervised Learning with Categorical Generative Adversarial Networks)
作者:Jost Tobias Springenberg
發表:ICLR 2016
- 論文:用一個對抗檢測表徵(Censoring Representations with an Adversary)
作者:Harrison Edwards, Amos Storkey
發表:ICLR 2016
- 論文:虛擬對抗訓練實現分散式順滑 (Distributional Smoothing with Virtual Adversarial Training)
作者:Takeru Miyato, Shin-ichi Maeda, Masanori Koyama, Ken Nakae, Shin Ishii
發表:ICLR 2016
- 論文:自然影象流形上的生成視覺操作(Generative Visual Manipulation on the Natural Image Manifold)
作者:朱儁彥, Philipp Krahenbuhl, Eli Shechtman, and Alexei A. Efros
發表: ECCV 2016.
- 論文:深度卷積生成對抗網路的無監督表示學習(Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks)
作者:Alec Radford, Luke Metz, Soumith Chintala
發表: ICLR 2016
問題回答
弗吉尼亞大學 / 微軟研究院
論文:VQA: Visual Question Answering, CVPR, 2015 SUNw:Scene Understanding workshop.
作者:Stanislaw Antol, Aishwarya Agrawal, Jiasen Lu, Margaret Mitchell, Dhruv Batra, C. Lawrence Zitnick, Devi Parikh
MPI / 伯克利
論文:Ask Your Neurons: A Neural-based Approach to Answering Questions about Images
作者:Mateusz Malinowski, Marcus Rohrbach, Mario Fritz,
釋出 : arXiv:1505.01121.
多倫多
論文: Image Question Answering: A Visual Semantic Embedding Model and a New Dataset
作者:Mengye Ren, Ryan Kiros, Richard Zemel
發表: arXiv:1505.02074 / ICML 2015 deep learning workshop.
百度/ 加州大學洛杉磯分校
作者:Hauyuan Gao, Junhua Mao, Jie Zhou, Zhiheng Huang, Lei Wang, 徐偉
論文:Are You Talking to a Machine? Dataset and Methods for Multilingual Image Question Answering
發表: arXiv:1505.05612.
POSTECH(韓國)
論文:Image Question Answering using Convolutional Neural Network with Dynamic Parameter Prediction
作者:Hyeonwoo Noh, Paul Hongsuck Seo, and Bohyung Han
發表: arXiv:1511.05765
CMU / 微軟研究院
論文:Stacked Attention Networks for Image Question Answering
作者:Yang, Z., He, X., Gao, J., Deng, L., & Smola, A. (2015)
發表: arXiv:1511.02274.
MetaMind
論文:Dynamic Memory Networks for Visual and Textual Question Answering
作者:Xiong, Caiming, Stephen Merity, and Richard Socher
發表: arXiv:1603.01417 (2016).
首爾國立大學 + NAVER
論文:Multimodal Residual Learning for Visual QA
作者:Jin-Hwa Kim, Sang-Woo Lee, Dong-Hyun Kwak, Min-Oh Heo, Jeonghee Kim, Jung-Woo Ha, Byoung-Tak Zhang
發表:arXiv:1606:01455
UC Berkeley + 索尼
論文:Multimodal Compact Bilinear Pooling for Visual Question Answering and Visual Grounding
作者:Akira Fukui, Dong Huk Park, Daylen Yang, Anna Rohrbach, Trevor Darrell, and Marcus Rohrbach
發表:arXiv:1606.01847
Postech
論文:Training Recurrent Answering Units with Joint Loss Minimization for VQA
作者:Hyeonwoo Noh and Bohyung Han
發表: arXiv:1606.03647
首爾國立大學 + NAVER
論文: Hadamard Product for Low-rank Bilinear Pooling
作者:Jin-Hwa Kim, Kyoung Woon On, Jeonghee Kim, Jung-Woo Ha, Byoung-Tak Zhan
發表:arXiv:1610.04325.
視覺注意力和顯著性
論文:Predicting Eye Fixations using Convolutional Neural Networks
作者:Nian Liu, Junwei Han, Dingwen Zhang, Shifeng Wen, Tianming Liu
發表:CVPR, 2015.
學習地標的連續搜尋
作者:Learning a Sequential Search for Landmarks
論文:Saurabh Singh, Derek Hoiem, David Forsyth
發表:CVPR, 2015.
視覺注意力機制實現多物體識別
論文:Multiple Object Recognition with Visual Attention
作者:Jimmy Lei Ba, Volodymyr Mnih, Koray Kavukcuoglu,
發表:ICLR, 2015.
視覺注意力機制的迴圈模型
作者:Volodymyr Mnih, Nicolas Heess, Alex Graves, Koray Kavukcuoglu
論文:Recurrent Models of Visual Attention
發表:NIPS, 2014.
低階視覺
超解析度
- Iterative Image Reconstruction
Sven Behnke: Learning Iterative Image Reconstruction. IJCAI, 2001.
Sven Behnke: Learning Iterative Image Reconstruction in the Neural Abstraction Pyramid. International Journal of Computational Intelligence and Applications, vol. 1, no. 4, pp. 427-438, 2001.
- Super-Resolution (SRCNN)
Chao Dong, Chen Change Loy, Kaiming He, Xiaoou Tang, Learning a Deep Convolutional Network for Image Super-Resolution, ECCV, 2014.
Chao Dong, Chen Change Loy, Kaiming He, Xiaoou Tang, Image Super-Resolution Using Deep Convolutional Networks, arXiv:1501.00092.
- Very Deep Super-Resolution
Jiwon Kim, Jung Kwon Lee, Kyoung Mu Lee, Accurate Image Super-Resolution Using Very Deep Convolutional Networks, arXiv:1511.04587, 2015.
- Deeply-Recursive Convolutional Network
Jiwon Kim, Jung Kwon Lee, Kyoung Mu Lee, Deeply-Recursive Convolutional Network for Image Super-Resolution, arXiv:1511.04491, 2015.
- Casade-Sparse-Coding-Network
Zhaowen Wang, Ding Liu, Wei Han, Jianchao Yang and Thomas S. Huang, Deep Networks for Image Super-Resolution with Sparse Prior. ICCV, 2015.
- Perceptual Losses for Super-Resolution
Justin Johnson, Alexandre Alahi, Li Fei-Fei, Perceptual Losses for Real-Time Style Transfer and Super-Resolution, arXiv:1603.08155, 2016.
- SRGAN
Christian Ledig, Lucas Theis, Ferenc Huszar, Jose Caballero, Andrew Cunningham, Alejandro Acosta, Andrew Aitken, Alykhan Tejani, Johannes Totz, Zehan Wang, Wenzhe Shi, Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network, arXiv:1609.04802v3, 2016.
其他應用
Optical Flow (FlowNet)
Philipp Fischer, Alexey Dosovitskiy, Eddy Ilg, Philip Häusser, Caner Hazırbaş, Vladimir Golkov, Patrick van der Smagt, Daniel Cremers, Thomas Brox, FlowNet: Learning Optical Flow with Convolutional Networks, arXiv:1504.06852.
Compression Artifacts Reduction
Chao Dong, Yubin Deng, Chen Change Loy, Xiaoou Tang, Compression Artifacts Reduction by a Deep Convolutional Network, arXiv:1504.06993.
Blur Removal
Christian J. Schuler, Michael Hirsch, Stefan Harmeling, Bernhard Schölkopf, Learning to Deblur, arXiv:1406.7444
Jian Sun, Wenfei Cao, Zongben Xu, Jean Ponce, Learning a Convolutional Neural Network for Non-uniform Motion Blur Removal, CVPR, 2015
Image Deconvolution
Li Xu, Jimmy SJ. Ren, Ce Liu, Jiaya Jia, Deep Convolutional Neural Network for Image Deconvolution, NIPS, 2014.
Deep Edge-Aware Filter
Li Xu, Jimmy SJ. Ren, Qiong Yan, Renjie Liao, Jiaya Jia, Deep Edge-Aware Filters, ICML, 2015.
Computing the Stereo Matching Cost with a Convolutional Neural Network
Jure Žbontar, Yann LeCun, Computing the Stereo Matching Cost with a Convolutional Neural Network, CVPR, 2015.
Colorful Image Colorization Richard Zhang, Phillip Isola, Alexei A. Efros, ECCV, 2016
Feature Learning by Inpainting
Deepak Pathak, Philipp Krahenbuhl, Jeff Donahue, Trevor Darrell, Alexei A. Efros, Context Encoders: Feature Learning by Inpainting, CVPR, 2016
邊緣檢測
Saining Xie, Zhuowen Tu, Holistically-Nested Edge Detection, arXiv:1504.06375.
DeepEdge
Gedas Bertasius, Jianbo Shi, Lorenzo Torresani, DeepEdge: A Multi-Scale Bifurcated Deep Network for Top-Down Contour Detection, CVPR, 2015.
DeepContour
Wei Shen, Xinggang Wang, Yan Wang, Xiang Bai, Zhijiang Zhang, DeepContour: A Deep Convolutional Feature Learned by Positive-Sharing Loss for Contour Detection, CVPR, 2015.
語義分割
SEC: Seed, Expand and Constrain
Alexander Kolesnikov, Christoph Lampert, Seed, Expand and Constrain: Three Principles for Weakly-Supervised Image Segmentation, ECCV, 2016.
Adelaide
Guosheng Lin, Chunhua Shen, Ian Reid, Anton van dan Hengel, Efficient piecewise training of deep structured models for semantic segmentation, arXiv:1504.01013. (1st ranked in VOC2012)
Guosheng Lin, Chunhua Shen, Ian Reid, Anton van den Hengel, Deeply Learning the Messages in Message Passing Inference, arXiv:1508.02108. (4th ranked in VOC2012)
Deep Parsing Network (DPN)
Ziwei Liu, Xiaoxiao Li, Ping Luo, Chen Change Loy, Xiaoou Tang, Semantic Image Segmentation via Deep Parsing Network, arXiv:1509.02634 / ICCV 2015 (2nd ranked in VOC 2012)
CentraleSuperBoundaries, INRIA
Iasonas Kokkinos, Surpassing Humans in Boundary Detection using Deep Learning, arXiv:1411.07386 (4th ranked in VOC 2012)
BoxSup
Jifeng Dai, Kaiming He, Jian Sun, BoxSup: Exploiting Bounding Boxes to Supervise Convolutional Networks for Semantic Segmentation, arXiv:1503.01640. (6th ranked in VOC2012)
POSTECH
Hyeonwoo Noh, Seunghoon Hong, Bohyung Han, Learning Deconvolution Network for Semantic Segmentation, arXiv:1505.04366. (7th ranked in VOC2012)
Seunghoon Hong, Hyeonwoo Noh, Bohyung Han, Decoupled Deep Neural Network for Semi-supervised Semantic Segmentation, arXiv:1506.04924.
Seunghoon Hong,Junhyuk Oh,Bohyung Han, andHonglak Lee, Learning Transferrable Knowledge for Semantic Segmentation with Deep Convolutional Neural Network, arXiv:1512.07928
Conditional Random Fields as Recurrent Neural Networks
Shuai Zheng, Sadeep Jayasumana, Bernardino Romera-Paredes, Vibhav Vineet, Zhizhong Su, Dalong Du, Chang Huang, Philip H. S. Torr, Conditional Random Fields as Recurrent Neural Networks, arXiv:1502.03240. (8th ranked in VOC2012)
DeepLab
Liang-Chieh Chen, George Papandreou, Kevin Murphy, Alan L. Yuille, Weakly-and semi-supervised learning of a DCNN for semantic image segmentation, arXiv:1502.02734. (9th ranked in VOC2012)
Zoom-out
Mohammadreza Mostajabi, Payman Yadollahpour, Gregory Shakhnarovich, Feedforward Semantic Segmentation With Zoom-Out Features, CVPR, 2015
Joint Calibration
Holger Caesar, Jasper Uijlings, Vittorio Ferrari, Joint Calibration for Semantic Segmentation, arXiv:1507.01581.
Fully Convolutional Networks for Semantic Segmentation
Jonathan Long, Evan Shelhamer, Trevor Darrell, Fully Convolutional Networks for Semantic Segmentation, CVPR, 2015.
Hypercolumn
Bharath Hariharan, Pablo Arbelaez, Ross Girshick, Jitendra Malik, Hypercolumns for Object Segmentation and Fine-Grained Localization, CVPR, 2015.
Deep Hierarchical Parsing
Abhishek Sharma, Oncel Tuzel, David W. Jacobs, Deep Hierarchical Parsing for Semantic Segmentation, CVPR, 2015.
Learning Hierarchical Features for Scene Labeling
Clement Farabet, Camille Couprie, Laurent Najman, Yann LeCun, Scene Parsing with Multiscale Feature Learning, Purity Trees, and Optimal Covers, ICML, 2012.
Clement Farabet, Camille Couprie, Laurent Najman, Yann LeCun, Learning Hierarchical Features for Scene Labeling, PAMI, 2013.
University of Cambridge
Vijay Badrinarayanan, Alex Kendall and Roberto Cipolla “SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation.” arXiv preprint arXiv:1511.00561, 2015.
Alex Kendall, Vijay Badrinarayanan and Roberto Cipolla “Bayesian SegNet: Model Uncertainty in Deep Convolutional Encoder-Decoder Architectures for Scene Understanding.” arXiv preprint arXiv:1511.02680, 2015.
Princeton
Fisher Yu, Vladlen Koltun, “Multi-Scale Context Aggregation by Dilated Convolutions”, ICLR 2016
Univ. of Washington, Allen AI
Hamid Izadinia, Fereshteh Sadeghi, Santosh Kumar Divvala, Yejin Choi, Ali Farhadi, “Segment-Phrase Table for Semantic Segmentation, Visual Entailment and Paraphrasing”, ICCV, 2015
INRIA
Iasonas Kokkinos, “Pusing the Boundaries of Boundary Detection Using deep Learning”, ICLR 2016
UCSB
Niloufar Pourian, S. Karthikeyan, and B.S. Manjunath, “Weakly supervised graph based semantic segmentation by learning communities of image-parts”, ICCV, 2015
其他資源
課程
深度視覺
[斯坦福] CS231n: Convolutional Neural Networks for Visual Recognition
[香港中文大學] ELEG 5040: Advanced Topics in Signal Processing(Introduction to Deep Learning)
· 更多深度課程推薦
[斯坦福] CS224d: Deep Learning for Natural Language Processing
[牛津 Deep Learning by Prof. Nando de Freitas
[紐約大學] Deep Learning by Prof. Yann LeCun
圖書
免費線上圖書
Deep Learning by Ian Goodfellow, Yoshua Bengio, and Aaron Courville
Neural Networks and Deep Learning by Michael Nielsen
Deep Learning Tutorial by LISA lab, University of Montreal
視訊
演講
Deep Learning, Self-Taught Learning and Unsupervised Feature Learning By Andrew Ng
Recent Developments in Deep Learning By Geoff Hinton
The Unreasonable Effectiveness of Deep Learning by Yann LeCun
Deep Learning of Representations by Yoshua bengio
軟體
框架
- Tensorflow: An open source software library for numerical computation using data flow graph by Google [Web]
- Torch7: Deep learning library in Lua, used by Facebook and Google Deepmind [Web]
- Torch-based deep learning libraries: [torchnet],
- Caffe: Deep learning framework by the BVLC [Web]
- Theano: Mathematical library in Python, maintained by LISA lab [Web]
- Theano-based deep learning libraries: [Pylearn2], [Blocks], [Keras], [Lasagne]
- MatConvNet: CNNs for MATLAB [Web]
- MXNet: A flexible and efficient deep learning library for heterogeneous distributed systems with multi-language support [Web]
- Deepgaze: A computer vision library for human-computer interaction based on CNNs [Web]
應用
- 對抗訓練 Code and hyperparameters for the paper “Generative Adversarial Networks” [Web]
- 理解與視覺化 Source code for “Understanding Deep Image Representations by Inverting Them,” CVPR, 2015. [Web]
- 詞義分割 Source code for the paper “Rich feature hierarchies for accurate object detection and semantic segmentation,” CVPR, 2014. [Web] ; Source code for the paper “Fully Convolutional Networks for Semantic Segmentation,” CVPR, 2015. [Web]
- 超解析度 Image Super-Resolution for Anime-Style-Art [Web]
- 邊緣檢測 Source code for the paper “DeepContour: A Deep Convolutional Feature Learned by Positive-Sharing Loss for Contour Detection,” CVPR, 2015. [Web]
- Source code for the paper “Holistically-Nested Edge Detection”, ICCV 2015. [Web]
講座
- [CVPR 2014] Tutorial on Deep Learning in Computer Vision
- [CVPR 2015] Applied Deep Learning for Computer Vision with Torch
部落格
- Deep down the rabbit hole: CVPR 2015 and [email protected]’s Computer Vision Blog
- CVPR recap and where we’re [email protected] Bylinskii (MIT PhD Student)’s Blog
- Facebook’s AI [email protected]
- Inceptionism: Going Deeper into Neural [email protected] Research
- Implementing Neural networks