计算机视觉近一年进展综述

2017 年 11 月 25 日 机器学习研究会
基于视觉的三维重建关键技术研究综述
专知会员服务
107+阅读 · 2020年5月1日
3D目标检测进展综述
专知会员服务
137+阅读 · 2020年4月24日
计算机视觉近一年进展综述

·Introduction

Computer Vision typically refers to the scientific discipline of giving machines the ability of sight, or perhaps more colourfully, enabling machines to visually analyse their environments and the stimuli within them. This process typically involves the evaluation of an image, images or video. The British Machine Vision Association (BMVA) defines Computer Vision as the automatic extraction, analysis and understanding of useful information from a single image or a sequence of images.[1]

The term understanding provides an interesting counterpoint to an otherwise mechanical definition of vision, one which serves to demonstrate both the significance and complexity of the Computer Vision field. True understanding of our environment is not achieved through visual representations alone. Rather, visual cues travel through the optic nerve to the primary visual cortex and are interpreted by the brain, in a highly stylised sense. The interpretations drawn from this sensory information encompass the near-totality of our natural programming and subjective experiences, i.e. how evolution has wired us to survive and what we learn about the world throughout our lives.

In this respect, vision only relates to the transmission of images for interpretation; whilecomputing said images is more analogous to thought or cognition, drawing on a multitude of the brain’s faculties. Hence, many believe that Computer Vision, a true understanding of visual environments and their contexts, paves the way for future iterations of Strong Artificial Intelligence, due to its cross-domain mastery.

However, put down the pitchforks as we’re still very much in the embryonic stages of this fascinating field. This piece simply aims to shed some light on 2016’s biggest Computer Vision advancements. And hopefully ground some of these advancements in a healthy mix of expected near-term societal-interactions and, where applicable, tongue-in-cheek prognostications of the end of life as we know it.

While our work is always written to be as accessible as possible, sections within this particular piece may be oblique at times due to the subject matter. We do provide rudimentary definitions throughout, however, these only convey a facile understanding of key concepts. In keeping our focus on work produced in 2016, often omissions are made in the interest of brevity.

One such glaring omission relates to the functionality of Convolutional Neural Networks (hereafter CNNs or ConvNets), which are ubiquitous within the field of Computer Vision. The success of AlexNet [2] in 2012, a CNN architecture which blindsided ImageNet competitors, proved instigator of a de facto revolution within the field, with numerous researchers adopting neural network-based approaches as part of Computer Vision’s new period of ‘normal science’.[3] 

Over four years later and CNN variants still make up the bulk of new neural network architectures for vision tasks, with researchers reconstructing them like legos; a working testament to the power of both open source information and Deep Learning. However, an explanation of CNNs could easily span several postings and is best left to those with a deeper expertise on the subject and an affinity for making the complex understandable.

For casual readers who wish to gain a quick grounding before proceeding we recommend the first two resources below. For those who wish to go further still, we have ordered the resources below to facilitate that:

  • What a Deep Neural Network thinks about your #selfie from Andrej Karpathy is one of our favourites for helping people understand the applications and functionalities behind CNNs.[4] 

  • Quora: “what is a convolutional neural network?” - Has no shortage of great links and explanations. Particularly suited to those with no prior understanding.[5]

  • CS231n: Convolutional Neural Networks for Visual Recognition from Stanford University is an excellent resource for more depth.[6]

  • Deep Learning (Goodfellow, Bengio & Courville, 2016) provides detailed explanations of CNN features and functionality in Chapter 9. The textbook has been kindly made available for free in HTML format by the authors.[7]

For those wishing to understand more about Neural Networks and Deep Learning in general we suggest:

  • Neural Networks and Deep Learning (Nielsen, 2017) is a free online textbook which provides the reader with a really intuitive understanding of the complexities of Neural Networks and Deep Learning. Even just completing chapter one should greatly illuminate the subject matter of this piece for first-timers.[8]

As a whole this piece is disjointed and spasmodic, a reflection of the authors’ excitement and the spirit in which it was intended to be utilised, section by section. Information is partitioned using our own heuristics and judgements, a necessary compromise due to the cross-domain influence of much of the work presented.

We hope that readers benefit from our aggregation of the information here to further their own knowledge, regardless of previous experience.

From all our contributors,

The M Tank

Part One: Classification/Localisation, Object Detection, Object Tracking

Classification/Localisation

The task of classification, when it relates to images, generally refers to assigning a label to the whole image, e.g. ‘cat’. Assuming this, Localisation may then refer to finding where the object is in said image, usually denoted by the output of some form of bounding box around the object. Current classification/localisation techniques on ImageNet[9] have likely surpassed an ensemble of trained humans.[10] For this reason, we place greater emphasis on subsequent sections of the blog.

Figure 1: Computer Vision Tasks




Source: Fei-Fei Li, Andrej Karpathy & Justin Johnson (2016) cs231n, Lecture 8 - Slide 8, Spatial Localization and Detection (01/02/2016). Available: http://cs231n.stanford.edu/slides/2016/winter1516_lecture8.pdf  

However, the introduction of larger datasets with an increased number of classes[11] will likely provide new metrics for progress in the near future. On that point, François Chollet, the creator of Keras,[12] has applied new techniques, including the popular architecture Xception, to an internal google dataset with over 350 million multi-label images containing 17,000 classes. [13],[14]  


Figure 2: Classification/Localisation results from ILSVRC (2010-2016)

Note: ImageNet Large Scale Visual Recognition Challenge (ILSVRC). The change in results from 2011-2012 resulting from the AlexNet submission. For a review of the challenge requirements relating to Classification and Localization see: http://www.image-net.org/challenges/LSVRC/2016/index#comp 

Source: Jia Deng (2016). ILSVRC2016 object localisation: introduction, results. Slide 2. Available:http://image-net.org/challenges/talks/2016/ILSVRC2016_10_09_clsloc.pdf 

Interesting takeaways from the ImageNet LSVRC (2016): 

  • Scene Classification refers to the task of labelling an image with a certain scene class like ‘greenhouse’, ‘stadium’, ‘cathedral’, etc. ImageNet held a Scene Classification challenge last year with a subset of the Places2[15] dataset: 8 million images for training with 365 scene categories. 
    Hikvision
    [16] won with a 9% top-5 error with an ensemble of deep Inception-style networks, and not-so-deep residuals networks.

  • Trimps-Soushen won the ImageNet Classification task with 2.99% top-5 classification error and 7.71% localisation error. The team employed an ensemble for classification (averaging the results of Inception, Inception-Resnet, ResNet and Wide Residual Networks models[17]) and Faster R-CNN for localisation based on the labels.[18] The dataset was distributed across 1000 image classes with 1.2 million images provided as training data. The partitioned test data compiled a further 100 thousand unseen images.

  • ResNeXt by Facebook came a close second in top-5 classification error with 3.03% by using a new architecture that extends the original ResNet architecture.[19] 


链接:

http://www.themtank.org/a-year-in-computer-vision


原文链接:

https://m.weibo.cn/1402400261/4177997059278344

登录查看更多
7

相关内容

基于视觉的三维重建关键技术研究综述
专知会员服务
107+阅读 · 2020年5月1日
3D目标检测进展综述
专知会员服务
137+阅读 · 2020年4月24日
专知会员服务
177+阅读 · 2020年3月6日
2019->2020必看的十篇「深度学习领域综述」论文
专知会员服务
243+阅读 · 2020年1月1日
人工智能顶刊TPAMI2019最新《多模态机器学习综述》
专知会员服务
72+阅读 · 2019年10月18日
强化学习最新教程,17页pdf
专知会员服务
96+阅读 · 2019年10月11日
[综述]深度学习下的场景文本检测与识别
专知会员服务
56+阅读 · 2019年10月10日
【资源】2019年计算机视觉综述论文汇聚
专知
36+阅读 · 2019年11月26日
【机器视觉】计算机视觉研究入门全指南
产业智能官
11+阅读 · 2018年9月23日
【综述】计算机视觉简介:历史、现状和发展趋势【可下载】
机器学习算法与Python学习
14+阅读 · 2018年9月21日
【推荐】RNN最新研究进展综述
机器学习研究会
23+阅读 · 2018年1月6日
综述 | 知识图谱发展概述
PaperWeekly
67+阅读 · 2017年11月3日
深度学习医学图像分析文献集
机器学习研究会
14+阅读 · 2017年10月13日
【论文】图上的表示学习综述
机器学习研究会
9+阅读 · 2017年9月24日
【推荐】深度学习目标检测全面综述
机器学习研究会
17+阅读 · 2017年9月13日
【推荐】GAN架构入门综述(资源汇总)
机器学习研究会
9+阅读 · 2017年9月3日
【推荐】全卷积语义分割综述
机器学习研究会
18+阅读 · 2017年8月31日
The Measure of Intelligence
Arxiv
5+阅读 · 2019年11月5日
AutoML: A Survey of the State-of-the-Art
Arxiv
56+阅读 · 2019年8月14日
Few-shot Learning: A Survey
Arxiv
344+阅读 · 2019年4月10日
Arxiv
121+阅读 · 2018年10月8日
Deep Learning for Generic Object Detection: A Survey
Arxiv
10+阅读 · 2018年5月13日
Arxiv
11+阅读 · 2018年1月11日
Arxiv
135+阅读 · 2017年8月1日
Arxiv
3+阅读 · 2012年11月20日
小贴士
相关VIP内容
基于视觉的三维重建关键技术研究综述
专知会员服务
107+阅读 · 2020年5月1日
3D目标检测进展综述
专知会员服务
137+阅读 · 2020年4月24日
专知会员服务
177+阅读 · 2020年3月6日
2019->2020必看的十篇「深度学习领域综述」论文
专知会员服务
243+阅读 · 2020年1月1日
人工智能顶刊TPAMI2019最新《多模态机器学习综述》
专知会员服务
72+阅读 · 2019年10月18日
强化学习最新教程,17页pdf
专知会员服务
96+阅读 · 2019年10月11日
[综述]深度学习下的场景文本检测与识别
专知会员服务
56+阅读 · 2019年10月10日
相关资讯
【资源】2019年计算机视觉综述论文汇聚
专知
36+阅读 · 2019年11月26日
【机器视觉】计算机视觉研究入门全指南
产业智能官
11+阅读 · 2018年9月23日
【综述】计算机视觉简介:历史、现状和发展趋势【可下载】
机器学习算法与Python学习
14+阅读 · 2018年9月21日
【推荐】RNN最新研究进展综述
机器学习研究会
23+阅读 · 2018年1月6日
综述 | 知识图谱发展概述
PaperWeekly
67+阅读 · 2017年11月3日
深度学习医学图像分析文献集
机器学习研究会
14+阅读 · 2017年10月13日
【论文】图上的表示学习综述
机器学习研究会
9+阅读 · 2017年9月24日
【推荐】深度学习目标检测全面综述
机器学习研究会
17+阅读 · 2017年9月13日
【推荐】GAN架构入门综述(资源汇总)
机器学习研究会
9+阅读 · 2017年9月3日
【推荐】全卷积语义分割综述
机器学习研究会
18+阅读 · 2017年8月31日
相关论文
The Measure of Intelligence
Arxiv
5+阅读 · 2019年11月5日
AutoML: A Survey of the State-of-the-Art
Arxiv
56+阅读 · 2019年8月14日
Few-shot Learning: A Survey
Arxiv
344+阅读 · 2019年4月10日
Arxiv
121+阅读 · 2018年10月8日
Deep Learning for Generic Object Detection: A Survey
Arxiv
10+阅读 · 2018年5月13日
Arxiv
11+阅读 · 2018年1月11日
Arxiv
135+阅读 · 2017年8月1日
Arxiv
3+阅读 · 2012年11月20日
Top
微信扫码咨询专知VIP会员