The 2020 IEEE Low-Power Computer Vision Challenge (LPCVC) concluded successfully on 2020/07/31, after a month of competition. Forty six teams submitted 378 solutions in four tracks. During the month-long challenge, many teams submitted multiple solutions and witnessed the scores becoming much higher. The 2020 LPCVC adds a video track and expands the Low-Power Image Recognition Challenge (LPIRC) started in 2015.

The 2020 LPCVC has three tracks:

  1. Recognizing English letters in video taken by an unmanned aerial vehicle (UAV, also called drone) using PyTorch Mobile
  2. Recognizing objects in images using FPGA (Field Programming Gate Array)
  3. Recognizing objects in images using TensorFlow
  4. Classifying images using TensorFlow

For more information, go to the competition introduction page. To see a detailed score breakdown for each submission, go to the leaderboard.

PyTorch - Video Track

This track requires that participating teams recognize English letters or numbers in the signs in the video captured by an unmanned aerial vehicle (UAV). The following two video frames show examples of such a challenge. The challenge appears in the form of question-answer pairs. A successful solution has to answer the English letters or numbers appearing in the same frame as the questions. For example, if the question is “RESTRICTED AREA”, the answer should be “B056 ELEVATOR CONTROL ELEVATOR PERSONNEL ONLY”. If the question is “CONFERENCE”, the answer should be “122”. The solutions are case insensitive. The solutions must use PyTorch running on Raspberry Pi 3B+.

Eleven teams submitted 84 solutions to this track. The winners of this tracks are

Prize

Team

Organization

Members

Representative

First

LPNet

ByteDance Inc

Xuefeng Xiao

Xing Wang

Li Lin

Tianyu Zhao

Ni Zhuang

Huixia Li

Xin Xia

Can Huang
Linfu Wen

Xuefeng Xiao
(xiaoxuefeng.ailab@bytedance.com)

Second

TAMU-KWAI

Texas A & M University and Kwai Inc

Yunhe Xue*

Zhenyu Hu*

Rahul Sridhar*

Zhenyu Wu*

Pengcheng Pi

Jiayi Shen

Jianchao Tan

Xiangru Lian

Zhangyang Wang

Ji Liu

Zhenyu Wu
(wuzhenyu_sjtu@tamu.edu)

Third

C408

Stony Brook University

(SUNY Korea)

Seonghwan Jeong

Jay Hoon Jung

YoungMin Kwon

Seonghwan Jeong (seonghwan.jeong@stonybrook.edu)

FPGA Track

This track uses Ultra96-V2 + Xilinx® Deep Learning Processor Unit (DPU) running software PYNQ + Vitis AI. The challenge recognizes objects in images. Nineteen teams submitted 115 solutions. The winners of this track are:

Prize

Team

Organization

Members

Representative

First

OnceForAll

MIT HAN Lab

Zhekai Zhang*

Han Cai*

Song Han

Yubei Chen

Jeffrey Pan

Ligeng Zhu

Tianzhe Wang

Song Han

Zhekai Zhang (zhangzk@mit.edu)

Second

MAAX

National Chiao Tung University, Taiwan

Shih-Yu Wei

Xuan-Hong Li

Yu-Da Ju

Juinn-Dar Huang

Xuan-Hong Li

(nonelee.ee05@g2.nctu.edu.tw)

Third

Water

SKLCA, Institute of Computing Technology, CAS

Shengwen Liang

Rick Lee

Ying Wang

Cheng Liu

Huawei Li

Shengwen Liang
(liangshengwen@ict.ac.cn)

TensorFlow Track (also called On-Device Visual Intelligence Challenge, OVIC)

This OVIC track contains three tracks:

  1. Interactive object detection: This category focuses on COCO detection models operating at 30 ms / image on a Pixel 4 smartphone (CPU).
  2. Real-time image classification: This category focuses on Imagenet classification models operating at 10 ms / image on a Pixel 4 smartphone (CPU).
  3. Real-time image classification: This category focuses on Imagenet classification models operating at 7 ms / image on a LG G8 smartphone (DSP).

Sixteen teams submitted 179 solutions to these tracks.

The winners of the first track (Interactive object detection using Pixel 4 CPU) are:

Prize

Team

Organization

Members

Representative

First

OnceForAll

MIT HAN Lab

Yubei Chen*

Jeffrey Pan*

Han Cai

Zhekai Zhang

Tianzhe Wang

Ligeng Zhu

Song Han

Yubei Chen (yubeic@berkeley.edu)

Second

SjtuBicasl

Shanghai Jiao Tong University

Lining Hu

Xinzi Xu

Yongfu Li

Weihong Yan

Xiaocui Li

Yuxin Ji

Xinzi Xu (xu_xinzi@sjtu.edu.cn)

Third

Novauto

Novauto Inc

Changcheng Tang
Tianyi Lu
Zhiyong Zhang
Shuang Liang
Tianchen Zhao
Xuefei Ning
Shiyao Li
Hanbo Sun
Shulin Zeng

Changcheng Tang
(tangcc1127@gmail.com)

The winners of the second track (Real-time image classification using Pixel 4 CPU) are:

Prize

Team

Organization

Members

Representative

First

BAIDU&THU

Baidu Inc & Tsinghua University

Zerun Wang

Teng Xi

Dahan Gong

Fei Tian

Zizhou Jia

Cheng Cui

Xiaoyu Huang

Zhihang Li

Fan Yang

Fukui Yang

Tianxiang Hao

Shengzhao Wen

Huiyue Yang

Gang Zhang

Guiguang Ding

Zerun Wang
(wangzrthu@gmail.com)

Second

imchinfei

Beihang University

Fei Qin

Yangyang Kuang

Fei Qin (64242200@qq.com)

Third

LPNet

ByteDance Inc

Xuefeng Xiao

Jiashi Li

Xin Xia

Huixia Li

Linfu Wen

Xuefeng Xiao (xiaoxuefeng.ailab@bytedance.com)

The winners of the third track (Real-time image classification using LG G8 DSP) are:

Prize

Team

Organization

Members

Representative

First

LPNet

ByteDance Inc

Xuefeng Xiao

Jiashi Li

Xin Xia

Huixia Li

Linfu Wen

Xuefeng Xiao (xiaoxuefeng.ailab@bytedance.com)

Second

imchinfei

Beihang University

Fei Qin

Yangyang Kuang

Fei Qin (64242200@qq.com)

Third

OnceForAll

MIT HAN Lab

Yubei Chen*

Jeffrey Pan*

Han Cai

Zhekai Zhang

Tianzhe Wang

Ligeng Zhu

Song Han

Yubei Chen (yubeic@berkeley.edu)

Third

FoxPanda

National Chiao Tung University and National Tsing Hua University.

Chia-Hsiang Liu

Wei-Xiang Guo

Yuan-Yao Sung

Yi Lee

Kai-Chiang Wu

Chia-Hsiang Liu (jacoblau.cs08g@nctu.edu.tw)

LPCVC started in 2015 with the aim to identify the technologies for computer vision using energy efficiently. IEEE Rebooting Computing has been the primary financial sponsor and provides administrative support. In 2020, sponsors are PyTorch, Google, Mediatek, Xilinx, IEEE Council of Design Automation, ELAN Microelectronics, National Science Foundation, IEEE Circuits and Systems Society, IEEE Rebooting Computing. A new IEEE technical committee has been created to coordinate future activities of low-power computer vision. People interested in joining the committee please contact Terence Martinez, Program Director Future Directions IEEE Technical Activities, t.c.martinez@ieee.org.

The organizing committee of the 2020 Low-Power Computer Vision Challenge are

First Name

Last Name

Organization

Hartwig

Adam

Google

Mohamed M. Sabry

Aly

Nanyang Technological University

Alexander C

Berg

University of North Carolina

Ming-Ching

Chang

University at Albany - SUNY

Bo

Chen

Google

Shu-Ching

Chen

Florida International University

Yen-Kuang

Chen

Alibaba

Yiran

Chen

Duke University

Chia-Ming

Cheng

Mediatek

Evgeni

Gousev

Qualcomm

Andrew

Howard

Google

Xiao

Hu

Purdue student

Christian

Keller

Facebook

Jaeyoun

Kim

Google

Mark

Liao

Academia Sinica, Taiwan

Tsung-Han

Lin

Mediatek

Yung-Hsiang

Lu

Purdue

An

Luo

Amazon

Hong

Luo

Xilinx Inc.

Terence

Martinez

IEEE Future Directions

Andreas

Moshovos

University of Toronto/Vector Institute

Naveen

Purushotham

Xilinx Inc.

Tim

Rogers

Purdue

Mei-Ling

Shyu

Miami University

Ashish

Sirasao

Xilinx Inc.

Joseph

Spisak

Facebook

George K.

Thiruvathukal

Loyola University Chiicago

Anirudh

Vegesana

Purdue student

Yueh-Hua

Wu

Academia Sinica, Taiwan

Carole-Jean

Wu

Facebook

Junsong

Yuan

University at Buffalo