MIPI 2022 Challenge on Under-Display Camera Image Restoration: Methods and Results

Ruicheng Feng; Chongyi Li; Shangchen Zhou; Wenxiu Sun; Qingpeng Zhu; Jun Jiang; Qingyu Yang; Chen Change Loy; Jinwei Gu; Yurui Zhu; Xi Wang; Xueyang Fu; Xiaowei Hu; Jinfan Hu; Xina Liu; Xiangyu Chen; Chao Dong; Dafeng Zhang; Feiyu Huang; Shizhuo Liu; Xiaobing Wang; Zhezhu Jin; Xuhao Jiang; Guangqi Shao; Xiaotao Wang; Lei Lei; Zhao Zhang; Suiyi Zhao; Huan Zheng; Yangcheng Gao; Yanyan Wei; Jiahuan Ren; Tao Huang; Zhenxuan Fang; Mengluan Huang; Junwei Xu; Yong Zhang; Yuechi Yang; Qidi Shu; Zhiwen Yang; Shaocong Li; Mingde Yao; Ruikang Xu; Yuanshen Guan; Jie Huang; Zhiwei Xiong; Hangyan Zhu; Ming Liu; Shaohui Liu; Wangmeng Zuo; Zhuang Jia; Binbin Song; Ziqi Song; Guiting Mao; Ben Hou; Zhimou Liu; Yi Ke; Dengpei Ouyang; Dekui Han; Jinghao Zhang; Qi Zhu; Naishan Zheng; Feng Zhao; Wu Jin; Marcos Conde; Sabari Nathan; Radu Timofte; Tianyi Xu; Jun Xu; P. S. Hrishikesh; Densen Puthussery; C. V. Jiji; Biao Jiang; Yuhan Ding; Wan Zhang Li; Xiaoyue Feng; Sijing Chen; Tianheng Zhong; Jiyang Lu; Hongming Chen; Zhentao Fan; Xiang Chen

doi:10.1007/978-3-031-25072-9_5

MIPI 2022 Challenge on Under-Display Camera Image Restoration: Methods and Results

Ruicheng Feng^*, Chongyi Li, Shangchen Zhou, Wenxiu Sun, Qingpeng Zhu, Jun Jiang, Qingyu Yang, Chen Change Loy, Jinwei Gu, Yurui Zhu, Xi Wang, Xueyang Fu, Xiaowei Hu, Jinfan Hu, Xina Liu, Xiangyu Chen, Chao Dong, Dafeng Zhang, Feiyu Huang, Shizhuo LiuXiaobing Wang, Zhezhu Jin, Xuhao Jiang, Guangqi Shao, Xiaotao Wang, Lei Lei, Zhao Zhang, Suiyi Zhao, Huan Zheng, Yangcheng Gao, Yanyan Wei, Jiahuan Ren, Tao Huang, Zhenxuan Fang, Mengluan Huang, Junwei Xu, Yong Zhang, Yuechi Yang, Qidi Shu, Zhiwen Yang, Shaocong Li, Mingde Yao, Ruikang Xu, Yuanshen Guan, Jie Huang, Zhiwei Xiong, Hangyan Zhu, Ming Liu, Shaohui Liu, Wangmeng Zuo, Zhuang Jia, Binbin Song, Ziqi Song, Guiting Mao, Ben Hou, Zhimou Liu, Yi Ke, Dengpei Ouyang, Dekui Han, Jinghao Zhang, Qi Zhu, Naishan Zheng, Feng Zhao, Wu Jin, Marcos Conde, Sabari Nathan, Radu Timofte, Tianyi Xu, Jun Xu, P. S. Hrishikesh, Densen Puthussery, C. V. Jiji, Biao Jiang, Yuhan Ding, Wan Zhang Li, Xiaoyue Feng, Sijing Chen, Tianheng Zhong, Jiyang Lu, Hongming Chen, Zhentao Fan, Xiang Chen

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

9 Citations (Scopus)

Abstract

Developing and integrating advanced image sensors with novel algorithms in camera systems is prevalent with the increasing demand for computational photography and imaging on mobile platforms. However, the lack of high-quality data for research and the rare opportunity for in-depth exchange of views from industry and academia constrain the development of mobile intelligent photography and imaging (MIPI). To bridge the gap, we introduce the first MIPI challenge including five tracks focusing on novel image sensors and imaging algorithms. In this paper, we summarize and review the Under-Display Camera (UDC) Image Restoration track on MIPI 2022. In total, 167 participants were successfully registered, and 19 teams submitted results in the final testing phase. The developed solutions in this challenge achieved state-of-the-art performance on Under-Display Camera Image Restoration. A detailed description of all models developed in this challenge is provided in this paper. More details of this challenge and the link to the dataset can be found at https://github.com/mipi-challenge/MIPI2022.

Original language	English
Title of host publication	Computer Vision – ECCV 2022 Workshops, Proceedings
Editors	Leonid Karlinsky, Tomer Michaeli, Ko Nishino
Publisher	Springer Science and Business Media Deutschland GmbH
Pages	60-77
Number of pages	18
ISBN (Print)	9783031250712
DOIs	https://doi.org/10.1007/978-3-031-25072-9_5
Publication status	Published - 2023
Externally published	Yes
Event	Workshops held at the 17th European Conference on Computer Vision, ECCV 2022 - Tel Aviv, Israel Duration: Oct 23 2022 → Oct 27 2022

Publication series

Name	Lecture Notes in Computer Science
Volume	13805 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	Workshops held at the 17th European Conference on Computer Vision, ECCV 2022
Country/Territory	Israel
City	Tel Aviv
Period	10/23/22 → 10/27/22

Bibliographical note

Publisher Copyright:
© 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.

ASJC Scopus Subject Areas

Theoretical Computer Science
General Computer Science

Keywords

Image restoration
MIPI challenge
Under-Display Camera

Access to Document

10.1007/978-3-031-25072-9_5

Cite this

Feng, R., Li, C., Zhou, S., Sun, W., Zhu, Q., Jiang, J., Yang, Q., Loy, C. C., Gu, J., Zhu, Y., Wang, X., Fu, X., Hu, X., Hu, J., Liu, X., Chen, X., Dong, C., Zhang, D., Huang, F., ... Chen, X. (2023). MIPI 2022 Challenge on Under-Display Camera Image Restoration: Methods and Results. In L. Karlinsky, T. Michaeli, & K. Nishino (Eds.), Computer Vision – ECCV 2022 Workshops, Proceedings (pp. 60-77). (Lecture Notes in Computer Science; Vol. 13805 LNCS). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-031-25072-9_5

@inproceedings{299477da14e0430680cbc97791a368e0,

title = "MIPI 2022 Challenge on Under-Display Camera Image Restoration: Methods and Results",

abstract = "Developing and integrating advanced image sensors with novel algorithms in camera systems is prevalent with the increasing demand for computational photography and imaging on mobile platforms. However, the lack of high-quality data for research and the rare opportunity for in-depth exchange of views from industry and academia constrain the development of mobile intelligent photography and imaging (MIPI). To bridge the gap, we introduce the first MIPI challenge including five tracks focusing on novel image sensors and imaging algorithms. In this paper, we summarize and review the Under-Display Camera (UDC) Image Restoration track on MIPI 2022. In total, 167 participants were successfully registered, and 19 teams submitted results in the final testing phase. The developed solutions in this challenge achieved state-of-the-art performance on Under-Display Camera Image Restoration. A detailed description of all models developed in this challenge is provided in this paper. More details of this challenge and the link to the dataset can be found at https://github.com/mipi-challenge/MIPI2022.",

keywords = "Image restoration, MIPI challenge, Under-Display Camera",

author = "Ruicheng Feng and Chongyi Li and Shangchen Zhou and Wenxiu Sun and Qingpeng Zhu and Jun Jiang and Qingyu Yang and Loy, \{Chen Change\} and Jinwei Gu and Yurui Zhu and Xi Wang and Xueyang Fu and Xiaowei Hu and Jinfan Hu and Xina Liu and Xiangyu Chen and Chao Dong and Dafeng Zhang and Feiyu Huang and Shizhuo Liu and Xiaobing Wang and Zhezhu Jin and Xuhao Jiang and Guangqi Shao and Xiaotao Wang and Lei Lei and Zhao Zhang and Suiyi Zhao and Huan Zheng and Yangcheng Gao and Yanyan Wei and Jiahuan Ren and Tao Huang and Zhenxuan Fang and Mengluan Huang and Junwei Xu and Yong Zhang and Yuechi Yang and Qidi Shu and Zhiwen Yang and Shaocong Li and Mingde Yao and Ruikang Xu and Yuanshen Guan and Jie Huang and Zhiwei Xiong and Hangyan Zhu and Ming Liu and Shaohui Liu and Wangmeng Zuo and Zhuang Jia and Binbin Song and Ziqi Song and Guiting Mao and Ben Hou and Zhimou Liu and Yi Ke and Dengpei Ouyang and Dekui Han and Jinghao Zhang and Qi Zhu and Naishan Zheng and Feng Zhao and Wu Jin and Marcos Conde and Sabari Nathan and Radu Timofte and Tianyi Xu and Jun Xu and Hrishikesh, \{P. S.\} and Densen Puthussery and Jiji, \{C. V.\} and Biao Jiang and Yuhan Ding and Li, \{Wan Zhang\} and Xiaoyue Feng and Sijing Chen and Tianheng Zhong and Jiyang Lu and Hongming Chen and Zhentao Fan and Xiang Chen",

note = "Publisher Copyright: {\textcopyright} 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.; Workshops held at the 17th European Conference on Computer Vision, ECCV 2022 ; Conference date: 23-10-2022 Through 27-10-2022",

year = "2023",

doi = "10.1007/978-3-031-25072-9\_5",

language = "English",

isbn = "9783031250712",

series = "Lecture Notes in Computer Science",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "60--77",

editor = "Leonid Karlinsky and Tomer Michaeli and Ko Nishino",

booktitle = "Computer Vision – ECCV 2022 Workshops, Proceedings",

address = "Germany",

}

Feng, R, Li, C, Zhou, S, Sun, W, Zhu, Q, Jiang, J, Yang, Q, Loy, CC, Gu, J, Zhu, Y, Wang, X, Fu, X, Hu, X, Hu, J, Liu, X, Chen, X, Dong, C, Zhang, D, Huang, F, Liu, S, Wang, X, Jin, Z, Jiang, X, Shao, G, Wang, X, Lei, L, Zhang, Z, Zhao, S, Zheng, H, Gao, Y, Wei, Y, Ren, J, Huang, T, Fang, Z, Huang, M, Xu, J, Zhang, Y, Yang, Y, Shu, Q, Yang, Z, Li, S, Yao, M, Xu, R, Guan, Y, Huang, J, Xiong, Z, Zhu, H, Liu, M, Liu, S, Zuo, W, Jia, Z, Song, B, Song, Z, Mao, G, Hou, B, Liu, Z, Ke, Y, Ouyang, D, Han, D, Zhang, J, Zhu, Q, Zheng, N, Zhao, F, Jin, W, Conde, M, Nathan, S, Timofte, R, Xu, T, Xu, J, Hrishikesh, PS, Puthussery, D, Jiji, CV, Jiang, B, Ding, Y, Li, WZ, Feng, X, Chen, S, Zhong, T, Lu, J, Chen, H, Fan, Z & Chen, X 2023, MIPI 2022 Challenge on Under-Display Camera Image Restoration: Methods and Results. in L Karlinsky, T Michaeli & K Nishino (eds), Computer Vision – ECCV 2022 Workshops, Proceedings. Lecture Notes in Computer Science, vol. 13805 LNCS, Springer Science and Business Media Deutschland GmbH, pp. 60-77, Workshops held at the 17th European Conference on Computer Vision, ECCV 2022, Tel Aviv, Israel, 10/23/22. https://doi.org/10.1007/978-3-031-25072-9_5

MIPI 2022 Challenge on Under-Display Camera Image Restoration: Methods and Results. / Feng, Ruicheng; Li, Chongyi; Zhou, Shangchen et al.
Computer Vision – ECCV 2022 Workshops, Proceedings. ed. / Leonid Karlinsky; Tomer Michaeli; Ko Nishino. Springer Science and Business Media Deutschland GmbH, 2023. p. 60-77 (Lecture Notes in Computer Science; Vol. 13805 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - MIPI 2022 Challenge on Under-Display Camera Image Restoration

T2 - Workshops held at the 17th European Conference on Computer Vision, ECCV 2022

AU - Feng, Ruicheng

AU - Li, Chongyi

AU - Zhou, Shangchen

AU - Sun, Wenxiu

AU - Zhu, Qingpeng

AU - Jiang, Jun

AU - Yang, Qingyu

AU - Loy, Chen Change

AU - Gu, Jinwei

AU - Zhu, Yurui

AU - Wang, Xi

AU - Fu, Xueyang

AU - Hu, Xiaowei

AU - Hu, Jinfan

AU - Liu, Xina

AU - Chen, Xiangyu

AU - Dong, Chao

AU - Zhang, Dafeng

AU - Huang, Feiyu

AU - Liu, Shizhuo

AU - Wang, Xiaobing

AU - Jin, Zhezhu

AU - Jiang, Xuhao

AU - Shao, Guangqi

AU - Wang, Xiaotao

AU - Lei, Lei

AU - Zhang, Zhao

AU - Zhao, Suiyi

AU - Zheng, Huan

AU - Gao, Yangcheng

AU - Wei, Yanyan

AU - Ren, Jiahuan

AU - Huang, Tao

AU - Fang, Zhenxuan

AU - Huang, Mengluan

AU - Xu, Junwei

AU - Zhang, Yong

AU - Yang, Yuechi

AU - Shu, Qidi

AU - Yang, Zhiwen

AU - Li, Shaocong

AU - Yao, Mingde

AU - Xu, Ruikang

AU - Guan, Yuanshen

AU - Huang, Jie

AU - Xiong, Zhiwei

AU - Zhu, Hangyan

AU - Liu, Ming

AU - Liu, Shaohui

AU - Zuo, Wangmeng

AU - Jia, Zhuang

AU - Song, Binbin

AU - Song, Ziqi

AU - Mao, Guiting

AU - Hou, Ben

AU - Liu, Zhimou

AU - Ke, Yi

AU - Ouyang, Dengpei

AU - Han, Dekui

AU - Zhang, Jinghao

AU - Zhu, Qi

AU - Zheng, Naishan

AU - Zhao, Feng

AU - Jin, Wu

AU - Conde, Marcos

AU - Nathan, Sabari

AU - Timofte, Radu

AU - Xu, Tianyi

AU - Xu, Jun

AU - Hrishikesh, P. S.

AU - Puthussery, Densen

AU - Jiji, C. V.

AU - Jiang, Biao

AU - Ding, Yuhan

AU - Li, Wan Zhang

AU - Feng, Xiaoyue

AU - Chen, Sijing

AU - Zhong, Tianheng

AU - Lu, Jiyang

AU - Chen, Hongming

AU - Fan, Zhentao

AU - Chen, Xiang

PY - 2023

Y1 - 2023

N2 - Developing and integrating advanced image sensors with novel algorithms in camera systems is prevalent with the increasing demand for computational photography and imaging on mobile platforms. However, the lack of high-quality data for research and the rare opportunity for in-depth exchange of views from industry and academia constrain the development of mobile intelligent photography and imaging (MIPI). To bridge the gap, we introduce the first MIPI challenge including five tracks focusing on novel image sensors and imaging algorithms. In this paper, we summarize and review the Under-Display Camera (UDC) Image Restoration track on MIPI 2022. In total, 167 participants were successfully registered, and 19 teams submitted results in the final testing phase. The developed solutions in this challenge achieved state-of-the-art performance on Under-Display Camera Image Restoration. A detailed description of all models developed in this challenge is provided in this paper. More details of this challenge and the link to the dataset can be found at https://github.com/mipi-challenge/MIPI2022.

AB - Developing and integrating advanced image sensors with novel algorithms in camera systems is prevalent with the increasing demand for computational photography and imaging on mobile platforms. However, the lack of high-quality data for research and the rare opportunity for in-depth exchange of views from industry and academia constrain the development of mobile intelligent photography and imaging (MIPI). To bridge the gap, we introduce the first MIPI challenge including five tracks focusing on novel image sensors and imaging algorithms. In this paper, we summarize and review the Under-Display Camera (UDC) Image Restoration track on MIPI 2022. In total, 167 participants were successfully registered, and 19 teams submitted results in the final testing phase. The developed solutions in this challenge achieved state-of-the-art performance on Under-Display Camera Image Restoration. A detailed description of all models developed in this challenge is provided in this paper. More details of this challenge and the link to the dataset can be found at https://github.com/mipi-challenge/MIPI2022.

KW - Image restoration

KW - MIPI challenge

KW - Under-Display Camera

UR - http://www.scopus.com/inward/record.url?scp=85150970340&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85150970340&partnerID=8YFLogxK

U2 - 10.1007/978-3-031-25072-9_5

DO - 10.1007/978-3-031-25072-9_5

M3 - Conference contribution

AN - SCOPUS:85150970340

SN - 9783031250712

T3 - Lecture Notes in Computer Science

SP - 60

EP - 77

BT - Computer Vision – ECCV 2022 Workshops, Proceedings

A2 - Karlinsky, Leonid

A2 - Michaeli, Tomer

A2 - Nishino, Ko

PB - Springer Science and Business Media Deutschland GmbH

Y2 - 23 October 2022 through 27 October 2022

ER -

Feng R, Li C, Zhou S, Sun W, Zhu Q, Jiang J et al. MIPI 2022 Challenge on Under-Display Camera Image Restoration: Methods and Results. In Karlinsky L, Michaeli T, Nishino K, editors, Computer Vision – ECCV 2022 Workshops, Proceedings. Springer Science and Business Media Deutschland GmbH. 2023. p. 60-77. (Lecture Notes in Computer Science). doi: 10.1007/978-3-031-25072-9_5