MIPI 2023 Challenge on RGBW Fusion: Methods and Results

Qianhui Sun; Qingyu Yang; Chongyi Li; Shangchen Zhou; Ruicheng Feng; Wenxiu Sun; Qingpeng Zhu; Chen Change Loy; Jinwei Gu; Hongyuan Yu; Yuqinq Liu; Weichen Yu; Lin Ge; Xiaolin Zhang; Qi Jia; Heng Zhang; Xuanwu Yin; Kunlong Zuo; Qi Wu; Wenjie Lin; Ting Jiang; Chengzhi Jiang; Mingyan Han; Xinpeng Li; Jinting Luo; Lei Yu; Haoqiang Fan; Shuaicheng Liu; Kunyu Wang; Chengzhi Cao; Yuanshen Guan; Jiyuan Xia; Ruikang Xu; Mingde Yao; Zhiwei Xiong

doi:10.1109/CVPRW59228.2023.00288

MIPI 2023 Challenge on RGBW Fusion: Methods and Results

Qianhui Sun^*, Qingyu Yang, Chongyi Li, Shangchen Zhou, Ruicheng Feng, Wenxiu Sun, Qingpeng Zhu, Chen Change Loy, Jinwei Gu, Hongyuan Yu, Yuqinq Liu, Weichen Yu, Lin Ge, Xiaolin Zhang, Qi Jia, Heng Zhang, Xuanwu Yin, Kunlong Zuo, Qi Wu, Wenjie LinTing Jiang, Chengzhi Jiang, Mingyan Han, Xinpeng Li, Jinting Luo, Lei Yu, Haoqiang Fan, Shuaicheng Liu, Kunyu Wang, Chengzhi Cao, Yuanshen Guan, Jiyuan Xia, Ruikang Xu, Mingde Yao, Zhiwei Xiong

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

3 Citations (Scopus)

Abstract

Developing and integrating advanced image sensors with novel algorithms in camera systems are prevalent with the increasing demand for computational photography and imaging on mobile platforms. However, the lack of high-quality data for research and the rare opportunity for an in-depth exchange of views from industry and academia constrain the development of mobile intelligent photography and imaging (MIPI). With the success of the 1st MIPI Workshop@ECCV 2022, we introduce the second MIPI challenge, including four tracks focusing on novel image sensors and imaging algorithms. This paper summarizes and reviews the RGBW Joint Fusion and Denoise track on MIPI 2023. In total, 69 participants were successfully registered, and 4 teams submitted results in the final testing phase. The final results are evaluated using objective metrics, including PSNR, SSIM, LPIPS, and KLD. A detailed description of the models developed in this challenge is provided in this paper. More details of this challenge and the link to the dataset can be found at https://mipi-challenge.org/MIPI2023/.

Original language	English
Title of host publication	Proceedings - 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2023
Publisher	IEEE Computer Society
Pages	2871-2877
Number of pages	7
ISBN (Electronic)	9798350302493
DOIs	https://doi.org/10.1109/CVPRW59228.2023.00288
Publication status	Published - 2023
Externally published	Yes
Event	2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2023 - Vancouver, Canada Duration: Jun 18 2023 → Jun 22 2023

Publication series

Name	IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops
Volume	2023-June
ISSN (Print)	2160-7508
ISSN (Electronic)	2160-7516

Conference

Conference	2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2023
Country/Territory	Canada
City	Vancouver
Period	6/18/23 → 6/22/23

Bibliographical note

Publisher Copyright:
© 2023 IEEE.

ASJC Scopus Subject Areas

Computer Vision and Pattern Recognition
Electrical and Electronic Engineering

Access to Document

10.1109/CVPRW59228.2023.00288

Cite this

Sun, Q., Yang, Q., Li, C., Zhou, S., Feng, R., Sun, W., Zhu, Q., Loy, C. C., Gu, J., Yu, H., Liu, Y., Yu, W., Ge, L., Zhang, X., Jia, Q., Zhang, H., Yin, X., Zuo, K., Wu, Q., ... Xiong, Z. (2023). MIPI 2023 Challenge on RGBW Fusion: Methods and Results. In Proceedings - 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2023 (pp. 2871-2877). (IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops; Vol. 2023-June). IEEE Computer Society. https://doi.org/10.1109/CVPRW59228.2023.00288

@inproceedings{00d78ba888e94814909462f56360257a,

title = "MIPI 2023 Challenge on RGBW Fusion: Methods and Results",

abstract = "Developing and integrating advanced image sensors with novel algorithms in camera systems are prevalent with the increasing demand for computational photography and imaging on mobile platforms. However, the lack of high-quality data for research and the rare opportunity for an in-depth exchange of views from industry and academia constrain the development of mobile intelligent photography and imaging (MIPI). With the success of the 1st MIPI Workshop@ECCV 2022, we introduce the second MIPI challenge, including four tracks focusing on novel image sensors and imaging algorithms. This paper summarizes and reviews the RGBW Joint Fusion and Denoise track on MIPI 2023. In total, 69 participants were successfully registered, and 4 teams submitted results in the final testing phase. The final results are evaluated using objective metrics, including PSNR, SSIM, LPIPS, and KLD. A detailed description of the models developed in this challenge is provided in this paper. More details of this challenge and the link to the dataset can be found at https://mipi-challenge.org/MIPI2023/.",

author = "Qianhui Sun and Qingyu Yang and Chongyi Li and Shangchen Zhou and Ruicheng Feng and Wenxiu Sun and Qingpeng Zhu and Loy, \{Chen Change\} and Jinwei Gu and Hongyuan Yu and Yuqinq Liu and Weichen Yu and Lin Ge and Xiaolin Zhang and Qi Jia and Heng Zhang and Xuanwu Yin and Kunlong Zuo and Qi Wu and Wenjie Lin and Ting Jiang and Chengzhi Jiang and Mingyan Han and Xinpeng Li and Jinting Luo and Lei Yu and Haoqiang Fan and Shuaicheng Liu and Kunyu Wang and Chengzhi Cao and Yuanshen Guan and Jiyuan Xia and Ruikang Xu and Mingde Yao and Zhiwei Xiong",

note = "Publisher Copyright: {\textcopyright} 2023 IEEE.; 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2023 ; Conference date: 18-06-2023 Through 22-06-2023",

year = "2023",

doi = "10.1109/CVPRW59228.2023.00288",

language = "English",

series = "IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops",

publisher = "IEEE Computer Society",

pages = "2871--2877",

booktitle = "Proceedings - 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2023",

address = "United States",

}

Sun, Q, Yang, Q, Li, C, Zhou, S, Feng, R, Sun, W, Zhu, Q, Loy, CC, Gu, J, Yu, H, Liu, Y, Yu, W, Ge, L, Zhang, X, Jia, Q, Zhang, H, Yin, X, Zuo, K, Wu, Q, Lin, W, Jiang, T, Jiang, C, Han, M, Li, X, Luo, J, Yu, L, Fan, H, Liu, S, Wang, K, Cao, C, Guan, Y, Xia, J, Xu, R, Yao, M & Xiong, Z 2023, MIPI 2023 Challenge on RGBW Fusion: Methods and Results. in Proceedings - 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2023. IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, vol. 2023-June, IEEE Computer Society, pp. 2871-2877, 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2023, Vancouver, Canada, 6/18/23. https://doi.org/10.1109/CVPRW59228.2023.00288

MIPI 2023 Challenge on RGBW Fusion: Methods and Results. / Sun, Qianhui; Yang, Qingyu; Li, Chongyi et al.
Proceedings - 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2023. IEEE Computer Society, 2023. p. 2871-2877 (IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops; Vol. 2023-June).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - MIPI 2023 Challenge on RGBW Fusion

T2 - 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2023

AU - Sun, Qianhui

AU - Yang, Qingyu

AU - Li, Chongyi

AU - Zhou, Shangchen

AU - Feng, Ruicheng

AU - Sun, Wenxiu

AU - Zhu, Qingpeng

AU - Loy, Chen Change

AU - Gu, Jinwei

AU - Yu, Hongyuan

AU - Liu, Yuqinq

AU - Yu, Weichen

AU - Ge, Lin

AU - Zhang, Xiaolin

AU - Jia, Qi

AU - Zhang, Heng

AU - Yin, Xuanwu

AU - Zuo, Kunlong

AU - Wu, Qi

AU - Lin, Wenjie

AU - Jiang, Ting

AU - Jiang, Chengzhi

AU - Han, Mingyan

AU - Li, Xinpeng

AU - Luo, Jinting

AU - Yu, Lei

AU - Fan, Haoqiang

AU - Liu, Shuaicheng

AU - Wang, Kunyu

AU - Cao, Chengzhi

AU - Guan, Yuanshen

AU - Xia, Jiyuan

AU - Xu, Ruikang

AU - Yao, Mingde

AU - Xiong, Zhiwei

PY - 2023

Y1 - 2023

N2 - Developing and integrating advanced image sensors with novel algorithms in camera systems are prevalent with the increasing demand for computational photography and imaging on mobile platforms. However, the lack of high-quality data for research and the rare opportunity for an in-depth exchange of views from industry and academia constrain the development of mobile intelligent photography and imaging (MIPI). With the success of the 1st MIPI Workshop@ECCV 2022, we introduce the second MIPI challenge, including four tracks focusing on novel image sensors and imaging algorithms. This paper summarizes and reviews the RGBW Joint Fusion and Denoise track on MIPI 2023. In total, 69 participants were successfully registered, and 4 teams submitted results in the final testing phase. The final results are evaluated using objective metrics, including PSNR, SSIM, LPIPS, and KLD. A detailed description of the models developed in this challenge is provided in this paper. More details of this challenge and the link to the dataset can be found at https://mipi-challenge.org/MIPI2023/.

AB - Developing and integrating advanced image sensors with novel algorithms in camera systems are prevalent with the increasing demand for computational photography and imaging on mobile platforms. However, the lack of high-quality data for research and the rare opportunity for an in-depth exchange of views from industry and academia constrain the development of mobile intelligent photography and imaging (MIPI). With the success of the 1st MIPI Workshop@ECCV 2022, we introduce the second MIPI challenge, including four tracks focusing on novel image sensors and imaging algorithms. This paper summarizes and reviews the RGBW Joint Fusion and Denoise track on MIPI 2023. In total, 69 participants were successfully registered, and 4 teams submitted results in the final testing phase. The final results are evaluated using objective metrics, including PSNR, SSIM, LPIPS, and KLD. A detailed description of the models developed in this challenge is provided in this paper. More details of this challenge and the link to the dataset can be found at https://mipi-challenge.org/MIPI2023/.

UR - http://www.scopus.com/inward/record.url?scp=85170829797&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85170829797&partnerID=8YFLogxK

U2 - 10.1109/CVPRW59228.2023.00288

DO - 10.1109/CVPRW59228.2023.00288

M3 - Conference contribution

AN - SCOPUS:85170829797

T3 - IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops

SP - 2871

EP - 2877

BT - Proceedings - 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2023

PB - IEEE Computer Society

Y2 - 18 June 2023 through 22 June 2023

ER -

Sun Q, Yang Q, Li C, Zhou S, Feng R, Sun W et al. MIPI 2023 Challenge on RGBW Fusion: Methods and Results. In Proceedings - 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2023. IEEE Computer Society. 2023. p. 2871-2877. (IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops). doi: 10.1109/CVPRW59228.2023.00288

MIPI 2023 Challenge on RGBW Fusion: Methods and Results

Abstract

Publication series

Conference

Bibliographical note

ASJC Scopus Subject Areas

Access to Document

Other files and links

Cite this