www.jimmyren.com

General Information

Publications

Some of My Previous Interns

Work Experience

Award and Certificate

 

 

 

 

Jimmy S. Ren 任思捷
Email: jimmy.sj.ren@gmail.com

General Information
I am currently an Executive Research Director at SenseTime. I lead a cross-functional R&D team where engineers, scientists, product managers, system integrators work together to create high-impact A.I. products. I received my Ph.D. from Department of Information Systems at The City University of Hong Kong where I studied theories and applications of decision making in large scale social systems using machine learning. Prior to that, I spent a few years at Intel and Ericsson (E///) as a software engineer.

My CV
Find me on linkedin

News
-> 07/2024: 1 paper accepted to ACMMM 2024.
-> 02/2024: 1 paper accepted to CVPR 2024.
-> 10/2023: 1 paper accepted to IJCV.
-> 10/2023: 1 paper accepted to TPAMI.
-> 02/2023: 1 paper accepted to CVPR 2023.

Publications [Google Scholar Page]

My research interests are Computational Photography, Computational Imaging, Image/Signal Processing. I am also interested in using machine learning and deep learning methods in these areas.

Date Topic
[65] "Color4E: Event Demosaicing for Full-color Event Guided Image Deblurring",
Yi Ma, Peiqi Duan, Yuchen Hong, Chu Zhou, Yu Zhang, Jimmy S. Ren, Boxin Shi
ACM Multimedia Conference (ACMMM 2024).
paper
2024 Event Camera
[64] "Latency Correction for Event-guided Deblurring and Frame Interpolation",
Yixin Yang, Jinxiu Liang, Bohan Yu, Yan Chen, Jimmy S. Ren, Boxin Shi
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2024).
paper
2024 Event Camera
[63] "Deep Richardson-Lucy Deconvolution for Low-Light Image Deblurring",
Liang Chen, Jiawei Zhang, Zhenhua Li, Yunxuan Wei, Faming Fang, Jimmy S. Ren, Jinshan Pan
International Journal of Computer Vision (IJCV).
paper
2024 Comp. Photography
[62] "Reliable Event Generation With Invertible Conditional Normalizing Flow",
Daxin Gu, Jia Li, Lin Zhu, Yu Zhang, Jimmy S. Ren
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI).
paper
2024 Event Camera
[61] "Joint Demosaicing and Denoising with Gradient Guidance in Quad Bayer CFA",
Xun Wu, Yaqi Wu, Jiawei Zhang, Feng Zhang, Jimmy S. Ren
IEEE International Conference on Image Processing (ICIP 2023).
paper
2023 Comp. Photography
[60] "Range-nullspace Video Frame Interpolation with Focalized Motion Estimation",
Zhiyang Yu, Yu Zhang, Dongqing Zou, Xijun Chen, Jimmy S. Ren, Shunqing Ren
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2023).
paper project code
2023 Deep Learning
[59] "Self-Supervised Intensity-Event Stereo Matching",
Jinjin Gu, Jinan Zhou, Ringo SaiWo Chu, Yan Chen, Jiawei Zhang, Xuanye Cheng, Song Zhang, Jimmy S. Ren
Electronic Imaging 2023 (JIST-First Issue of the Journal of Imaging Science and Technology) (EI 2023).
paper project code
2023 Event Camera
[58] "Deep Bayesian Video Frame Interpolation",
Zhiyang Yu, Yu Zhang, Xujie Xiang, Dongqing Zou, Xijun Chen, Jimmy S. Ren
European Conference on Computer Vision (ECCV 2022).
paper code
2022 Deep Learning
[57] "Rethinking Learning-based Demosaicing, Denoising, and Super-Resolution Pipeline",
Guocheng Qian, Yuanhao Wang, Jinjin Gu, Chao Dong, Wolfgang Heidrich, Bernard Ghanem, Jimmy S. Ren
International Conference on Computational Photography (ICCP 2022).
paper project
2022 Comp. Photography
[56] "Image Deblurring Aided by Low-Resolution Events",
Zhouxia Wang, Jimmy S. Ren, Jiawei Zhang, Ping Luo
Electronics 11(4), 631 (Electronics).
paper
2022 Event Camera
[55] "Learning Spatially Variant Linear Representation Models for Joint Filtering",
Jiangxin Dong, Jinshan Pan, Jimmy S. Ren, Liang Lin, Jinghui Tang, Ming-Hsuan Yang
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI).
paper
2021 Comp. Photography
[54] "Bringing Events into Video Deblurring with Non-consecutively Blurry Frames",
Wei Shang, Dongwei Ren, Dongqing Zou, Jimmy S. Ren, Ping Luo, Wangmeng Zuo
International Conference on Computer Vision (ICCV 2021).
paper code
2021 Event Camera
[53] "Training Weakly Supervised Video Frame Interpolation with Events",
Zhiyang Yu, Deyuan Liu, Yu Zhang, Dongqing Zou, Xijun Chen, Yebin Liu, Jimmy S. Ren
International Conference on Computer Vision (ICCV 2021).
paper code
2021 Event Camera
[52] "A New Journey from SDRTV to HDRTV",
Xiangyu Chen, Zhengwen Zhang, Jimmy S. Ren, Lynhoo Tian, Yu Qiao, Chao Dong
International Conference on Computer Vision (ICCV 2021).
paper code
2021 Deep Learning
[51] "Low-dose CT Denoising Using a Structure-Preserving Kernel Prediction Network",
Lu Xu, Yuwei Zhang, Ying Liu, Daoye Wang, Mu Zhou, Jimmy S. Ren, Jingwei Wei, Zhaoxiang Ye
IEEE International Conference on Image Processing (ICIP 2021).
paper code
2021 Comp. Photography
[50] "Deep Dynamic Scene Deblurring from Optical Flow",
Jiawei Zhang, Jinshan Pan, Daoye Wang, Shangchen Zhou, Xing Wei, Furong Zhao, Jianbo Liu, Jimmy S. Ren,
IEEE Transactions on Circuits and Systems for Video Technology (TCSVT).
paper
2021 Comp. Photography
[49] "Learning a Non-blind Deblurring Network for Night Blurry Images",
Liang Chen, Jiawei Zhang, Jinshan Pan, Songnan Lin, Faming Fang, Jimmy S. Ren,
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2021).
paper
2021 Comp. Photography
[48] "Blind Deblurring for Saturated Images",
Liang Chen, Jiawei Zhang, Songnan Lin, Faming Fang, Jimmy S. Ren,
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2021).
paper
2021 Comp. Photography
[47] "Deblurring Dynamic Scenes via Spatially Varying Recurrent Neural Networks",
Wenqi Ren, Jiawei Zhang, Jinshan Pan, Sifei Liu, Jimmy S. Ren, Junping Du, Xiaochun Cao, Ming-Hsuan Yang,
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI).
paper
2021 Comp. Photography
[46] "Efficient Deep Image Denoising via Class Specific Convolution",
Lu Xu, Jiawei Zhang, Xuanye Cheng, Feng Zhang, Xing Wei, Jimmy S. Ren,
Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI-21).
paper poster
2021 Comp. Photography
[45] "Cross-spectral Stereo Matching for Facial Disparity Estimation in The Dark",
Songnan Lin, Jiawei Zhang, Jing Chen, Yongtian Wang, Yicun Liu, Jimmy S. Ren,
Computer Vision and Image Understanding, Volume 200, 103046 (CVIU 2020).
paper
2020 3D & Stereo
[44] "Learning to See in the Dark with Events",
Song Zhang, Zhe Jiang, Yu Zhang, Dongqing Zou, Jimmy S. Ren, Bin Zhou,
European Conference on Computer Vision (ECCV 2020).
paper
2020 Event Camera
[43] "Learning Event-Driven Video Deblurring and Interpolation",
Songnan Lin, Jiawei Zhang, Zhe Jiang, Dongqing Zou, Jinshan Pan, Yongtian Wang, Jing Chen, Jimmy S. Ren,
European Conference on Computer Vision (ECCV 2020).
paper code
2020 Event Camera
[42] "PIPAL: a Large-Scale Image Quality Assessment Dataset for Perceptual Image Restoration",
Jinjin Gu, Haoming Cai, Haoyu Chen, Xiaoxing Ye, Jimmy S. Ren, Chao Dong,
European Conference on Computer Vision (ECCV 2020).
paper dataset
2020 Comp. Photography
[41] "Learning to Predict Context-adaptive Convolution for Semantic Segmentation",
Jianbo Liu, Junjun He, Yu Qiao, Jimmy S. Ren, Hongsheng Li,
European Conference on Computer Vision (ECCV 2020).
paper
2020 Deep Learning
[40] "EfficientFCN: Holistically-guided Decoding for Semantic Segmentation",
Jianbo Liu, Junjun He, Jiawei Zhang, Jimmy S. Ren, Hongsheng Li,
European Conference on Computer Vision (ECCV 2020).
paper
2020 Deep Learning
[39] "Visually Imbalanced Stereo Matching",
Yicun Liu, Jimmy S. Ren, Jiawei Zhang, Jianbo Liu, Mude Lin,
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2020).
paper code
2020 3D & Stereo
[38] "Learning Event-Based Motion Deblurring",
Zhe Jiang, Yu Zhang, Dongqing Zou, Jimmy S. Ren, Jiancheng Lv, Yebin Liu,
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2020).
paper
2020 Event Camera
[37] "Learning a Reinforced Agent for Flexible Exposure Bracketing Selection",
Zhouxia Wang, Jiawei Zhang, Mude Lin, Jiong Wang, Ping Luo, Jimmy S. Ren,
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2020).
paper code
2020 Comp. Photography
[36] "Physics-Based Generative Adversarial Models for Image Restoration and Beyond",
Jinshan Pan, Jiangxin Dong, Yang Liu, Jiawei Zhang, Jimmy S. Ren, Jinhui Tang, Yu-Wing Tai, Ming-Hsuan Yang,
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI).
project paper
2020 Comp. Photography
[35] "Very Power Efficient Neural Time-of-Flight",
Yan Chen, Jimmy S. Ren, Xuanye Cheng, Keyuan Qian, Luyang Wang, Jinwei Gu,
IEEE Winter Conference on Applications of Computer Vision (WACV 2020).
paper
2020 Comp. Photography
[34] "Self-Guided Novel View Synthesis via Elastic Displacement Network",
Yicun Liu, Jiawei Zhang, Ye Ma, Jimmy S. Ren,
IEEE Winter Conference on Applications of Computer Vision (WACV 2020).
paper
2020 3D & Stereo
[33] "Image Formation Model Guided Deep Image Super-Resolution",
Jinshan Pan, Deqing Sun, Yang Liu, Jimmy S. Ren, Ming-Ming Cheng, Jian Yang, Jinhui Tang,
The 34th AAAI Conference on Artificial Intelligence (AAAI-20).
paper
2020 Comp. Photography
[32] "Learning to Deblur Face Images via Sketch Synthesis",
Songnan Lin, Jiawei Zhang, Jinshan Pan, Yicun Liu, Yongtian Wang, Jing Chen, Jimmy S. Ren,
The 34th AAAI Conference on Artificial Intelligence (AAAI-20).
paper
2020 Comp. Photography
[31] "Generalizing Monocular 3D Human Pose Estimation in the Wild",
Luyang Wang, Yan Chen, Zhenhua Guo, Keyuan Qian, Mude Lin, Hongsheng Li, Jimmy S. Ren,
International Conf. on Computer Vision - Workshop on Geometry Meets Deep Learning (ICCVW 2019).
paper code data
2019 3D & Stereo
[30] "Spatio-Temporal Filter Adaptive Network for Video Deblurring",
Shangchen Zhou, Jiawei Zhang, Jinshan Pan, Haozhe Xie, Wangmeng Zuo, Jimmy S. Ren,
International Conference on Computer Vision (ICCV 2019).
paper project
2019 Comp. Photography
[29] "Dual Student: Breaking the Limits of Teacher in Semi-supervised Learning",
Zhanghan Ke, Daoye Wang, Qiong Yan Jimmy S. Ren, Rynson Lau,
International Conference on Computer Vision (ICCV 2019).
paper code
2019 Deep Learning
[28] "Learning Deep Priors for Image Dehazing",
Yang Liu, Jinshan Pan, Jimmy S. Ren, Zhixun Su,
International Conference on Computer Vision (ICCV 2019).
paper
2019 Comp. Photography
[27] "Trinity of Pixel Enhancement: a Joint Solution for Demosaicking, Denoising and Super-Resolution",
Guocheng Qian, Jinjin Gu, Jimmy S. Ren, Chao Dong, Furong Zhao, Juan Lin,
arxiv prepints 1905.02538.
paper code dataset
2019 Comp. Photography
[26] "DAVANet: Stereo Deblurring with View Aggregation",
Shangchen Zhou, Jiawei Zhang, Wangmeng Zuo, Haozhe Xie, Jinshan Pan, Jimmy S. Ren,
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2019) - oral.
paper project data
2019 Comp. Photography
[25] "Structure-Preserving Stereoscopic View Synthesis with Multi-Scale Adversarial Correlation Matching",
Yu Zhang, Dongqing Zou, Jimmy S. Ren, Zhe Jiang, Xiaohao Chen,
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2019).
paper
2019 3D & Stereo
[24] "Spatially Variant Linear Representation Models for Joint Filtering",
Jinshan Pan, Jiangxin Dong, Jimmy S. Ren, Liang Lin, Jinhui Tang, Ming-Hsuan Yang,
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2019).
paper
2019 Comp. Photography
[23] "DSR: Direct Self-rectification for Uncalibrated Dual-lens Cameras",
Ruichao Xiao, Wenxiu Sun, Jiahao Pang, Qiong Yan, Jimmy S. Ren,
International Conference on 3D Vision (3DV 2018).
paper code
2018 3D & Stereo
[22] "Learning Monocular Depth by Distilling Cross-domain Stereo Networks",
Xiaoyang Guo, Hongsheng Li, Shuai Yi, Jimmy S. Ren, Xiaogang Wang,
European Conference on Computer Vision (ECCV 2018).
paper code video
2018 3D & Stereo
[21] "Learning Selfie-Friendly Abstraction from Artistic Style Images",
Yicun Liu, Jimmy S. Ren, Jianbo Liu, Jiawei Zhang, Xiaohao Chen,
The 10th Asian Conference on Machine Learning (ACML 2018).
paper code video
2018 Comp. Photography
[20] "Deep Reasoning with Knowledge Graph for Social Relationship Understanding",
Zhouxia Wang, Tianshui Chen, Jimmy S. Ren, Weihao Yu, Hui Cheng, Liang Lin,
The 27th International Joint Conference on Artificial Intelligence (IJCAI 2018).
paper code
2018 Deep Learning
[19] "Single View Stereo Matching",
Yue Luo, Jimmy S. Ren, Mude Lin, Jiahao Pang, Wenxiu Sun, Hongsheng Li, Liang Lin,
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2018) - spotlight.
paper project code video
2018 3D & Stereo
[18] "Dynamic Scene Deblurring Using Spatially Variant Recurrent Neural Networks",
Jiawei Zhang, Jinshan Pan, Jimmy S. Ren, Yibing Song, Linchao Bao, Rynson Lau, Ming-Hsuan Yang,
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2018) - spotlight.
paper code
2018 Comp. Photography
[17] "3D Human Pose Estimation in the Wild by Adversarial Learning",
Wei Yang, Wanli Ouyang, Xiaolong Wang, Jimmy S. Ren, Hongsheng Li, Xiaogang Wang,
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2018).
paper video
2018 3D & Stereo
[16] "LSTM Pose Machines",
Yue Luo, Jimmy S. Ren, Zhouxia Wang, Wenxiu Sun, Jinshan Pan, Jianbo Liu, Jiahao Pang, Liang Lin,
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2018).
paper project code
2018 Deep Learning
[15] "Zoom and Learn: Generalizing Deep Stereo Matching to Novel Domains",
Jiahao Pang, Wenxiu Sun, Chengxi Yang, Jimmy S. Ren, Ruichao Xiao, Jin Zeng, Liang Lin,
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2018).
paper
2018 3D & Stereo
[14] "Learning Dual Convolutional Neural Networks for Low-Level Vision",
Jinshan Pan, Sifei Liu, Deqing Sun, Jiawei Zhang, Yang Liu, Jimmy S. Ren, Zechao Li, Jinhui Tang, Huchuan Lu, Yu-Wing Tai, Ming-Hsuan Yang,
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2018).
paper project code
2018 Comp. Photography
[13] "Cascade Residual Learning: A Two-stage Convolutional Neural Network for Stereo Matching",
Jiahao Pang, Wenxiu Sun, Jimmy S. Ren, Chengxi Yang, Qiong Yan,
International Conf. on Computer Vision - Workshop on Geometry Meets Deep Learning (ICCVW 2017)
paper Ranked 1st in KITTI Stereo Evaluation 2015 code
2017 3D & Stereo
[12] "Robust Tracking Using Region Proposal Networks",
Jimmy S. Ren, Zhiyang Yu, Jianbo Liu, Rui Zhang, Wenxiu Sun, Jiahao Pang, Xiaohao Chen, Qiong Yan,
arxiv 1705.10447 (2017)
paper code
2017 Deep Learning
[11] "Accurate Single Stage Detector Using Recurrent Rolling Convolution",
Jimmy S. Ren, Xiaohao Chen, Jianbo Liu, Wenxiu Sun, Jiahao Pang, Qiong Yan, Yu-Wing Tai, Li Xu,
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017).
paper code  KITTI ranking
 
2017 Deep Learning
[10] "Look, Listen and Learn - A Multimodal LSTM for Speaker Identification",
Jimmy S. Ren, Yongtao Hu, Yu-Wing Tai, Chuan Wang, Li Xu, Wenxiu Sun, Qiong Yan,
The 30th AAAI Conference on Artificial Intelligence (AAAI-16)(oral) 
paper code  
2016 Deep Learning
[9] "Shepard Convolutional Neural Networks",
Jimmy S. Ren, Li Xu, Qiong Yan, Wenxiu Sun,
Advances in Neural Information Processing Systems (NeurIPS 2015).
paper code  
2015 Comp. Photography
[8] "Deep Edge-Aware Filters",
Li Xu, Jimmy S. Ren, Qiong Yan, Renjie Liao, Jiaya Jia,
The 32nd International Conference on Machine Learning (ICML 2015).
paper project code poster video 
2015 Comp. Photography
[7] "Deep Multimodal Speaker Naming",
Yongtao Hu, Jimmy S. Ren, Jingwen Dai, Chang Yuan, Li Xu, Wenping Wang,
The 23rd ACM International Conference on Multimedia (MM 2015).
paper project code dataset video 
2015 Deep Learning
[6] "On Vectorization of Deep Convolutional Neural Networks for Vision Tasks",
Jimmy S. Ren and Li Xu,
The 29th AAAI Conference on Artificial Intelligence (AAAI-15).
paper code 
2015 Deep Learning
[5] "Deep Convolutional Neural Network for Image Deconvolution",
Li Xu, Jimmy S. Ren, Ce Liu, Jiaya Jia,
Advances in Neural Information Processing Systems (NeurIPS 2014).
paper poster project  
2014 Comp. Photography
[4] "The Process of Information Propagation along a Traffic Stream through Inter-vehicle Communication",
Wei Wang, Stephen Liao, Xin Li, Jimmy S. Ren,
IEEE Transaction on Intelligent Transportation Systems (IEEE TITS), 15(1), 345-354.
paper
2014 Modelling
[3] "Exploring The Contribution of Unlabeled Data in Financial Sentiment Analysis",
Jimmy S. Ren, Wei Wang, Jiawei Wang, Stephen Liao,
The 27th AAAI Conference on Artificial Intelligence (AAAI-13).
paper data
2013 Deep Learning
[2] "An Unsupervised Feature Learning Approach to Improve Automatic Incident Detection",
Jimmy S. Ren, Wei Wang, Jiawei Wang, Stephen Liao,
The 15th IEEE International Conference on Intelligent Transportation Systems (ITSC 2012).
paper
2012 Deep Learning
[1] "Optimal Refactoring Policy for Agile Information Systems Maintenance: A Control Theoretic Approach",
Jimmy S. Ren, Wei Wang, Zhimin Hua, Kaiquan Xu, Stephen Liao,
The 32nd International Conference on Information Systems (ICIS 2011).
paper
2011 Modelling

Some of My Previous Interns

Name   Next Position
Yue Luo 2017-2018 MSc student in Columbia University
Yicun Liu 2017-2018 MSc student in Columbia University
Fangjun Zhang 2017-2018 MSc student in New York University
Ziqi Chen 2018 MSc student in Carnegie Mellon University
Danlei Zhu 2018 PhD student in Carnegie Mellon University
Zhengyang Xia 2018 MSc student in Carnegie Mellon University
Cheng-Tsung Liu 2018 MSc student in University of Southern California
Guocheng Qian 2018-2019 MSc student in King Abdullah Univ. of Sci. and Technology
Jinjin Gu 2018-2019 PhD student in University of Sydney
Daoye Wang 2018-2019 MSc student in ETH Zurich
Lu Xu 2019-2020 MSc student in Carnegie Mellon University
Jinan Zhou 2020-2021 MSc student in Carnegie Mellon University

Work Experience
Senior Research Scientist, SenseTime Hong Kong (2015-now)
Research Engineer, Lenovo Labs Hong Kong (2013-2015)
Software Engineer, Ericsson China R&D (2006-2009)
Intern, Intel Asia Pacific R&D center (2006)
Research assistant, School of Software, Fudan University (2006)

Award and Certificate
SenseTime Research Dean's project list (2020)
First Prize of Lenovo Research Idea Platform (2015)
Best new employee, Lenovo Group Limited (2014)
Best performance of the year, Ericsson China R&D center (2008)
Certified Scrum Master (CSM) (2008)
Best performance (intern), Intel Asia Pacific R&D center (2006)
First class scholarship award of ECNU (2006)