||   Bio   ||   Research   ||   Students   ||   Teaching   ||   Services   ||


Guoyu Lu

Assistant Professor
Chester F. Carlson Center for Imaging Science
Rochester Institute of Technology
Office: CAR-3132
54 Lomb Memorial Dr., Rochester, NY 14623
Email: luguoyu at cis.rit.edu
Phone: (585) 475-6518

Biography
I am an Assistant Professor at the Chester F. Carlson Center for Imaging Science of Rochester Institute of Technology (RIT). Prior to joining RIT, I was a research scientist on autonomous driving at Ford Research and computer vision engineer at ESPN Advanced Technology Group. I also conducted an academic visiting at Auckland University of Technology. I was a research intern at Siemens Corporate Research in Princeton and Bosch Research in Palo Alto. I finished my PhD and MS in Computer Science at the University of Delaware. Before coming to UD, I was in European Master in Informatics (EuMI) Erasmus Mundus program. I obtained Master degree in Computer Science at University of Trento and Master degree in Media Informatics at RWTH Aachen University. I completed my Bachelor degree in Software Engineering at Nanjing University of Posts & Telecommunications, with a minor in Business Administration and Management.

As PI, my research has been supported by NSF (CSSI, CRII, and SHF programs), USDA, Ford, Qualcomm, Tencent, Mackinac etc. I have received USDA New Investigator Award, Ford URP Award, Tencent Rhino-Bird Young Faculty Award, Frank A. Pehrson Award, and Erasmus Mundus Scholarship. I serve as the Associate Editor of IST/SPIE Journal of Electronic Imaging. I have board research interests spreading across computer vision, machine/deep learning, multimedia, and robotics. I always look for students to conduct research with me. Please send me an email with your CV if interested.
Research
Journals

Yawen Lu, Yuxing Wang, Devarth Parikh, Awais, Khan, Guoyu Lu, Simultaneous Direct Depth Estimation and Synthesis Stereo for Single Image Plant Root Reconstruction, IEEE Transactions on Imaging Processing, 2021

Yawen Lu, Guoyu Lu, SuperThermal: Matching Thermal As Visible Through Thermal Feature Exploration, IEEE Robotics and Automation Letters, 2021

Yawen Lu, Guoyu Lu, Self-supervised Single-image Depth Estimation From Focus and Defocus Clues, IEEE Robotics and Automation Letters, 2021

Zhihua Xie, Jieyi Niu, Yi Li, Guoyu Lu, Regularization and Attention Feature Distillation base on Light CNN for Hyperspectral Face Recognition, Journal of Multimedia Tools and Applications, 2021

Zhihua Xie, Yi Li, Jieyi Niu, Ling Shi, Zhipeng Wang, and Guoyu Lu, Hyperspectral face recognition based on sparse spectral attention deep neural networks, Optics Express, 2020

Yawen Lu, Yuxing Wang, Zhanjie Chen, Awais Khan, Carl Salvaggio, Guoyu Lu, 3D Plant Root Reconstruction Based on Fusion of Deep Structure-from-Motion and IMU, Journal of Multimedia Tools and Applications, 2020

Zhelin Yu, Lidong Zhu, Guoyu Lu. An Improved Phase Correlation Method for Stop Detection of Autonomous Driving, IEEE Access 2020

Zhen Wang, Guoshan Xu, Yong Ding, Bin Wu, Guoyu Lu, A vision-based active learning convolutional neural network model for concrete surface crack detection, Advances in Structural Engineering, 2020

Guoyu Lu, Liqiang Nie, Scott Sorenson, Chandra Kambhamettu, Large-scale Tracking for Images with Few Textures, IEEE Transactions on Multimedia, 2017

Guoyu Lu, Yan Yan, Nicu Sebe, Chandra Kambhamettu, Indoor Localization via Multi-View Images and Videos, Journal of Computer Vision and Image Understanding (CVIU), 2017

Guoyu Lu, Li Ren, Abhishek Kolagunda, Xiaolong Wang, Ismail, Turkbey, Peter Choyke, Chandra Kambhamettu, Representing 3D Shapes based on Implicit Surface Functions Learned from RBF Neural Networks, Journal of Visual Communication and Image Representation, 2016

Guoyu Lu, Yan Yan, Li Ren, Philip Saponaro, Nicu Sebe and Chandra Kambhamettu, Where Am I in the Dark: Exploring Active Transfer Learning on the Use of Indoor Localization based on Thermal Imaging, Journal of Neurocomputing, 2016

Gaowen Liu, Yan Yan, Subramanian Ramanathan, Jingkuan Song, Guoyu Lu, Nicu Sebe, Active Domain Adaptation with Noisy Labels for Multimedia Analysis, Journal of World Wide Web 2016

Guoyu Lu, Nicu Sebe, Confu Xu, Chandra Kambhamettu, Memory Efficient Image-based Localization, Journal of Multimedia Tools and Applications, 2015


Conferences

Yawen Lu, Guoyu Lu, 3D Modeling Beneath Ground: Plant Root Detection and Reconstruction Based on Ground-Penetrating Radar, IEEE Winter Conference on Applications of Computer Vision (WACV) 2022

Yuxing Wang, Yawen Lu, Zhihua Xie, Guoyu Lu, Deep Unsupervised 3D SfM Face Reconstruction Based on Massive Landmark Bundle Adjustment, ACM Multimedia (MM) (oral), 2021

Yawen Lu, Nikola Kasabov and Guoyu Lu, Multi-view Geometry Consistency Network for Facial Micro-Expression Recognition From Various Perspectives, IJCNN 2021

Hao Wang, Tao Zhang, Guoyu Lu, Unsupervised HDR Image Reconstruction Based on Over/Under-Exposed LDR Image Pair, ICME 2021

Yawen Lu, Yuhao Zhu, Guoyu Lu, 3D SceneFlowNet: Self-supervised 3D Scene Flow Estimation based on Graph CNN, ICIP 2021

Zhelin Yu, Lidong Zhu, Guoyu Lu, VINS-Motion: Tightly-coupled Fusion of VINS and Motion Constraint, ICRA 2021

Yuxing Wang, Yawen Lu, Guoyu Lu, Stereo Rectification Based on Epipolar Constrained Neural Network, ICASSP 2021

Bhavesh Deshpande, Sourabh Hanamsheth, Yawen Lu, Guoyu Lu, Matching As Color Images: Thermal Image Local Feature Detection And Description, ICASSP 2021

Yawen Lu, Guoyu Lu, An Alternative of LIDAR in Nighttime: Unsupervised Depth Estimation Based on Single Thermal Image, IEEE Winter Conference on Applications of Computer Vision (WACV) 2021

Yawen Lu, Yuxing Wang, Di Wu, Yuan Xin, Guoyu Lu, Unsupervised Gaze: Exploration of Geometric Constraints for 3D Gaze Estimation, International Conference on Multimedia Modeling (MMM), 2021

SICK Inc. TiM$10K Challenge (2020) winning team, Converting 2D LiDAR into 3D LiDAR, details in (https://sickusablog.com/using-2d-lidar-camera-3d-lidar-applications/)

Yawen Lu, Yuxing Wang, Guoyu Lu, Single Image Shape-from-Silhouettes, 28th ACM Multimedia (MM) 2020

Yawen Lu, Michel Sarkis, Guoyu Lu, Multi-task Learning for Single Image Depth Estimation and Segmentation Based on Unsupervised Network, ICRA 2020

Yawen Lu, Yuxing Wang, Devarth Parikh, Guoyu Lu, Extending Single Beam Lidar To Full Resolution By Fusing with Single Image Depth Estimation, ICPR 2020

Yawen Lu*, Sophia Kourian*, Carl Salvaggio, Chenliang Xu, Guoyu Lu, Single Image 3D Vehicle Pose Estimation for Augmented Reality, IEEE Global Conference on Signal and Information Processing (GlobalSIP), 2019 (* indicates equal contribution) (IEEE Student Travel Award)

Devarth Parikh, Yawen Lu, Jeff Pelz, Guoyu Lu, Where Am I Looking: Localizing Gaze In Reconstructed 3D Space, IEEE Global Conference on Signal and Information Processing (GlobalSIP), 2019

Yawen Lu, Guoyu Lu, A Geometric Convolutional Neural Network for 3D Object Detection, IEEE Global Conference on Signal and Information Processing (GlobalSIP), 2019

Guoyu Lu, Bring Light to the Night: Classifying Thermal Image via Convolutional Neural Network based on Visible Domain Transformation, IEEE Global Conference on Signal and Information Processing (GlobalSIP), 2019

Yawen Lu, Guoyu Lu, Deep Unsupervised Learning for Simultaneous Visual Odometry and Depth Estimation, 26th IEEE International Conference on Image Processing (ICIP), 2019

Guoyu Lu, Xue-Iuan Wong, James McBride, From Mapping to Localization: A Complete Framework to Visually Estimate Position and Attitude for Autonomous Vehicles, 26th IEEE International Conference on Image Processing (ICIP), 2019

Guoyu Lu, Yahong Han, 3D Shape Retrieval Through Multilayer RBF Neural Network, 26th IEEE International Conference on Image Processing (ICIP), 2019

Guoyu Lu, Xue-Iuan Wong, Taking Me to The Correct Place: Vision-based Localization for Autonomous Vehicles, 26th IEEE International Conference on Image Processing (ICIP), 2019

Guoyu Lu, Jingkuan Song, 3D Image-based Indoor Localization Joint With WiFi Positioning, ACM ICMR 2018

Guoyu Lu, Huili Yu, Chun Yuan, Getting Rid of Night: Thermal Image Classification Based on Feature Fusion, 24th ICPR 2018

Guoyu Lu, Li Ren, Jeff Caplan, Chandra Kambhamettu, Stromule Branch Tip Detection Based on Accurate Cell Image Segmentation, 24th IEEE International Conference on Image Processing (ICIP), 2017

Guoyu Lu, Li Ren, Abhishek Kolagunda, Chandra Kambhamettu, Neural Network Shape: Organ Shape Representation With Radial Basis Function Neural Networks, 41st ICASSP (NSF travel grant) 2016.

Guoyu Lu, Yan Yan, Abhishek Kolagunda, Chandra Kambhamettu, A Fast 3D Indoor-localization Approach Based on Video Queries, 22nd Multimedia Modelling Conference (MMM) (oral), 2016

Guoyu Lu, Yan Yan, Li Ren, Jingkuan Song, Nicu Sebe, Chandra Kambhamettu, Localize me Anywhere, Anytime: A Multi-task Point-Retrieval Approach, ICCV 2015

Abhishek Kolagunda, Guoyu Lu, Chandra Kambhamettu, Hybrid Hierarchical Shape Representation for Medical Shapes, BMVC 2015

Guoyu Lu, Yan Yan, Nicu Sebe, Chandra Kambhamettu, Knowing Where I Am:Exploiting Multi-Task Learning for Mult-view Indoor Image-based Localization, 25th BMVC, 2014

Guoyu Lu, Vincent Ly, Chandra Kambhamettu, Structure-from-Motion Reconstruction Based on Weighted Hamming Descriptors, 24th IEEE IJCNN, 2014

Guoyu Lu, Yingjie Hu, Chandra Kambhamettu, Weighted SIFT Feature Learning with Hamming Distance for Face Recognition, The 9th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISAPP) 2014. (Oral)

Guoyu Lu, Vincent Ly, Chandra Kambhamettu, Large-scale Structure-from-Motion Reconstruction with small memory consumption, The 11th International Conference on Advances in Mobile Computing and Multimedia, 2013

Guoyu Lu, Vincent Ly, Xiaolong Wang, Rohith MV, Orlando Ayala, Lian-Ping Wang, Chandra Kambhamettu, A Tool for VisualizingLarge-Scale Interactions Between Turbulence and Particles in 3D Spacethrough 2D Trajectory Visualization, International Symposium on Visual Computing, 2013. (oral)

Guoyu Lu, Vincent Ly, Haoquan Shen, Abhishek Kolagunda, ChandraKambhamettu, Improving Image-based Localization Through Increasing Correct Feature Correspondences, International Symposium on Visual Computing, 2013. (oral)

Rohith MV, Stephen Rhein, Guoyu Lu, Scott Sorensen, Andrew R. Mahoney, Hajo Eicken, Iterative reconstruction of large scenes using heterogeneous feature tracking, CVPR workshop (Big Data Computer Vision) 2013

Xiaolong Wang, Vincent Ly, Guoyu Lu Chandra Kambhamettu, Could We Minimize the Influence Brought by Gender and Race Difference in Age Estimation?, 12th IEEE International Conference on Machine Learning and Applications (ICMLA), 2013

Ammar Mohemmed, Guoyu Lu, Nikola Kasabov, Evaluating SPAN Incremental Learning for Handwritten Digit Recognition, 19th ICONIP conference, 2012 (Oral)

Students
PhD: Yawen Lu, Yuxing Wang
MS: Sourabh Hanamsheth, Saurabh Sonje, Janardhan Chaudhari, Xiya Liu
Alumni: Jinil Gondalia, MS (first job after graduation: R&D Engineer at Vecna Robotics), Atharva Tembe, MS (first job after graduation: Software Engineer at Qualcomm), Bhavesh Deshpande MS, (first job after graduation: Camera Systems Engineer at Light) Devarth Parikh, MS, (first job after graduation: Research Engineer at Ford Motor Company), Yogeshwar Vishnu Jadhav, MS, (first job after graduation: Robotics Deployment Engineer at 6 River Systems), Pranav Kelkar, MS, (first job after graduation: SDE at Amazon), Donald Shultz, BS, (graduate with summa cum laude, first job after graduation: graduate student at RIT Math Modeling), Ian Smith, BS, Christian Lusardi, BS, (first job after graduation: graduate student at RIT Imaging Science), Sophia Kourian, BS, (first job after graduation: System Engineer at United Technologies), Makayla Roof, BS, (first job after graduation: Imaging Scientist at D3 Engineering)
Teaching
  • IMGS-682 Image Processing and Computer Vision (Spring 2019, Spring 2020)
  • IMGS-712 Multi-view Imaging (Spring 2018, Spring 2019, Spring 2020, Spring 2021)
  • IMGS-789 Robot Vision (Fall 2018)
  • Professional Services


    Last updated: June, 2021