Machine Vision and Intelligence Group


Cewu Lu 卢策吾

Professor

School of Artificial Intelligence
Shanghai Jiao Tong University
Shanghai, China 200240


Email: lucewu[at]sjtu[dot]edu[dot]cn

Google Scholar

Recruiting

We are Recruiting Ph.D. students, Master students, Postdocs, and Undergraduate Research Interns. Contact us if you are interested in Embodied AI.

大家好,我们MVIG实验室诚邀大家加入我们(本科实习,硕士/博士,博士后,研究助理教授/研究员)做有影响力与原创的科研!有意向同学请发送邮件至:lucewu@sjtu.edu.cntami@sjtu.edu.cn,具体详情如下:

点击查看申请要求

本科实习生申请:

更多关于本科实习的信息请见详情

硕士、博士申请

博士后申请

Research AP(研究助理教授/研究员)申请

Short Bio

Cewu Lu, Professor at Shanghai Jiao Tong University, Distinguished Professor of the Changjiang Scholars Program (长江学者特聘教授), and recipient of the Scientific Exploration Award. In 2016, he was selected as a high-level overseas young talent, and in 2018, he was named one of the 35 Innovators Under 35 in China by MIT Technology Review (MIT TR35). In 2019, he received the Qiushi Outstanding Young Scholar Award, and in 2020, he was the third contributor to the Shanghai Science and Technology Progress Special Award. In 2022, he received the Ministry of Education Youth Science Award and was recognized for one of the six best papers at IROS (out of 3579 submissions). In 2023, he was nominated for the Best System Paper Award at the Robotics: Science and Systems (RSS) conference (one of four nominations) and received the Scientific Exploration Award (the only recipient in the field of embodied intelligence).

Before he joined SJTU, he was a research fellow at Stanford University working under Prof. Fei-Fei Li and Prof. Leonidas J. Guibas. He was a Research Assistant Professor at Hong Kong University of Science and Technology with Prof. Chi Keung Tang. He got the his PhD degree from The Chinese Univeristy of Hong Kong, supervised by Prof. Jiaya Jia.

As a corresponding author or first author, he has published more than 100 papers in high-impact journals and conferences, including Nature, Nature Machine Intelligence, and TPAMI. He serves as a reviewer for Science, Nature sub-journals, Cell sub-journals, and as area chair for NeurIPS, CVPR, ICCV, ECCV, IROS, and ICRA. His research interests include embodied intelligence and computer vision.


卢策吾老师曾在斯坦福大学人工智能实验室(导师:李飞飞,Leo Guibas)从事博士后研究。近年来获长江学者特聘教授,国家青年千人计划,《麻省理工科技评论》35位35岁以下科技精英(MIT TR35),科学探索奖(全国具身智能方向唯一),求是杰出青年学者,教育部青年科学奖,科学中国人杰出青年科学家,多年获得爱思唯尔Elsevier中国高被引学者等奖项荣誉。国际机器人顶会IROS、ICRA最佳论文获得者。担任《Nature》《Science》审稿人,CVPR、ICCV、ECCV、NeurIPS、AAAI等人工智能顶会的领域主席。 累计以第一或通讯作者发表CCF-A类期刊、会议论文100余篇,总引用量超过2万,包括《Nature》正刊,《Nature》机器智能子刊(上海交大第一篇),TPAMI,IJCV,T-RO,IJRR(机器人领域TOP期刊)等。

Our Task and Vision

The development of Robots for general-purpose has long been a shared dream of humanity, as their realization would significantly enhance productivity—by, for instance, performing tasks typically undertaken by nurses or cleaning staff—and improve the quality of life through applications such as domestic service robots. A general-purpose robot must be capable of executing a wide range of tasks in diverse and open-ended environments, posing a formidable challenge in the field of artificial intelligence. The crux of this challenge lies in enabling robots to acquire human behavioral capabilities. Building upon a strong foundation in the visual understanding of human behavior, we aim to explore a novel approach: empowering robots to learn comprehensive, general-purpose behaviors by observing and interpreting vast amounts of human activity in video form. Compared to the mainstream approach of guiding robotic behavior through large language models, our strategy offers several advantages in achieving generalizability:

By implementing this innovative approach, we pave the way for a more universally applicable and effective solution to the challenge of creating general-purpose robots.



实验室研究方向为通用机器人(具身智能),是实现通用人工智能的重要分支。与被动接收信息不同,具身智能强调智能体主动与物理环境进行交互。人类也在文艺作品里描绘过很多浪漫的机器人故事,比如《机器管家》中的安德鲁、《机器人总动员》中的瓦利和夏娃、《星球大战》里的R2-D2和C-3PO等等。 具身智能驱动的通用机器人将是人工智能的终极状态,也是目前国际学术和产业前沿。英伟达CEO黄仁勋在2023 world ITF大会表示:The next wave of AI, known as embodied AI, refers to intelligent systems that can understand, reason about, and interact with the physical world。即,人工智能的下一波浪潮被称为具身智能,它指的是能够理解、推理和与物理世界互动的智能系统。期待大家的加入和我们一起推动推动具身智能的变革。

-->