Letian (Max) Fu

I am a PhD student at UC Berkeley advised by Professor Ken Goldberg. I am also a research intern at NVIDIA, working with Jim Fan and Yuke Zhu.

I work on multi-modal models for both perception and robot learning. I am interested in scaling robot foundation models by investigating various approaches to expand robot datasets and leveraging priors from existing foundation models.

I received B.A./M.S. in Computer Science and Applied Mathematics from UC Berkeley in 2023.

Email / Google Scholar / Twitter / Resume

Selected Publications

	🦦OTTER: A Vision-Language-Action Model with Text-Aware Visual Feature Extraction Huang Huang, Fangchen Liu, Letian Fu, Tingfan Wu, Mustafa Mukadam, Jitendra Malik, Ken Goldberg, Pieter Abbeel Equal contribution Arxiv 2025, Paper, Website, Code
	In-Context Imitation Learning via Next-Token Prediction Letian Fu, Huang Huang, Gaurav Datta, Lawrence Yunliang Chen, William Chung-Ho Panitch, Fangchen Liu, Hui Li, Ken Goldberg Equal contribution ICRA 2025, Paper, Website, Code, Dataset
	A Touch, Vision, and Language Dataset for Multimodal Alignment Letian Fu, Gaurav Datta, Huang Huang, William Chung-Ho Panitch, Jaimyn Drake, Joseph Ortiz, Mustafa Mukadam, Mike Lambeta, Roberto Calandra, Ken Goldberg Equal contribution ICML* 2024, Oral Presentation, OpenReview, Website, Code, Dataset
	Rethinking Patch Dependence for Masked Autoencoders Letian Fu, Long Lian, Renhao Wang, Baifeng Shi, Xudong Wang, Adam Yala†, Trevor Darrell†, Alexei A Efros†, Ken Goldberg† Equal contribution, †Equal advising TMLR* 2025, Paper, Website, Code
	Robot Learning with Sensorimotor Pre-training Ilija Radosavovic, Baifeng Shi, Letian Fu, Ken Goldberg, Trevor Darrell, Jitendra Malik CoRL 2023, Oral Presentation, OpenReview
	Safely Learning Visuo-Tactile Feedback Policies in Real For Industrial Insertion Letian Fu, Huang Huang, Lars Berscheid, Hui Li, Ken Goldberg, Sachin Chitta, ICRA 2023, arXiv
	Evo-NeRF: Evolving NeRF for Sequential Robot Grasping Justin Kerr, Letian Fu, Huang Huang, Yahav Avigal, Matthew Tancik, Jeffrey Ichnowski, Angjoo Kanazawa, Ken Goldberg CoRL 2022, Oral Presentation, OpenReview
	Mechanical Search on Shelves with Efficient Stacking and Destacking of Objects Letian Fu, Huang Huang, Michael Danielczuk, Chung Min Kim, Zachary Tam, Jeffrey Ichnowski, Anelia Angelova, Brian Ichter, and Ken Goldberg, Equal contribution ISRR* 2022, arXiv
	LEGS: Learning Efficient Grasp Sets for Exploratory Grasping Letian Fu, Michael Danielczuk, Ashwin Balakrishna, Daniel S. Brown, Jeffrey Ichnowski, Eugen Solowjow, Ken Goldberg, ICRA 2022, IEEE, arxiv
	Mechanical Search on Shelves using a Novel "Bluction" Tool Huang Huang, Michael Danielczuk, Chung Min Kim, Letian Fu, Zachary Tam, Jeffrey Ichnowski, Anelia Angelova, Brain Ichter, Ken Goldberg, ICRA 2022, IEEE, arXiv

Website is in part based on Jon Barron's site.