RRSI: Regularized Recursive Self-Improvement of Agent Harnesses
Agents that improve their own harnesses, with regularization that keeps the loop stable.
Peng Xia, Rujun Han, Zifeng Wang, Yanfei Chen, Yufan Zhang, Yoonho Lee, Chengsong Huang, Han Yu, Zhongying CuiZhu, Yifei Ming, Huaxiu Yao, Burak Gokturk, Tomas Pfister, Chen-Yu Lee
arXiv 2026 · Paper · Project Page · Code
EnvHarness: Awakening Static Worlds for Agent Learning
Turns static data and tools into interactive training environments for agents.
Chengsong Huang, Zifeng Wang, Rujun Han, Jun Yan, Yanfei Chen, Zoey CuiZhu, Ke Jiang, Peng Xia, Han Yu, Yufan Zhuang, Yifei Ming, Jiaqi Pan, Bhavana Dalvi Mishra, Jiaxin Huang, Burak Gokturk, Tomas Pfister, Chen-Yu Lee
arXiv 2026 · Paper · Project Page · Code
SkillOS: Learning Skill Curation for Self-Evolving Agents
Learns how a self-evolving agent should curate its library of reusable skills.
Siru Ouyang, Jun Yan, Yanfei Chen, Rujun Han, Zifeng Wang, Bhavana Dalvi Mishra, Rui Meng, Chun-Liang Li, Yizhu Jiao, Kaiwen Zha, Maohao Shen, Vishy Tirumalashetty, George Lee, Jiawei Han, Tomas Pfister, Chen-Yu Lee
NeurIPS 2026 · Paper
ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memory
Distills reusable insights from an agent's successes and failures.
Siru Ouyang, Jun Yan, I-Hung Hsu, Yanfei Chen, Ke Jiang, Zifeng Wang, Rujun Han, Long T. Le, Samira Daruki, Xiangru Tang, Vishy Tirumalashetty, George Lee, Mahsan Rofouei, Hangfei Lin, Jiawei Han, Chen-Yu Lee, Tomas Pfister
ICLR 2026 · Paper · Code · Google AI Blog — Featured in VentureBeat and Andrej Karpathy's interview
Supervised Reinforcement Learning: From Expert Trajectories to Step-wise Reasoning
Turns expert trajectories into step-wise rewards for learning multi-step reasoning.
Yihe Deng, I-Hung Hsu, Jun Yan, Zifeng Wang, Rujun Han, Gufeng Zhang, Yanfei Chen, Wei Wang, Tomas Pfister, Chen-Yu Lee
ICLR 2026 · Paper — Featured in VentureBeat
Budget-Aware Tool-Use Enables Effective Agent Scaling
Scaling agents under explicit tool and compute budgets.
Tengxiao Liu, Zifeng Wang, Jin Miao, I-Hung Hsu, Jun Yan, Jiefeng Chen, Rujun Han, Fangyuan Xu, Yanfei Chen, Ke Jiang, Samira Daruki, Yi Liang, William Yang Wang, Tomas Pfister, Chen-Yu Lee
COLM 2026 · Paper · Code — Featured in VentureBeat
Deep Researcher with Test-Time Diffusion
The research agent behind Gemini Enterprise Deep Research and Gemini Deep Research Max.
Rujun Han, Yanfei Chen, Zoey CuiZhu, Lesly Miculicich, Guan Sun, Yuanjun Bi, Weiming Wen, Hui Wan, Chunfeng Wen, Solène Maître, George Lee, Vishy Tirumalashetty, Emily Xue, Zizhao Zhang, Salem Haykal, Burak Gokturk, Tomas Pfister, Chen-Yu Lee
arXiv 2025 · Paper · Google AI Blog — Featured in VentureBeat
Speculative Knowledge Distillation: Bridging the Teacher-Student Gap Through Interleaved Sampling
The student proposes tokens and the teacher replaces poor ones, keeping distillation on-policy and stable.
Wenda Xu, Rujun Han, Zifeng Wang, Long T. Le, Dhruv Madeka, Lei Li, William Yang Wang, Rishabh Agarwal, Chen-Yu Lee, Tomas Pfister
ICLR 2025 · Paper · Code
Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizes
Small models trained on LLM rationales outperform much larger LLMs using less data.
Cheng-Yu Hsieh, Chun-Liang Li, Chih-Kuan Yeh, Hootan Nakhost, Yasuhisa Fujii, Alexander Ratner, Ranjay Krishna, Chen-Yu Lee, Tomas Pfister
ACL 2023 · Paper (Findings)
· Code · Google AI Blog — Google ACL 2023 Spotlight
Deeply-Supervised Nets
Adds supervision to hidden layers to train deep networks more effectively.
Chen-Yu Lee*, Saining Xie*, Patrick Gallagher, Zhengyou Zhang, Zhuowen Tu (*equal contribution)
AISTATS 2015 · Paper · Code — Test-of-Time Award, AISTATS 2025 (slides)
NIPS 2014 DL Workshop · Paper — Oral Presentation
More papers →
Honors & Awards
Test-of-Time Award at AISTATS 2025
Google Spotlight Award at ACL 2023
Oral: NAACL 2025, ACL 2021, NIPS 2014 DL Workshop
Academic Service
Area Chair: NeurIPS (2025, 2026), ICLR (2024, 2025, 2026, 2027), ICML (2026)
Reviewer: NeurIPS, ICML, ICLR, ACL, NAACL, EMNLP, COLM, CVPR, ICCV, ECCV, BMVC, PAMI, IJCV, JMLR
Outstanding Reviewer: CVPR 2019, BMVC 2019