About
Hi! I'm Zhexi, a Ph.D. student in Computer Science at Rensselaer Polytechnic Institute (RPI), advised by Prof. Lei Yu. My research focuses on post-training for large language models and agents. I study how on-policy distillation and reinforcement learning improve reasoning and tool use, and how these methods affect generalization, memorization, privacy, and reliability. I am especially interested in how different learning signals shape model behavior, and whether capability gains are tied to memorization of training data. Recently, I have extended these questions to agents that reason over multiple steps and call tools. My long-term goal is to understand how post-training works, and to use that understanding to build models and agents that are more capable, efficient, and trustworthy.
News
Publications
Experience
Self-distillation for LLM reasoning
Failure detection in multi-turn agentic interactions
Membership inference attacks against fine-tuned LLMs