Yinmin Zhong

Latest

• TokenLake: A Unified Segment-level Prefix Cache Pool for Fine-grained Elastic Long-Context LLM Serving
• Fast Distributed Inference Serving for Large Language Models
• Optimizing RLHF Training for Large Language Models with Stage Fusion
• StreamRL: Scalable, Heterogeneous, and Elastic RL for LLMs with Disaggregated Stream Generation
• LoongServe: Efficiently Serving Long-Context Large Language Models with Elastic Sequence Parallelism