Shengyu Liu

Latest

• FastServe: Iteration-Level Preemptive Scheduling for Large Language Model Inference
• Optimizing RLHF Training for Large Language Models with Stage Fusion
• LoongServe: Efficiently Serving Long-Context Large Language Models with Elastic Sequence Parallelism