Publications

ExpertPlex: A High-Goodput Disaggregated Serving System for MoE LLMs with Adaptive Persistent Kernels.
Bingyang Wu, Chao Jin, Zili Zhang, Xinming Wei, Yinmin Zhong, Ruidong Zhu, Chengxu Yang, Xin Jin, Yuliang Liu

In Preprint. PDF Cite DOI

UltraEP: Unleash MoE Training and Inference on Rack-Scale Nodes with Near-Optimal Load Balancing.
Xinming Wei, Chao Jin, Tuo Dai, Yinmin Zhong, Shan Yu, Chengxu Yang, Bingyang Wu, Zili Zhang, Jing Mai, Qianchao Zhu, Zhouyang Li, Yuliang Liu, Guojie Luo

In Preprint. PDF Cite DOI

ReLibra: Routing-Replay-Guided Load Balancing for MoE Training in Reinforcement Learning.
Chao Jin, Xinming Wei, Yinmin Zhong, Chengxu Yang, Bingyang Wu, Ruidong Zhu, Zili Zhang, Yuliang Liu, Xin Jin

In Preprint. PDF Cite DOI

FastServe: Iteration-Level Preemptive Scheduling for Large Language Model Inference.
Bingyang Wu, Yinmin Zhong, Zili Zhang, Shengyu Liu, Fangyue Liu, Yuanhang Sun, Gang Huang, Xuanzhe Liu, Xin Jin

In NSDI 2026. PDF Cite DOI

Heddle: A Distributed Orchestration System for Agentic RL Rollout.
Zili Zhang, Yinmin Zhong, Chengxu Yang, Chao Jin, Bingyang Wu, Xinming Wei, Yuliang Liu, Xin Jin

In Preprint. PDF Cite DOI

Epiphron: Resource-Efficient Distributed Key-Value Storage.
Ruidong Zhu, Zili Zhang, Bingyang Wu, Xin Yao, Renhai Chen, Gong Zhang, Xuanzhe Liu, Xin Jin

In TKDE 2026. PDF Cite DOI

TokenLake: A Unified Segment-level Prefix Cache Pool for Fine-grained Elastic Long-Context LLM Serving.
Bingyang Wu, Zili Zhang, Yinmin Zhong, Guanzhe Huang, Yibo Zhu, Xuanzhe Liu, Xin Jin

In Preprint. PDF Cite DOI

Optimizing RLHF Training for Large Language Models with Stage Fusion.
Yinmin Zhong, Zili Zhang, Bingyang Wu, Shengyu Liu, Yukun Chen, Changyi Wan, Hanpeng Hu, Lei Xia, Ranchen Ming, Yibo Zhu, Xin Jin

In NSDI 2025. PDF Cite

StreamRL: Scalable, Heterogeneous, and Elastic RL for LLMs with Disaggregated Stream Generation.
Yinmin Zhong, Zili Zhang, Xiaoniu Song, Hanpeng Hu, Chao Jin, Bingyang Wu, Nuo Chen, Yukun Chen, Yu Zhou, Changyi Wan, Hongyu Zhou, Yimin Jiang, Yibo Zhu, Daxin Jiang

In Preprint. PDF Cite DOI

LoongServe: Efficiently Serving Long-Context Large Language Models with Elastic Sequence Parallelism.
Bingyang Wu, Shengyu Liu, Yinmin Zhong, Peng Sun, Xuanzhe Liu, Xin Jin

In SOSP 2024. PDF Cite DOI

dLoRA: Dynamically Orchestrating Requests and Adapters for LoRA LLM Serving.
Bingyang Wu, Ruidong Zhu, Zili Zhang, Peng Sun, Xuanzhe Liu, Xin Jin

In OSDI 2024. PDF Cite

A Survey of Resource-efficient LLM and Multimodal Foundation Models.
Mengwei Xu, Wangsong Yin, Dongqi Cai, Rongjie Yi, Daliang Xu, Qipeng Wang, Bingyang Wu, Yihao Zhao, Chen Yang, Shihe Wang, Qiyang Zhang, Zhenyan Lu, Li Zhang, Shangguang Wang, Yuanchun Li, Yunxin Liu, Xin Jin, Xuanzhe Liu

In Preprint. PDF Cite DOI

XRON: A Hybrid Elastic Cloud Overlay Network for Video Conferencing at Planetary Scale.
Bingyang Wu, Kun Qian, Bo Li, Yunfei Ma, Qi Zhang, Zhigang Jiang, Jiayu Zhao, Dennis Cai, Ennan Zhai, Xuanzhe Liu, Xin Jin

In SIGCOMM 2023. PDF Cite DOI

Transparent GPU Sharing in Container Clouds for Deep Learning Workloads.
Bingyang Wu, Zili Zhang, Zhihao Bai, Xuanzhe Liu, Xin Jin

In NSDI 2023. PDF Cite

AMOS: Enabling Automatic Mapping for Tensor Computations On Spatial Accelerators with Hardware Abstraction.
Size Zheng, Renze Chen, Anjiang Wei, Yicheng Jin, Qin Han, Liqiang Lu, Bingyang Wu, Xiuhong Li, Shengen Yan, Yun Liang

In ISCA 2022. PDF Cite DOI

NeoFlow: A Flexible Framework for Enabling Efficient Compilation for High Performance DNN Training.
Size Zheng, Renze Chen, Yicheng Jin, Anjiang Wei, Bingyang Wu, Xiuhong Li, Shengen Yan, Yun Liang

In TPDS 2021. PDF Cite DOI