Publications

TokenLake: A Unified Segment-level Prefix Cache Pool for Fine-grained Elastic Long-Context LLM Serving.
Bingyang Wu, Zili Zhang, Yinmin Zhong, Guanzhe Huang, Yibo Zhu, Xuanzhe Liu, Xin Jin

In Preprint. PDF Cite DOI

Fast Distributed Inference Serving for Large Language Models.
Bingyang Wu, Yinmin Zhong, Zili Zhang, Shengyu Liu, Fangyue Liu, Yuanhang Sun, Gang Huang, Xuanzhe Liu, Xin Jin

In NSDI 2026 (To appear). PDF Cite DOI

Optimizing RLHF Training for Large Language Models with Stage Fusion.
Yinmin Zhong, Zili Zhang, Bingyang Wu, Shengyu Liu, Yukun Chen, Changyi Wan, Hanpeng Hu, Lei Xia, Ranchen Ming, Yibo Zhu, Xin Jin

In NSDI 2025. PDF Cite

StreamRL: Scalable, Heterogeneous, and Elastic RL for LLMs with Disaggregated Stream Generation.
Yinmin Zhong, Zili Zhang, Xiaoniu Song, Hanpeng Hu, Chao Jin, Bingyang Wu, Nuo Chen, Yukun Chen, Yu Zhou, Changyi Wan, Hongyu Zhou, Yimin Jiang, Yibo Zhu, Daxin Jiang

In Preprint. PDF Cite DOI

LoongServe: Efficiently Serving Long-Context Large Language Models with Elastic Sequence Parallelism.
Bingyang Wu, Shengyu Liu, Yinmin Zhong, Peng Sun, Xuanzhe Liu, Xin Jin

In SOSP 2024. PDF Cite DOI

dLoRA: Dynamically Orchestrating Requests and Adapters for LoRA LLM Serving.
Bingyang Wu, Ruidong Zhu, Zili Zhang, Peng Sun, Xuanzhe Liu, Xin Jin

In OSDI 2024. PDF Cite

A Survey of Resource-efficient LLM and Multimodal Foundation Models.
Mengwei Xu, Wangsong Yin, Dongqi Cai, Rongjie Yi, Daliang Xu, Qipeng Wang, Bingyang Wu, Yihao Zhao, Chen Yang, Shihe Wang, Qiyang Zhang, Zhenyan Lu, Li Zhang, Shangguang Wang, Yuanchun Li, Yunxin Liu, Xin Jin, Xuanzhe Liu

In Preprint. PDF Cite DOI

XRON: A Hybrid Elastic Cloud Overlay Network for Video Conferencing at Planetary Scale.
Bingyang Wu, Kun Qian, Bo Li, Yunfei Ma, Qi Zhang, Zhigang Jiang, Jiayu Zhao, Dennis Cai, Ennan Zhai, Xuanzhe Liu, Xin Jin

In SIGCOMM 2023. PDF Cite DOI

Transparent GPU Sharing in Container Clouds for Deep Learning Workloads.
Bingyang Wu, Zili Zhang, Zhihao Bai, Xuanzhe Liu, Xin Jin

In NSDI 2023. PDF Cite

AMOS: Enabling Automatic Mapping for Tensor Computations On Spatial Accelerators with Hardware Abstraction.
Size Zheng, Renze Chen, Anjiang Wei, Yicheng Jin, Qin Han, Liqiang Lu, Bingyang Wu, Xiuhong Li, Shengen Yan, Yun Liang

In ISCA 2022. PDF Cite DOI

NeoFlow: A Flexible Framework for Enabling Efficient Compilation for High Performance DNN Training.
Size Zheng, Renze Chen, Yicheng Jin, Anjiang Wei, Bingyang Wu, Xiuhong Li, Shengen Yan, Yun Liang

In TPDS 2021. PDF Cite DOI