[preprint] EPIC: Efficient Position-Independent Context Caching for Serving Large Language Models
Junhao Hu, Wenrui Huang, Haoyi Wang, Weidong Wang, Tiancheng Hu, Qin Zhang, Hao Feng, Xusheng Chen, Yizhou Shan, Tao Xie
In: arXiv preprint arXiv:2410.15332
[paper] [code][preprint] MemServe: Context Caching for Disaggregated LLM Serving with Elastic Memory Pool
Cunchen Hu, Heyang Huang, Junhao Hu, Jiang Xu, Xusheng Chen, Tao Xie, Chenxi Wang, Sa Wang, Yungang Bao, Ninghui Sun, Yizhou Shan
In: arXiv preprint arXiv:2406.17565
[paper] [code][preprint] Cupcleaner: A data cleaning approach for comment updating
Qingyuan Liang, Zeyu Sun, Qihao Zhu, Junhao Hu, Yifan Zhao, Lu Zhang
In: arXiv preprint arXiv:2308.06898
[paper] [code][ASE 2023] Predicting Compilation Resources for Adaptive Build in an Industrial Setting (CCF-A)
Junhao Hu, Chaozheng Wang, Hailiang Huang, Huang Luo, Yu Jin, Yuetang Deng, Tao Xie
In: The 38th IEEE/ACM International Conference on Automated Software Engineering, September 11-15, 2023, 1808-1813, Luxembourg
[paper] [code][ESEC/FSE 2023] How Practitioners Expect Code Completion? (CCF-A)
Chaozheng Wang, Junhao Hu, Cuiyun Gao, Yu Jin, Tao Xie, Hailiang Huang, Zhenyu Lei, Yuetang Deng
In: The 31th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, December 3 - 9, 2023, 1294-1306, San Francisco, California, USA
[paper] [code]