Posts by Collection

portfolio

High-Performance Inference & Serving for LLMs

Accelerating the inference speed and improving the serving quality of popular large language models through system-level optimizations. We focus on efficient deployment across heterogeneous GPUs and support for advanced model features like multimodal and long-context.

Pre/Post-Training System for LLM

Optimizing the training efficiency through high-performance kernels and parallel techniques. We focus on extracting peak performance from GPU/CPU hardwares to accelerate training speed.

publications

Cloudmix: Generating Diverse and Reducible Workloads for Cloud Systems

Published in IEEE International Conference on Cloud Computing, *CCF-C*, 2017-06

Rui Han, Zan Zong, Fan Zhang, Jose Luis Vazquez-Poletti, Zhen Jia, Lei Wang

Adaptiveconfig: Runtime Configuration of Cluster Schedulers for Cloud Short-Running Jobs

Published in IEEE International Conference on Distributed Computing Systems (ICDCS), *CCF-B*, 2018-07

Rui Han, Zan Zong, Lydia Y Chen, Siyi Wang, Jianfeng Zhan

Workload-Adaptive Configuration Tuning for Hierarchical Cloud Schedulers

Published in IEEE Transactions on Parallel and Distributed Systems (TPDS), *CCF-A*, 2019-06

Rui Han, Chi Harold Liu, Zan Zong, Lydia Y Chen, Wending Liu, Siyi Wang, Jianfeng Zhan

Scaleplus: Towards Fast Scaling of Distributed Streaming Dataflows

Published in IEEE Intl Conf on Parallel & Distributed Processing with Applications, **CCF-C**, 2020-12

Zan Zong, Lijie Wen, Xiao Liu, Li Lin, Chen Qian, Leilei Lin

MespaConfig: Memory-Sparing Configuration Auto-Tuning for Co-Located In-Memory Cluster Computing Jobs

Published in IEEE Transactions on Services Computing (TSC), *CCF-A*, 2021-03

Zan Zong, Lijie Wen, Xuming Hu, Rui Han, Chen Qian, Li Lin

MM-CPRED: A Multi-Task Predictive Model for Continuous-Time Event Sequences with Mixture Learning Losses

Published in International Conference on Database Systems for Advanced Applications (DASFAA), *CCF-B*, 2021-04

Li Lin, Zan Zong, Lijie Wen, Chen Qian, Shuang Li, Jianmin Wang

A Swap Dominated Tensor Re-Generation Strategy for Training Deep Learning Models

Published in IEEE International Parallel and Distributed Processing Symposium (IPDPS), *CCF-B*, 2022-05

Lijie Wen, Zan Zong*, Li Lin, Leilei Lin

STR: Hybrid Tensor Re-Generation to Break Memory Wall for DNN Training

Published in IEEE Transactions on Parallel and Distributed Systems (TPDS), *CCF-A*, 2023-04

Zan Zong, Li Lin, Leilei Lin, Lijie Wen, Yu Sun

SmartMoE: Efficiently Training Sparsely-Activated Models through Combining Offline and Online Parallelization

Published in USENIX Annual Technical Conference (ATC), *CCF-A*, 2023-06

Mingshu Zhai, Jiaao He, Zixuan Ma, Zan Zong, Runqing Zhang, Jidong Zhai

Training Large Models on Heterogeneous and Geo-Distributed Resource with Constricted Networks

Published in IEEE Big Data Mining and Analytics, *中科院1区*, 2025-03

Zan Zong, Minkun Guo, Mingshu Zhai, Yinan Tang, Jianjiang Li, Jidong Zhai

大规模异构一致性融合计算系统的性能建模与优化

Published in 计算机研究与发展, *CCF-A*, 2025-06

李仁刚, 唐轶男, 郭振华, 王丽, 宗瓒, 杨广文

Multi-view Trace Clustering Based on Graph Convolutional Networks in Process Mining

Published in IEEE Transactions on Services Computing (TSC), *CCF-A*, 2025-06

Leilei Lin, Yunuo Cao, Wenlong Chen, Zan Zong, Chen Qian, Lijie Wen

Accelerating Distributed Training of Large Concurrent-Branch Models through Bidirectional Pipeline Coordination

Published in Tsinghua Science and Technology, *中科院2区*, 2025-07

Zan Zong, Yuyang Chen, Qi Zhang, Daming Zhao, Jianjiang Li, Yijun Jing, Jidong Zhai

TraceFlow: Efficient Trace Analysis for Large-Scale Parallel Applications via Interaction Pattern-Aware Trace Distribution

Published in Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC), *CCF-A*, 2025-11

Yuyang Jin, Xirui Shui, Mingshu Zhai, Zan Zong, Feng Zhang, Felix Wolf, Jidong Zhai

UltraAttn: Efficiently Parallelizing Attention through Hierarchical Context-Tiling

Published in Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC), *CCF-A*, 2025-11

Haoyu Yang, Zan Zong, Yuyang Jin, Kinman Lei, Jiaao He, Qigang Yang, Jidong Zhai

DiTango: Cost-Effective Parallel Diffusion Generation with Selective Attention State Reuse

Published in HPDC, *CCF-A*, 2026-07

Yuyang Chen, Runxin Zhong, Zan Zong, Hengjie Li, Yuyang Jin, Jidong Zhai

teaching

Computer Architecture

Undergraduate Course (Assistant), School of Computer and Communication Engineering, 2026

Data Structure

Undergraduate Course, School of Computer and Communication Engineering, 2027

Zan Zong (宗瓒)