About me
I am currently a Research Assistant Professor at the Department of Computing, The Hong Kong Polytechnic University. I am also a member of Internet and Mobile Computing Laboratory (IMCL) lead by Prof. Jiannong Cao.
I received my Ph.D. degree from the Department of Computer Science, The University of Hong Kong, and very fortunate to work with my supervisor Prof. Cho-Li Wang. Before studying at HKU, I used to work with Prof. Ray C. C. Cheung in CALAS Lab at City University of Hong Kong. I received my Bachelor’s degree in Computer Science from Xi’an Jiaotong University.
Email: zhaorui.zhang@polyu.edu.hk
Address: PQ748, Mong Man Wai Building, Hong Kong Polytechnic University
Opening!
If you are interested in AI Infrastructure, Agent Infra, LLM for System, LLMs Fine-Tuning and Inference/Serving, HPC for AI, we are actively looking for motivated students at different levels (Postdoc, PhD, MSc, Undergraduate, etc.) to reach out and join us!
PhD: We have multiple PhD positions open for 27 now. If you are interested in AI Infra, Agent Infra, LLMs, HPC, and Distributed Systems. Welcome to reach out and join us! We will send the interview invitation before the PhD application deadline (generally, the deadline is January every year), so if you don’t receive a timely reply from us, please don’t be discouraged and kindly wait patiently, we appreciate your patience!
Postdoc Positions: Currently, we have Postdoc Positions related to the large-scale machine learning system, checkpointing design and optimization. Welcome to reach out and join us!
MSc Dissertaion/Thesis at PolyU: We have positions opening every year for the MSc Dissertation/Thesis related to LLM, LLM Serving, and Agent Infra, which will collaborate with the industry. We can provide industry intern opportunities. Welcome to reach out and join us! We will provide hands-on guidance for your work!
Capstone Project/URIS Project for Undergraduate Student at PolyU (FYP): We have positions openings every year for the Capstone Project and URIS project related to LLM, LLM Serving, and Agent Infra which will collaborate with the industry. We can provide industry intern opportunities. Welcome to reach out and join us! We will provide hands-on guidance for your work!
Research Interests:
AI Infrastructure, Agent Infra, LLM for System, HPC for AI:
- AI Infra, Agent Infra, LLM(Agent) for System, LLM Serving, LLMs Fine-Tuning, Checkpointing: I am broadly interested in the building and optimization of AI systems from both sides of the system and AI algorithms based on a wide range of computing platforms (e.g., HPC, distributed, cloud, IoT, AIoT, and even quantum and photonic platforms) for emerging big data and AI applications, including distributed communication optimization, data compression, fault-tolerance, etc.
HPC, Parallel and Distributed Systems, Cloud Computing, FPGAs:
- I am also interested in high-performance computing (HPC), parallel and distributed systems, data reduction, cloud computing, error-bounded lossy compression, fault tolerance, and FPGA.
Recent Highlight:
26 June 2026, Our project “SkyPS: A New Distributed Large-Scale Model Training/Fine-Tuning System Over Sky Computing Platform” was funded by HK-RGC: RGC General Research Fund (GRF).
08 June 2026, We will organize a Workshop DC4AI The 1st International Workshop on Data Compression for AI and AI Applications (DC4AI) at ATC’26, The 2026 ACM SIGOPS Annual Technical Conference, Hong Kong, November 15-18, 2026. Welcome to submit!
24 April 2026, We will organize a Workshop DC4AI The 1st International Workshop on Data Compression for AI and Big Data Applications at ICPP’26, 55th International Conference on Parallel Processing, Singapore, September 28 - October 1, 2026. Welcome to submit!
18 Dec. 2025, We will organize a “Tutorial” DC4FL about the data reduction for large-scale AI model training and fine-tuning at HPDC’26, The 35th ACM International Symposium on High-Performance Parallel and Distributed Computing, Cleveland, OH, USA, July 13-16, 2026. Welcome to our tutorial at HPDC’26.
18 Dec. 2025, Invited to serve as the Technical Program Commitee of SC’ 26 The International Conference for High-Performance Computing, Networking, Storage and Analysis, Chicago, IL, USA • NOV 15–20.
20 Nov. 2025, Happy to serve as the Session Chair for System Software and Cloud in SC’ 25 The International Conference for High-Performance Computing, Networking, Storage and Analysis, St. louis, MO, USA • NOV 16–21.
28 May. 2025, We are organizing the Data Reduction Workshop at IEEE Big Data 2025. Welcome to submit!
29 Jan. 2025, Invited to serve as the Technical Program Commitee of SC’ 25, “ The International Conference for High-Performance Computing, Networking, Storage and Analysis “, St. louis, MO, USA • NOV 16–21.