I am currently a postdoctoral associate at Duke University, working with Prof. Yiran Chen and Prof. Hai (Helen) Li. I obtained the Ph.D. degree from the Department of Computer Science and Engineering (CSE) at Shanghai Jiao Tong University in September 2023, under the supervision of Prof. Jingwen Leng. My research interests include computer architecture and high-performance computing. I have published more than 10 papers at international conferences with a total of Google Scholar .

🔥 News

• 2024.03:  🎉🎉🎉 I received the 2023 Shanghai Jiao Tong University Outstanding Doctoral Dissertation Award, 15 winners in 2023 at SJTU (上海交通大学优秀博士学位论文，全校共15人).
• 2023.11:  🎉 Two papers (one collaborative paper) are accepted by ASPLOS 2024.

📝 Publications

• ASPLOS 2024 GMLake: Efficient and Transparent GPU Memory Defragmentation for Large-scale DNN Training with Virtual Memory Stitching, Cong Guo, Rui Zhang, Jiale Xu, Jingwen Leng, Zihan Liu, Ziyu Huang, Minyi Guo, Hao Wu, Shouren Zhao, Junping Zhao, Ke Zhang;
• ASPLOS 2024 JUNO: Optimizing High-Dimensional Approximate Nearest Neighbour Search with Sparsity-Aware Algorithm and Ray-Tracing Core Mapping, Zihan Liu, Wentao Ni, Jingwen Leng, Yu Feng, Cong Guo, Quan Chen, Chao Li, Minyi Guo, Yuhao Zhu;
• TC 2024 Accelerating Sparse DNNs Based on Tiled GEMM, Cong Guo, Fengchen Xue, Jingwen Leng, Yuxian Qiu, Yue Guan, Weihao Cui, Quan Chen, Minyi Guo;
• ISCA 2023 OliVe: Accelerating Large Language Models via Hardware-friendly Outlier-Victim Pair Quantization, Cong Guo, Jiaming Tang, Weiming Hu, Jingwen Leng, Chen Zhang, Fan Yang, Yunxin Liu, Minyi Guo, Yuhao Zhu;

• Micro 2022 (2023 IEEE Micro Top Picks Honorable Mention) ANT: Exploiting Adaptive Numerical Data Type for Low-bit Deep Neural Network Quantization, Cong Guo, Chen Zhang, Jingwen Leng, Zihan Liu, Fan Yang, Yunxin Liu, Minyi Guo, Yuhao Zhu;

• ICLR 2022 SQuant: On-the-Fly Data-Free Quantization via Diagonal Hessian Approximation, Cong Guo, Yuxian Qiu, Jingwen Leng, Xiaotian Gao, Chen Zhang, Yunxin Liu, Fan Yang, Yuhao Zhu, Minyi Guo;
• ICCD 2022 Nesting Forward Automatic Differentiation for Memory-Efficient Deep Neural Network Training, Cong Guo, Yuxian Qiu, Jingwen Leng, Chen Zhang, Ying Cao, Quanlu Zhang, Yunxin Liu, Fan Yang, Minyi Guo;

• MSN 2022 (Best Paper Award) Towards Reliable AI Applications via Algorithm-Based Fault Tolerance on NVDLA, Mustafa Tarik Sanic, Cong Guo, Jingwen Leng, Minyi Guo, Weiyin Ma;

• IISWC 2021 Characterizing and Demystifying the Implicit Convolution Algorithm on Commercial Matrix-Multiplication Accelerators, Yangjie Zhou, Mengtian Yang, Cong Guo, Jingwen Leng, Yun Liang, Quan Chen, Minyi Guo, Yuhao Zhu;
• ISCA 2021 Dual-side Sparse Tensor Core, Yang Wang, Chen Zhang, Zhiqiang Xie, Cong Guo, Yunxin Liu, Jingwen Leng;
• SC 2022 Accelerating Sparse DNN Models without Hardware-Support via Tile-Wise Sparsity, Cong Guo, Bo Yang Hsueh, Jingwen Leng, Yuxian Qiu, Yue Guan, Zehuan Wang, Xiaoying Jia, Xipeng Li, Minyi Guo, Yuhao Zhu;
• DAC 2020 Balancing Efficiency and Flexibility for DNN Acceleration via Temporal GPU-Systolic Array Integration, Cong Guo, Yangjie Zhou, Jingwen Leng, Yuhao Zhu, Zidong Du, Quan Chen, Chao Li, Bin Yao, Minyi Guo;
• CVPR 2019 Adversarial Defense Through Network Profiling Based Path Extraction, Yuxian Qiu, Jingwen Leng, Cong Guo, Quan Chen, Chao Li, Minyi Guo, Yuhao Zhu;

🎖 Honors and Awards

• 2024.03 Outstanding Doctoral Dissertation Award, Shanghai Jiao Tong University
• 2023.07 IEEE Micro Top Picks from Computer Architecture Conferences Honorable Mention
• 2023.06 Outstanding Doctoral Graduates, Shanghai Jiao Tong University
• 2022.08 Excellent Ph.D. Scholarship of Yang Yuanqing Education Fund (Top-3/500+), Shanghai Jiao Tong University
• 2020.11 Ph.D. National Scholarship (Top-8/500+), Ministry of Education, PRC
• 2020.07 DAC2020 Richard Newton Young Student Fellow, Design Automation Conference
• 2018.11 VMware Scholarship, Shanghai Jiao Tong University
• 2017.11 National Second Prize, The 14th China Post-Graduate Mathematical Contest in Modeling

📖 Educations

• 2020.09 - 2023.09, Ph.D in Computer Science and Technology, Department of Computer Science and Engineering, Shanghai Jiao Tong University.
• 2017.09 - 2020.03, M.E. in Computer Technology, Department of Computer Science and Engineering, Shanghai Jiao Tong University.
• 2012.09 - 2016.06, B.S. in Computer Science and Technology, College of Computer Science and Software Engineering, Shenzhen University.

💻 Work Experience

• 2023.12 - Now, Postdoctoral associate, Department of ECE, Duke University.

• 2020.06 - 2021.05, Research intern, Microsoft Research Asia (Beijing).

• 2019.05 - 2019.12, Intern, NVIDIA (Shanghai).