I am currently a Ph.D. candidate jointly affiliated with the School of Integrated Circuits and the Institute for Artificial Intelligence at Peking University, advised by Prof. Meng Li. My research focuses on efficient and secure AI systems, especially software-hardware co-design and privacy-preserving inference. More recently, I have begun exploring inference infrastructure for large language models (LLMs) and omni-modal models, with a broader interest in systems for multimodal generation and post-training. I have published as a (co-)first author in computer architecture, systems, and security conferences, including CCS, MICRO, USENIX Security, and ICCAD.

Education

• Ph.D. Candidate in Integrated Circuit Science and Engineering
  School of Integrated Circuits and Institute for Artificial Intelligence, Peking University, 2024-Present
• B.Sc. in Applied Physics
  School of Electronic Engineering and Computer Science, Peking University, 2020-2024
  Dual Degree: Computer Science and Technology

News

• Jul. 2026 [Paper] Our paper ROSETTA was accepted to ACM CCS 2026.
• Jul. 2026 [Paper] Our paper OptiPrime was accepted to IEEE/ACM MICRO 2026.
• Jul. 2026 [Award] Received the Noteworthy Reviewer Recognition from the USENIX Security 2026 Artifact Evaluation Committee (33/222 AEC members).

Publications

First-Author Papers

• ROSETTA: Efficient and Accurate Privacy-Preserving LLM Decoding via Hybrid CKKS/TFHE Evaluation
  Jiangrui Yu, Baosheng Zhang, Liang Kong, Lin Ding, Yi Chen, Ye Yu, Mingzhe Zhang, Meng Li
  ACM SIGSAC Conference on Computer and Communications Security (CCS), CCF-A, 2026
• OptiPrime: Optimizing Private Inference through Protocol-Hardware Co-Design
  Jiangrui Yu, Ye Yu, Si Chen, Chenqi Lin, Wenxuan Zeng, Junfeng Fan, Mingyu Gao, Meng Li
  IEEE/ACM International Symposium on Microarchitecture (MICRO), CCF-A, 2026
  Distinguished Paper Award @ UTI 2026
• (Invited) PEFT: A Near-Memory Processing-Enabled Heterogeneous Accelerator for BatchPBS TFHE
  Jiangrui Yu, Yi Chen, Meng Li
  IEEE International Symposium on Circuits and Systems (ISCAS), CCF-B, 2026. [Paper]
• Breaking the Layer Barrier: Remodeling Private Transformer Inference with Hybrid CKKS and MPC
  Tianshi Xu*, Wen-jie Lu*, Jiangrui Yu*, Yi Chen, Chenqi Lin, Runsheng Wang, Meng Li
  34th USENIX Security Symposium, CCF-A, 2025. [Paper] [arXiv]
• FlexHE: A Flexible Kernel Generation Framework for Homomorphic Encryption-Based Private Inference
  Jiangrui Yu, Wenxuan Zeng, Tianshi Xu, Renze Chen, Yun (Eric) Liang, Runsheng Wang, Ru Huang, Meng Li
  IEEE/ACM International Conference on Computer-Aided Design (ICCAD), CCF-B, 2024. [Paper]

Co-Authored Papers

• (Invited) FENIX: Flexible and Efficient Hybrid HE/MPC Acceleration with Near-Memory Processing
  Tengyu Zhang, Chenqi Lin, Jiangrui Yu, Yi Chen, Shuwen Deng, Meng Li
  IEEE/ACM International Conference on Computer-Aided Design (ICCAD), CCF-B, 2025. [Paper]
• Trinity: A General Purpose FHE Accelerator
  Xianglong Deng, Shengyu Fan, Zhicheng Hu, Zhuoyu Tian, Zihao Yang, Jiangrui Yu, Dingyuan Cao, Dan Meng, Rui Hou, Meng Li, Qian Lou, Mingzhe Zhang
  57th IEEE/ACM International Symposium on Microarchitecture (MICRO), CCF-A, 2024. [Paper] [arXiv]

* Equal contribution.

Patents

• An Efficient Homomorphic Computation Method for Privacy-Preserving Inference in Neural Networks (CN121418079A). Meng Li, Jiangrui Yu, Ye Yu, Wenxuan Zeng, Runsheng Wang. China Patent Application, 2026.

Honors and Awards

Research and Competition Awards

• Noteworthy Reviewer Recognition (33/222 AEC members), USENIX Security 2026.
• 1st Place, DAC System Design Contest, DAC 2025.

University Honors

• Doctoral Dean’s Scholarship (Excellence Award), Institute for Artificial Intelligence, Peking University, 2025.
• Outstanding Research Award, Peking University, 2025.
• Huawei Scholarship (Third Prize), 2025.
• DACS Industry Contribution Award, Peking University, 2024.
• Outstanding Graduate, Peking University and Beijing, 2024.
• National Scholarship (top 0.2%), 2023.
• Merit Student, 2021-2023.
• Canon Scholarship, 2022.
• Lihuirong Scholarship, 2021.
• Bronze Medal, 35th Chinese Physics Olympiad (CPhO), 2018 (as a second-year high school student).

Internship Experience

• Intern, Ant Group, Aug. 2025-Aug. 2026.
  Topic: Compiler and cryptographic protocol design for private AI acceleration.
  Mentors: Mingzhe Zhang and Liang Kong.

Academic Service

• Artifact Evaluation Committee Member (Full-term), 35th USENIX Security Symposium, 2026.

Last updated: August 2026