I'm Gongfan Fang, an incoming Research Scientist at NVIDIA, where I will be working on LLMs. I recently completed my Ph.D. at the xML Lab, National University of Singapore, under the supervision of Prof. Xinchao Wang. Prior to that, I received my B.Eng. (2019) and M.Eng. (2022) from Zhejiang University under the supervision of Prof. Mingli Song.

My research focuses on Efficient Deep Learning. I am the creator of Torch-Pruning, an open-source framework for structured pruning and acceleration. And I also received the 2024 ByteDance Scholarship.

News

May, 2026	🍺 Four papers were accepted to ICML’26.
Feb, 2026	☕️ Two papers were accepted to CVPR’26.
Jan, 2026	🥤 Three papers dParallel, SparseD and Invisible Safety Threat (Oral) were accepted to ICLR’26.

Selected Publications

Google Scholar

NeurIPS’25
Thinkless: LLM Learns When to Think

Gongfan Fang, Xinyin Ma, and Xinchao Wang

Advances in Neural Information Processing Systems, 2025

Auto Thinking via Decoupled GRPO | Cuts 50%-90% of Unnecessary Thinking | Stop Overthinking 1+1=?

arXiv Bib Code
@article{fang2025thinkless, title = {Thinkless: LLM Learns When to Think}, author = {Fang, Gongfan and Ma, Xinyin and Wang, Xinchao}, journal = {Advances in Neural Information Processing Systems}, year = {2025}, }
NeurIPS’24
MaskLLM: Learnable Semi-structured Sparsity for Large Language Models

Gongfan Fang, Hongxu Yin, Saurav Muralidharan, Greg Heinrich, Jeff Pool, Jan Kautz, Pavlo Molchanov, and Xinchao Wang

Advances in Neural Information Processing Systems, 2024

NeurIPS’24 Spotlight (2%) | Sparse Large Language Models | The First Scalable Algorithm for N:M Sparsity in LLMs | 1.5x Faster with 30%+ Memory Saving

arXiv Webpage Bib Code
@article{fang2024maskllm, title = {MaskLLM: Learnable Semi-structured Sparsity for Large Language Models}, author = {Fang, Gongfan and Yin, Hongxu and Muralidharan, Saurav and Heinrich, Greg and Pool, Jeff and Kautz, Jan and Molchanov, Pavlo and Wang, Xinchao}, journal = {Advances in Neural Information Processing Systems}, year = {2024}, }
CVPR’23
DepGraph: Towards Any Structural Pruning

Gongfan Fang, Xinyin Ma, Mingli Song, Michael Bi Mi, and Xinchao Wang

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

900+ Citations, 3000+ Stars, 600,000+ Downloads | Github #Model-Compression Top-5 | Pruning of Foundation Models | Integrated in NVIDIA TAO

arXiv Bib PDF Code
@inproceedings{fang2023depgraph, title = {DepGraph: Towards Any Structural Pruning}, author = {Fang, Gongfan and Ma, Xinyin and Song, Mingli and Mi, Michael Bi and Wang, Xinchao}, booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition}, pages = {16091--16101}, year = {2023}, }

CVPR’24

DeepCache: Accelerating Diffusion Models for Free

Xinyin Ma, Gongfan Fang, and Xinchao Wang

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

The first Cache method for diffusion models | 2-7x Speedup on Diffusion Models

arXiv Bib Code

@inproceedings{ma2023deepcache,
  title = {DeepCache: Accelerating Diffusion Models for Free},
  author = {Ma, Xinyin and Fang, Gongfan and Wang, Xinchao},
  booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  year = {2024},
}

Education

2022.07 - 2026.07 - Ph.D. in Electrical and Computer Engineering, National University of Singapore.

2019.09 - 2022.04 - M.Eng. in Computer Science, Zhejiang University.

2015.09 - 2019.06 - B.S. in Computer Science, Zhejiang University.