I'm Gongfan Fang, an incoming Research Scientist at NVIDIA, where I will be working on LLMs. I recently completed my Ph.D. at the xML Lab, National University of Singapore, under the supervision of Prof. Xinchao Wang. Prior to that, I received my B.Eng. (2019) and M.Eng. (2022) from Zhejiang University under the supervision of Prof. Mingli Song.

My research focuses on Efficient Deep Learning. I am the creator of Torch-Pruning, an open-source framework for structured pruning and acceleration. And I also received the 2024 ByteDance Scholarship.

News

May, 2026	🍺 Four papers were accepted to ICML’26.
Feb, 2026	☕️ Two papers were accepted to CVPR’26.
Jan, 2026	🥤 Three papers dParallel, SparseD and Invisible Safety Threat (Oral) were accepted to ICLR’26.

Selected Publications

Google Scholar

NeurIPS’25
Thinkless: LLM Learns When to Think

Gongfan Fang, Xinyin Ma, and Xinchao Wang

Advances in Neural Information Processing Systems, 2025

National University of Singapore

Auto Switch between Long-Short Reasoning via Decoupled GRPO | Cuts 50%-90% of Unnecessary Thinking | Stop Overthinking 1+1=?

arXiv Bib Code
@article{fang2025thinkless, title = {Thinkless: LLM Learns When to Think}, author = {Fang, Gongfan and Ma, Xinyin and Wang, Xinchao}, journal = {Advances in Neural Information Processing Systems}, year = {2025}, }
NeurIPS’24
MaskLLM: Learnable Semi-structured Sparsity for Large Language Models

Gongfan Fang, Hongxu Yin, Saurav Muralidharan, Greg Heinrich, Jeff Pool, Jan Kautz, Pavlo Molchanov, and Xinchao Wang

Advances in Neural Information Processing Systems, 2024

NVIDIA Research, National University of Singapore

NeurIPS’24 Spotlight (2%) | Post-training of Sparse LLMs | The First Scalable Algorithm for N:M Sparsity in LLMs | 1.5x Faster with 30%+ Memory Saving

arXiv Webpage Bib Code
@article{fang2024maskllm, title = {MaskLLM: Learnable Semi-structured Sparsity for Large Language Models}, author = {Fang, Gongfan and Yin, Hongxu and Muralidharan, Saurav and Heinrich, Greg and Pool, Jeff and Kautz, Jan and Molchanov, Pavlo and Wang, Xinchao}, journal = {Advances in Neural Information Processing Systems}, year = {2024}, }
CVPR’23
DepGraph: Towards Any Structural Pruning

Gongfan Fang, Xinyin Ma, Mingli Song, Michael Bi Mi, and Xinchao Wang

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

National University of Singapore, Zhejiang University, Huawei

500+ Citations, 3000+ Stars, 300,000+ Downloads | Github #Model-Compression Top-5 | Pruning of Foundation Models | Integrated in NVIDIA TAO

arXiv Bib PDF Code
@inproceedings{fang2023depgraph, title = {DepGraph: Towards Any Structural Pruning}, author = {Fang, Gongfan and Ma, Xinyin and Song, Mingli and Mi, Michael Bi and Wang, Xinchao}, booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition}, pages = {16091--16101}, year = {2023}, }
CVPR’24
DeepCache: Accelerating Diffusion Models for Free

Xinyin Ma, Gongfan Fang, and Xinchao Wang

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

National University of Singapore

Training-free and almost lossless | 2-7x Speedup on Diffusion Models

arXiv Bib Code
@inproceedings{ma2023deepcache, title = {DeepCache: Accelerating Diffusion Models for Free}, author = {Ma, Xinyin and Fang, Gongfan and Wang, Xinchao}, booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition}, year = {2024}, }