Hi there! I'm Gongfan Fang, currently a third-year Ph.D. Candidate at the xML Lab @ National University of Singapore, under the supervision of Prof. Xinchao Wang (Presidential Young Professor) . Prior to joining LV Lab, I earned my Bachelor’s degree in 2019 and subsequently completed my Master’s degree in 2022 at the Visual Intelligence and Pattern Analysis (VIPA) Lab @ Zhejiang University, adviced by Prof. Mingli Song.

My research focuses on Efficient Deep Learning and Generative Models. I'm also actively contributing to several open-source projects such as Torch-Pruning, a framework for neural network pruning.

News

Feb, 2025	🍺 One first-author paper TinyFusion and three co-authored papers were accepted by CVPR’25.
Dec, 2024	🎵 I’m deeply honored to be awarded the 2024 ByteDance Scholarship (10~15 recipients per year).
Sep, 2024	🚀 Two first-author papers MaskLLM (Spotlight) and Remix-DiT were accepted by NeurIPS’24.

Selected Publications

CVPR’25

TinyFusion: Diffusion Transformers Learned Shallow

Gongfan Fang, Kunjun Li, Xinyin Ma, and Xinchao Wang

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2025

Compressing DiTs at 7% Training Costs | 2x Faster Inference

arXiv Bib Code

@article{fang2024tinyfusion,
  title = {TinyFusion: Diffusion Transformers Learned Shallow},
  author = {Fang, Gongfan and Li, Kunjun and Ma, Xinyin and Wang, Xinchao},
  journal = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  year = {2025},
  note = {Compressing DiTs at 7% Training Costs | 2x Faster Inference}
}

NeurIPS’24

MaskLLM: Learnable Semi-structured Sparsity for Large Language Models

Gongfan Fang, Hongxu Yin, Saurav Muralidharan, Greg Heinrich, Jeff Pool, Jan Kautz, Pavlo Molchanov, and Xinchao Wang

Advances in Neural Information Processing Systems, 2024

NeurIPS Spotlight (2.08%) | Sparse LLMs via End-to-End Training

arXiv Webpage Bib Code

@article{fang2024maskllm,
  title = {MaskLLM: Learnable Semi-structured Sparsity for Large Language Models},
  author = {Fang, Gongfan and Yin, Hongxu and Muralidharan, Saurav and Heinrich, Greg and Pool, Jeff and Kautz, Jan and Molchanov, Pavlo and Wang, Xinchao},
  journal = {Advances in Neural Information Processing Systems},
  year = {2024},
  note = {NeurIPS Spotlight (2.08%) | Sparse LLMs via End-to-End Training }
}

CVPR’23

DepGraph: Towards Any Structural Pruning

Gongfan Fang, Xinyin Ma, Mingli Song, Michael Bi Mi, and Xinchao Wang

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

Automated Network Pruning | Top-5 on Github #Model-Compression

arXiv Bib PDF Code

@inproceedings{fang2023depgraph,
  title = {DepGraph: Towards Any Structural Pruning},
  author = {Fang, Gongfan and Ma, Xinyin and Song, Mingli and Mi, Michael Bi and Wang, Xinchao},
  booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  pages = {16091--16101},
  year = {2023},
  note = {Automated Network Pruning | Top-5 on Github #Model-Compression}
}

CVPR’24

DeepCache: Accelerating Diffusion Models for Free

Xinyin Ma, Gongfan Fang, and Xinchao Wang

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

Training-free and almost lossless | 2-7x Speedup on Diffusion Models

arXiv Bib Code

@inproceedings{ma2023deepcache,
  title = {DeepCache: Accelerating Diffusion Models for Free},
  author = {Ma, Xinyin and Fang, Gongfan and Wang, Xinchao},
  booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  year = {2024},
  note = {Training-free and almost lossless | 2-7x Speedup on Diffusion Models}
}

NeurIPS’23

LLM-Pruner: On the Structural Pruning of Large Language Models

Xinyin Ma, Gongfan Fang, and Xinchao Wang

Advances in Neural Information Processing Systems, 2023

The First Structured Pruning Method for LLMs | Low-cost Pruning and Training

arXiv Bib Code

@inproceedings{ma2023llmpruner,
  title = {LLM-Pruner: On the Structural Pruning of Large Language Models},
  author = {Ma, Xinyin and Fang, Gongfan and Wang, Xinchao},
  booktitle = {Advances in Neural Information Processing Systems},
  year = {2023},
  note = {The First Structured Pruning Method for LLMs | Low-cost Pruning and Training}
}

Education

2022.07 - Present - Ph.D. in Electrical and Computer Engineering, National University of Singapore.

2019.09 - 2022.04 - M.Eng. in Computer Science, College of Computer Science and Technology, Zhejiang University.

2015.09 - 2019.06 - B.S. in Computer Science, College of Computer Science and Technology, Zhejiang University.