Hello there! I'm Gongfan Fang, currently a third-year Ph.D. Candadite at the Learning and Vision (LV) Lab @ National University of Singapore, under the supervision of Prof. Xinchao Wang. Prior to joining LV Lab, I earned my Bachelor’s degree in 2019 and subsequently completed my Master’s degree in 2022 at the Visual Intelligence and Pattern Analysis (VIPA) Lab @ Zhejiang University, adviced by Prof. Mingli Song.

My research focuses on Efficient Deep Learning and Generative AI. In addition, I also actively contribute to several open-source projects such as Torch-Pruning.

News

Sep, 2024	🚀 Two first-author papers MaskLLM (Spotlight) and Remix-DiT were accepted by NeurIPS’24.
Sep, 2024	🚀 Three co-authored papers Learning-to-Cache, SlimSAM and AsyncDiff were accepted by NeurIPS’24.
Jul, 2024	🚀 One paper Isomorphic Pruning was accepted by ECCV’24.

Selected Publications

NeurIPS’24

MaskLLM: Learnable Semi-structured Sparsity for Large Language Models

Gongfan Fang, Hongxu Yin, Saurav Muralidharan, Greg Heinrich, Jeff Pool, Jan Kautz, Pavlo Molchanov, and Xinchao Wang

Advances in Neural Information Processing Systems, 2024

arXiv Webpage Bib Code

@article{fang2024maskllm,
  title = {MaskLLM: Learnable Semi-structured Sparsity for Large Language Models},
  author = {Fang, Gongfan and Yin, Hongxu and Muralidharan, Saurav and Heinrich, Greg and Pool, Jeff and Kautz, Jan and Molchanov, Pavlo and Wang, Xinchao},
  journal = {Advances in Neural Information Processing Systems},
  year = {2024}
}

NeurIPS’24

Remix-DiT: Mixing Diffusion Transformers for Multi-Expert Denoising

Gongfan Fang, Xinyin Ma, and Xinchao Wang

Advances in Neural Information Processing Systems, 2024

arXiv Bib Code

@article{fang2024remixdit,
  title = {Remix-DiT: Mixing Diffusion Transformers for Multi-Expert Denoising},
  author = {Fang, Gongfan and Ma, Xinyin and Wang, Xinchao},
  journal = {Advances in Neural Information Processing Systems},
  year = {2024}
}

ECCV’24

Isomorphic Pruning for Vision Models

Gongfan Fang, Xinyin Ma, Michael Bi Mi, and Xinchao Wang

European Conference on Computer Vision, 2024

arXiv Bib Code

@article{fang2024isomorphic,
  title = {Isomorphic Pruning for Vision Models},
  author = {Fang, Gongfan and Ma, Xinyin and Mi, Michael Bi and Wang, Xinchao},
  journal = {European Conference on Computer Vision},
  year = {2024}
}

CVPR’23

DepGraph: Towards Any Structural Pruning

Gongfan Fang, Xinyin Ma, Mingli Song, Michael Bi Mi, and Xinchao Wang

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

arXiv Bib PDF Code

@inproceedings{fang2023depgraph,
  title = {DepGraph: Towards Any Structural Pruning},
  author = {Fang, Gongfan and Ma, Xinyin and Song, Mingli and Mi, Michael Bi and Wang, Xinchao},
  booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  pages = {16091--16101},
  year = {2023}
}

CVPR’24

DeepCache: Accelerating Diffusion Models for Free

Xinyin Ma, Gongfan Fang, and Xinchao Wang

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

arXiv Bib Code

@inproceedings{ma2023deepcache,
  title = {DeepCache: Accelerating Diffusion Models for Free},
  author = {Ma, Xinyin and Fang, Gongfan and Wang, Xinchao},
  booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  year = {2024}
}

NeurIPS’23

LLM-Pruner: On the Structural Pruning of Large Language Models

Xinyin Ma, Gongfan Fang, and Xinchao Wang

Advances in Neural Information Processing Systems, 2023

arXiv Bib Code

@inproceedings{ma2023llmpruner,
  title = {LLM-Pruner: On the Structural Pruning of Large Language Models},
  author = {Ma, Xinyin and Fang, Gongfan and Wang, Xinchao},
  booktitle = {Advances in Neural Information Processing Systems},
  year = {2023}
}

NeurIPS’23

Structural Pruning for Diffusion Models

Gongfan Fang, Xinyin Ma, and Xinchao Wang

Advances in Neural Information Processing Systems, 2023

arXiv Bib Code

@inproceedings{fang2023structural,
  title = {Structural Pruning for Diffusion Models},
  author = {Fang, Gongfan and Ma, Xinyin and Wang, Xinchao},
  booktitle = {Advances in Neural Information Processing Systems},
  year = {2023}
}

Education

2022.07 - Present - Ph.D. in Electrical and Computer Engineering, National University of Singapore.

2019.09 - 2022.04 - M.Eng. in Computer Science, College of Computer Science and Technology, Zhejiang University.

2015.09 - 2019.06 - B.S. in Computer Science, College of Computer Science and Technology, Zhejiang University.