Yixiao Ge

• MLLM-NPU: Training Multimodal Large Language Models on Ascend NPUs
  Chen Li, Tianheng Cheng, Yuying Ge, Teng Wang, Yixiao Ge
• Open-MAGVIT2: Democratizing Autoregressive Visual Generation
  Zhuoyan Luo, Fengyuan Shi, Yixiao Ge

( *equal contribution   ^#corresponding author / project lead )

Selected Preprints:

• SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generation
  The latest version of the SEED series, towards multimodal models in the real world.
  Yuying Ge*, Sijie Zhao*, Jinguo Zhu*, Yixiao Ge^#, Kun Yi, Lin Song, Chen Li, Xiaohan Ding, Ying Shan
  [Tech Report] [Code]

2024:

• GrootVL: Tree Topology is All You Need in State Space Model
  Yicheng Xiao, Lin Song, Shaoli Huang, Jiangshan Wang, Siyu Song, Yixiao Ge, Xiu Li, Ying Shan
  NeurIPS, 2024 (Spotlight) [Paper] [Code]
• Vision-language instruction tuning: A review and analysis
  Chen Li, Yixiao Ge, Dian Li, Ying Shan
  TMLR, 2024 [Paper] [Code] [Data]
• ST-LLM: Large Language Models Are Effective Temporal Learners
  Ruyang Liu, Chen Li, Haoran Tang, Yixiao Ge, Ying Shan, Ge Li
  ECCV, 2024 [Paper] [Code]
• DreamDiffusion: Generating High-Quality Images from Brain EEG Signals
  Yunpeng Bai, Xintao Wang, Yan-pei Cao, Yixiao Ge, Chun Yuan, Ying Shan
  ECCV, 2024 [Paper] [Code]
• LLaMA Pro: Progressive LLaMA with Block Expansion
  SOTA foundation models among the LLaMA family, excelling in general tasks, code, and math.
  Chengyue Wu, Yukang Gan, Yixiao Ge^#, Zeyu Lu, Jiahao Wang, Ye Feng, Ping Luo, Ying Shan
  ACL, 2024 [Project] [Paper] [Code] [Model]
• YOLO-World: Real-Time Open-Vocabulary Object Detection
  A real-time open-vocabulary object detector with SOTA performance.
  Tianheng Cheng*, Lin Song*^#, Yixiao Ge^#, Wenyu Liu, Xinggang Wang^#, Ying Shan
  CVPR, 2024 [Project] [Paper] [Code]
• ViT-Lens: Towards Omni-modal Representations
  Advancing omni-modal representation learning with modality lens. Support 3D point cloud, depth, audio, tactile, EEG. Enable any-modality to text and image generation.
  Weixian Lei, Yixiao Ge^#, Kun Yi, Jianfeng Zhang, Difei Gao, Dylan Sun, Yuying Ge, Ying Shan, Mike Zheng Shou^#
  CVPR, 2024 [Project] [Paper] [Code] [Model] [Version 1]
• SEED-Bench: Benchmarking Multimodal Large Language Models
  Comprises 24K multiple-choice questions with accurate human annotations, which spans 27 dimensions, including the evaluation of both text and image generation.
  Bohao Li*, Yuying Ge*, Yixiao Ge^#, Guangzhi Wang, Rui Wang, Ruimao Zhang^#, Ying Shan
  CVPR, 2024 [Paper] [Code & Data] [Leaderboard] [Version 1]
• UniRepLKNet: A Universal Perception Large-Kernel ConvNet for Audio, Video, Point Cloud, Time-Series and Image Recognition
  Xiaohan Ding, Yiyuan Zhang, Yixiao Ge, Sijie Zhao, Lin Song, Xiangyu Yue, Ying Shan
  CVPR, 2024 [Paper] [Code]
• BT-Adapter: Video Conversation is Feasible Without Video Instruction Tuning
  Ruyang Liu, Chen Li, Yixiao Ge, Ying Shan, Thomas H. Li, Ge Li
  CVPR, 2024 [Paper] [Code]
• SmartEdit: Exploring Complex Instruction-based Image Editing with Large Language Models
  Yuzhou Huang, Liangbin Xie, Xintao Wang, Ziyang Yuan, Xiaodong Cun, Yixiao Ge, Jiantao Zhou, Chao Dong, Rui Huang, Ruimao Zhang, Ying Shan
  CVPR, 2024 [Paper] [Code]
• Rethinking the Objectives of Vector-Quantized Tokenizers for Image Synthesis
  Yuchao Gu, Xintao Wang, Yixiao Ge, Ying Shan, Mike Zheng Shou
  CVPR, 2024 [Paper]
• Multimodal Pathway: Improve Transformers with Irrelevant Data from Other Modalities
  Yiyuan Zhang, Xiaohan Ding, Kaixiong Gong, Yixiao Ge, Ying Shan, Xiangyu Yue
  CVPR, 2024 [Paper] [Code]
• LoRA-Sparse: Low-Rank Approximation for Sparse Large Language Models
  Lin Song, Yukang Chen, Shuai Yang, Xiaohan Ding, Yixiao Ge, Ying-Cong Chen, Ying Shan
  CVPR, 2024 [Paper (Coming soon)]
• Making LLaMA SEE and Draw with SEED Tokenizer
  Offers unified multimodal comprehension and generation, featuring multi-turn in-context emergent capabilities, akin to an AI aide.
  Yuying Ge*, Sijie Zhao*, Ziyun Zeng, Yixiao Ge^#, Chen Li, Xintao Wang, Ying Shan
  ICLR, 2024 [Project] [Version 1] [Paper] [Code] [Model]
• Cached Transformers: Improving Transformers with Differentiable Memory Cache
  Zhaoyang Zhang, Wenqi Shao, Yixiao Ge, Xiaogang Wang, Jinwei Gu, Ping Luo
  AAAI, 2024 [Paper]

2023:

• GPT4Tools: Teaching Large Language Model to Use Tools via Self-instruction
  Rui Yang, Lin Song, Yanwei Li, Sijie Zhao, Yixiao Ge, Xiu Li, Ying Shan
  NeurIPS, 2023 [Project] [Paper] [Demo] [Code]
• Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Models
  Yuchao Gu, Xintao Wang, Jay Zhangjie Wu, Yujun Shi, Yunpeng Chen, Zihan Fan, Wuyou Xiao, Rui Zhao, Shuning Chang, Weijia Wu, Yixiao Ge, Ying Shan, Mike Zheng Shou
  NeurIPS, 2023 [Project] [Paper] [Code]
• Meta-Adapter: An Online Few-shot Learner for Vision-Language Model
  Cheng Cheng, Lin Song, Ruoyi Xue, Hang Wang, Hongbin Sun, Yixiao Ge, Ying Shan
  NeurIPS, 2023 [Paper] [Code]
• Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation
  Jay Zhangjie Wu, Yixiao Ge, Xintao Wang, Weixian Lei, Yuchao Gu, Yufei Shi, Wynne Hsu, Ying Shan, Xiaohu Qie, Mike Zheng Shou
  ICCV, 2023 [Project] [Paper] [Demo] [Code]
• Exploring Model Transferability through the Lens of Potential Energy
  Xiaotong Li, Zixuan Hu, Yixiao Ge, Ying Shan, Lingyu Duan
  ICCV, 2023 [Paper] [Code]
• BoxSnake: Polygonal Instance Segmentation with Box Supervision
  Rui Yang, Lin Song, Yixiao Ge, Xiu Li
  ICCV, 2023 [Paper] [Code]
• Unleashing Vanilla Vision Transformer with Masked Image Modeling for Object Detection
  Yuxin Fang*, Shusheng Yang*, Shijie Wang*, Yixiao Ge, Ying Shan, Xinggang Wang
  ICCV, 2023 [Paper] [Code]
• Binary Embedding-based Retrieval at Tencent
  Yukang Gan*, Yixiao Ge*, Chang Zhou*, Shupeng Su, Zhouchuan Xu, Xuyuan Xu, Quanchao Hui, Xiang Chen, Yexin Wang, Ying Shan
  KDD, 2023 [Paper] [Code]
• π-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation
  Chengyue Wu, Teng Wang, Yixiao Ge^#, Zeyu Lu, Ruisong Zhou, Ying Shan, Ping Luo
  ICML, 2023 [Paper] [Code]
• Accelerating Vision-Language Pretraining with Free Language Modeling
  Teng Wang, Yixiao Ge, Feng Zheng, Ran Cheng, Ying Shan, Xiaohu Qie, Ping Luo
  CVPR, 2023 [Paper] [Code]
• Masked Visual Reconstruction in Language Semantic Space
  Shusheng Yang, Yixiao Ge^#, Kun Yi, Dian Li, Ying Shan, Xiaohu Qie, Xinggang Wang^#
  CVPR, 2023 [Paper] [Code]
• Learning Transferable Spatiotemporal Representations from Natural Script Knowledge
  Ziyun Zeng*, Yuying Ge*, Xihui Liu, Bin Chen^#, Ping Luo, Shu-Tao Xia, Yixiao Ge^#
  CVPR, 2023 [Paper] [Code]
• All in One: Exploring Unified Video-Language Pre-training
  Alex Jinpeng Wang, Yixiao Ge, Rui Yan, Yuying Ge, Xudong Lin, Guanyu Cai, Jianping Wu, Ying Shan, Xiaohu Qie, Mike Zheng Shou
  CVPR, 2023 [Paper] [Code]
• Masked Image Modeling with Denoising Contrast
  Kun Yi*, Yixiao Ge*^#, Xiaotong Li, Shusheng Yang, Dian Li, Jianping Wu, Ying Shan, Xiaohu Qie
  ICLR, 2023 [Paper] [Code]
• Darwinian Model Upgrades: Model Evolving with Selective Compatibility
  Binjie Zhang*, Shupeng Su*, Yixiao Ge^#, Xuyuan Xu, Yexin Wang, Chun Yuan, Mike Zheng Shou, Ying Shan
  AAAI, 2023 [Paper]
• Video-Text Pre-training with Learned Regions
  Rui Yan, Mike Zheng Shou, Yixiao Ge, Alex Jinpeng Wang, Xudong Lin, Guanyu Cai, Jinhui Tang
  AAAI, 2023 [Paper] [Code]

2022:

• MILES: Visual BERT Pre-training with Injected Language Semantics for Video-text Retrieval
  Yuying Ge, Yixiao Ge, Xihui Liu, Jinpeng Wang, Jianping Wu, Ying Shan, Xiaohu Qie, Ping Luo
  ECCV, 2022 [Paper] [Code]
• Not All Models Are Equal: Predicting Model Transferability in a Self-challenging Fisher Space
  Wenqi Shao^#, Xun Zhao, Yixiao Ge^#, Zhaoyang Zhang, Lei Yang, Xiaogang Wang, Ying Shan, Ping Luo
  ECCV, 2022 [Paper] [Code]
• mc-BEiT: Multi-choice Discretization for Image BERT Pre-training
  Xiaotong Li, Yixiao Ge, Kun Yi, Zixuan Hu, Ying Shan, Lingyu Duan
  ECCV, 2022 [Paper] [Code]
• Towards Universal Backward-Compatible Representation Learning
  Binjie Zhang, Yixiao Ge^#, Yantao Shen, Shupeng Su, Fanzi Wu, Chun Yuan^#, Xuyuan Xu, Yexin Wang, Ying Shan
  IJCAI, 2022 (Long oral) [Paper] [Code]
• Bridging Video-text Retrieval with Multiple Choice Questions
  Yuying Ge, Yixiao Ge, Xihui Liu, Dian Li, Ying Shan, Xiaohu Qie, Ping Luo
  CVPR, 2022 (Oral) [Paper] [Code]
• Object-aware Video-language Pre-training for Retrieval
  Alex Jinpeng Wang, Yixiao Ge, Guanyu Cai, Rui Yan, Xudong Lin, Ying Shan, Xiaohu Qie, Mike Zheng Shou
  CVPR, 2022 [Paper] [Code]
• Hot-Refresh Model Upgrades with Regression-Alleviating Compatible Training in Image Retrieval
  Binjie Zhang, Yixiao Ge^#, Yantao Shen, Yu Li, Chun Yuan^#, Xuyuan Xu, Yexin Wang, Ying Shan
  ICLR, 2022 [Paper] [Code]
• Dynamic Token Normalization Improves Vision Transformer
  Wenqi Shao, Yixiao Ge, Zhaoyang Zhang, Xuyuan Xu, Xiaogang Wang, Ying Shan, Ping Luo
  ICLR, 2022 [Paper] [Code]
• Uncertainty Modeling for Out-of-Distribution Generalization
  Xiaotong Li, Yongxing Dai, Yixiao Ge, Jun Liu, Ying Shan, Lingyu Duan
  ICLR, 2022 [Paper] [Code]
• Structured Domain Adaptation with Online Relation Regularization for Unsupervised Person Re-ID
  Yixiao Ge, Feng Zhu, Dapeng Chen, Rui Zhao, Xiaogang Wang, Hongsheng Li
  IEEE TNNLS, 2022 [Project] [Paper]

2021:

• Progressive Correspondence Pruning by Consensus Learning
  Chen Zhao*, Yixiao Ge*, Feng Zhu, Rui Zhao, Hongsheng Li, Mathieu Salzmann
  ICCV, 2021 [Project] [Paper] [Code]
• Online Pseudo Label Generation by Hierarchical Cluster Dynamics for Adaptive Person Re-identification
  Yi Zheng, Shixiang Tang, Guolong Teng, Yixiao Ge, Kaijian Liu, Donglian Qi, Jing Qin, Dapeng Chen
  ICCV, 2021 [Paper]
• Refining Pseudo Labels with Clustering Consensus over Generations for Unsupervised Object Re-identification
  Xiao Zhang*, Yixiao Ge*, Yu Qiao, Hongsheng Li
  CVPR, 2021 [Paper]
• DivCo: Diverse Conditional Image Synthesis via Contrastive Generative Adversarial Network
  Rui Liu, Yixiao Ge, Ching Lam Choi, Xiaogang Wang, Hongsheng Li
  CVPR, 2021 [Paper] [Code]
• Mutual CRF-GNN Network for Few-shot Learning
  Shixiang Tang, Dapeng Chen, Lei Bai, Kaijian Liu, Yixiao Ge, Wanli Ouyang
  CVPR 2021 [Paper]

2020:

• Self-paced Contrastive Learning with Hybrid Memory for Domain Adaptive Object Re-ID
  Yixiao Ge, Feng Zhu, Dapeng Chen, Rui Zhao, Hongsheng Li
  NeurIPS, 2020 [Project] [Paper] [Code]
• Self-supervising Fine-grained Region Similarities for Large-scale Image Localization
  Yixiao Ge, Haibo Wang, Feng Zhu, Rui Zhao, Hongsheng Li
  ECCV, 2020 (Spotlight) [Project] [Paper] [Code]
• Mutual Mean-Teaching: Pseudo Label Refinery for Unsupervised Domain Adaptation on Person Re-identification
  Yixiao Ge, Dapeng Chen, Hongsheng Li
  ICLR, 2020 [Project] [Paper] [Code]

Before 2020:

• FD-GAN: Pose-guided Feature Distilling GAN for Robust Person Re-identification
  Yixiao Ge*, Zhuowan Li*, Haiyu Zhao, Guojun Yin, Shuai Yi, Xiaogang Wang, Hongsheng Li
  NeurIPS, 2018 [Project] [Paper] [Code]