Jianshu Zhang

Jianshu Zhang

Wuhan University

😊 About Me

Greetings!👋 I’m Jianshu Zhang (张鉴殊), a 4th year undergraduate student at the School of Cyber Science and Engineering, Wuhan University.
Prior to WHU, I spent three years studying at Shenzhen Middle School (深圳中学).

My research interests mainly focus on Reliable (multimodal) LLMs, Data-centric AI, and Lifelong Learning. Recently, I’ve started exploring Reasoning, focusing on key areas such as multimodal reasoning; longer reasoning and inference time scaling laws; and step-by-step reward mechanisms.

Currently, I’m actively seeking 🤗 25Fall Ph.D. positions 🤗 to further pursue my research goals. Feel free to connect and discuss exciting opportunities or collaborations!

🔥 News

  • 2024.10:   I was selected as Outstanding National Scholarship Student Representative!
  • 2024.10:   I won the National Scholarship 🥰 (Award Rate: 0.2% national-wide)!
  • 2024.09:   One paper has been accepted by NeurIPS 2024 (D&B track). ✊
  • 2024.09:   Two papers have been accepted by EMNLP 2024 (Main). 👏
  • 2024.07:   Attended CogSci 2024 in Rotterdam, Netherlands. The atmosphere is fantastic!
  • 2024.03:   One paper has been accepted by Cogsci 2024 [Oral].
  • 2024.01:   Our work of FuzzLLM is invited to present at one of the top hacker conventions – ShmooCon 2024!


📝 Publications

† : equal contribution (names listed in no particular order), * : corresponding author

Data-Centric AI

Image Textualization
Image Textualization: An Automatic Framework for Generating Rich and Detailed Image Descriptions
Jianshu Zhang† , Renjie Pi†, Jipeng Zhang, Rui Pan, Zhekai Chen, Tong Zhang*
The Thirty-Eighth Annual Conference on Neural Information Processing Systems (NeurIPS 2024)
[arXiv] [code]
Personalized Visual Instruction Tuning
Personalized Visual Instruction Tuning
Jianshu Zhang† , Renjie Pi†, Tianyang Han, Jipeng Zhang, Rui Pan, Tong Zhang*
Under Review
[arXiv] [code]
Bridge-Coder
Bridge-Coder: Unlocking LLMs' Potential to Overcome Language Gaps in Low-Resource Code
Jianshu Zhang† , Jipeng Zhang†, Yuanzhe LI†, Renjie Pi, Rui Pan, Runtao Liu, Zheng Ziqiang, Tong Zhang*
Under Review
[arXiv] [code]



Reliable (Multi-modal) LLMs

MLLM-Protector
MLLM-Protector: Ensuring MLLM's Safety without Hurting Performance
Jianshu Zhang† , Renjie Pi†, Tianyang Han†, Yueqi XIE, Rui Pan, Qing LIAN, Hanze Dong, Jipeng Zhang, Tong Zhang*
The 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP 2024)
[arXiv] [code]
FIRST
FIRST: Teach A Reliable Large Language Model Through Efficient Trustworthy Distillation
Jianshu Zhang† , KaShun SHUM†, Minrui Xu†, Zixin CHEN, Shizhe Diao, Hanze Dong, Jipeng Zhang, Muhammad Omer Raza
The 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP 2024)
[arXiv] [code]
FuzzLLM
FuzzLLM: A Novel and Universal Fuzzing Framework for Proactively Discovering Jailbreak Vulnerabilities in Large Language Models
Jianshu Zhang† , Dongyu Yao†, Ian G. Harris*, Marcel Carlsson
2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2024)
[arXiv] [code]


Lifelong Learning

CORE
CORE: Mitigating Catastrophic Forgetting in Continual Learning through Cognitive Replay
Jianshu Zhang† , Yankai Fu†, Ziheng Peng†, Dongyu Yao, Kun He*
2024 Cognitive Science Society Annual Conference (Cogsci 2024) [Oral]
[arXiv] [code]
Client As Navigator
CAN: Injecting More "Federation" into Federated Continual Learning by Positioning Clients as Navigators
Jianshu Zhang† , Xuankun Rong†, Kun He, Mang Ye*
Under Review
[arXiv] [code]




🏆 Honors and Awards

  • 2024.10:   Outstanding National Scholarship Student Representative (the Only One from the department)
  • 2024.10:   National Scholarship (0.2% national-wide) Ministry of Education, China
  • 2024.09:   2023-2024 Merit Student Wuhan University
  • 2024.09:   First Class Scholarship (5% school-wide) Wuhan University
  • 2024.05:   First Prize in the 17th China Undergraduate Computer Design Competition of Middle South Division (3% division-wide)
  • 2023.12:   Advanced Individual in Scientific Innovation Wuhan University
  • 2023.10:   2022-2023 Merit Student Wuhan University
  • 2023.05:   First Prize (4.5% nationwide), Huazhong Contest in Mathematical Modeling
  • 2022.10:   2021-2022 Merit Student Wuhan University

📖 Educations

💻 Internships