Portrait of Jianshu Zhang

Jianshu Zhang 张鉴殊

CS Ph.D. Student Northwestern University sterzhang [at] u.northwestern.edu

About Me

Hi! I’m Jianshu Zhang (张鉴殊), a first-year CS Ph.D. student at Northwestern University. My research focuses on building multimodal and agentic AI systems that are truly ready to understand, reason about, and act in the interactive and physical world. Feel free to reach out if you’d like to chat.

Research Interests

How can large vision-language models truly step into our world?

  • Safe and diverse behavior: before VLMs act in open environments, they need to remain safe, reliable, and robust across diverse users, contexts, and failure modes.
  • Clear visual perception: VLMs must see the world precisely, preserving fine-grained perception and visual grounding instead of relying mainly on language priors.
  • Spatial and physical intelligence: beyond recognizing images, VLMs should build spatial mental models, reason about unseen or interactive environments, and connect perception to physical action.

News

  • [May 2026] SpaceNum was released, revisiting spatial-numerical understanding in VLMs.
  • [May 2026] ProgressLM was selected as Oral in ACL 2026.
  • [May 2026] I was selected as a Silver Reviewer in ICML 2026.
  • [Apr 2026] AdvEvo-MARL was accepted to ICML 2026.
  • [Apr 2026] ProgressLM and COREWeaver were accepted to ACL 2026 (Main).
Show more
  • [Jan 2026] MindCube was accepted to ICLR 2026.
  • [Jan 2026] ProgressLM was released, probing how well VLMs reason in progress.
  • [Sep 2025] Honored to receive McCormick School of Engineering Fellowship from Northwestern University.
  • [Sep 2025] Joined Northwestern University as a Ph.D. student in Computer Science.
  • [Aug 2025] Evo-MARL and FairReason were accepted to T2FM@ICCV 2025.
  • [Aug 2025] WebCoT was accepted to EMNLP 2025 (Findings) and AIA@COLM 2025.
  • [Jun 2025] MultiVerse was accepted to ICCV 2025.
  • [Jun 2025] Graduated with a B.E. degree and selected as Outstanding Undergraduate.
  • [May 2025] VLM2-Bench was accepted to ACL 2025 (Main), and Bridge-Coder to ACL 2025 (Findings).
  • [May 2025] Honored with the Lei Jun Computer Breakthrough Award (50K RMB).
  • [May 2025] CAN was accepted to ICML 2025.
  • [Jan 2025] PVIT was accepted to ICLR 2025.
  • [Nov 2024] PVIT-3M dataset ranked Top 3 in downloads on Hugging Face.
  • [Oct 2024] Awarded the National Scholarship (top 0.2% nationally).
  • [Sep 2024] Image Textualization accepted to NeurIPS 2024 (D&B).
  • [Sep 2024] MLLM-Protector and FIRST accepted to EMNLP 2024 (Main).
  • [Mar 2024] CORE accepted to CogSci 2024 (Oral).
  • [Dec 2023] FuzzLLM accepted to ICASSP 2024.

Publications

2026 (7) 2025 (7) 2024 (5)

2026

  1. SpaceNum teaser New
    SpaceNum: Revisiting Spatial Numerical Understanding in VLMs
    Jianshu Zhang*, Yijiang Li*, Huifeixin Chen, Haoran Lu, Letian Xue, Bingyang Wang, Han Liu
    New Released
    PDF Project Page
  2. ProgressLM teaser ACL
    PROGRESSLM: Towards Progress Reasoning in Vision-Language Models
    Jianshu Zhang*, Chengxuan Qian*, Haosen Sun, Haoran Lu, Dingcheng Wang, Letian Xue, Han Liu
    ACL 2026 (Main); ICLR 2026 Workshop on World Models
    Oral
    PDF Project Page
  3. MindCube teaser ICLR
    Spatial Mental Modeling from Limited Views
    Baiqiao Yin, Qineng Wang, Pingyue Zhang, Jianshu Zhang, Kangrui Wang, Zihan Wang, Jieyu Zhang, Keshigeyan Chandrasegaran, Han Liu, Ranjay Krishna, Saining Xie, Manling Li, Jiajun Wu, Li Fei-Fei
    ICLR 2026; ICCV 2025 Workshop SP4V
    Best Paper Award
    Paper
  4. Explore to Evolve teaser ACL
    Explore to Evolve: Scaling Evolved Aggregation Logic via Proactive Online Exploration for Deep Research Agents
    Rui Wang, Ce Zhang, Jun-Yu Ma, Jianshu Zhang, Hongru Wang, Yi Chen, Boyang Xue, Tianqing Fang, Zhisong Zhang, Hongming Zhang, Haitao Mi, Dong Yu, Kam-Fai Wong
    ACL 2026 (Main)
    PDF
  5. AdvEvo-MARL teaser ICML
    AdvEvo-MARL: Shaping Internalized Safety through Adversarial Co-Evolution in Multi-Agent Reinforcement Learning
    Zhenyu Pan, Yiting Zhang, Zhuo Liu, Yolo Yunlong Tang, Zeliang Zhang, Haozheng Luo, Yuwei Han, Jianshu Zhang, Dennis Wu, Hong-Yu Chen, Haoran Lu, Haoyang Fang, Manling Li, Chenliang Xu, Philip S. Yu, Han Liu
    ICML 2026
    Paper PDF
  6. MagicSim teaser arXiv
    MagicSim: A Unified Infrastructure for Executable Embodied Interaction
    Haoran Lu, Songling Liu, Yue Chen, Guo Ye, Mutian Shen, Shuyang Yu, Yu Xiao, Jihai Zhao, Shang Wu, Jianshu Zhang, Xiangtian Gui, Chuye Hong, Yuran Wang, Maojiang Su, Jiayi Wang, Ruihai Wu, Zhaoran Wang, Han Liu
    arXiv preprint arXiv:2606.17511
    Paper PDF
  7. Phys4D teaser arXiv
    Phys4D: Fine-Grained Physics-Consistent 4D Modeling from Video Diffusion
    Haoran Lu, Shang Wu, Songling Liu, Jianshu Zhang, Maojiang Su, Guo Ye, Chenwei Xu, Lie Lu, Pranav Maneriker, Fan Du, Manling Li, Zhaoran Wang, Han Liu
    arXiv preprint arXiv:2603.03485
    Paper PDF

2025

  1. VLM2-Bench teaser ACL
    VLM2-Bench: A Closer Look at How Well VLMs Implicitly Link Explicit Matching Visual Cues
    Jianshu Zhang*, Dongyu Yao*, Renjie Pi, Paul Pu Liang, Yiren Fung
    ACL 2025 (Main)
    Paper
  2. MultiVerse teaser ICCV
    MultiVerse: A Multi-Turn Conversation Benchmark for Evaluating Large Vision and Language Models
    Young-Jun Lee, Byung-Kwan Lee, Jianshu Zhang, Yechan Hwang, Byungsoo Ko, Han-Gyu Kim, Dongyu Yao, Xuankun Rong, Eojin Joo, Seung-Ho Han, Bowon Ko, Ho-Jin Choi
    ICCV 2025; ICCV 2025 Workshop KnowledgeMR
    Paper
  3. Personalized Visual Instruction Tuning teaser ICLR
    Personalized Visual Instruction Tuning
    Renjie Pi*, Jianshu Zhang*, Tianyang Han, Jipeng Zhang, Rui Pan, Tong Zhang
    ICLR 2025
    Paper
  4. WebCoT teaser EMNLP
    WebCoT: Enhancing Web Agent Reasoning by Reconstructing Chain-of-Thought in Reflection, Branching, and Rollback
    Minda Hu, Tianqing Fang, Jianshu Zhang, Junyu Ma, Zhisong Zhang, Jingyan Zhou, Hongming Zhang, Haitao Mi, Dong Yu, Irwin King
    EMNLP 2025 (Findings); COLM 2025 Workshop AIA
    Paper
  5. FairReason teaser arXiv
    FairReason: Balancing Reasoning and Social Bias in MLLMs
    Zhenyu Pan, Yutong Zhang, Jianshu Zhang, Haoran Lu, Haozheng Luo, Yuwei Han, Philip S. Yu, Manling Li, Han Liu
    arXiv preprint arXiv:2507.23067
    Paper PDF
  6. CAN teaser ICML
    CAN: Leveraging Clients as Navigators for Generative Replay in Federated Continual Learning
    Xuankun Rong*, Jianshu Zhang*, He Kun, Mang Ye
    ICML 2025
    Paper
  7. Bridge-Coder teaser ACL
    Bridge-Coder: Transferring Model Capabilities from High-Resource to Low-Resource Programming Language
    Jipeng Zhang*, Jianshu Zhang*, Yuanzhe Li*, Renjie Pi, Rui Pan, Runtao Liu, Zheng Ziqiang, Tong Zhang
    ACL 2025 (Findings)
    Paper

2024

  1. Image Textualization teaser NeurIPS
    Image Textualization: An Automatic Framework for Creating Accurate and Detailed Image Descriptions
    Renjie Pi*, Jianshu Zhang*, Jipeng Zhang, Rui Pan, Zhekai Chen, Tong Zhang
    NeurIPS 2024
    Paper
  2. MLLM-Protector teaser EMNLP
    MLLM-Protector: Ensuring MLLM's Safety without Hurting Performance
    Renjie Pi*, Tianyang Han*, Jianshu Zhang*, Yueqi Xie, Rui Pan, Qing Lian, Hanze Dong, Jipeng Zhang, Tong Zhang
    EMNLP 2024 (Main)
    Paper
  3. FuzzLLM teaser ICASSP
    FuzzLLM: A Novel and Universal Fuzzing Framework for Proactively Discovering Jailbreak Vulnerabilities in Large Language Models
    Dongyu Yao*, Jianshu Zhang*, Ian G. Harris, Marcel Carlsson
    ICASSP 2024; Presented at ShmooCon 2024
    Paper
  4. FIRST teaser EMNLP
    FIRST: Teach A Reliable Large Language Model Through Efficient Trustworthy Distillation
    KaShun Shum*, Minrui Xu*, Jianshu Zhang*, Zixin Chen, Shizhe Diao, Hanze Dong, Jipeng Zhang, Muhammad Omer Raza
    EMNLP 2024 (Main)
    Paper
  5. CORE teaser CogSci
    CORE: Mitigating Catastrophic Forgetting in Continual Learning through Cognitive Replay
    Jianshu Zhang*, Yankai Fu*, Ziheng Peng*, Dongyu Yao, Kun He
    CogSci 2024
    Oral
    Paper

Awards

  • McCormick School of Engineering Fellowship (~46K USD)
  • National Scholarship
  • Lei Jun Computer Breakthrough Award (50K RMB)
  • Outstanding Undergraduate
  • First-Class Scholarship (ranked 1st)
  • Merit Student

Education

  • Northwestern University, Ph.D. in Computer Science (2025-2030)
  • Wuhan University (2021-2025)
  • Shenzhen Middle School (2018-2021)