About me

English | 中文

Short Bio

I am Jing Peng (彭景), a second-year Zhiyuan Honor Ph.D. Student at Shanghai Jiao Tong University (SJTU), X-LANCE Lab, advised by Prof. Kai Yu (and co-advised by Prof. Shinji Watanabe), closely collaborating with Prof. Shuai Wang.

Basic Information

🎂
Date of Birth

2003-10-06

📍
Hometown

Hengyang, Hunan, China

🌐
Languages

Mandarin, English

✉️
💻
GitHub

PigeonDan1

📚
Google Scholar

Profile

🔬
Semantic Scholar

Profile

🔗
LinkedIn

Profile

Education

Sep 2025 – Present
Shanghai Jiao Tong University (SJTU)

Zhiyuan Honors Ph.D. Program, X-LANCE Lab, College of Computer Science

Ph.D. Student

Sep 2021 – Jun 2025
Xi'an Jiao Tong University (XJTU)

B.Eng. in Automation, minor in Electrical Engineering

Qian Xuesen Honor Class

Aug 2023 – Dec 2023
University of California, Berkeley

Exchange Student, Berkeley Global Access (BGA), College of Engineering

Research Interests

My research spans reproducible evaluation, speech-language alignment, speech recognition, language and audio agents, and spatial audio.

📊 Reproducible Research & Reliable Evaluation

The SURE series connects reproducible experimentation, agentic evaluation, and semi-structured speech representations for compositional analysis.

🔗 Cross-Modal Speech Alignment

Aligning speech and language through text-only training, controllable CTC simulation, instruction-conditioned adaptation, and text-guided speech editing.

📚 Surveys

Systematizing Speech LLM architectures, training strategies, tasks, and evaluation to map the field and its open challenges.

🎙️ Automatic Speech Recognition

Unified streaming and non-streaming recognition, ASR error correction, and metrics for reliable transcription.

🌍 ASR in Complex Scenarios

Multilingual and multi-speaker ASR, hotword and contextual recognition, multilingual evaluation benchmarks and normalization, and adaptive data sampling.

🤖 Agentic Systems for Language & Research

Executable protocols, evidence-grounded research, and auditable collaboration for language-based agents.

🎧 Voice & Audio Agents

Building agents that reason over speech and audio evidence, coordinate specialist tools, and make their decisions auditable.

🧭 Spatial Audio

Exploring spatial audio perception and understanding, connecting acoustic scenes with spatial context.

DiS-TSENCMMSC 2026 · Poster

Research Experience

🎙️ Speech LLMs for Speech Understanding

AISpeech, Suzhou, Jiangsu
I work on ASR and multimodal alignment methods that connect speech representations with language model reasoning and instruction following.

🗣️ SA-ASR with Speech LLMs

Shenzhen Research Institute of Big Data, Remote
I explore Speech LLM-based frameworks for speaker-attributed transcription, aiming to improve speaker consistency and controllability in multi-speaker scenarios.

👥 Speaker Discrimination on Omni/SLM

Hi Lab, Xiaohongshu, Shanghai
I study explicit speaker discrimination and implicit speaker selection strategies for multi-speaker understanding, with an eye toward robust speaker identity modeling under real-world conditions.

Open Source Projects

SURE / Open-Bench

I lead a reproducible speech evaluation toolkit spanning evaluation frameworks, interactive demos, and semi-structured speech annotation.

Audio Agents & Speech Systems

Core contributor to Qwen-Audio-Agent (architecture and backend models); contributor to SLAM-LLM (NPU support) and speech-to-speech (CJK punctuation and Chinese TTS token budgeting).

Research Utilities

I lead paper_claw for paper crawling and ps-slm for speech and language modeling utilities.

Publications (Selected)

SURE-Tagger: Structured Speech Representations for Compositional Evaluation and Targeted Data Selection
Jing Peng, Huifei Wang, Weihan Chen, Shuo Gao, Bicheng Zhang, Junhao Du, Hanqi Li, Chaolei Liu, Wen Wen, Tao Liu, Xu Li, Yu Xi, Shuai Wang, Kai Yu
arXiv preprint · 2026
ETC-Bench: A Multilingual Benchmark for Evaluation-Side Transcript Canonicalization
Zhiheng Qian, Junhao Du, Jing Peng, Hanqi Li, Kunyang Peng, Feng Xue, Shuai Wang, Kai Yu
arXiv preprint · 2026
VISH-ASR: Viterbi-Guided Selection of Hotwords for Speech-LLM Contextual ASR
Xiaoyu Gu, Yu Xi, Chencheng Wang, Zonghan Zhou, Haoyu Li, Jing Peng, Kai Yu
arXiv preprint · 2026
Agentic Data Sampling Framework for Multilingual ASR via Linguistic-Aware Error-Driven Optimization
Zhiheng Qian, Junhao Du, Jing Peng, Hanqi Li, Kunyang Peng, Feng Xue, Lu Chen, Shuai Wang, Kai Yu
NCMMSC 2026 (accepted, Poster) · 2026
In-Context Adapter Generation for Compositional Generalization in Large Audio Language Models
Yiwei Guo, Siqi Huang, Bohan Li, Jing Peng, Hankun Wang, Zhihan Li, Kai Yu
arXiv preprint · 2026
SURE-EVAL: A Systematic and Unified Agentic Framework for Reproducible Evaluation
Jing Peng*, Junhao Du*, Yixuan Wang*, Bowen Wang*, Hanqi Li*, Chaolei Liu, Weihan Chen, Haohui Xie, Ruichen Sun, Chenghao Wang, Wen Wen, Guanyu Chen, Xiaoyu Gu, Haoyu Li, Yiwei Guo, Bohan Li, Tao Liu, Yucheng Wang, Yu Xi, Yihua Zhou, Qiang Zhou, Feng Lu, Shuai Wang, Kai Yu
NCMMSC 2026 (accepted, Oral) · 2026
TASU2: Controllable CTC Simulation for Alignment and Low-Resource Adaptation of Speech LLMs
Jing Peng*, C. Wang*, Y. Yang, L. Qian, J. Li, Y. Xi, S. Wang, K. Yu
Interspeech 2026 (accepted, Oral) · 2026
Audio-Mind: An Auditable Agentic Framework for Audio Understanding
Yucheng Wang*, Jing Peng*, Hanqi Li, Chenghao Wang, Wenming Tu, Yu Xi, Zhaokai Sun, Kai Yu, Shuai Wang
submitted to EMNLP 2026 · 2026
XFlow: An Executable Protocol Programming System for Reliable Multi-Agent Workflows
H. Li*, Jing Peng*, Z. Wang, L. Chen, K. Yu
arXiv preprint · 2026
Making AI Scientists Auditable from Evidence to Claim
Zijian Wang, Hanqi Li, Ziyue Yang, Zijian Hu, Shenghan Zuo, Yunzhe Zhang, Da Ma, Danyu Luo, Chenrun Wang, Jing Peng, Tiancheng Huang, Sijia Guo, Huayang Wang, Zichen Zhu, Senyu Han, Yilu Cao, Bo Chen, Xin Chen, Kai Yu, Lu Chen
arXiv preprint · 2026
G-STAR: End-to-End Global Speaker-Tracking Attributed Recognition
Jing Peng*, Z. Chen*, H. Li*, Y. Wang, D. Ma, M. Li, Y. Du, D. Xu, K. Yu, S. Wang
Findings of EMNLP 2026 (accepted) · 2026
TC-BiMamba: Trans-Chunk bidirectionally within BiMamba for unified streaming and non-streaming ASR
Qingshun She*, Jing Peng*, Yangui Fang, Yu Xi, Kai Yu
Findings of EMNLP 2026 (accepted) · 2026
A Unified and Reproducible Experimentation Framework for Speech Understanding
Jing Peng*, J. Du*, C. Wang*, H. Li*, Y. Yang*, Y. Wang, X. Gu, G. Chen, Y. Wang, J. Li, Z. Zhao, H. Wang, W. Tu, H. Li, D. Ma, L. Qian, Y. Xi, W. Wen, J. Guo, H. Zhang, S. Fan, W. Jiang, S. Wang, K. Yu
Interspeech 2026 (accepted, Oral) · 2026
RAS: a Reliability Oriented Metric for Automatic Speech Recognition
W. Huang, Y. Qiu, B. Li, Y. Guo, Jing Peng, H. Wang, X. Chen, K. Yu
Interspeech 2026 (accepted, Oral) · 2026
A Survey on Speech Large Language Models for Understanding
Jing Peng*, Yucheng Wang*, Bohan Li, Yiwei Guo, Hankun Wang, Yangui Fang, Yu Xi, Haoyu Li, Xu Li, Ke Zhang, Shuai Wang, Kai Yu
IEEE Journal of Selected Topics in Signal Processing · 2025
TASU: Text-Only Alignment for Speech Understanding
Jing Peng, Y. Yang, X. Li, Y. Xi, Q. Tang, Y. Fang, J. Li, K. Yu
ICASSP 2026 (accepted, Oral) · 2026
Low-Resource Domain Adaptation for Speech LLMs via Text-Only Fine-Tuning
Y. Fang*, Jing Peng*, X. Li, Y. Xi, C. Zhang, G. Zhong, K. Yu
ASRU 2025 (accepted) · 2025
MOSA: Mixtures of Simple Adapters Outperform Monolithic Approaches in LLM-based Multilingual ASR
Junjie Li, Jing Peng, Yangui Fang, Shuai Wang, Kai Yu
ICASSP 2026 (accepted, Poster) · 2026
dots.tts.edit: Precisely Controlled Speech Editing with a Continuous Autoregressive Model
Hankun Wang, Bohan Li, Shi Lian, Xiaoyu Gu, Jing Peng, Da Zheng, Yiwei Guo, Colin Zhang, Shuai Wang, Kai Yu
arXiv preprint · 2026

Resume

📄 View or download my resume

Personal Information

I am originally from Hengyang, Hunan, China, a beautiful city. Outside of research, I enjoy exploring local food and traveling, and I am also an active fan of sports such as badminton and basketball.

If you are interested in my research directions, feel free to reach out—I am happy to discuss potential collaborations.