Jing Peng
Jing Peng
Hi, I am Jing Peng（彭景）. I am now a second-year Ph.D. student at X-LANCE Lab of Shanghai Jiao Tong University, supervised by Prof. Kai Yu.

English | 中文

最新动态 🎉

🌟 故事开始于 2024/5/20 — 我给俞凯教授写的第一封自荐信

我是 上海交通大学 (SJTU) X-LANCE Lab 的致远荣誉博士生，目前为博士二年级。导师是 俞凯教授（联合导师是 Shinji Watanabe 教授），并与 王帅教授 紧密合作。

研究兴趣

我的研究涵盖可复现评测、语音跨模态对齐、语音识别、语言与音频智能体，以及空间音频。

📊 可复现研究与可靠评测

以 SURE 系列连接可复现实验、智能体评测与半结构化语音表征，支持可组合的条件分析与可靠评估。

SURE-TaggerarXiv preprint · 2026 SURE-EVALNCMMSC 2026 · Oral SUREInterspeech 2026 · Oral ISA-BenchICASSP 2026 · Oral

🔗 语音跨模态对齐

研究仅文本训练、可控 CTC 模拟、指令条件自适应与文本指令驱动的语音编辑，连接语音和语言的跨模态表征与控制。

T2L-ICAGarXiv preprint · 2026 TASU2Interspeech 2026 · Oral TASUICASSP 2026 · Oral Low-Resource DAASRU 2025 Multilingual TASUNCMMSC 2026 · Oral · Spotlight Candidate dots.tts.editarXiv preprint · 2026

📚 综述

系统梳理语音大语言模型的架构、训练方法、任务与评测，厘清研究脉络和开放问题。

Speech LLM SurveyIEEE JSTSP · 2025

🎙️ 自动语音识别

研究流式与非流式统一识别、ASR 错误纠正，以及衡量转写可靠性的评测指标。

TC-BiMambaEMNLP Findings 2026 RASInterspeech 2026 · Oral Fewer HallucinationsASRU 2025 SCORENCMMSC 2026 · Poster

🌍 复杂场景 ASR

面向多语种、多说话人、热词与上下文识别，研究多语种评测基准、文本规范化和自适应数据采样。

ETC-BencharXiv preprint · 2026 VISH-ASRarXiv preprint · 2026 Agentic Data SamplingNCMMSC 2026 · Poster G-STAREMNLP Findings 2026 MOSAICASSP 2026 · Poster Joint DecodingarXiv preprint · 2025 MoE EENDNCMMSC 2026 · Oral PA-TSENCMMSC 2026 · Oral

🤖 语言与科研智能体系统

面向语言类智能体，研究可执行协议、基于证据的科研流程与可审计的多智能体协作。

XFlowarXiv preprint · 2026 Xcientist / Research HarnessarXiv preprint · 2026

🎧 语音与音频智能体

构建围绕语音与音频证据进行推理、调用专业工具并提供可审计决策过程的智能体。

Audio-Mindsubmitted to EMNLP 2026 VISAInterspeech 2026 · Oral Qwen-Audio-Agent

🧭 空间音频

探索空间音频感知与理解，连接声学场景及其空间信息。

DiS-TSENCMMSC 2026 · Poster

研究经历

🎙️ 用于语音理解的语音大模型

AISpeech，苏州，江苏
我从事 ASR 和多模态对齐方法的研究，将语音表示与语言模型推理和指令跟随连接起来。

🗣️ 基于语音大模型的 SA-ASR

深圳大数据研究院，远程
我探索基于语音大模型的说话人归属转录框架，旨在改善多说话人场景中的说话人一致性和可控性。

👥 Omni/SLM 上的说话人区分

小红书 Hi Lab，上海
我研究多说话人理解中的显式说话人区分和隐式说话人选择策略，关注真实世界条件下的鲁棒说话人身份建模。

开源项目

SURE / Open-Bench

主导可复现语音评测工具链，整合评测框架、在线演示与半结构化语音标注。

Open-Bench 在线演示 sure-eval sure-evaluation SURE-Tagger

音频智能体与语音系统

Qwen-Audio-Agent 核心贡献者，负责架构与后端模型；为 SLAM-LLM 贡献 NPU 支持，并为 speech-to-speech 优化中日韩标点保留与中文 TTS token 预算。

研究工具

主导 paper_claw（论文爬取）与 ps-slm（语音与语言建模工具）。

发表论文 (精选)

SURE-Tagger: Structured Speech Representations for Compositional Evaluation and Targeted Data Selection
Jing Peng, Huifei Wang, Weihan Chen, Shuo Gao, Bicheng Zhang, Junhao Du, Hanqi Li, Chaolei Liu, Wen Wen, Tao Liu, Xu Li, Yu Xi, Shuai Wang, Kai Yu
arXiv preprint · 2026
ETC-Bench: A Multilingual Benchmark for Evaluation-Side Transcript Canonicalization
Zhiheng Qian, Junhao Du, Jing Peng, Hanqi Li, Kunyang Peng, Feng Xue, Shuai Wang, Kai Yu
arXiv preprint · 2026
VISH-ASR: Viterbi-Guided Selection of Hotwords for Speech-LLM Contextual ASR
Xiaoyu Gu, Yu Xi, Chencheng Wang, Zonghan Zhou, Haoyu Li, Jing Peng, Kai Yu
arXiv preprint · 2026
Agentic Data Sampling Framework for Multilingual ASR via Linguistic-Aware Error-Driven Optimization
Zhiheng Qian, Junhao Du, Jing Peng, Hanqi Li, Kunyang Peng, Feng Xue, Lu Chen, Shuai Wang, Kai Yu
NCMMSC 2026 (accepted, Poster) · 2026
In-Context Adapter Generation for Compositional Generalization in Large Audio Language Models
Yiwei Guo, Siqi Huang, Bohan Li, Jing Peng, Hankun Wang, Zhihan Li, Kai Yu
arXiv preprint · 2026
SURE-EVAL: A Systematic and Unified Agentic Framework for Reproducible Evaluation
Jing Peng*, Junhao Du*, Yixuan Wang*, Bowen Wang*, Hanqi Li*, Chaolei Liu, Weihan Chen, Haohui Xie, Ruichen Sun, Chenghao Wang, Wen Wen, Guanyu Chen, Xiaoyu Gu, Haoyu Li, Yiwei Guo, Bohan Li, Tao Liu, Yucheng Wang, Yu Xi, Yihua Zhou, Qiang Zhou, Feng Lu, Shuai Wang, Kai Yu
NCMMSC 2026 (accepted, Oral) · 2026
TASU2: Controllable CTC Simulation for Alignment and Low-Resource Adaptation of Speech LLMs
Jing Peng*, C. Wang*, Y. Yang, L. Qian, J. Li, Y. Xi, S. Wang, K. Yu
Interspeech 2026 (accepted, Oral) · 2026
Audio-Mind: An Auditable Agentic Framework for Audio Understanding
Yucheng Wang*, Jing Peng*, Hanqi Li, Chenghao Wang, Wenming Tu, Yu Xi, Zhaokai Sun, Kai Yu, Shuai Wang
submitted to EMNLP 2026 · 2026
XFlow: An Executable Protocol Programming System for Reliable Multi-Agent Workflows
H. Li*, Jing Peng*, Z. Wang, L. Chen, K. Yu
arXiv preprint · 2026
Making AI Scientists Auditable from Evidence to Claim
Zijian Wang, Hanqi Li, Ziyue Yang, Zijian Hu, Shenghan Zuo, Yunzhe Zhang, Da Ma, Danyu Luo, Chenrun Wang, Jing Peng, Tiancheng Huang, Sijia Guo, Huayang Wang, Zichen Zhu, Senyu Han, Yilu Cao, Bo Chen, Xin Chen, Kai Yu, Lu Chen
arXiv preprint · 2026
G-STAR: End-to-End Global Speaker-Tracking Attributed Recognition
Jing Peng*, Z. Chen*, H. Li*, Y. Wang, D. Ma, M. Li, Y. Du, D. Xu, K. Yu, S. Wang
Findings of EMNLP 2026 (accepted) · 2026
TC-BiMamba: Trans-Chunk bidirectionally within BiMamba for unified streaming and non-streaming ASR
Qingshun She*, Jing Peng*, Yangui Fang, Yu Xi, Kai Yu
Findings of EMNLP 2026 (accepted) · 2026
A Unified and Reproducible Experimentation Framework for Speech Understanding
Jing Peng*, J. Du*, C. Wang*, H. Li*, Y. Yang*, Y. Wang, X. Gu, G. Chen, Y. Wang, J. Li, Z. Zhao, H. Wang, W. Tu, H. Li, D. Ma, L. Qian, Y. Xi, W. Wen, J. Guo, H. Zhang, S. Fan, W. Jiang, S. Wang, K. Yu
Interspeech 2026 (accepted, Oral) · 2026
RAS: a Reliability Oriented Metric for Automatic Speech Recognition
W. Huang, Y. Qiu, B. Li, Y. Guo, Jing Peng, H. Wang, X. Chen, K. Yu
Interspeech 2026 (accepted, Oral) · 2026
A Survey on Speech Large Language Models for Understanding
Jing Peng*, Yucheng Wang*, Bohan Li, Yiwei Guo, Hankun Wang, Yangui Fang, Yu Xi, Haoyu Li, Xu Li, Ke Zhang, Shuai Wang, Kai Yu
IEEE Journal of Selected Topics in Signal Processing · 2025
TASU: Text-Only Alignment for Speech Understanding
Jing Peng, Y. Yang, X. Li, Y. Xi, Q. Tang, Y. Fang, J. Li, K. Yu
ICASSP 2026 (accepted, Oral) · 2026
Low-Resource Domain Adaptation for Speech LLMs via Text-Only Fine-Tuning
Y. Fang*, Jing Peng*, X. Li, Y. Xi, C. Zhang, G. Zhong, K. Yu
ASRU 2025 (accepted) · 2025
MOSA: Mixtures of Simple Adapters Outperform Monolithic Approaches in LLM-based Multilingual ASR
Junjie Li, Jing Peng, Yangui Fang, Shuai Wang, Kai Yu
ICASSP 2026 (accepted, Poster) · 2026
dots.tts.edit: Precisely Controlled Speech Editing with a Continuous Autoregressive Model
Hankun Wang, Bohan Li, Shi Lian, Xiaoyu Gu, Jing Peng, Da Zheng, Yiwei Guo, Colin Zhang, Shuai Wang, Kai Yu
arXiv preprint · 2026

联系方式

我非常乐意就上述话题进行交流和合作，您可以通过以下方式联系我：