Renjie Zheng

pic

Biography

I am a Research Scientist at TikTok.

I received my Ph.D. in the Electrical Engineering & Computer Science Department at Oregon State University working with Professor Liang Huang in ACL Group.

I received my Bachelor and Master degree from Tongji University, Shanghai.

I have worked with Professor Rao and Professor Liu during my master degree.

I have also worked with Professor Qiu in Fudan NLP Group as a visiting student.

Publications

Xiaoran Fan, Chao Pang, Tian Yuan, He Bai, Renjie Zheng, Pengfei Zhu, Shuohuan Wang, Junkun Chen, Zeyu Chen, Liang Huang, Yu Sun, Hua Wu. ERNIE-SAT: Speech and Text Joint Pretraining for Cross-Lingual Multi-Speaker Text-to-Speech 2022. arXiv

He Bai*, Renjie Zheng*, Junkun Chen, Xintong Li, Mingbo Ma, Liang Huang. A3T: Alignment-Aware Acoustic and Text Pretraining for Speech Synthesis and Editing. ICML 2022. arXiv

Hui Zhang, Tian Yuan, Junkun Chen, Xintong Li, Renjie Zheng, Yuxin Huang, Xiaojie Chen, Enlei Gong, Zeyu Chen, Xiaoguang Hu, Dianhai Yu, Yanjun Ma, Liang Huang. PaddleSpeech: An Easy-to-Use All-in-One Speech Toolkit. NAACL Demo Track Best Demo Paper 2022.

Junkun Chen*, Renjie Zheng*, Atsuhito Kita, Mingbo Ma, Liang Huang. Improving Simultaneous Translation with Pseudo References. EMNLP 2021. arXiv

Junkun Chen*, Mingbo Ma*, Renjie Zheng, Liang Huang. Direct Simultaneous Speech-to-Text Translation Assisted by Synchronized Streaming ASR. EMNLP Findings 2021. arXiv

Jiahong Yuan, Xingyu Cai, Dongji Gao, Renjie Zheng, Liang Huang, Kenneth Church. DECOUPLING RECOGNITION AND TRANSCRIPTION IN MANDARIN ASR. ASRU 2021. arXiv

Renjie Zheng*, Junkun Chen*, Mingbo Ma, Liang Huang. Fused Acoustic and Text Encoding for Multimodal Bilingual Pretraining and Speech Translation. ICML, 2021. (* equal contribution) arXiv

Junkun Chen*, Mingbo Ma*, Renjie Zheng, Liang Huang. SpecRec: An Alternative Solution for Improving End-to-End Speech-to-Text Translation via Spectrogram Reconstruction. Interspeech 2021. arXiv

Xingyu Cai, Jiahong Yuan, Renjie Zheng, Liang Huang, Kenneth Church. Speech emotion recognition with multi-task learning. Interspeech 2021. arXiv

Renjie Zheng*, Mingbo Ma*, Baigong Zheng, Kaibo Liu, Jiahong Yuan, Kenneth Church, Liang Huang. Fluent and Low-latency Simultaneous Speech-to-Speech Translation with Self-adaptive Training. EMNLP Findings, 2020. arXiv

Mingbo Ma*, Baigong Zheng*, Kaibo Liu, Renjie Zheng, Hairong Liu, Kainan Peng, Kenneth Church, Liang Huang. Incremental text-to-speech synthesis with prefix-to-prefix framework. EMNLP Findings, 2020, arXiv

Renjie Zheng*, Mingbo Ma*, Baigong Zheng, Kaibo Liu, Liang Huang. Opportunistic Decoding with Timely Correction for Simultaneous Translation. ACL, 2020. arXiv

Baigong Zheng, Kaibo Liu, Renjie Zheng, Mingbo Ma, Hairong Liu, Liang Huang. Simultaneous translation policies: from fixed to adaptive. ACL, 2020, arXiv

Renjie Zheng*, Mingbo Ma*, Baigong Zheng, Liang Huang. Speculative Beam Search for Simultaneous Translation. EMNLP, November 2019. arXiv (* equal contribution)

Baigong Zheng*, Renjie Zheng*, Mingbo Ma, Liang Huang. Simpler and Faster Learning of Adaptive Policies for Simultaneous Translation. EMNLP, November 2019. arXiv (* equal contribution)

Renjie Zheng*, Hairong Liu*, Mingbo Ma, Baigong Zheng, Liang Huang. Robust Machine Translation with Domain Sensitive Pseudo-Sources: Baidu-OSU WMT19 MT Robustness Shared Task System Report. WMT, August 2019. arXiv (* equal contribution)

Baigong Zheng*, Renjie Zheng*, Mingbo Ma, Liang Huang. Simultaneous Translation with Flexible Policy via Restricted Imitation Learning. ACL, July 2019. arXiv (* equal contribution)

Mingbo Ma*, Liang Huang*, Hao Xiong, Renjie Zheng, Kaibo Liu, Baigong Zheng, Chuanqiang Zhang, Zhongjun He, Hairong Liu, Xing Li, Hua Wu and Haifeng Wang. STACL: Simultaneous Translation with Implicit Anticipation and Controllable Latency. ACL, July 2019. arXiv (* equal contribution)

Mingbo Ma*, Renjie Zheng*, Liang Huang. Learning to Stop in Structured Prediction for Neural Machine Translation. NAACL, June 2019. arXiv (* equal contribution)

Renjie Zheng, Mingbo Ma, Liang Huang. Multi-Reference Training with Pseudo-References for Neural Translation and Text Generation. EMNLP, October 2018. arXiv code slides

Renjie Zheng*, Yilin Yang*, Mingbo Ma, Liang Huang. Ensemble Sequence Level Training for Multimodal MT: OSU-Baidu WMT18 Multimodal Machine Translation System Report. WMT, October 2018. arXiv (* equal contribution)

Renjie Zheng, Junkun Chen, Xipeng Qiu. Same Representation, Different Attentions: Shareable Sentence Representation Learning from Multiple Tasks. IJCAI, July 2018. arXiv

Renjie Zheng, Qin Liu, Mingxuan Yuan, Jia Zeng, Weixiong Rao. Topic Model-Based Road Network Inference from Massive Trajectories. 18th IEEE International Conference on Mobile Data Management (MDM), May 2017, Best Paper Award. PDF

Renjie Zheng, Qin Liu, Hanjun Mao, Hongming Zhu, Weixiong Rao. Trajbase: Searching Trajectories in Multi-region. ACM SIGSPATIAL International Workshop on Smart Cities and Urban Analytics (UrbanGIS) October 2016. PDF