Yixiao Zhang


PhD Student in Artificial Intelligence and Music,
Centre for Digital Music (C4DM),
Queen Mary University of London
ENG 408
Phone: +44 0752 914 6850
E-mail: yixiao.zhang [@] qmul [DOT] ac [DOT] uk
Google Scholar | Linkedin | Zhihu
The Chinese version: homepage


  • I will visit MBZUAI in August 2022 as a visiting student.

About me

  • I am currently the 2nd-year PhD in AIM Program, Queen Mary University of London. I am honored to be advised by Prof. Simon Dixon and Dr. Mark Levy. My research is related to music and NLP, e.g. music story generation, cross-modal music retrieval and generation.

  • Before that, I was a Research Assistant in the Music X Lab at NYU Shanghai from 2019 to 2020, working on music generation.

  • I received the Bachelor of Engineering degree (2015-2019) in Computer Science and Technology from University of Electronic Science and Technology of China (UESTC).

Research Interests

My research interests include controllable music generation, music representation learning, and natural language processing.


  • 2020.9 - Current: PhD Student in Artificial Intelligence and Music, Queen Mary University of London (QMUL), UK

  • 2015.9 - 2019.6: Bachelor of Engineering in Computer Science and Technology, UESTC, China

Research Experience

  • 2020.9 - Current: PhD Student, Queen Mary University of London. Supervisor: Prof. Simon Dixon and Dr. Mark Levy

    • Topic: Machine Learning Methods for Artificial Musicality (in collaboration with Apple)

  • 2019.6 - 2020.9: Research Assistant, Music X Lab, NYU Shanghai. Supervisor: Dr. Gus Xia

    • Topic: Music Representation Learning, Music Generation

  • 2018.11 - 2019.6: Research Intern, Machine Learning Group, Microsoft Research Asia. Supervisor: Dr. Weiqing Liu and Dr. Xiao Yang

    • Topic: Meta Learning on Finaincial Data Prediction

  • 2018.7 - 2018.10: Undergraduate Research Assistant, University of Lethbridge, Canada. Supervisor: Prof. Yllias Chali

    • Topic: Deep Learning Methods on Text Summarization

  • 2016.9 - 2018.6: Undergraduate Research Assistant, Institute of Intelligent Learning Science and Applications, UESTC. Supervisor: Prof. Hong Qu

    • Topic: Natural Language Processing

Conference Publications


  • Yixiao Zhang, Junyan Jiang, Gus Xia and Simon Dixon, “Interpreting Song Lyrics with an Audio-Informed Pre-trained Language Model”, ISMIR 2022, to appear

  • Junyan Jiang, Daniel Chin, Yixiao Zhang and Gus Xia, “Learning Hierarchical Metrical Structure Beyond Measures”, ISMIR 2022, to appear

  • Shiqi Wei, Gus Xia, Yixiao Zhang, Liwei Lin and Weiguo Gao, “Music Phrase inpainting using long-term representation and contrastive loss”, ICASSP 2022. paper


  • Yixiao Zhang and Simon Dixon, “Generating Comments from Music and Lyrics”, DMRN+16 Workshop (Poster).

  • Nick Bryan-Kinns, Berker Banar, Corey Ford, Courtney N Reed, Yixiao Zhang, Simon Colton and Jack Armitage, “Exploring XAI for the Arts: Explaining Latent Space in Generative Music”, NeurIPS 2021 Workshop XAI4Debugging. paper

  • Yixiao Zhang, Gus Xia, Mark Levy and Simon Dixon, “COSMIC: A Conversational Interface for Human-AI Music Co-Creation”, NIME 2021. paper


  • Yixiao Zhang, Ziyu Wang, Dingsu Wang and Gus Xia, “BUTTER: A Representation Learning Framework for Bi-directional Music-Sentence Retrieval and Generation”, NLP4MusA Workshop for ISMIR 2020. paper

  • Ziyu Wang, Yiyi Zhang, Yixiao Zhang, Junyan Jiang, Ruihan Yang, Junbo Zhao(Jake) and Gus Xia, “PianoTree VAE: Structured Representation Learning for Polyphonic Music,” ISMIR 2020. paper

  • Ziyu Wang, Dingsu Wang, Yixiao Zhang and Gus Xia, “Learning Interpretable Representation for Controllable Polyphonic Music Generation,” ISMIR 2020. paper

  • Yixiao Zhang and Gus Xia, “Symbolic Melody Phrase Segmentation Using Neural Network with Conditional Random Field”, CSMT 2020. paper

Book Chapters

  • 《音频音乐与计算机的交融:音频音乐技术(下)》(The intersection of audio, music and computers: audio & music technology (ii), ISBN: 978-7-309-15990-5/J.466). Contributed to the writing of Chapter 11.

Teaching Assistants

2022 Spring

  • ECS759P Artificial Intelligence

2021 Fall

  • ECS7020P Principles of Machine Learning

  • ECS759P Artificial Intelligence

2017 Fall

  • C & Cpp Programming

Community Activities


  • Volunteer, AI Song COntest 2022

  • Volunteer, NIME 2021

  • Tech Volunteer, ISMIR 2021


  • Organizer, DMRN+16 Workshop

GitHub Projects

Simplified JukeMIR link

  • This project is a simplified version of the JukeMIR project, with minimal code for extracting music representations, and can be easily embedded into projects.

  • I have also fixed some bugs in the original project.

Blog Posts

  • Representation Learning for Controllable Music Generation: A Survey, 2020 link

  • “A glance at ISMIR” series 2021 / 2020