Yixiao Zhang


PhD Student in Artificial Intelligence and Music,
Centre for Digital Music (C4DM),
Queen Mary University of London
ENG 408
Phone: +44 0752 914 6850
E-mail: yixiao.zhang [@] qmul [DOT] ac [DOT] uk
Google Scholar | Linkedin | Zhihu
The Chinese version: homepage

About me

  • I am currently the 2nd-year PhD in AIM Program, Queen Mary University of London. I am honored to be advised by Prof. Simon Dixon and Dr. Mark Levy. My research is related to music and NLP, e.g. music story generation, cross-modal music retrieval and generation.

  • Before that, I was a Research Assistant in the Music X Lab at NYU Shanghai from 2019 to 2020, working on music generation.

  • I received the Bachelor of Engineering degree (2015-2019) in Computer Science and Technology from University of Electronic Science and Technology of China (UESTC).

Research Interests

My research interests include

  • Controllable Music Generation

  • Music Representation Learning

  • Music and Natural Language Processing (NLP)


  • 2020.9 - Current: PhD Student in Artificial Intelligence and Music, Queen Mary University of London (QMUL)

  • 2015.9 - 2019.6: Bachelor of Engineering in Computer Science and Technology, UESTC

Research Experience

  • 2020.9 - Current: PhD Student, Queen Mary University of London. Supervisor: Prof. Simon Dixon and Dr. Mark Levy

    • Topic: Machine Learning Methods for Artificial Musicality (in collaboration with Apple)

  • 2019.6 - 2020.9: Research Assistant, Music X Lab, NYU Shanghai. Supervisor: Dr. Gus Xia

    • Topic: Music Representation Learning, Music Generation

  • 2018.11 - 2019.6: Research Intern, Machine Learning Group, Microsoft Research Asia. Supervisor: Dr. Weiqing Liu and Dr. Xiao Yang

    • Topic: Meta Learning on Finaincial Data Prediction

  • 2018.7 - 2018.10: Undergraduate Research Assistant, University of Lethbridge, Canada. Supervisor: Prof. Yllias Chali

    • Topic: Deep Learning Methods on Text Summarization

  • 2016.9 - 2018.6: Undergraduate Research Assistant, Institute of Intelligent Learning Science and Applications, UESTC. Supervisor: Prof. Hong Qu

    • Topic: Natural Language Processing

Conference Publications


  • Yixiao Zhang and Simon Dixon, “Generating Comments from Music and Lyrics”, DMRN+16 Workshop (Poster).

  • Shiqi Wei, Gus Xia, Yixiao Zhang, Liwei Lin and Weiguo Gao, “Music Phrase inpainting using long-term representation and contrastive loss”, submitted to ICASSP 2022.

  • Nick Bryan-Kinns, Berker Banar, Corey Ford, Courtney N Reed, Yixiao Zhang, Simon Colton and Jack Armitage, “Exploring XAI for the Arts: Explaining Latent Space in Generative Music”, NeurIPS 2021 Workshop XAI4Debugging.

  • Yixiao Zhang, Gus Xia, Mark Levy and Simon Dixon, “COSMIC: A Conversational Interface for Human-AI Music Co-Creation”, NIME 2021. pdf


  • Yixiao Zhang, Ziyu Wang, Dingsu Wang and Gus Xia, “BUTTER: A Representation Learning Framework for Bi-directional Music-Sentence Retrieval and Generation”, NLP4MusA Workshop for ISMIR 2020. pdf

  • Ziyu Wang, Yiyi Zhang, Yixiao Zhang, Junyan Jiang, Ruihan Yang, Junbo Zhao(Jake) and Gus Xia, “PianoTree VAE: Structured Representation Learning for Polyphonic Music,” ISMIR 2020. pdf

  • Ziyu Wang, Dingsu Wang, Yixiao Zhang and Gus Xia, “Learning Interpretable Representation for Controllable Polyphonic Music Generation,” ISMIR 2020. pdf

  • Yixiao Zhang and Gus Xia, “Symbolic Melody Phrase Segmentation Using Neural Network with Conditional Random Field”, CSMT 2020. pdf

Book Chapters

  • 《音频音乐与计算机的交融:音频音乐技术(下)》(The intersection of audio, music and computers: audio & music technology (ii)). Contributed to the writing of Chapter 11.

Teaching Assistants

2021 Fall

  • ECS7020P Principles of Machine Learning

  • ECS759P Artificial Intelligence

2017 Fall

  • C & Cpp Programming

Community Activities

  • Volunteer, NIME 2021

  • Tech Volunteer, ISMIR 2021

  • Orgranizer, DMRN+16 Workshop

Blog Posts

Informal Literature review

“A glance at ISMIR” series

A litereature review of ISMIR papers in Chinese.