Yixiao Zhang

profile 

PhD Student in Artificial Intelligence and Music,
Centre for Digital Music (C4DM),
Queen Mary University of London
ENG 408
Phone: +44 0752 914 6850
E-mail: yixiao.zhang [@] qmul [DOT] ac [DOT] uk
Google Scholar | Linkedin | Zhihu
The Chinese version: homepage

News

  • I will visit MBZUAI in August 2022 as a visiting student.

About me

  • I am currently the 2nd-year PhD in AIM Program, Queen Mary University of London. I am honored to be advised by Prof. Simon Dixon and Dr. Mark Levy. My research is related to music and NLP, e.g. music story generation, cross-modal music retrieval and generation.

  • Before that, I was a Research Assistant in the Music X Lab at NYU Shanghai from 2019 to 2020, working on music generation.

  • I received the Bachelor of Engineering degree (2015-2019) in Computer Science and Technology from University of Electronic Science and Technology of China (UESTC).

Research Interests

My research interests include controllable music generation, music representation learning, and natural language processing.

Education

  • 2020.9 - Current: PhD Student in Artificial Intelligence and Music, Queen Mary University of London (QMUL), UK

  • 2015.9 - 2019.6: Bachelor of Engineering in Computer Science and Technology, UESTC, China

Research Experience

  • 2020.9 - Current: PhD Student, Queen Mary University of London. Supervisor: Prof. Simon Dixon and Dr. Mark Levy

    • Topic: Machine Learning Methods for Artificial Musicality (in collaboration with Apple)

  • 2019.6 - 2020.9: Research Assistant, Music X Lab, NYU Shanghai. Supervisor: Dr. Gus Xia

    • Topic: Music Representation Learning, Music Generation

  • 2018.11 - 2019.6: Research Intern, Machine Learning Group, Microsoft Research Asia. Supervisor: Dr. Weiqing Liu and Dr. Xiao Yang

    • Topic: Meta Learning on Finaincial Data Prediction

  • 2018.7 - 2018.10: Undergraduate Research Assistant, University of Lethbridge, Canada. Supervisor: Prof. Yllias Chali

    • Topic: Deep Learning Methods on Text Summarization

  • 2016.9 - 2018.6: Undergraduate Research Assistant, Institute of Intelligent Learning Science and Applications, UESTC. Supervisor: Prof. Hong Qu

    • Topic: Natural Language Processing

Conference Publications

2022

  • Yixiao Zhang, Junyan Jiang, Gus Xia and Simon Dixon, “Interpreting Song Lyrics with an Audio-Informed Pre-trained Language Model”, ISMIR 2022, to appear

  • Junyan Jiang, Daniel Chin, Yixiao Zhang and Gus Xia, “Learning Hierarchical Metrical Structure Beyond Measures”, ISMIR 2022, to appear

  • Shiqi Wei, Gus Xia, Yixiao Zhang, Liwei Lin and Weiguo Gao, “Music Phrase inpainting using long-term representation and contrastive loss”, ICASSP 2022. paper

2021

  • Yixiao Zhang and Simon Dixon, “Generating Comments from Music and Lyrics”, DMRN+16 Workshop (Poster).

  • Nick Bryan-Kinns, Berker Banar, Corey Ford, Courtney N Reed, Yixiao Zhang, Simon Colton and Jack Armitage, “Exploring XAI for the Arts: Explaining Latent Space in Generative Music”, NeurIPS 2021 Workshop XAI4Debugging. paper

  • Yixiao Zhang, Gus Xia, Mark Levy and Simon Dixon, “COSMIC: A Conversational Interface for Human-AI Music Co-Creation”, NIME 2021. paper

2020

  • Yixiao Zhang, Ziyu Wang, Dingsu Wang and Gus Xia, “BUTTER: A Representation Learning Framework for Bi-directional Music-Sentence Retrieval and Generation”, NLP4MusA Workshop for ISMIR 2020. paper

  • Ziyu Wang, Yiyi Zhang, Yixiao Zhang, Junyan Jiang, Ruihan Yang, Junbo Zhao(Jake) and Gus Xia, “PianoTree VAE: Structured Representation Learning for Polyphonic Music,” ISMIR 2020. paper

  • Ziyu Wang, Dingsu Wang, Yixiao Zhang and Gus Xia, “Learning Interpretable Representation for Controllable Polyphonic Music Generation,” ISMIR 2020. paper

  • Yixiao Zhang and Gus Xia, “Symbolic Melody Phrase Segmentation Using Neural Network with Conditional Random Field”, CSMT 2020. paper

Book Chapters

  • 《音频音乐与计算机的交融:音频音乐技术(下)》(The intersection of audio, music and computers: audio & music technology (ii), ISBN: 978-7-309-15990-5/J.466). Contributed to the writing of Chapter 11.

Teaching Assistants

2022 Spring

  • ECS759P Artificial Intelligence

2021 Fall

  • ECS7020P Principles of Machine Learning

  • ECS759P Artificial Intelligence

2017 Fall

  • C & Cpp Programming

Community Activities

Volunteer

  • Volunteer, AI Song COntest 2022

  • Volunteer, NIME 2021

  • Tech Volunteer, ISMIR 2021

Committee

  • Organizer, DMRN+16 Workshop

GitHub Projects

Simplified JukeMIR link

  • This project is a simplified version of the JukeMIR project, with minimal code for extracting music representations, and can be easily embedded into projects.

  • I have also fixed some bugs in the original project.

Blog Posts

  • Representation Learning for Controllable Music Generation: A Survey, 2020 link

  • “A glance at ISMIR” series 2021 / 2020