Agentic Music Post-Production

*Work done while an intern at Sony

Overview of MixAgent

MixAgent pipeline. (a) A grouping agent routes input tracks into groups such as drums, guitars and vocals. (b) A tool planning agent uses track captions, the style reference and retrieved examples to build audio effect plans at the track, subgroup and full-mix levels. (c) Parameters are initialized, then at each stage a learned detector flags what to fix and a learned critic proposes how to fix it, producing the final mix with an editable plan and log.
(a) A grouping agent routes input tracks into groups. (b) A tool planning agent builds effect plans at the track, subgroup, and full-mix levels. (c) At each level, a learned detector flags what to fix and a learned critic proposes the new parameter values.

Walkthrough of one mix

A jazz clip with 15 input tracks, followed through all three levels. Qwen plan only keeps Qwen's initial settings at every level, and its subgroup and full-mix examples use the uncorrected track outputs. MixAgent applies corrections at each level.

Click a level in the diagram, or use the tabs below, to hear that level.

Listen to the examples

Citation

@article{koo2026agentic,
  title   = {Agentic Music Post-Production},
  author  = {Koo, Jaywon and Koo, Junghyun and Mart{\'\i}nez-Ram{\'\i}rez, Marco A. and Liao, Wei-Hsiang and Doh, Seungheon and Wu, Qiyu and Ordonez, Vicente and Mitsufuji, Yuki},
  journal = {arXiv preprint arXiv:2610.29093},
  year    = {2026}
}