MIT develops new Music Mixing AI

MIT (Massachusetts Institute of Technology) is a name that usually conjures up images of super tech breakthroughs by incredibly gifted geeks. Well, they are at it again and this time it looks like they are about to revolutionize the music sound mixing industry forever. They have announced a new AI (Artificial Intelligence) computer program that has the capability to isolate individual instruments within a piece of music.  It also allows the user of the technology to adjust the individual elements, remove them, or remix them in any way.

The system they have developed they refer to as their ‘PixelPlayer’ system. “Trained on over 60 hours of videos, the ‘PixelPlayer’ system can view a never-before-seen musical performance, identify specific instruments at pixel level, and extract the sounds that are associated with those instruments,” states MIT.

There is little doubt that this new technology is going to revolutionize audio editing. Music educators will be able to play a video in their class and the ‘PixelPlayer’ system will help students identify individual instruments in the piece as well as individual notes the instrument is producing.

We at GigMonster can see that Pixel Player is going to benefit the digital audio editing world for decades to come. It allows the creative music artists to insert and test new sounds in songs from multiple instruments with the click of a mouse.

Hang Zhao, the lead author for the project at MIT, envisioned a best-case scenario in which the researchers could recognize which instruments make which sounds.  “We were surprised that we could actually spatially locate the instruments at the pixel level,” states Zhao. “Being able to do that opens up a lot of possibilities, like being able to edit the audio of individual instruments by a single click on the video.”

We at GigMonster are looking forward to seeing the real-world applications that will come from this technology.

Are you a digital audio mixer? GigMonster wants to hear what you think about Pixel Player. What other applications can you think of for this technology? Let us know, we want to hear from our highly creative friends here.

 

You might also like

---

More from blog

---