MIXING MULTICHANNEL MUSIC WITH DEARVR SPATIAL CONNECT

Spatial audio expert and FOH sound engineer Michael Ochs talks about his experience mixing "Berlin Walls" in VR using dearVR SPATIAL CONNECT and dearVR PRO. He shares insights about his workflow as well as positioning and automating sound objects.

MICHAEL, CAN YOU GIVE US SOME GENERAL FACTS ABOUT THE PROJECT?

“Yes – of course. Last year, I mixed the song “Berlin Walls” of the band Monotronix. Monotronix is a live and studio act founded by drummer Hendrik Lensing and producer/keyboarder Julian David. Electronic beats and hooks collide with live drums and visuals, exploding on stage as a collective music experience. For the mix I used the original stem mixes provided by the producer Julian David and processed them using the dearVR PRO VST plugin which was controlled by dearVR SPATIAL CONNECT.” 

WHICH APPROACH DID YOU FOLLOW MIXING THIS SONG?

“My creative approach for this mix was to use only natural rooms within dearVR PRO to give an impression of the engine’s capabilities and rather avoid traditional reverb FXs. 
I applied the following rooms to the stems: Warehouse, Kings Hall, Cathedral, Staircase, Car 1&2, Cellar, Small Living Room, Outdoor Street, Large Recording Hall.”

CAN YOU GIVE US SOME INSIGHTS ABOUT YOUR POST-PRODUCTION PROCESS IN THE PAST?

“The post-production in the 3D world has always been shadowed by the circumstances of fiddling around with 2D user interfaces for 3D. These approaches never really felt 100% intuitive to me. Especially positioning the virtual sound sources, writing and correcting the automation data was still an unnerving and time-consuming process.”

HOW DOES DEARVR SPATIAL CONNECT HELP YOU IN YOUR DAILY WORK?

“Utilizing the new dearVR SPATIAL CONNECT I am now able to mix physically in a real 3D soundfield. Being visually guided in VR via an HMD (Head Mounted Display) is so much more intuitive, and especially multiple times faster than working traditionally with a mouse in a DAW environment with a 2D screen and equirectangular video. Spatial Connect is the next step moving forward in the 3D post production towards a more intuitive production workflow.”

CAN YOU SHARE SOME INSIGHTS ABOUT THE POSITIONING OF THE INSTRUMENTS AND THE SINGER?

“I gave the recorded acoustic drums, the lows and kicks a static position due to time and low-end pressure reasons. In addition, I wanted to have an acoustical fixing point to have a stable orientation. The lead vocal was also rather static to emphasize its monologue/prayer-like attitude. I followed this approach till the end when he leaves the cellar. Everything else is animated and moving.”

WHAT ABOUT AUTOMATION DATA?

“All automation data was written using dearVR SPATIAL CONNECT with one exception: For the monologue of the lead vocals at the end of the track I used some additional envelopes that haven’t been implemented in the Beta yet.”

DID YOU USE ANY ADDITIONAL SOFTWARE?

“Last year I worked on this mix using dearVR PRO’s TOA (Third Order Ambisonics) mode and decoded the signal via Blue Ripple Rapture 3D Advanced tool to the 3D cave and to the audiosuite 7.1 loudspeaker setup. 
Doing this project again, I’d stay in dearVR PRO and select the multi-channel output mode which is currently in Beta. Using this new feature, you won’t lose spatial information when converting Ambisonics to multi-channel.”

HOW WOULD YOU EVALUATE THE WORKFLOW?

“In general, mixing “Berlin Walls” was easy due to the quality of the stems. 
Creative elements like slap-back-delays and delay-FXs have already been rendered into the stems by Julian. There was no need for any further dynamic or EQ editing.  This comes close to my general approach working with immersive audio and spatializing audio content. 
Be it in real-time or in post-production: All standard sound editing and mixing should be done in an earlier stage in the signal chain before 3D rendering takes place. So you can concentrate on building the 3D impression of the soundscape.  
It is also important to mention that I never had any audible artifacts, no matter how fast any of the content was animated in its position.”
Summing things up, I can strongly recommend dearVR PRO and the combination of the plugin with dearVR SPATIAL CONNECT to 3D audio related sound engineers. The combination really opened a new world of how to work and interfere with the spatial audio world.”

CAN YOU TELL US MORE ABOUT THE TIME REQUIRED TO FINALIZE A 3D PRODUCTION?

“It is really a single operator system. Compared to standard linear post production, standard timings and needed staff is comparable to 2D post production. As soon as all tracks are done, you just need an additional time slot for spatialization and automation. Any important parameter you need can be easily accessed via Spatial Connect.

WHAT BENEFITS DO YOU PERSONALLY EXPERIENCE WORKING WITH SPATIAL CONNECT?

“For me it is a fast and intuitive controller to optimize especially TOA based soundscapes that are rendered with dearVR PRO. Combining architectural pre-renderings of event locations as an video overlay for dearVR SPATIAL CONNECT, the pre-production for installations and events becomes more and more realistic and as close as possible to the actual real installation as one can get. This enables me and the final client to experience how the overall installation will look and sound like.
Furthermore, the standard 360° video post-production workflow will benefit. Mixing for 360° video content will now move on from just guessing by looking at room angle overlays on a 2D equirectangular video within Reaper or Nuendo, to actually seeing the video material in 3D VR and being able to position the sound sources as intuitive and precisely as one can think of."

Julian David

Monotronix

Song: Berlin Wall

Artist: Monotronix feat. Andy Smart

Songwriter: Andy Smart, Hendrik Lensing, Julian David

Michael Ochs
Michael joined the Dear Reality team in September 2020. He strives to increase the value of all products with his expertise in 3D audio for immersive real-time applications and installations, 3D audio for VR/AR, generative and interactive audio, and the therefore needed technical and acoustical system planning. Before working at Dear Reality, Michi worked as a FOH and system tech for large scale R&R productions and lectures electroacoustics and sound reinforcement systems at the University of Applied Sciences Düsseldorf.

Also in Overview

Why Spatial Audio Production is Inescapable in 2024
Why Spatial Audio Production is Inescapable in 2024

In recent years, the way we perceive audio has undergone a dramatic transformation. Immersive and Spatial Audio are no longer just buzzwords; they have become essential technologies elevating our auditory experiences to new heights. Production tools such as those offered by Dear Reality, including dearVR PRO 2, dearVR MONITOR, and dearVR SPATIAL CONNECT, have firmly established themselves in the daily workflow of audio producers. This blog article explores why, in 2024, creators cannot avoid embracing these audiovisual innovations.

Read More

dearVR PRO 2: The Perfect Choice for Crafting Immersive Reverbs in Spatial Audio Production
dearVR PRO 2: The Perfect Choice for Crafting Immersive Reverbs in Spatial Audio Production

As of 2024, spatial audio formats dominate the field of professional audio production, a trend that shows no signs of waning. Not only will Apple's Vision Pro accelerate its proliferation, but developments like AMBEO 2-Channel Spatial Audio show that spatial audio formats can seamlessly establish themselves as standard formats in AAA media production and that spatial audio is finding its way into "usually" stereo contexts.

Read More

dearVR PRO 2: Elevating Your Audio Mixing to New Heights
dearVR PRO 2: Elevating Your Audio Mixing to New Heights

If you're serious about audio mixing and ready to explore the realms of spatial audio, look no further than dearVR PRO 2. This cutting-edge plugin from Dear Reality represents the pinnacle of evolution in audio mixing technology, designed to take your audio productions to unprecedented levels of depth and realism. 

Read More