Virtual cameras and physical stages

Project overview

A collaboration led by the Norwich University of the Arts, is developing a prototype 360-degree virtual camera which will be used in an experimental real-time broadcast scenario working in conjunction with the virtual production studio.

The adaptive virtual camera will provide a method by which an unusual LED volume would be run as a direct final output from unreal engine in real time, with the geometry of the physical LED structure catered for by the virtual camera.

In most immersive experiences and live contexts, the use of a media server is the only way to manage significant curvature or 90-degree corners. Sony has created a toolset on the new Venice digital cinema motion picture camera system that progresses options for corner volumes. However, in the immersive world, curves, cylinders and increasingly experimental volumes present challenges for technicians and filmmakers working with the technology.

The University’s Production Technical Services team are collaborating with colleagues in the Institute for Creative Technologies and industry partners at Sony to develop a prototype to enable real-time navigation with direct end display on complex volumes. The collaboration will also explore the creative potential of blending virtual and physical displays in immersive filmmaking, using the prototype to produce a short immersive test film with the University’s Virtual Production Studio.

As an existing partner to the technician team at Norwich, Sony will bring expertise in technology, innovation and cinema alongside training, support and the loan of resources to the research and development project.

The project is based at the University’s Havers Road site, which hosts the Immersive Visualisation and Simulation Lab and Virtual Production Studio. ‘Virtual cameras and physical stages’ is one of eight university-led collaborations awarded up to £25,000 of R&D funding from the XR Network+ XR Labs Fund to develop extended reality prototypes using facilities at UK universities.