Fraunhofer IIS
Booth number: A53-B
www.iis.fraunhofer.de
About us
The Fraunhofer-Gesellschaft, headquartered in Germany, is the world’s leading applied research organization. Its research activities are conducted by 75 institutes and research units at locations throughout Germany. The Fraunhofer-Gesellschaft employs a staff of 29,000, who work with an annual research budget totaling more than 2.8 billion euros. The Fraunhofer Institute for Integrated Circuits IIS, headquartered in Erlangen, Germany, conducts world-class research on microelectronic and IT system solutions and services. Today, it is the largest institute of the Fraunhofer-Gesellschaft. For over 30 years, the institute’s Audio and Media Technologies division has been shaping the globally deployed standards and technologies in the fields of audio and moving picture production. Starting with the creation of mp3 and continuing with the co-development of AAC and the Digital Cinema Initiative test plan, almost all consumer electronic devices, computers and mobile phones are equipped with systems and technologies from Erlangen today. Meanwhile, a new generation of best-in-class media technologies – such as MPEG-H Audio, xHE-AAC, EVS, LC3/LC3plus, Symphoria, Sonamic and upHear – is elevating the user experience to new heights. Detailed information on: www.iis.fraunhofer.de/en
Address
Am Wolfsmantel 33
D-91058 Erlangen
Germany
E-mail: info@iis.fraunhofer.de
Phone: +49 9131 7760
Internet: www.iis.fraunhofer.de
Contact person:
Dr. Joachim Keinert
E-mail: joachim.keinert@iis.fraunhofer.de
Products & Services
Fraunhofer IIS combines digital signal processing with artificial intelligence in a center for research, consulting and licensing and for creating special customized solutions. Enhancing 3D reconstructions with machine learning to revolutionize film production and virtual experiences with efficient 3D data transmission.
ToHyVe - Photorealistic presentation
The neural 3D reconstruction and rendering pipeline developed at Fraunhofer IIS can be used to digitize complex objects, including their viewing angle-dependent effects. The model can then be rendered in real time in a game engine or a web browser.
Social Stage VR - Bringing stage events with real actors to your home in VR
We demonstrate a novel method how to integrate stereo content of a live act into a virtual reality (VR) environment. This opens a new level of immersion, when watching the recording of a stage event using a head mounted display. In contrast to existing solutions, we offer proper depth perception, allow for a low complexity recording and distribution and still avoid any motion sickness caused by objects being close to the observer. To this end, we separate the digitization of the event location from the recording of the actor’s performance. As a main contribution of the paper, we show how to achieve high visual quality when compositing the stereo recording showing the actors with the reconstructed 3D-model of the event location. To do so, we have created a tool that allows to simulate the 3D perception of the stereo video depending on the selected stereo parameters such as inter-camera distance and focal length. By these means, we can ensure a smooth transition between the stereo video and the 3D model of the event location, leading to superior visual quality.
