SpinVR: Towards Live VR Video | SIGGRAPH Asia 2017

Robert Konrad*, Donald G. Dansereau*, Aniq Masood, Gordon Wetzstein

A computational camera system that directly captures streaming 3D virtual reality content natively in the omni-directional stereo (ODS) format.

SpinVR: Towards Live VR Video

ABSTRACT

Streaming of 360° content is gaining attention as an immersive way to remotely experience live events. However live capture is presently limited to 2D content due to the prohibitive computational cost associated with multi-camera rigs. In this work we present a system that directly captures streaming 3D virtual reality content. Our approach does not suffer from spatial or temporal seams and natively handles phenomena that are challenging for existing systems, including refraction, reflection, transparency and speculars. Vortex natively captures in the omni-directional stereo (ODS) format, which is widely supported by VR displays and streaming pipelines. We identify an important source of distortion inherent to the ODS format, and demonstrate a simple means of correcting it. We include a detailed analysis of the design space, including tradeoffs between noise, frame rate, resolution, and hardware complexity. Processing is minimal, enabling live transmission of immersive 3D 360° content. We construct a prototype and demonstrate capture of 360° scenes at up to 8192 × 4096 pixels at 5 fps, and establish the viability of operation up to 32 fps.

FILES

 

CITATION

R. Konrad, D. G. Dansereau, A. Masood, G. Wetzstein. “SpinVR: Towards Live-Streaming 3D Virtual Reality Video”, ACM SIGGRAPH Asia (Transactions on Graphics 36, 6), 2017.

BibTeX

@article{Konrad:2017:SpinVR,
author = {R. Konrad, D. G. Dansereau, A. Masood, G. Wetzstein},
title = {{SpinVR: Towards Live-Streaming 3D Virtual Reality Video}},
journal = {ACM Trans. Graph. (SIGGRAPH Asia)},
issue = {36},
number = {6},
year = {2017},
}