Transferring Object Layouts from Virtual to Physical Rooms: Towards Adapting a Virtual Scene to a Physical Scene for VR

One crucial problem in VR is to establish a good correspondence between the virtual and physical scenes, while respecting the key structure and layout of the two spaces. A VR scene may well allow a user to move towards a certain direction, but in reality, a wall could block his/her path. The reason is that the virtual scene is often designed by designers for a large user population, being unable to consider individual physical constraints. Recent works involve redirected walking or additional VR hardware. We propose an alternative solution by adapting the virtual scene to the physical scene. The goal is to preserve the layout of the original design while allowing the virtual scene to be fully walkable. To move towards that goal, this paper proposes an object layout transfer mechanism to transfer an object layout from a virtual room to a physical room. A VR application can automatically transfer a designer’s virtual scene to fit any household room. Our solution involves key object layout features extraction and a multi-stage algorithm to shuffle the objects in the physical space. A user study is conducted to demonstrate that the proposed model is able to synthesize transferred layouts that appear to be created by a human designer.