Transferring Object Layouts from Virtual to Physical Rooms: Towards Adapting a Virtual Scene to a Physical Scene for VR

Ping Tat Sin, Hiu Fung Ng, Chi Keung Simon Shiu, Fu Lai Korris Chung, Hong Va Leong

Research output: Chapter in book / Conference proceedingConference article published in proceeding or bookAcademic researchpeer-review


One crucial problem in VR is to establish a good correspondence between the virtual and physical scenes, while respecting the key structure and layout of the two spaces. A VR scene may well allow a user to move towards a certain direction, but in reality, a wall could block his/her path. The reason is that the virtual scene is often designed by designers for a large user population, being unable to consider individual physical constraints. Recent works involve redirected walking or additional VR hardware. We propose an alternative solution by adapting the virtual scene to the physical scene. The goal is to preserve the layout of the original design while allowing the virtual scene to be fully walkable. To move towards that goal, this paper proposes an object layout transfer mechanism to transfer an object layout from a virtual room to a physical room. A VR application can automatically transfer a designer’s virtual scene to fit any household room. Our solution involves key object layout features extraction and a multi-stage algorithm to shuffle the objects in the physical space. A user study is conducted to demonstrate that the proposed model is able to synthesize transferred layouts that appear to be created by a human designer.

Original languageEnglish
Title of host publicationAdvances in Computer Graphics - 36th Computer Graphics International Conference, CGI 2019, Proceedings
EditorsMarina Gavrilova, Jian Chang, Nadia Magnenat Thalmann, Eckhard Hitzer, Hiroshi Ishikawa
Number of pages13
ISBN (Print)9783030225131
Publication statusPublished - 1 Jan 2019
Event36th Computer Graphics International Conference, CGI 2019 - Calgary, Canada
Duration: 17 Jun 201920 Jun 2019

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11542 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Conference36th Computer Graphics International Conference, CGI 2019


  • Layout discrepancy measure
  • Object layout transfer
  • Space adaptation

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science


Dive into the research topics of 'Transferring Object Layouts from Virtual to Physical Rooms: Towards Adapting a Virtual Scene to a Physical Scene for VR'. Together they form a unique fingerprint.

Cite this