Gaze-Contingent Rendering in Virtual Reality

Fang Zhu, Ping Lu, Ping Li, Bin Sheng, Lijuan Mao

Research output: Chapter in book / Conference proceedingConference article published in proceeding or bookAcademic researchpeer-review

Abstract

Virtual reality (VR) is a technology that relies on a computer graphics system and other external display and control interfaces, to create an immersive experience by generating an interactive three-dimensional environment on a computer. Currently, however, most virtual reality scenes are far behind the real world in naturalism. One of the limitations is the insufficient graphics computing performance of the computer. It is difficult for mainstream consumer GPUs to meet the requirements of high picture quality and high fluency at the same time when running VR scenes, resulting in a reduction in the game’s visual experience and even human discomfort. In order to balance the quality and fluency of the picture, the areas within and outside the focus range of the user’s sight can be rendered hierarchically, so as to efficiently use computing resources. In order to achieve this goal, the following article proposes a model that combines the saliency information of the virtual scene and the head motion information to predict the focus of the field of view in real time. The model can assign different rendering priorities to objects in the field of view according to the prediction results, and give different priorities, use different rendering algorithms to provide a flexible VR scene rendering optimization solution.

Original languageEnglish
Title of host publicationAdvances in Computer Graphics - 37th Computer Graphics International Conference, CGI 2020, Proceedings
EditorsNadia Magnenat-Thalmann, Constantine Stephanidis, George Papagiannakis, Enhua Wu, Daniel Thalmann, Bin Sheng, Jinman Kim, Marina Gavrilova
PublisherSpringer Science and Business Media Deutschland GmbH
Pages16-23
Number of pages8
ISBN (Print)9783030618636
DOIs
Publication statusPublished - 2020
Event37th Computer Graphics International Conference, CGI 2020 - Geneva, Switzerland
Duration: 20 Oct 202023 Oct 2020

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12221 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference37th Computer Graphics International Conference, CGI 2020
Country/TerritorySwitzerland
CityGeneva
Period20/10/2023/10/20

Keywords

  • Foveated rendering
  • Picture saliency
  • Viewpoint prediction
  • VR

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Cite this