TY - GEN
T1 - Towards Neural Ar: Unsupervised Object Segmentation with 3d Scanned Model Through Relative
AU - Sin, Zackary P.T.
AU - Ng, Peter H.F.
AU - Leong, Hong Va
N1 - Publisher Copyright:
© 2020 IEEE.
PY - 2020/7
Y1 - 2020/7
N2 - Neural AR augments the reality with a neural model to enable direct manipulation of the reality. This demands object tracking for augmentation, but there is not much work as in typical AR setting. Since most computer vision models manipulate on an image level, effectively tracking a target object for manipulation manifests as a segmentation problem. To the best of our knowledge, there is a gap for a model to perform unsupervised object segmentation with a 3D scanned model useful for Neural AR in reducing the labor-intensive data annotation. We propose in this paper a CycleGAN-inspired model, Realistic Layered Training Image from Virtual Environment (ReLaTIVE), which only requires a user to 3D scan a target object as with typical AR. The ReLaTIVE generator then outputs the object's mask for Neural AR. Without any annotated segmentation mask, it enables the generation of training samples with the 3D scanned model for learning to separate the foreground and background.
AB - Neural AR augments the reality with a neural model to enable direct manipulation of the reality. This demands object tracking for augmentation, but there is not much work as in typical AR setting. Since most computer vision models manipulate on an image level, effectively tracking a target object for manipulation manifests as a segmentation problem. To the best of our knowledge, there is a gap for a model to perform unsupervised object segmentation with a 3D scanned model useful for Neural AR in reducing the labor-intensive data annotation. We propose in this paper a CycleGAN-inspired model, Realistic Layered Training Image from Virtual Environment (ReLaTIVE), which only requires a user to 3D scan a target object as with typical AR. The ReLaTIVE generator then outputs the object's mask for Neural AR. Without any annotated segmentation mask, it enables the generation of training samples with the 3D scanned model for learning to separate the foreground and background.
KW - 3D Scanned Model
KW - Neural AR
KW - Training Sample Generation
KW - Unsupervised Segmentation
UR - http://www.scopus.com/inward/record.url?scp=85091758714&partnerID=8YFLogxK
U2 - 10.1109/ICMEW46912.2020.9106037
DO - 10.1109/ICMEW46912.2020.9106037
M3 - Conference article published in proceeding or book
AN - SCOPUS:85091758714
T3 - 2020 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2020
SP - 1
EP - 6
BT - 2020 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2020
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2020 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2020
Y2 - 6 July 2020 through 10 July 2020
ER -