Phygital Paper Crafting: A Physical Interactive System to Support Paper Crafting in a Virtual Environment

In traditional design, the foundational material expresses three-dimensional concepts, blending artisanal skills, visual perception, and cognitive processes. Modern computer-aided design shifts this process to digital manipulation, increasing efficiency but reducing the connection between sensory experiences. Recent advancements in immersive technologies rapidly progress interaction methodologies. Real-time systems, with features like gesture recognition, enable customized sensory perception and communication in the design process. Importantly, these technologies seamlessly integrate digital models into the tangible world through Mixed Reality (MR) technology and inter-sensory connections while simplifying the modelling process. In the current project, the utilization of digital twins emerges as a strategic approach, orchestrating a harmonious fusion of visual and tactile senses. The paper crafting processing methodology was analysed using it as a foundational reference, while concurrently simplifying the user gesture and modelling system. Utilizing three motion-driven sensors to simulate movements during the paper folding process, an operational platform integrating immersive technology was developed. This platform enables users to model intricate cylindrical structures, thereby illustrating the feasibility of achieving architectural modelling with potential applications in participatory design and smart building technologies construction.