"Occlusion" is the ability to hide virtual objects behind real things in augmented reality. Meaning augmented objects rendered over a real-world environment will appear in front of and behind a person depending on the IOS device's concern. With the new release of ARKit 3, we developed an AR application to place a 3D model on the surface. The developed application was able to recognize people's location and position them to appear in front of objects, thus partially occluding them.
As a novel visualization technology, Augmented Reality has gained widespread attention and seen prototype applications in multiple engineering disciplines for conveying simulation results, visualizing operations design, inspections. By default, virtual content covers anything in the camera feed. However, when a person passes in front of a virtual object, the object is drawn on top of the person, breaking the AR experience's illusion. ARKit accomplishes the occlusion by identifying regions in the camera feed where people reside and preventing virtual content from drawing into that region's pixels.
Notably, the prior versions of the platform had limitations in terms of human interaction. ARKit 3 introduces human occlusion. For AR, occlusion is vital for experiences to be immersive; virtual objects should be displayed when there are no physical objects between them and the camera. The primary challenge in generating convincing Augmented Reality graphics is to project 3D models onto a user's view of the real world while handling occlusion between real and virtual objects.
The application was developed using ARKit 3