Apple’s iPad Pro with LiDAR Sensor – How well it works and what you can do with it.
In March 2020, the new iPad Pro 2020 by Apple was released. This device comes with an A12Z Bionic chip, making it more powerful and even faster than common laptops. What is more, it also features an integrated LiDAR Scanner, enabling you to 3D scan the environment.
This scanner delivers indoor and outdoor capabilities for distance measurement within a radius of up to five meters utilizing a photon level at nano-second speeds.
Here is a video scanning our office:
However, Google is also investigating new features for the use of LiDAR Scans both, with and without operating a depth camera.
Application types using depth cameras
VIEWAR created an augmented reality ecosystem, to create AR experiences for use cases like indoor navigation, remote assistance, predictive maintenance or product visualization. We also developed various applications using depth cameras and reconstruction using external cameras like the Structure.io sensor.
Measuring (Surface & Volume computation)
Using a depth sensor allows you to create a 3D reconstruction of a room or objects. This can be used in order to compute measurements and volume like we did in a project for Lufthansa Cargo:
The LiDAR Scanner on the new iPad Pro provides useful guiding lines that instantly appear when using the “Measure app” for a more fast and accurate measurement of objects. In addition, this app also offers a more granular “Ruler View” allowing you to save lists of all measurements and include screenshots to save it for future projects.
A depth sensor is also highly relevant for industries in the field of flooring. It allows you to visualize different flooring materials in a room. Also it provides accurate measurements of the flooring area.
ViewAR is currently working on a solution for flooring. If you are interested in this solution, register at portal.viewar.com and request early access for the flooring template.
Product Visualization – Occlusion
One of the main aspects in product visualization is that objects should look and behave like they were real, they should merge with the environment.
There is also a huge opportunity for 3d reconstructions in indoor navigation. Scanning 3d environments can help to determine your position and also add advanced occlusion effects while using the application.
The 3d scans can also be used for admin interfaces of indoor navigation.
Image: GuideBOT Admin Interface – SAP.iO Foundry office Munich
Using the ViewAR system and the LiDAR sensor
We are constantly adding features like Apple’s LiDAR scanning capabilities to our developer platform to provide a more user friendly experience when creating AR apps with VIEWAR. Would you like to find out more about our offerings?
Register at portal.viewar.com to find out more about the ViewAR system.
Or contact us if you want us to build an app for you.