March 28, 2020

Apple’s iPad Pro with LiDAR Sensor – How well it works and what you can do with it.

This week Apple released the new iPad Pro 2020, equipped with some new features and the A12Z Bionic chip, so it will be faster and more powerful than most laptops. But the real breakthrough feature is the integrated LiDAR Scanner, that enables 3d scanning the environment.

The LiDAR Scanner measures the distance to surrounding objects up to five meters away, works both indoors and outdoors, operating at the photon level at nano-second speeds. 

Here is a video scanning our office:

Not only Apple has got LIDAR-Features, Google is also working on this. They are planning to offer LIDAR-like features, with and without the use of a depth camera.

Application types using depth cameras

At ViewAR, we created an AR system that supports all kind of AR scenarios – from AR product visualization and indoor navigation to remote assistance and much more. We also developed various applications using depth cameras and reconstruction using external cameras like the Structure.io sensor.

Measuring (Surface & Volume computation)

Using a depth sensor allows you to create a 3D reconstruction of a room or objects. This can be used in order to compute measurements and volume like we did in a project for Lufthansa Cargo:

ViewAR’s application for Lufthansa Cargo

The LiDAR Scanner also improves the Measure app, making it faster and easier to automatically calculate someone’s height, while helpful vertical and edge guides automatically appear to let users more quickly and accurately measure objects. The Measure app also now comes with Ruler View for more granular measurements and allows users to save a list of all measurements, including screenshots for future use.

Flooring

A depth sensor is also highly relevant for industries in the field of flooring. It allows you to visualize different flooring materials in a room. Also it provides accurate measurements of the flooring area.

ViewAR is currently working on a solution for flooring. If you are interested in this solution, register at portal.viewar.com and request early access for the flooring template. 

Product Visualization – Occlusion

One of the main aspects in product visualization is that objects should look and behave like they were real, they should merge with the environment. The 3d reconstruction allows to…

Indoor Navigation

There is also a huge opportunity for 3d reconstructions in indoor navigation. Scanning 3d environments can help to determine your position and also add advanced occlusion effects while using the application. 

The 3d scans can also be used for admin interfaces of indoor navigation. 

GuideBOT Admin Interface Sap.iO Foundry
GuideBOT Indoor Navigation Admin Interface @ SAP.iO Foundry

Image: GuideBOT Admin Interface – SAP.iO Foundry office Munich

Using the ViewAR system and the LiDAR sensor

The idea of the ViewAR system is that users can very easily create AR applications using pre-defined templates or use the ViewAR JavaScript API to create custom applications. 

We are constantly adding features like Apple’s LiDAR reconstruction to our system allowing a huge user group to access these features. Interested?

Register at portal.viewar.com to find out more about the ViewAR system.

Or contact us if you want us to build an app for you.