iOS 16 'RoomPlan' API creates 3D floor plans using LiDAR - 9to5Mac

2022-07-15 22:00:48 By : Mr. Winter Sun

- Jun. 15th 2022 5:26 pm PT

Apple didn’t say a word about augmented and virtual reality at the WWDC 2022 opening keynote (as if it was trying to hide something), but iOS 16 brings a lot of improvements when it comes to ARKit and related technologies. One of these technologies is “RoomPlan,” a new API that uses LiDAR scanning to quickly create 3D floor plans.

Apps capable of creating 3D floor plans using the iPhone and iPad camera aren’t exactly new, but they aren’t exactly accurate either. When Apple introduced the LiDAR scanner with the 2020 iPad Pro and iPhone 12 Pro, it became easier to detect the dimensions of objects more accurately.

For those unfamiliar, LiDAR is a technology that emits lasers and calculates the time it takes for the light to return to the sensor in order to precisely measure the distance between the device and the objects. As such, a LiDAR scanner is able to detect dimensions and even the shape of an object or indoor environment.

Now with iOS 16, Apple has combined LiDAR with iPhone and iPad cameras in the new RoomPlan API to let users create 3D floor plans in seconds. According to Apple, the API can be useful for real estate, architecture, and interior design apps, since it is precise and easy to use.

Help customers make more informed decisions by using RoomPlan to create a floor plan of a room directly in your apps, such as real estate, e-commerce, or hospitality apps. These scans can also be the first step in architecture and interior design workflows to help streamline conceptual exploration and planning.

Of course, since RoomPlan is an API, you won’t find it as a feature available right away by default on a device running iOS 16. Instead, it requires developers to create and update their apps to support the new feature.

I was able to try out the RoomPlan API on my iPhone 13 Pro Max using sample code provided by Apple. And I must say, it works quite well. With just a few seconds, I was able to create the 3D floor plan of my living room just by pointing the iPhone at the walls. All you have to do is open a compatible app and scan your environment.

The API can even recognize some objects, although the capture shows only blocks to represent them since the focus is on the floor plan.

What impressed me most, besides the precision, is how fast the scanning works. The API provides a great animation and a real-time preview that shows the scanning progress. The 3D floor plan can be exported as a USDZ file that is compatible with popular tools such as Cinema 4D, Shapr3D, and AutoCAD.

Apple introduced this API for iPhone and iPad devices, but something inside me says that this API has a higher purpose. It’s almost as if Apple is working on a LiDAR-based device that needs to detect the environment around the user in real time.

With iOS 16, Apple also added 4K HDR video support for ARKit apps for the first time, while it also updated the Nearby Interaction API to integrate the U1 chip with AR. As the company has reportedly been working on its own mixed reality headset, perhaps these new APIs were created with the headset in mind.

More details about RoomPlan and what’s new in ARKit can be found on Apple’s website. iOS 16 will be available this fall for all users.

FTC: We use income earning auto affiliate links. More.

Check out 9to5Mac on YouTube for more Apple news:

Augmented Reality (AR) is mixing real-world images with artificial ones in real time – sometimes also known as Mixed Reality. This contrasts with Virtual Reality (VR) where the entire image is artificial ...

Filipe Espósito is a Brazilian tech Journalist who started covering Apple news on iHelp BR with some exclusive scoops — including the reveal of the new Apple Watch Series 5 models in titanium and ceramic. He joined 9to5Mac to share even more tech news around the world.

Best Prime Day Apple deals

Get iOS 16: Here’s how to install the beta

Inside Apple Car: Jony Ive, skepticism, more

iPhone 14 news: Here’s everything we know so far