Magic Leap 2 Devices
Last Revised: September 29, 2022
In this Learn More, we cover:
- Magic Leap 2 Sensors
- Magic Leap 2 Features
- Spatial Mapping
- Voice Commands
- System Voice Commands
- In-App Voice Commands
- Hand Tracking/Gestures
- Iris ID
For information regarding Magic Leap 2’s second generation ecosystem or Spatial Mapping for Magic Leap 2, please refer to the “Learn Mores” for Magic Leap 2, available here.
Magic Leap 2 is a standalone spatial computer (along with available products and accessories) that enables a user to build and run immersive AR experiences. Magic Leap 2 devices may include certain technical features that enable you (or the enterprise managing the devices) to collect data from such Magic Leap 2 devices. You, or the managing enterprise, may elect to share certain data with Magic Leap for limited purposes (like to check for software updates, receive customer support services, or monitor license key compliance), however, Magic Leap 2 devices are not designed to offer a consumer-focused ecosystem like Magic Leap 1.
Magic Leap 2 Sensors
Overview: Magic Leap 2 devices use a variety of sensors:
- World Sensing Cameras: Outward-facing cameras on Magic Leap 2 devices collect wide view images of your surroundings in grayscale, which can be used, for example, to help determine the position of your head and refine spatial maps of your environment. Note that World Sensing Cameras were previously referred to as “Peripheral Cameras” for the Magic Leap 1 device.
- Ambient Light Sensors: Ambient light sensors measure the light intensity around you.
- Depth Sensors: Depth sensors collect depth images of your surroundings, which can be used, for example, to build spatial maps of your environment (by identifying the relative distance of nearby objects), as well as to identify gestures made by your hands.
- Inertial Measurement Unit (IMU) Sensors: IMU sensors in your Magic Leap 2 Headset, Compute Pack, and Controller measure the relative position, orientation, and motion of these devices over time. Note that IMU Sensors were previously referred to as “Motion Sensors” for the Magic Leap 1 device.
- Eye Tracking Cameras: Magic Leap 2 devices also have inward-facing cameras, which can be used, for example, to figure out where you are looking. Note that Eye Tracking Cameras were previously referred to as “Eye Cameras” for the Magic Leap 1 device.
- Microphones: Microphones on Magic Leap 2 devices capture audio of your voice during video recordings, calls, and when you use Speech Commands. The microphones also collect acoustic sound from the world around you, which can be used to help improve the spatial maps of your surroundings and create realistic digital sound effects.
- Picture Camera: Magic Leap 2 devices also have a picture (or “RGB”) camera that you can use to take pictures or videos of the world around you. Apps and certain Magic Leap platform features with your permission may also access the picture camera.
- Altimeters: Barometric pressure sensors collect air pressure readings of your surroundings, which can be used, for example, to determine changes in your altitude above ground and improve audio playback quality.
Processing of Sensor Data: If you use a Magic Leap 2 device managed by an enterprise, such enterprise may have access to, may elect to collect and/or store, and may decide to share with third parties and/or with Magic Leap, any or all of the Magic Leap 2 sensor data outlined above, or other on-device output derived from such data. Magic Leap does not automatically collect any such Magic Leap 2 sensor data directly from Magic Leap 2 devices; unless your enterprise chooses to collect or otherwise process such sensor data, it is designed to be processed on your Magic Leap 2 device.
Privacy Status Indicator: The Magic Leap 2 headset has external and internal-facing privacy status indicators. The external-facing indicator light provides certain information that helps to alert others about when certain Magic Leap 2 device sensors are capturing information. The internal-facing privacy indicators provide UI for when an application is using the picture camera, microphone, or is streaming content to an external source. Additional information regarding the lights on your Magic Leap 2 device may be found here.
Magic Leap 2 Features
Magic Leap 2 devices have several features that offer you choices around whether or how you use them. For example:
Spatial Mapping: Spatial maps are a critical part of the Magic Leap ecosystem and help Magic Leap’s platform enable interactions between digital content and your actual physical surroundings. Magic Leap 2 devices create spatial maps in a different manner than prior generations of Magic Leap products. Learn more about spatial mapping and your options for storing your spatial maps for Magic Leap 2 devices here.
Voice Commands: Magic Leap 2 devices offer Voice Commands, a speech-driven input methodology for performing certain system and in-app actions on your Magic Leap 2 device in place of using your Controller, such as changing the volume of audio, exiting an application, or taking a camera capture. Processing to enable Voice Commands is done locally on your Magic Leap 2 device. Voice Command data is not designed to be exposed to apps. Disabling Voice Commands in your Magic Leap 2 device settings will only affect your use of System Voice Commands.
- System Voice Commands: If you enable Voice Commands for system functionality, your Magic Leap 2 device’s near-field microphone will be available to the system locally to wait for the wake phrase (“Hey Magic Leap”). Once the system recognizes “Hey Magic Leap”, a voice clip (typically five-to-ten seconds in duration) will be recorded locally and analyzed by on-device software. Note that words and phrases similar to “Hey Magic Leap” may inadvertently activate System Voice Commands. System Voice Commands are built with a preloaded library on your Magic Leap 2 device, so your Magic Leap 2 device should not recognize or respond to any audio or instructions other than the available System Voice Commands or In-App Voice Commands (if you’ve chosen to install an application that utilizes In-App Voice Commands).
Iris ID: Iris ID is not currently available for Magic Leap 2 devices. In upcoming releases, Magic Leap will offer enterprises the option to enable Iris ID functionality.
Analytics and Optimization
Unlike Magic Leap 1 devices, Magic Leap does not directly collect information from Magic Leap 2 devices. However, Magic Leap does provide tools and services to enterprises that enable them to manage their Magic Leap 2 devices. If you use a Magic Leap 2 device managed by an enterprise, then, in addition to certain sensor and feature information, as described above, enterprises may collect, process, and/or share other information from such Magic Leap 2 devices, as follows:
- Device Usage Data: An enterprise may collect device usage analytics data, including information about how you use your Magic Leap 2 device, such as volume levels, buttons pressed on the Magic Leap 2 device, and whether you are using accessories with your Magic Leap 2 device.
- Device and Software Performance Data: An enterprise may collect other performance data regarding your Magic Leap 2 device and platform software including data regarding the performance of algorithms and our operating system, such as the performance of our head pose algorithms, data regarding whether your Magic Leap 2 device is properly calibrated, data regarding performance of other aspects of the system, such as your Controller, and power management performance. If you enable Speech Commands, this may also include the resulting text strings and event success or failure data from your use of Speech Commands.
- Eye Tracking Data: An enterprise may collect eye tracking data including eye measurements and information about where your eyes are looking, such as: pupil measurements and pupil positions, cornea measurements and cornea positions, glint measurements, gaze, target, and vergence measurements. Magic Leap 2 device eye tracking data will not contain any images of your eyes or measurements of your eyes that we know could uniquely identify you.
- Crash Reports: An enterprise may collect crash reports which are stored on your Magic Leap 2 device. Such Crash reports may include information about your Magic Leap 2 device and what it was doing at the time of the crash, log files and other information regarding the performance of the app and operating system when the crash occurred.
- Log Information: An enterprise may collect log files from Magic Leap 2 devices they manage. This information includes access times, services used, hardware and software versions, device identifiers, and IP address.
- App Install and Usage Information: An enterprise may collect information about apps that you install to and use on a Magic Leap 2 device managed by such enterprise, including the apps you start, stop, pause and resume.
- Settings Information: An enterprise may collect information about the settings on your Magic Leap 2 device, including a list of paired Bluetooth devices, volume preferences, and which apps have received permission to access Magic Leap 2 device data or functionality, such as the Magic Leap 2 device microphones or picture camera.
- Other Information through Apps on Device: An enterprise may also collect information about use of a Magic Leap 2 device it manages through the use of additional apps installed on such devices. Please refer to the information below regarding app permissions for more details regarding what data apps on a Magic Leap 2 device may collect.
Location Detection and Use
Unlike Magic Leap 1, Magic Leap 2 devices do not attempt to derive any information regarding your location, nor does Magic Leap currently provide any functionality designed to enable an enterprise to determine the location of a Magic Leap 2 device user.
While some information from your Magic Leap 2 device is shared automatically with third-party apps that you choose to install on your Magic Leap 2 device, you may also choose to share other information with the providers of those third-party apps. Please refer to the App Permissions for Magic Leap 2 section below to learn more about the choices you may have with respect to the data that apps on your Magic Leap 2 device may be able to access.
Magic Leap 2 follows a data permissions model very similar to the Android permissions model, however, Magic Leap also requires additional permissions that are beyond the scope of the Android permissions to cover certain data that are specific to your Magic Leap 2 device, such as eye tracking, spatial maps, and custom voice commands. Details of the Android permissions model can be found in the Permissions on Android documentation.
Data Available to all Apps on Magic Leap 2
Below are examples of the types of information that are automatically shared with apps. Access to certain of these types of information may be disabled by you or your employer through your Magic Leap 2’s device settings. If you do not wish to share information with an app provider, do not install apps from that provider.
- Internet: Apps will be able to access the internet connection your Magic Leap 2 device is using, however, Magic Leap’s platform is not designed to share any information about your connection such as SSID (Network Name) or BSSID (MAC Address).
- IMU, 3-axis Accelerometer and Gyroscope Sensors: Apps will be able to access course motion information from the IMU, accelerometer, and gyroscope sensors in your Magic Leap 2 device.
- Perception: Apps will be able to access your hand positions, certain motion information (such as the speed and direction of your motions), gestures, and Controller positions. Some perception information, such as head position, and motion are accessible by all apps running, including while in the background. Apps use this information, for example, to understand when and how you are interacting with the apps.
- Marker Tracking: Apps will be able to access information regarding markers, such as aruco markers, in your environment, including a location for each such marker relative to your location. This information can be accessed by applications at any time, including in the background to help the application understand your physical environment.
- Spatial Anchors: Apps will be able to access information regarding persistent anchors placed in your environment, including a location for each anchor relative to your location in the World Model spatial map.
- Other: Apps will also be able to access other, less sensitive data and features, such as battery percentage, the ability to upload and download data in the background, digital rights management certificates, webviews, and media player integration information among many others.
Data Available with Permissions on Magic Leap 2
Below are examples of the types of information that require your permission for apps to access. An app is required to request access to this type of data before the app may access the information for the first time. If you wish to change which permissions you have granted an app, you can do so through your Magic Leap 2’s device settings at any time.
- Camera: Granting this permission allows an app to access the picture camera on your Magic Leap 2 device for the purposes of capturing images and video, and for some limited computer vision processing use cases (such as a QR code or for purposes of overlaying filters on faces or objects).
- Microphone: Granting this permission allows an app access to your Magic Leap 2 device’s near field and far field microphones to capture audio streams.
- Spatial Maps: Granting this permission allows an app to access the World Model spatial map of your surroundings while the apps are running, including while in the background. Apps need this information to display within and interact with your environment.
- Voice Commands: Granting this permission allows an app to access your Magic Leap 2 device’s microphone to create custom voice commands.
- Eye Tracking: Granting this permission allows an app to access the eye tracking cameras on your Magic Leap 2 device for the purposes of exposing eye movement to the app.
Get the latest news and updates
Sign up to receive offers, promotions and other marketing emails from Magic Leap. You can opt out of them at any time.