Apple

On the UI/UX side, 1 patent describes a system that lets a wearable device serve as a gesture-based controller for a range of other devices, including phones, tablets, and smart home Hardware. Rather than treating every device the same way, the system recognizes which device is currently active or in focus and adjusts how it interprets hand movements accordingly, so the same gesture can trigger different commands depending on context.

The 1 Hardware patent centers on making hand tracking practical from a power consumption standpoint. The approach pairs sensors built into a smartwatch with a camera that adjusts its frame rate dynamically, using motion data from the watch to determine when the camera actually needs to capture detailed imagery. By letting the wearable act as a trigger rather than running the camera continuously at high frame rates, the system cuts power consumption by 60-80% compared to always-on camera-based tracking.

A single VR & AR patent tackles a tradeoff that arises when headsets need to both display the real world to the user and record what the camera sees. Apple's filing describes a dual-pipeline architecture where one processing path handles the low-latency video feed shown to the wearer, while a separate path independently captures bracketed HDR images for recording purposes. Because the 2 pipelines operate independently, the recording process does not interrupt or degrade the real-time passthrough view the user sees.