The Apple Vision Pro could potentially support an Apple Pencil-like input device, according to a newly published patent application spotted by Patently Apple. The patent, filed in September 2023, describes an "input device" for controlling a "virtual pointer" in a three-dimensional environment. One of the challenges with drawing or writing in virtual reality is the lack of physical resistance from a surface. As the report describes, "because of the one-to-one relationship between the movement of the input device and the movement of the virtual pointer element, the respective movements are mapped precisely which may cause undesirable artifacts (e.g., flaws due to handshaking and/or hesitations) appearing in the generated virtual object." To address this issue, Apple proposes introducing "elasticity" into the physics model used to translate the input device's movements into virtual strokes or shapes. As the report notes, "an elasticity model can be applied which includes various modes of physics" to "improve the visual characteristics of the generated virtual object." Additionally, the patent suggests using audible feedback "in response to movements of the virtual pointer element" to help users maintain control and precision. While the patent doesn't explicitly mention the Apple Pencil by name, the described functionality aligns with recent reports that Apple has internally tested a new Apple Pencil with VisionOS support. As cited in the report, this could enable improved text input and drawing capabilities within apps like Freeform and Pixelmator on Vision Pro. It's worth noting that this patent application was published by the US Patent and Trademark Office. And as with any patent filing, there's no guarantee that the described technology will make its way into a consumer product.
