US Patent No. 10,338,786

METHOD AND APPARATUS FOR PRESENTING TASK-RELATED OBJECTS IN AN AUGMENTED REALITY DISPLAY


Patent No. 10,338,786
Issue Date July 02, 2019
Title Method And Apparatus For Presenting Task-related Objects In An Augmented Reality Display
Inventorship Marko Tapio Tuukkanen, Schlenzer (DE)
Assignee HERE GLOBAL B.V., Veldhoven (NL)

Claim of US Patent No. 10,338,786

1. A method comprising:initiating, by an apparatus, one or more indications of one or more parts in a plurality of augmented reality user interfaces of respective user devices, wherein the one or more parts are associated with at least one task associated with a vehicle to be performed via coordinated actions of users of the respective user devices, and wherein each of the augmented reality user interfaces comprises an electronic display of a camera;
initiating, by the apparatus, one or more guides for alignment of the one or more indications with the one or more parts respectively in the augmented reality user interfaces corresponding to the coordinated actions to be performed by the users, wherein the alignment is realized by movement of the respective augmented reality user interface to align the one or more indications with the one or more parts located in real space, and wherein the electronic display allows the respective user to view the augmented reality user interface during the alignment and while performing the coordinated actions;
processing, by the apparatus, sensor information, telematics information, or a combination thereof collected at the user devices, the vehicle, or a combination thereof to determine the coordinated actions;
initiating, by the apparatus in response to the sensor information, the telematics information, or a combination thereof, a presentation in the electronic display of a tutorial video via one or more networks, wherein the tutorial video is a step by step guide to perform the coordinated actions as steps; and
upon determining based on the sensor information, the telematics information, or a combination thereof that one step shown on one of the user devices is completed by one of the users that uses the user device, initiating, by the apparatus, real-time skipping the step from the presentation of the tutorial video on the remaining one or more user devices and presenting a next step of the tutorial video on the remaining one or more user devices,
wherein the different steps of the tutorial video are presented among the user devices based, at least in part, on the real-time skipping.