Amazon's published US Application 20180218218: AUGMENTED REALITY USER INTERFACE FACILITATING FULFILLMENT

From the patent application:


[0015] The present disclosure relates to generating and/or rendering a user interface upon a display of a device that displays information related to various types of tasks. For example, a task can be related to the fulfillment process of electronic commerce orders by personnel or workers in a fulfillment center. Such a task can also be related to delivery of a parcel by a package delivery service. The present disclosure also relates to determining a location of a worker within the fulfillment center, which can facilitate rendering information on a user interface on the display to facilitate a given task. user interface can be rendered and displayed by a wearable computing device, such as augmented reality glasses, that overlay a user interface over a field of view of a fulfillment center worker.

[0016] For example, if a location of a worker within a fulfillment center can be determined, location-specific information, such as, for example, turn-by-turn directions to a destination within the fulfillment center, can be rendered in the user interface. A destination within the fulfillment center can include a particular floor, row, shelf, bin, or a particular item or product that is stocked within the fulfillment center. Accordingly, embodiments of the disclosure can facilitate providing various types of information to a worker in a fulfillment center in a user interface that is rendered by a wearable computing device, where the information is also based at least in part on the location of the user as detected in accordance with embodiments described herein.

(...)

[0025] The user interface 105 can also be updated in response to the changing orientation of the wearable computing device 103. Because the wearable computing device 103 can take the form of augmented reality glasses that are worn on the user's head and in which the user interface 105 is rendered upon one or more lenses of the augmented reality glasses, it may be the case that the visual indicator 109 requires updating as the user moves his or her head while moving through the fulfillment center as well as when the user is standing still within the fulfillment center. Accordingly, the wearable computing device 103 can also be equipped with one or more sensors that can detect movement, acceleration,
orientation, and other aspects of the position of the device.

(...)

[0048] The wearable computing device 103 can also be configured with wireless communication capabilities such as wireless local area network (WLAN) capability that can be employed to facilitate communications with the computing environment 303 via the network 309. Additionally, the wearable computing device 103 can also be equipped with personal area network (PAN) wireless communications capabilities such as a Bluetooth capability. In any form, the wireless communications capabilities of the wearable computing device 103 can allow the wearable computing device 103 to detect location beacons that are positioned throughout the fulfillment center 200. A location beacon can comprise a device that emits a wireless signal indicating a location within the fulfillment center 200. Such a location beacon can emit a location identifier that can be captured by the wireless communications capabilities of the wearable computing device 103 and in turn by the client application 381.

[0049] The wearable computing device 103 can also be equipped with one or more position sensors 385 that can provide information about orientation and/or movement of the wearable computing device 103. For example, position sensors 385 can include accelerometers, altimeters, speedometers, or other sensors that can provide pitch data, yaw data, roll data, velocity, acceleration, or other information related to movement and orientation of the wearable computing device 103. In one embodiment, the wearable computing device 103 can execute an operating system that provides an application programming interface (API) that provides API calls with which the client application 381 can access information about device position and/or orientation or other data obtained by the position sensors 385.