Loading...
Please wait, while we are loading the content...
Hybrid World/body Locked Hud on An Hmd
| Content Provider | The Lens |
|---|---|
| Abstract | A system and method are disclosed for displaying virtual objects in a mixed reality environment in a way that is optimal and most comfortable for a user to interact with the virtual objects. When a user is not focused on the virtual object, which may be a heads-up display, or HUD, the HUD may remain body locked to the user. As such, the user may explore and interact with a mixed reality environment presented by the head mounted display device without interference from the HUD. When a user wishes to view and/or interact with the HUD, the user may look at the HUD. At this point, the HUD may change from a body locked virtual object to a world locked virtual object. The user is then able to view and interact with the HUD from different positions and perspectives of the HUD. |
| Related Links | https://www.lens.org/lens/patent/010-634-087-971-368/frontpage |
| Language | English |
| Publisher Date | 2019-01-08 |
| Access Restriction | Open |
| Content Type | Text |
| Resource Type | Patent |
| Jurisdiction | United States of America |
| Date Applied | 2013-06-18 |
| Agent | Arent Fox Llp |
| Applicant | Microsoft Technology Licensing Llc |
| Application No. | 201313921116 |
| Claim | A system for presenting a mixed reality experience to one or more users, the system comprising: a display device including a display unit for displaying a virtual object; and a computing system operatively coupled to the display device, the computing system configured to: generate the virtual object for display on the display device, determine whether a field of view of the display device includes the virtual object for at least a determined period of time, position, based on determining that the field of view does not include the virtual object for at least the determined period of time, the virtual object as being body locked with respect to the display device, and position, based on determining that the field of view includes the virtual object for at least the determined period of time, the virtual object as being world locked. The system of claim 1 , wherein the computing system comprises at least one of a hub computing system or one or more processing units. The system of claim 1 , wherein the computing system is configured to switch the position of the virtual object from being body locked to being world locked in response to determining that the virtual object remains within the field of view of the display device for the determined period of time. The system of claim 1 , wherein the computing system is configured to switch the position of the virtual object from being world locked to being body locked in response to determining that the virtual object remains outside of the field of view of the display device for the determined period of time. The system of claim 1 , wherein the computing system is configured to switch the position of the virtual object from being world locked to being body locked in response to determining that the user is not looking in a direction of the virtual object. The system of claim 1 , wherein the virtual object is a heads-up display (HUD) including content. The system of claim 1 , wherein the computing system is configured to allow a user to select the virtual object when the virtual object is world locked, and move the virtual object to a new position in three dimensional space with a gesture. The system of claim 7 , wherein the virtual object is selected by the user performing a gesture with the user's hands, body or eyes. A system for presenting a mixed reality experience, the system comprising: a display device including a first set of sensors for sensing data relating to a position of the display device and a display unit for displaying a virtual object to a user of the display device; and a computing system operatively coupled to the display device, the computing system including a second set of sensors for sensing data relating to a position of the user, and the computing system configured to: generate the virtual object for display on the display device, determine whether a field of view of the display device includes the virtual object for at least a determined period of time, maintain the virtual object in a body locked position outside of the field of view of the display device in response to determining that the field of view does not include the virtual object for at least the determined period of time, and maintain the virtual object in world locked position within the field of view of the display device in response to determining that the field of view includes the virtual object for at least the determined period of time. The system of claim 9 , wherein a user may view the virtual object from different perspectives and positions when the virtual object is world locked. The system of claim 9 , wherein the virtual object is body locked by remaining a fixed distance away from the user's head as the user moves around. The system of claim 9 , wherein the virtual object is body locked by remaining in front of a user's head and above a horizontal plane in which the user's head resides. The system of claim 9 , wherein the virtual object is body locked by pivoting with the user's head as the user's head turns from side to side. The system of claim 9 , wherein the virtual object is body locked by pivoting with the user's head as the user's head nods up and down. The system of claim 9 , wherein the virtual object is body locked by pivoting with the user's head as the user's head tilts from side to side. The system of claim 9 , wherein the virtual object is a first virtual object, the system further including a second virtual object, the computing system further configured to: maintain the second virtual object in a body locked position outside of the field of view of the display device in response to determining that the field of view does not include the virtual object for at least the determined period of time, and maintain the second virtual object in world locked position within the field of view of the display device in response to determining that the field of view includes the virtual object for at least the determined period of time. A method of presenting a mixed reality experience to one or more users, the method comprising: determining whether a field of view of a display device includes a virtual object for at least a determined period of time, locking a position of the virtual object in a fixed position with respect to a portion of a user's body in response to determining that the field of view does not include the virtual object for at least the determined period of time; and locking a position of the virtual object in a fixed position in three-dimensional space in response to determining that the field of view includes the virtual object for at least the determined period of time. The method of claim 17 , wherein locking the position of the virtual object comprises locking the position of the virtual object with respect to the user's head. The method of claim 17 , further comprising switching the virtual object from the body locked position to the world locked position upon determining that the field of view includes the virtual object for at least the determined period of time. The method of claim 17 , further comprising switching the virtual object from the world locked position to the body locked position upon determining that the field of view does not include the virtual object for at least the determined period of time. A system for presenting a mixed reality experience to a user, the system comprising: a display device including a display unit for displaying a virtual object; and a processor operatively coupled to the display device, the processor configured to: generate the virtual object for display on the display device, determine whether a field of view of the display device includes the virtual object for at least a determined period of time, operate, in response to determining that the field of view does not include the virtual object for at least a determined period of time, a first mode of operation where the virtual object is positioned outside of a central portion of a field of view of the display device, the virtual object moving with a body part of the user other than a head of the user so as to remain accessible to the user as the user moves, and such that the user can look toward and away from the virtual object in the first mode of operation, operate, in response to determining that the field of view includes the virtual object for at least a determined period of time, in a second mode of operation where the virtual object is world locked and the user can move around a fixed position of the virtual object, and switch from the first mode to the second mode by focusing on the virtual object in the first mode for a predetermined period of time. The system of claim 21 , wherein the the processor is further configured to switch the position of the virtual object from being world locked to being body locked in response to determining that the field of view does not include the virtual object for at least a determined period of time. The system of claim 21 , wherein the the processor is further configured to switch the position of the virtual object from being world locked to being body locked in response to determining that the user is not looking in a direction of the virtual object. The system of claim 21 , wherein the virtual object is a heads-up display (HUD) including content. The system of claim 21 , wherein the processor is further configured to allow a user to select the virtual object in response to the virtual object being world locked, and to move the virtual object to a new position in three dimensional space with a gesture. |
| CPC Classification | ELECTRIC DIGITAL DATA PROCESSING OPTICAL ELEMENTS; SYSTEMS OR APPARATUS IMAGE DATA PROCESSING OR GENERATION; IN GENERAL |
| Examiner | Jin-cheng Wang |
| Extended Family | 010-634-087-971-368 111-958-397-070-904 034-477-871-869-142 159-353-903-637-29X 088-521-158-667-769 041-538-552-549-555 138-570-679-150-565 060-461-477-021-318 194-905-936-702-643 010-230-281-925-700 136-494-416-126-921 |
| Patent ID | 10175483 |
| Inventor/Author | Salter Tom G Sugden Ben J Deptford Daniel Crocco Jr Robert L Keane Brian E Massey Laura K Kipman Alex Aben-athar Kinnebrew Peter Tobias Kamuda Nicholas Ferianc |
| IPC | G06T19/00 G02B27/01 G06F3/01 G06T11/60 |
| Status | Active |
| Owner | Microsoft Technology Licensing Llc Microsoft Corporation |
| Simple Family | 034-477-871-869-142 111-958-397-070-904 010-634-087-971-368 159-353-903-637-29X 088-521-158-667-769 041-538-552-549-555 010-230-281-925-700 194-905-936-702-643 138-570-679-150-565 136-494-416-126-921 060-461-477-021-318 |
| CPC (with Group) | G06F3/011 G02B2027/014 G02B2027/0178 G02B2027/0187 G06F3/012 G06F3/013 G02B27/017 G06T11/60 G06T19/006 |
| Issuing Authority | United States Patent and Trademark Office (USPTO) |
| Kind | Patent/New European patent specification (amended specification after opposition procedure) |
