A method and apparatus for creating virtual worlds wherein a user may begin with a database containing a limited pictorial representation of a desired virtual world and then edit the database to specify the remaining data needed to create the actual virtual world. In one embodiment of the present invention, a database containing a limited pictorial representation of a virtual world is communicated to a receiving unit, and a grouping unit collects various descriptions of the pictorial representation into selected groups. An attribute assigning unit then assigns attributes to the groups. The attributes may include group hierarchy, constraints of motion, color, texture or other features. The modified database is then communicated to a data coupling unit which couples real world data to the groups. Finally, a rendering unit renders the virtual world which looks and functions according to the specified attributes and the real world data.
|
1. An apparatus for creating a virtual world data base, comprising:
receiving means for receiving first, second and third polygon representations of respective first, second and third virtual objects in a virtual world;
selecting means, coupled to said receiving means, for selecting a first edge of said first virtual object and for selecting a second edge of said second virtual object; and
grouping means, coupled to the receiving means and the selecting means, for grouping said first and second virtual objects in the virtual world into a grouped object comprising said first and second virtual objects joined at an intersection of the first and second edges, the grouped object represented by at least one of a three-dimensional and rotatable wireframe objects and a three-dimensional and rotatable sweep polygon.
0. 16. A method for creating a data base representing a virtual world, the method comprising:
receiving a plurality of polygon representations of virtual objects, wherein the plurality of polygon representations include a first, a second, and a third representation of respective first, second, and third virtual objects, wherein the virtual objects have edges;
selecting first and second virtual objects using the edges from said plurality of polygon representations of virtual objects;
grouping the first and second virtual objects into a grouped object comprising a combination of the first and second virtual objects, wherein the first and second virtual objects intersect; and
representing the gouped object by at least one of the following:
a three-dimensional and rotatable wireframe object, and
a three-dimensional and rotatable sweep polygon object.
0. 11. A method for creating a data base representing a virtual world, the method comprising: receiving a plurality of polygon representations of virtual objects; selecting first and second virtual objects from said plurality of polygon representations of virtual objects; grouping the first and second virtual objects into a three-dimensional grouped object, wherein said grouping the first and second virtual objects includes: selecting a first edge of said first virtual object; selecting a second edge of said second virtual object; wherein said three-dimensional grouped object comprises said first and second virtual objects joined at an intersection of the first and second edges; assigning a grouping hierarchy for the first and second virtual objects, wherein the second virtual object is assigned as the child of the first virtual object; and calculating an orientation and position of the child object relative to the first virtual object.
0. 10. A method for creating a data base representing a virtual world, the method comprising: receiving a plurality of polygon representations of virtual objects; selecting first and second virtual objects from said plurality of polygon representations of virtual objects; grouping the first and second virtual objects into a three-dimensional grouped object, wherein said grouping the first and second virtual objects includes: selecting a first edge of said first virtual object; selecting a second edge of said second virtual object; wherein said three-dimensional grouped object comprises said first and second virtual objects joined with at least a portion of said first edge of said first virtual object contacting at least a portion of said second edge of said second virtual object; assigning a grouping hierarchy for the first and second virtual objects, wherein the second virtual object is assigned as the child of the first virtual object; and calculating an orientation and position of the child object relative to the first virtual object.
0. 31. A computer program for creating a virtual world data base, wherein said computer program is embodied on computer-readable media and comprises instructions configured to:
read polygon representations of a plurality of virtual objects, including a first virtual object, a second virtual object, and a third virtual object;
select the first virtual object and the second virtual object from said plurality of virtual objects;
assign attributes to the first and second virtual objects;
group said first and second virtual objects into a grouped object, wherein said first and second virtual objects intersect;
represent the grouped object by at least one of the following:
a three-dimensional and rotatable wireframe object, and
a three-dimensional and rotatable polygon object;
assign a grouping hierarchy to the first and second virtual objects, wherein the second virtual object is assigned as the child of the first virtual object; and
calculate an orientation and position of the child object relative to the first virtual object.
0. 42. A computer program embodied on a computer-readable medium, wherein the computer program is configured to create a data base representing a virtual world by: receiving a plurality of polygon representations of virtual objects; selecting first and second virtual obhects from said plurality of polygon representations of virtual objects; grouping the first and second virtual objects into a hierarchical grouped object, wherein said grouping includes: selecting a first mathematical edge of said first virtualobject; selecting a second mathematical edge of said second virtual object; and representing the grouped object by at least one of the following: a three-dimensional and rotatable hierarchical wireframe object, and a three-dimensional and rotatable hierarchical polygon object and wherein the first and second virtual objects intersect, and wherein the grouped object comprises said first and second virtual objects joined with at least a portion of said first edge of said first virtual object contacting at least a portion of said second edge of said second virtual object.
0. 15. A system for creating a data base representing a virtual world, the system comprising: a computer system comprising a cpu and memory, wherein the memory stores a plurality of polygon representations of virtual objects; a user input device coupled to the computer system for providing user input to the computer system; wherein the cpu is operable to select first and second virtual objects from said plurality of polygon representations of virtual objects; wherein the cpu is operable to group the first and second virtual objects into a three-dimensional grouped object; wherein said cpu is configured to group the first and second virtual objects by: selecting a first edge of said first virtual object, and selecting a second edge of said second virtual object, wherein said three-dimensional grouped object comprises said first and second virtual objects joined at an intersection of the first and second edges, wherein the cpu is operable to assign a grouping hierarchy for the first and second virtual objects, wherein the second virtual object is assigned as the child of the first virtual object; and wherein the cpu is operable to calculate an orientation and position of the child object relative to the first virtual object.
0. 14. A system for creating a data base representing a virtual world, the system comprising: a computer system comprising a cpu and memory, wherein the memory stores a plurality of polygon representations of virtual objects; a user input device coupled to the computer system for providing user input to the computer system; wherein the cpu is operable to select first and second virtual objects from said plurality of polygon representations of virtual objects; wherein the cpu is operable to group the first and second virtual objects into a three-dimensional grouped object; wherein the cpu is further configured to: select a first edge of said first virtual object, and select a second edge of said second virtual object, wherein said three-dimensional grouped object comprises said first and second virtual objects joined with at least a portion of said first edge of said first virtual object contacting at least a portion of said second edge of said second virtual object, wherein the cpu is operable to assign a grouping hierarchy for the first and second virtual objects, wherein the second virtual object is assigned as the child of the first virtual object; and wherein the cpu is operable to calculate an orientation and position of the child object relative to the first virtual object.
0. 13. A memory medium comprising program instructions for creating a data base representing a virtual world, wherein the program instructions are executable to implement: receiving a plurality of polygon representations of a plurality of virtual objects including a first virtual object, a second virtual object, and a third virtual object; selecting the first and second virtual objects from said plurality of polygon representations of virtual objects using edges of the virtual objects; grouping the first and second virtual objects into a three-dimensional grouped object represented by at least one of the following: a three-dimensional and rotatable wireframe object, and a three-dimensional and rotatable polygon object; wherein said grouping the first and second virtual objects includes: selecting a first edge of said first virtual object; selecting a second edge of said second virtual object; wherein said three-dimensional grouped object comprises said first and second virtual objects joined at an intersection of the first and second edges; assigning a grouping hierarchy for the first and second virtual objects, wherein the second virtual object is assigned as the child of the first virtual object; and calculating an orientation and position of the child object relative to the first virtual object.
0. 12. A memory medium comprising program instructions for creating a data base representing a virtual world, wherein the program instructions are executable to implement: receiving a plurality of polygon representations of a plurality of virtual objects including a first virtual object, a second virtual object, and a third virtual object; selecting the first and second virtual objects from said plurality of polygon representations of virtual objects using edges of the virtual objects; grouping the first and second virtual objects into a three-dimensional grouped object represented by at least one of the following: a three-dimensional and rotatable wireframe object, and a three-dimensional and rotatable polygon object; wherein said grouping the first and second virtual objects includes: selecting a first edge of said first virtual object; selecting a second edge of said second virtual object; wherein said three-dimensional grouped object comprises said first and second virtual objects joined with at least a portion of said first edge of said first virtual object contacting at least a portion of said second edge of said second virtual object; assigning a grouping hierarchy for the first and second virtual objects, wherein the second virtual object is assigned as the child of the first virtual object; and calculating an orientation and position of the child object relative to the first virtual object.
8. An apparatus for creating a virtual world comprising:
receiving means for receiving first, second and third polygon representations of respective first, second and third virtual objects in a virtual world;
selecting means, coupled to said receiving means, for selecting a first edge of a first virtual object and for selecting a second edge of a second virtual object; and
grouping means, coupled to the receiving means and the selecting means, for grouping said first and second virtual objects in the virtual world into a grouped object comprising said first and second virtual objects joined at an intersection of the first and second edges, the grouped object represented by at least one of a three-dimensional and rotatable wireframe object and a three-dimensional and rotatable sweep polygon;
attribute assigning means, coupled to the grouping means, for assigning an attribute to the first and second edges of the first and second virtual objects, the attribute assigning means including:
hierarchy means for assigning a grouping hierarchy for the first and second virtual objects wherein the second virtual object is assigned as as child object of the first virtual object and an orientation and a position of the child object is calculated relative to the first virtual object; and
origin assigning means for assigning an origin on the first virtual objects around which the third virtual object can rotate; and
constraint assigning means for assigning a three-dimensional constraint of motion to the the third virtual object to constrain how the third virtual object can rotate with respect to the first virtual object; and
rendering means for rendering the virtual world including the grouped object.
2. The apparatus according to
3. The apparatus according to
origin assigning means for assigning an origin on the first virtual object around which the third virtual objects can rotate; and
constraint assigning means for assigning a three-dimensional contraint of motion to the the third virtual object to constrain how the third virtual object can rotate with respect to the first virtual object.
4. The apparatus of
5. The apparatus according to
6. The apparatus according to
7. The apparatus according to
9. The apparatus of
0. 17. The method as recited in
assigning a grouping hierarchy for the first and second virtual objects, wherein the second virtual object is assigned as the child of the first virtual object; and
calculating an orientation and position of the child object relative to the first virtual object.
0. 18. The method as recited in
assigning group attributes to the grouped object; and
assigning individual attributes to a particular virtual object within the grouped object, wherein the individual attributes are inherited by child objects of the particular virtual object.
0. 19. The method as recited in
assigning an origin on the first virtual object around which the second virtual object can rotate; and
assigning a three-dimensional constraint of motion to the second virtual object that constrains how the second virtual object can rotate with the respect to the first virtual object.
0. 20. The method as recited in
0. 21. The method as recited in
0. 22. The method as recited in
grouping a third virtual object into the grouped object; and
assigning a three-dimensional constraint of motion to the third virtual object that constrains how the third virtual object can rotate with respect to the origin.
0. 23. The method as recited in
0. 24. The method as recited in
0. 25. The method as recited in
0. 26. The method as recited in
taking sensor data from real world inputs; and
varying the orientation of the child object with respect to the origin in relation to the sensor data.
0. 27. The method as recited in
taking sensor data from real world inputs; and
varying the position of the child object with respect to the origin in relation to the sensor data.
0. 28. The method as recited in
sensing the relative position of two real world physical objects; and
adjusting the relative position of the second virtual object relative to the origin accordingly.
0. 29. The method as recited in
sensing the relative orientation of two real world physical objects; and
adjusting the relative orientation of the second virtual object relative to the origin accordingly.
0. 30. The method as recited in
0. 32. The computer program as recited in
assign an origin on the first virtual object around which the second virtual object can rotate; and
assign a three-dimensional constraint of motion to the second virtual object, wherein said three-dimensional constraint of motion constrains how the second virtual object can rotate with respect to the first virtual object.
0. 33. The computer program as recited in
0. 34. The computer program as recited in
0. 35. The computer program as recited in
0. 36. The computer program as recited in
0. 37. The computer program as recited in
take sensor data from real world inputs; and
vary the orientation of the child object with respect to the origin in relation to the sensor data.
0. 38. The computer program as recited in
take sensor data from real world inputs; and
vary the position of the child object with respect to the origin in relation to the sensor data.
0. 39. The computer program as recited in
sense the relative position of two real world physical objects; and
adjust the relative position of the second virtual object relative to the origin accordingly.
0. 40. The computer program as recited in
sense the relative orientation of two real world physical objects; and
adjust the relative orientation of the second virtual object relative to the origin accordingly.
0. 41. The computer program as recited in
|
This is a continuation of application Ser. No. 07/621,474 filed Nov. 30, 1990, now abandoned.
This invention relates to virtual systems and, more particularly, to a method and apparatus for creating a virtual world from a database containing a limited pictorial representation of the virtual world.
Users of computer systems are now able to create virtual realities which they may view and interact with. One type of virtual reality system is disclosed in U.S. patent application Ser. No. 08/133,802, filed Oct. 8, 1993, which is a continuation of U.S. patent application Ser. No. 07/535,253, filed Jun. 7, 1990, now abandoned, entitled “Virtual Reality Network,” the disclosure of which is incorporated herein by reference. One task which must be performed is the creation of the virtual worlds within which the users interact. This can be a very tedious task, since a complete description of all virtual objects in the virtual world, including their constraints of motion, hierarchy, color, texture and other attributes must be made and entered into the virtual reality computer. Thus, it would be desirable to make virtual world creation as simple as possible.
The present invention is a method and apparatus for creating virtual worlds wherein a user may begin with a database containing a limited pictorial representation of a desired virtual world and then edit the database to specify the remaining data needed to create the actual virtual world. In one embodiment of the present invention, a database containing a limited pictorial representation of a virtual world is communicated to a receiving unit, and a grouping unit collects various descriptions of the pictorial representation into selected groups. An attitude assigning unit then assigns attributes to the groups. The attributes may include group hierarchy, constraints of motion, color, texture or other features. The modified database is then communicated to a data coupling unit which couples real world data to the groups. Finally, a rendering unit renders the virtual world which looks and functions according to the specified attributes and the real world data.
Appendix 1 is a source code listing of a program used for creating a virtual world database according to the present invention;
Appendix 2 is a text description of the operation of the operation of the program entitled “Starch” listed in appendix 1;
Appendix 3 is a text description of the operation of the program entitled “Wringer” listed in Appendix 1; and
Appendix 4 is a text description of the overall steps used to create a virtual world according to the present invention.
1. Project Description
The Matis database conversion project enables the use of the Matis kitchen database in a virtual reality environment. To accomplish this, the Matis kitchen files are converted into the Isaac file format via RB2Swivel.
This conversion process has several steps. First, the Matis product files are edited, using the STARCH editor. The added editing information is stored in a GROUPING file which can be reloaded into the editor. Once the editing is complete, the product is converted into an RB2Swivel Script file. Once the products needed to construct a kitchen are in dm RB2Swivel format, the WRINGER program builds an RB2Swivel Script file containing the information necessary to make a virtual world. The RB2Swivel worlds are then loaded into Body Electric, along with the Body Electric Data Messagers (DMs) necessary to animate the word.
2. The STARCH Editor
This program runs on the SGI and enables the user to convert Matis product data into the GROUPING file data format. The final output format of the editor is RB2Swivel Script files. The GROUPING data file contains all the information necessary to edit a product from its last saved state. This information can also be used to speed the editing of similar products. Once editing is completed, the grouped Matis product data is converted temporarily to the SOAP data format. It is then converted to a Swivel Script file. There is one Swivel script file per product.
The editor provides file tools necessary for the grouping of matis graphic primitives into polygons or sweeps. Additional information such as constraints, thickness, and color can then be added.
2.1 Product Selection
The user needs to select which product to edit. This is accomplished by entering either the product number or name, or by cycling through the list of products of a kitchen as contained in the Matis planfile.
There is one GROUPING file per product. If a product which has already been edited is reselected for editing, the user is asked to confirm his intentions.
2.2 Default Parameter Addition
When a product is initially selected for conversion editing, default values for color, grouping, constraints, and thickness are added whenever possible.
Grouping defaults are a non-trivial problem. Currently, grouping is accomplish interactively. Future project phases may automate this process.
On completion of the grouping of graphic primitives into a part, a part name can be supplied by the user, or default to a predetermined value in order to establish constraint and thickness defaults.
Color, Thickness, and Constraint defaults are determined upon entry of a part name, such as door.
2.3 Product Editing
The grouping view also supports hierarchy editing. It displays an indented notation tree structure which specifies the Swivel linking constraints of the parts. The default relationship of the parts is a flat tree structure where every part is a child of the root (the product).
COLOR VIEW
This view displays the RGB color value of the current part.
The four functions which the editor must provide are the ability to group Matis graphic primitives and subprimitives into parts, edit product color information, determine physical constraints, and add part thickness. This is accomplished in a one screen editing environment consisting of 8 views:
MATIS GRAPHIC VIEW
This view displays the original Matis data as a 3-D rotatable wireframe object. This view is used for selection and feedback, but is not modifiable, except for the addition of user polygons and constraint origins.
MATIS TEXT VIEW
All of the graphic primitives which compose the product are displayed in this vie in a text list format. The association of text to graphics is accomplished through the use of color and highlighting. Primitives which can be subdivided into subprimitives have menu entries representing rite subprimitives.
Grouping Process
One or more primitives and subprimitives are selected. They are then grouped using the appropriate grouping menu item, at which time a part name can be supplied. This name then appears in the Grouping text view. When the one or more primitives and subprimitives are grouped, either a polygon or a wireframe part is generated as the result. If the definition of the polygon is not planar, it will be grouped as a sweep polygon automatically. A sweep polygon is defined by two sets of lines and arcs, each element in one set is parallel to a mirror image element in the other set, and the sets are connected by a single edge describing the thickness. Sweeps may also be created implicitly, as part of a thickened polygon.
Two objects in a virtual reality world may be assigned as connected hierarchically. The hierarchy is created by selecting an object and designating it as a child object of another object.
Objects additionally can be assigned as rotatable about a portion of another object. This is necessary only if the part is unconstrained in some way. For instance, a door needs to rotate about one of its edges. To define a rotational constraint of motion for an objects, the edge about which an object will rotate is selected. The origin will be set to the center of the edge if a line segment is selected, or the origin will be set to the center point of the defining endcap of a column if a column is selected. For example, to allow a faucet arm to swing side to side, an origin must be specified, and then the minimum and maximum constraint values must be set. Once an object or a grouped object has been designated as rotatable about an origin, a change in an angle of rotation will cause the selected object to rotate about the origin by the specified amount.
GROUPING TEXT VIEW
This view contains a list of the part names of the currently grouped parts. When one of the names is selected, the primitives which compose the part will become selected.
THICKNESS VIEW
This view consists of edited text items which enable thickness to be added to the currently selected part. The editable items are height and height type. The height is the measurement by which to thicken the selected part in the direction of its normal vector. The height type specifies whether the thickness is added to the positive direction, negative direction, or equally distributed.
CONSTRAINTS VIEW
This view displays positional and rotational constraints of the currently selected part. It displays the current, minimum, and maximum constraint values, as well as lock status.
CONVERSION (SOAP) VIEW
This view displays the most recently convened state of the product. The product is displayed in shaded, polygonal format.
COLOR GRID VIEW
This view displays a color grid from which to interactively specify a grouping's color. This view only appears in Soap Edit mode, as described in the Starch User's Manual, Section 4.4, and replaces the Matis Graphic View.
3. The WRINGER World Constructor
This module constructs a kitchen as determined by the Matis index and plan files. Its one interaction with the user is to select a particular kitchen to build. A master Swivel script file is output by this module and is ported to the Macintosh, and loaded into RB2Swivel.
3.1 Kitchen Selection
The user can input the index file entry number or the managing number as a command line argument when running the module. Wall, floor, and ceiling colors may also be specified by creating a “wringer.color” file. See the Wringer User's Manual for more details.
3.2 Making a World
The plan file referenced by the index fie entry is loaded.
A new RB2Swivel script file is then written. As each wall is created, its products are located upon it as specified by the plan file. The file includes a head and hand, and initial world orientation information.
4. Body Electric Interaction
DMs are defined for each type of movement that might be needed. They are then loaded by BE by indexing off the key part names in each product. This loading process occurs automatically when a world is loaded into BE.
Lanier, Jaron Z., Browning, Dan D., Joffe, Ethan D.
Patent | Priority | Assignee | Title |
Patent | Priority | Assignee | Title |
4463380, | Sep 25 1981 | Lockheed Martin Corp | Image processing system |
4645459, | Jul 30 1982 | THESEUS RESEARCH, INC | Computer generated synthesized imagery |
4807158, | Sep 30 1986 | IVEX CORPORATION, 4357 J PARK DRIVE, NORCROSS, GA 30093, A DE CORP | Method and apparatus for sampling images to simulate movement within a multidimensional space |
4952922, | Jul 18 1985 | Hughes Aircraft Company | Predictive look ahead memory management for computer image generation in simulators |
5021976, | Nov 14 1988 | Microelectronics and Computer Technology Corporation | Method and system for generating dynamic, interactive visual representations of information structures within a computer |
5159687, | Nov 14 1989 | KASE SYSTEMS, INC , A CORP OF GA | Method and apparatus for generating program code files |
5237647, | Sep 15 1989 | Massachusetts Institute of Technology | Computer aided drawing in three dimensions |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Sep 23 1998 | Sun Microsystems, Inc. | (assignment on the face of the patent) | / |
Date | Maintenance Fee Events |
Date | Maintenance Schedule |
Mar 31 2012 | 4 years fee payment window open |
Oct 01 2012 | 6 months grace period start (w surcharge) |
Mar 31 2013 | patent expiry (for year 4) |
Mar 31 2015 | 2 years to revive unintentionally abandoned end. (for year 4) |
Mar 31 2016 | 8 years fee payment window open |
Oct 01 2016 | 6 months grace period start (w surcharge) |
Mar 31 2017 | patent expiry (for year 8) |
Mar 31 2019 | 2 years to revive unintentionally abandoned end. (for year 8) |
Mar 31 2020 | 12 years fee payment window open |
Oct 01 2020 | 6 months grace period start (w surcharge) |
Mar 31 2021 | patent expiry (for year 12) |
Mar 31 2023 | 2 years to revive unintentionally abandoned end. (for year 12) |