A system and method for autonomously transporting and delivering one or more commodities from drop-off point to recipient preferred environment, is disclosed. The system is configured to analyze an authorized person's voice command or request and executes the request. The system provides at least two modes of operation to deliver the commodities comprising mapped location delivery mode and human following delivery mode. The system is configured to analyze the command and extract the delivery location. The system is further configured to identify the location of the point of the interest based on object detection system and environment understanding system, to deliver the commodities. At human following delivery mode, the ADV follows the recipient and saves the location or path data once the preferred environment is located. At mapped location delivery mode, ADV maneuvers itself to the destination location by retrieving information on recipient's previous history of delivering commodities.
|
7. A method for autonomously transporting one or more commodities from a drop-off point to recipient preferred environment via an autonomous vehicle, comprising:
when a first request containing a destination is received, controlling the autonomous vehicle to deliver the one or more commodities from the drop-off point to the destination;
determining whether an authentication data is input by a recipient who locates at about the destination for receiving the one or more commodities;
authenticating the recipient when the authentication data is received;
determining whether a second request from the recipient is received when the recipient is authenticated successfully, the second request comprising a command to follow the recipient to a location and a command to a specific location;
when the command to follow the recipient is received, controlling the autonomous vehicle to follow the recipient to deliver the one or more commodities from the destination to a delivery location, the delivery location is a specific location in the destination; or
when the command to a specific location in the destination, controlling the autonomous vehicle to deliver the one or more commodities from the destination to the specific location along a stored path data or a planning path data based on stored map data, and environment data detected by sensors disposed at the autonomous vehicle.
14. An autonomous vehicle, for autonomously transporting one or more commodities from a drop-off point to recipient preferred environment, comprising:
a plurality of sensors, and
a computer device, communicated with the plurality of the sensors, comprising:
a storage configured to storage programs; and
a processor configured to execute the programs to perform a method of autonomously transporting one or more commodities from a drop-off point to recipient preferred environment, the method comprising:
when a first request containing a destination is received, controlling the autonomous vehicle to deliver the one or more commodities from the drop-off point to the destination;
determining whether an authentication data is input by a recipient who locates at about the destination for receiving the one or more commodities;
authenticating the recipient when the authentication data is received; and
determining whether a second request from the recipient is received when the recipient is authenticated successfully, the second request comprising a command to follow the recipient to a location and a command to a specific location;
when the command to follow the recipient is received, controlling the autonomous vehicle to enter into a human following deliver mode that the autonomous vehicle follows the recipient to deliver the one or more commodities from the destination to a delivery location, the delivery location is a specific location in the destination; or
when the command to a specific location in the destination, controlling the autonomous vehicle to enter into a mapped location deliver mode that the autonomous vehicle delivers the one or more commodities from the destination to the specific location along a stored path data or a planning path data based on stored map data, and environment data detected by sensors disposed at the autonomous vehicle.
1. A system for autonomously transporting one or more commodities from a drop-off point to recipient preferred environment, comprising:
an autonomous vehicle comprising a computing device including means for executing artificial intelligence device (AI) software and map data;
an inertial measurement unit (IMU) sensor configured to generate IMU data;
a sensor assembly in communication with the computing device comprising one or more sensors configured to collect environmental data around the autonomous vehicle;
an input assembly in communication with the computing device configured to receive input from the recipient,
wherein the computing device comprises a processor and a memory unit, wherein the memory unit stores a set of program modules, wherein the processor in communication with the memory unit, configured to execute the set of program modules, wherein the set of program modules comprise:
a control module,
a motion planning module operatively connected to the control module to manipulate a movement of the autonomous delivery vehicle,
an obstacle detection module operatively connected to the control module comprising one or more sensors configured to collect environmental data of at least a portion of an environment around the autonomous delivery vehicle to detect one or more obstacles located therein,
a face authorization module operatively to the control module configured to receive authentication data from the recipient,
a human detection module operatively connected to the control module and one or more camera,
a human interface module configured to detect a request provided by the recipient on authentication of recipient data,
a human tracking module configured to track the recipient to obtain a trajectory of the recipient, and
a point of interest generator module,
wherein when an another request containing a destination is received at or before the drop off point, controlling the autonomous vehicle to deliver the one or more commodities from the drop-off point to the destination;
wherein when the request provided is a command to follow the recipient to a location, the control module and the motion planning module are configured to manipulate the autonomous delivery vehicle to follow the recipient to deliver the commodities using a path data generated by the control module and the motion planning module base on the trajectory of the recipient, the map data, and the IMU data, and the point of interest generator module is configured to store the path data used to follow the recipient, and
wherein when the request provided is a specific location to deliver the commodities and when a path data of the specific location is stored in the memory, the control module and the motion planning module are configured to manipulate the autonomous delivery vehicle to reach the location provided by the recipient utilizing the stored path data.
2. The system of
3. The system of
4. The system of
5. The system of
6. The system of
8. The method of
storing a path following the recipient from the destination to the delivery location, and the planning path.
9. The method of
generating the planning path data base on a trajectory of the recipient, stored map data, and environment data detected by sensors disposed on the autonomous vehicle; and
delivering the one or more commodities from the destination to a delivery location using the planning path data.
10. The method of
providing an interface displayed on the autonomous vehicle to enable the recipient to input the authentication.
12. The method of
when the second request is the command to specific location, searching a storage for a path from the destination to the specific location; and
when the path from the destination to specific location does not exist in the storage, planning a path from the destination to specific location based on the map data and environment data detected by sensors disposed at the autonomous vehicle.
13. The method of
when the path from the destination to specific location exists in the storage, setting the existed path from the destination to specific location as the stored path.
15. The autonomous vehicle of
storing a path following the recipient from the destination to the delivery location, and the planning path.
16. The autonomous vehicle of
generating the planning path data base on a trajectory of the recipient, stored map data, and environment data detected by sensors disposed on the autonomous vehicle; and
delivering the one or more commodities from the destination to a delivery location using the planning path data.
17. The autonomous vehicle of
providing an interface displayed on the autonomous vehicle to enable the recipient to input the authentication.
18. The autonomous vehicle of
19. The autonomous vehicle of
when the second request is the command to specific location, searching a storage for a path from the destination to the specific location; and
when the path from the destination to specific location does not exist in the storage, planning a path from the destination to specific location based on the map data and environment data detected by sensors disposed at the autonomous vehicle.
20. The autonomous vehicle of
when the path from the destination to the specific location exists in the storage, setting the existed path from the destination to specific location as the stored path.
|
|||||||||||||||||||||||||||||
The present disclosure generally relates to an autonomous vehicle. More specifically, the present invention relates to a system and method for autonomously transporting and delivering one or more commodities to recipient's preferred environment using autonomous delivery vehicle (ADV).
The level of interest around autonomous delivery vehicle (ADV) has increased dramatically, as it provides a cost-effective solution for businesses involving home delivery services. However, there is still much research and development required on ADV to solve the problem of delivering commodities such as, food, groceries or any items, to reach remote areas. Still, it does not alleviate the problem concerned with the final stage or point of delivery. Because, some recipient's preferred location for the ADV could not be usually accessible due to some facts, for instance, a detailed 3D HD maps incorporated for directing or navigating ADVs are not available for set delivery point inside a building. Henceforth, the recipient needs to manually carry the commodity regardless of its length, weight or bulkiness, from the ADV to their preferred location, e.g., kitchen, storage room of the house or apartment. The final few meters (for example, final 100 meters) of transporting and delivering the commodities is a cumbersome task, particularly when the commodities are heavy in weight, breakable, hot or in awkward shape.
Existing ADVs are not intelligent enough to function as an interactive assistant to the recipient to aid in transport and delivery of commodities to the last few meters from the drop off location. Further, existing ADVs faces difficulty to traverse final 100 meters of the delivery point, because the area around the set delivery point is not accessible, or non-availability of maps to the preferred location. In addition, the ADV has not been there before, or in other words, lacks information or history of delivering commodities to the particular location.
Certain autonomous system has been designed to address the problem of transportation of objects in different day-to-day situations. US20150229906A1 of Luis Carlos Inacio De Matos et al discloses an autonomous system for tracking an individual. The system is adapted to follow a given person and has application in retail areas or any other area that benefits from object carrying technologies that make use of image recognition and artificial intelligence. Above-mentioned prior art autonomous system merely designed to follow individual's instructions, however, said system lacks in receiving an environmental information or an interactive assistant from the recipient.
Henceforth, there is a need for an efficient system and method for autonomously transporting and delivering commodities or goods from drop off point to recipient's preferred environment or location using autonomous delivery vehicle (ADV). The system is also required to enable the recipient to interact with the ADV regarding preferred location to autonomously deliver the commodities or goods. Further, the system is required to retrieve information on their previous history of delivering commodities to execute recipient's preferred delivery of the commodities.
A system and method for autonomously transporting and delivering commodities or goods from drop off point to a recipient's preferred environment or location using autonomous delivery vehicle (ADV) is disclosed. The system and method according to the present invention, aids in transporting and delivering commodities to the last few meters (for example, final 100 meters) from the drop off location. The commodities could be any items, but not limited to particular items such as, food, grocery, electronic goods or any heavy items. The autonomous delivery vehicle of the system is adapted to maneuver at any preferred environment or structure such as home, private environments, apartments, businesses and schools. The system is further configured to analyze an authorized person's voice command or request and executes the request.
According to the present invention, the system comprises an autonomous delivery vehicle (ADV) in communication with a cloud server. The ADV comprises a computing device including a processor for executing artificial intelligence (AI) software and a memory unit. The ADV further comprises a sensor assembly in communication with the computing device comprising one or more sensors, is configured to collect environmental data around the autonomous vehicle, and an input assembly in communication with the computing device configured to receive input from the recipient. The computing device comprises a processor and a memory unit, wherein the memory unit stores a set of program modules, wherein the processor in communication with the memory unit, configured to execute the set of program modules. In one embodiment, the set of program modules comprises a control module, and a motion planning module, a sensor module, a communication module, an authentication module, a human detection module, and a human interface module, operatively connected to the control module.
In an embodiment, the motion planning module is configured to manipulate a movement of the autonomous delivery vehicle. In one embodiment, the sensor module is configured to collect environmental data of at least a portion of an environment around the autonomous delivery vehicle. The ADV is configured to analyze the environmental data to detect one or more obstacles along the path of the advancing or moving ADV. In one embodiment, the authentication module is configured to receive authentication data to validate the recipient. In one embodiment, the human interface module is configured to receive a request provided by the recipient on authentication of recipient data. In some embodiments, the ADV further comprises map data for locating the position of ADV.
In one embodiment, if the recipient provides a request such as a location to deliver the commodities, a point of interest generator module is configured to identify a location, proximate to the location specified by the recipient, to deliver the commodities. The control and motion planning modules receive path data to maneuver the autonomous delivery vehicle to reach the location provided by the recipient.
For example, if the requested command is “follow me to kitchen”, the ADV is configured to follow the recipient to the delivery location. The control and motion planning modules receive path data to maneuver the autonomous delivery vehicle to follow the path of the recipient. In another embodiment, the ADV is configured to store the discovered path in the memory unit and enabled to use the same data, if the recipient requests a same location to deliver one or more commodities in future. For example, if the requested command is “deliver to kitchen”, the ADV utilizes the previously discovered path to deliver one or more commodities in the requested delivery location.
In one embodiment, a method to autonomously transport and deliver one or more commodities from drop-off point to recipient preferred environment, is disclosed. At one step, an autonomous vehicle comprising a computing device including means for executing artificial intelligence device (AI) software is provided. At another step, a sensor assembly in communication with the computing device comprising one or more sensors configured to collect environmental data around the autonomous vehicle is provided. At another step, an input assembly in communication with the computing device configured to receive input from the recipient is provided. The computing device comprises a processor and a memory unit, wherein the memory unit stores a set of program modules, wherein the processor in communication with the memory unit, configured to execute the set of program modules. The set of program modules comprises control module, motion planning module, an obstacle detection module, a face authorization module, a human detection module, a human interface module, a localization module, a scene segmentation module and a human detector module.
The motion planning module is configured to manipulate a movement of the autonomous delivery vehicle. The obstacle detection module is configured to collect environmental data of at least a portion of an environment around the ADV. The ADV is configured to analyze the environmental data to detect one or more obstacles along the path of the advancing ADV. The face authorization module is configured to receive authentication data from the recipient. The ADV is configured to detect a request provided by the recipient on authentication of recipient data.
At another step, the authentication data of the recipient is verified. At another step, a request from the recipient is received, at the autonomous delivery vehicle. If the request provided is a command to follow the recipient to kitchen, the ADV is configured to follow the recipient to the delivery location to deliver the commodities, and the control and the motion planning module manipulate the autonomous delivery vehicle to follow the recipient. The ADV is configured to store the discovered path in the memory unit and enabled to use the same data, if the recipient requests a same location to deliver one or more commodities in future. For example, if the requested command is “deliver to kitchen”, the ADV utilizes the previously discovered path to deliver one or more commodities in the requested delivery location
Other features and advantages will become apparent from the following description of the preferred embodiments, taken in conjunction with the accompanying drawings.
The embodiments herein will be better understood from the following detailed description with reference to the drawings, in which:
A description of embodiments of the present invention will now be given with reference to the Figures. It is expected that the present invention may be embodied in other specific forms without departing from its spirit or essential characteristics. The described embodiments are to be considered in all respects only as illustrative and not restrictive. The scope of the invention is, therefore, indicated by the appended claims rather than by the foregoing description. All changes that come within the meaning and range of equivalency of the claims are to be embraced within their scope.
In an embodiment, the computing device 112 is at least one of a general or special purpose computer. In an embodiment, it operates as a single computer, which could be a hardware and/or software server, a workstation, a mainframe, a supercomputer, a server farm, and so forth. In an embodiment, the wireless network 118 could be a global area network (GAN), such as an internet, a wide area network (WAN), a local area network (LAN), or any other type of network or combination of networks. The autonomous delivery vehicle 102 of the system is adapted to maneuver at any structure such as home, private environments, apartments, businesses, and schools. The system is further configured to analyze an authorized person's voice command or request and extract a delivery location. For instance, if the user issues a command to follow me to kitchen, the system is configured to follow the recipient to the delivery location, using map data and IMU data, to deliver the commodities at the kitchen.
In one embodiment, if the recipient provides a request such as a location to deliver the commodities, the ADV 102 is configured to identify a location specified by the recipient to deliver the commodities. The control and motion planning modules receive path data to manipulate the autonomous delivery vehicle 102 to reach the location provided by the recipient.
In one embodiment, if the recipient provides a request such as follow the recipient, the ADV 102 is configured to follow the recipient to the delivery location. The control and motion planning modules receive path data to manipulate the autonomous delivery vehicle 102 to follow the path of the recipient. In another embodiment, the ADV 102 is configured to store the discovered path in the memory unit and enabled to use the same data, if the recipient requests a same location to deliver one or more commodities in future.
During operation of the ADV 102, the ADV 102 arrives at the destination such as at a door of a house, structure or building, the recipient is enabled to authentic himself to the ADV 102 by providing authentication data via the touch screen 122, or face authentication using camera 106. In an embodiment, the ADV 102 employs various authentication means such as using One Time Password (OTP) data, biometric data, electronic cards, etc. On authentication of the recipient, the ADV 102 creates a vision recognition of the recipient. After authentication, the recipient is enabled to provide command or request to assist the recipient to deliver the commodities at the desired location. In one embodiment, the request could be provided via speech or other input means. If the recipients input a request to follow him, the ADV 102 is configured to follow the recipient. Here, the ADV 102 depends on the vision recognition to follow the recipient.
The recipient is enabled to provide a request via touch screen or microphone to the ADV 102 to deliver the commodities. In one embodiment, the system provides at least two options or modes to deliver the commodities to a desired location of the recipient, which comprises a human following delivery mode and a mapped location delivery mode. The term “human following delivery mode” is defined as the mode that enables ADV to follow the person or recipient instruction for delivering the commodities in desired location, wherein the location could be a mapped or unmapped location. The term “mapped location delivery mode” is defined as the mode that enables ADV to deliver the commodities in desired location by utilizing the previously discovered path or past delivery history (already mapped route) stored in the memory unit.
In one embodiment, the recipient is enabled to initiate any mode by simple voice commands. The input received from the recipient via the microphone 104 is sent to the natural language processing (NLP) unit 144. In one embodiment, the ADV 102 accepts request only after recipient authentication. The NLP unit 144 analyses an authorized person's voice command and provides mode selection signal to operation mode selector 146. Based on the voice command, the scene segmentation module 164, point of interest generator 166, target location arbitrator 168 determines the target location.
At human following delivery mode, the recipient is enabled to provide a request to follow to reach the desired location (for example, kitchen) of the recipient. The camera 106 detects the recipient via a human detection module 156. Further, the ADV 102 is configured to verify the face of the recipient using the face authorization module 158 and tracks the recipient during operation or movement of the ADV 102 via a human tracking module 162. The ADV 102 assumes the position of the authorized recipient as the target position and follows the recipient with the obstacle detection module 160, and planning and control module 148. In another embodiment, the ADV is configured to store the discovered path in the memory unit and enabled to use the same data, if the recipient requests a same location to deliver one or more commodities in future.
At mapped location delivery mode, the recipient is enabled to provide a location to deliver the commodities via speech, for example, deliver commodities or goods in kitchen. The obstacle detection planning and control module 148 actuates an actuator 150 to direct the ADV 102 to the target zone. The ADV utilizes the previously discovered path to deliver one or more commodities in the requested delivery location such as kitchen. Both point of mapped location delivery mode and human following delivery mode could be terminated by human voice commands, e.g. “stop here”.
At one step, an autonomous vehicle comprises a computing device with a means for executing artificial intelligence device (AI) software is provided. At another step, a sensor assembly in communication with the computing device comprising one or more sensors configured to collect environmental data around the autonomous vehicle is provided. At another step, an input assembly in communication with the computing device configured to receive input from the recipient is provided. The computing device comprises a processor and a memory unit, wherein the memory unit stores a set of program modules, wherein the processor in communication with the memory unit, configured to execute the set of program modules. The set of program modules comprises a control module, a motion planning module, an obstacle detection module, a face authorization module, a human detection module, a human interface module, a localization module, a scene segmentation module and a human detector module.
The motion planning module is configured to manipulate a movement of the autonomous delivery vehicle. The obstacle detection module is configured to collect environmental data of at least a portion of an environment around the ADV. The ADV is configured to analyze the environmental data to detect one or more obstacles along the path of the advancing or moving ADV. The face authorization module is configured to receive authentication data from the recipient. The ADV is configured to detect a request provided by the recipient on authentication of recipient data.
At another step, the authentication data of the recipient is verified. At another step, a request from the recipient is received, at the autonomous delivery vehicle. If the request provided is a command to follow the recipient, the ADV is configured to assume a location of the recipient as the location to deliver the commodities, and the control and the motion planning module manipulate the autonomous delivery vehicle to follow the recipient. If the request provided is a location to deliver the commodities, the control and motion planning module is configured to manipulate the autonomous delivery vehicle to reach the location provided by the recipient.
According to the present invention, the system and method assists in autonomously transporting and delivering commodities or goods from a drop off point to a recipient's preferred environment or location using autonomous delivery vehicle (ADV) 102. Further, the system aids in transporting and delivering commodities to the last few meters (for example, final 100 meters) from the drop off location. Further, the system is configured to retrieve information on their previous history of delivering commodities to execute recipient's preferred delivery of the commodities. The commodities could be any items, but not limited to particular items such as, food, grocery, electronic goods or any heavy items.
The foregoing description comprises illustrative embodiments of the present invention. Having thus described exemplary embodiments of the present invention, it should be noted by those skilled in the art that the within disclosures are exemplary only, and that various other alternatives, adaptations, and modifications may be made within the scope of the present invention. Merely listing or numbering the steps of a method in a certain order does not constitute any limitation on the order of the steps of that method. Many modifications and other embodiments of the invention will come to mind to one skilled in the art to which this invention pertains having the benefit of the teachings presented in the foregoing descriptions. Although specific terms may be employed herein, they are used only in generic and descriptive sense and not for purposes of limitation. Accordingly, the present invention is not limited to the specific embodiments illustrated herein.
| Patent | Priority | Assignee | Title |
| 11789452, | Jun 10 2019 | Method for controlling intelligent pallet |
| Patent | Priority | Assignee | Title |
| 6760647, | Jul 25 2000 | Axxon Robotics, LLC | Socially interactive autonomous robot |
| 7228203, | Mar 27 2004 | Vision Robotics Corporation | Autonomous personal service robot |
| 7818090, | Nov 18 2004 | Panasonic Corporation | Method of controlling movement of mobile robot |
| 8392065, | Sep 11 2008 | Deere & Company | Leader-follower semi-autonomous vehicle with operator on side |
| 20050216126, | |||
| 20080079383, | |||
| 20090024250, | |||
| 20150094879, |
| Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
| Jul 20 2018 | AUTOX, INC. | (assignment on the face of the patent) | / | |||
| Mar 18 2020 | XIAO, JIANXIONG | AUTOX, INC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 052240 | /0920 |
| Date | Maintenance Fee Events |
| Jul 20 2018 | BIG: Entity status set to Undiscounted (note the period is included in the code). |
| Aug 03 2018 | SMAL: Entity status set to Small. |
| Jul 12 2024 | M2551: Payment of Maintenance Fee, 4th Yr, Small Entity. |
| Date | Maintenance Schedule |
| Jan 12 2024 | 4 years fee payment window open |
| Jul 12 2024 | 6 months grace period start (w surcharge) |
| Jan 12 2025 | patent expiry (for year 4) |
| Jan 12 2027 | 2 years to revive unintentionally abandoned end. (for year 4) |
| Jan 12 2028 | 8 years fee payment window open |
| Jul 12 2028 | 6 months grace period start (w surcharge) |
| Jan 12 2029 | patent expiry (for year 8) |
| Jan 12 2031 | 2 years to revive unintentionally abandoned end. (for year 8) |
| Jan 12 2032 | 12 years fee payment window open |
| Jul 12 2032 | 6 months grace period start (w surcharge) |
| Jan 12 2033 | patent expiry (for year 12) |
| Jan 12 2035 | 2 years to revive unintentionally abandoned end. (for year 12) |