A target tracking method includes receiving an initial video of a number of targets to be tracked acquired by a first mobile camera device, identifying the number of targets to be tracked in the initial video, tracking the plurality of targets to be tracked, and determining whether all of the targets to be tracked are within a tracking range of the first mobile camera device. If at least one target to be tracked is not within the tracking range of the first mobile camera device, at least one second mobile camera device is controlled to track the at least one target to be tracked that is not within the tracking range of the first mobile camera device.
|
1. A target tracking method comprising:
receiving an initial video of a plurality of targets to be tracked acquired by a first mobile camera device;
identifying the plurality of targets to be tracked in the initial video;
tracking the plurality of targets to be tracked, and determining whether all of the plurality of targets to be tracked are within a tracking range of the first mobile camera device;
if at least one target to be tracked is not within the tracking range of the first mobile camera device, controlling at least one second mobile camera device to track the at least one target to be tracked that is not within the tracking range of the first mobile camera device; and
wherein when the at least one second mobile camera device does not receive an instruction to track at least one of the plurality of targets to be tracked, the at least one second mobile camera device maintains a preset distance from the first mobile camera device.
7. A computing device comprising:
a processor; and
a memory storing a plurality of instructions, which when executed by the processor, cause the processor to:
receive an initial video of a plurality of targets to be tracked acquired by a first mobile camera device;
identify the plurality of targets to be tracked in the initial video;
track the plurality of targets to be tracked, and determine whether all of the plurality of targets to be tracked are within a tracking range of the first mobile camera device;
if at least one target to be tracked is not within the tracking range of the first mobile camera device, control at least one second mobile camera device to track the at least one target to be tracked that is not within the tracking range of the first mobile camera device; and
wherein when the at least one second mobile camera device does not receive an instruction to track at least one of the plurality of targets to be tracked, the at least one second mobile camera device maintains a preset distance from the first mobile camera device.
13. A non-transitory storage medium having stored thereon instructions that, when executed by a processor of a computing device, causes the processor to perform a target tracking method, wherein the method comprises:
receiving an initial video of a plurality of targets to be tracked acquired by a first mobile camera device;
identifying the plurality of targets to be tracked in the initial video;
tracking the plurality of targets to be tracked, and determining whether all of the plurality of targets to be tracked are within a tracking range of the first mobile camera device;
if at least one target to be tracked is not within the tracking range of the first mobile camera device, controlling at least one second mobile camera device to track the at least one target to be tracked that is not within the tracking range of the first mobile camera device; and
wherein when the at least one second mobile camera device does not receive an instruction to track at least one of the plurality of targets to be tracked, the at least one second mobile camera device maintains a preset distance from the first mobile camera device.
2. The target tracking method of
identifying feature information of the plurality of targets to be tracked in the initial video;
receiving first tracking videos captured by the first mobile camera device at preset time intervals; and
searching for the feature information of the plurality of targets to be tracked in an image frame of the first tracking videos to determine whether all of the plurality of targets to be tracked are within the tracking range of the first mobile camera device.
3. The target tracking method of
sending the feature information of the at least one target to be tracked that is not within the tracking range of the first mobile camera device to the at least one second mobile camera device to track the at least one target to be tracked.
4. The target tracking method of
sending a movement direction of the at least one target to be tracked to the at least one second mobile camera device; wherein the movement direction is a direction of movement of the at least one target to be tracked relative to the first mobile camera device centered on an orientation of the first mobile camera device.
5. The target tracking method of
obtaining a second tracking video acquired by the at least one second mobile camera device flying in accordance with the movement direction of the at least one target to be tracked;
identifying feature information in an image frame of the second tracking video acquired by the at least one second mobile camera device, and comparing the feature information of the second tracking video received from the at least one second mobile camera device to the feature information of the at least one target to be tracked received from the first mobile camera device;
if the feature information of the second tracking video received from the at least one second mobile camera device is the same as the feature information of the at least one target to be tracked received from the first mobile camera device, controlling the at least one second mobile camera device to continuously acquire the second tracking video of the at least one target to be tracked every preset time interval; and
if the feature information of the second tracking video received from the at least one second mobile camera device is not the same as the feature information of the at least one target to be tracked received from the first mobile camera device, searching for the feature information of the at least one target to be tracked in videos acquired by other second mobile camera devices.
6. The target tracking method of
a flying speed of the first mobile camera device is equal to an average speed of the plurality of targets to be tracked.
8. The computing device of
identifying feature information of the plurality of targets to be tracked in the initial video;
receiving first tracking videos captured by the first mobile camera device at preset time intervals; and
searching for the feature information of the plurality of targets to be tracked in an image frame of the first tracking videos to determine whether all of the plurality of targets to be tracked are within the tracking range of the first mobile camera device.
9. The computing device of
sending the feature information of the at least one target to be tracked that is not within the tracking range of the first mobile camera device to the at least one second mobile camera device to track the at least one target to be tracked.
10. The computing device of
sending a movement direction of the at least one target to be tracked to the at least one second mobile camera device; wherein the movement direction is a direction of movement of the at least one target to be tracked relative to the first mobile camera device centered on an orientation of the first mobile camera device.
11. The computing device of
obtain a second tracking video acquired by the at least one second mobile camera device flying in accordance with the movement direction of the at least one target to be tracked;
identify feature information in an image frame of the second tracking video acquired by the at least one second mobile camera device, and compare the feature information of the second tracking video received from the at least one second mobile camera device to the feature information of the at least one target to be tracked received from the first mobile camera device;
if the feature information of the second tracking video received from the at least one second mobile camera device is the same as the feature information of the at least one target to be tracked received from the first mobile camera device, control the at least one second mobile camera device to continuously acquire the second tracking video of the at least one target to be tracked every preset time interval; and
if the feature information of the second tracking video received from the at least one second mobile camera device is not the same as the feature information of the at least one target to be tracked received from the first mobile camera device, search for the feature information of the at least one target to be tracked in videos acquired by other second mobile camera devices.
12. The computing device of
a flying speed of the first mobile camera device is equal to an average speed of the plurality of targets to be tracked.
14. The non-transitory storage medium of
identifying feature information of the plurality of targets to be tracked in the initial video;
receiving first tracking videos captured by the first mobile camera device at preset time intervals; and
searching for the feature information of the plurality of targets to be tracked in an image frame of the first tracking videos to determine whether all of the plurality of targets to be tracked are within the tracking range of the first mobile camera device.
15. The non-transitory storage medium of
sending the feature information of the at least one target to be tracked that is not within the tracking range of the first mobile camera device to the at least one second mobile camera device to track the at least one target to be tracked.
16. The non-transitory storage medium of
sending a movement direction of the at least one target to be tracked to the at least one second mobile camera device; wherein the movement direction is a direction of movement of the at least one target to be tracked relative to the first mobile camera device centered on an orientation of the first mobile camera device.
17. The non-transitory storage medium of
obtaining a second tracking video acquired by the at least one second mobile camera device flying in accordance with the movement direction of the at least one target to be tracked;
identifying feature information in an image frame of the second tracking video acquired by the at least one second mobile camera device, and comparing the feature information of the second tracking video received from the at least one second mobile camera device to the feature information of the at least one target to be tracked received from the first mobile camera device;
if the feature information of the second tracking video received from the at least one second mobile camera device is the same as the feature information of the at least one target to be tracked received from the first mobile camera device, controlling the at least one second mobile camera device to continuously acquire the second tracking video of the at least one target to be tracked every preset time interval; and
if the feature information of the second tracking video received from the at least one second mobile camera device is not the same as the feature information of the at least one target to be tracked received from the first mobile camera device, searching for the feature information of the at least one target to be tracked in videos acquired by other second mobile camera devices.
18. The non-transitory storage medium of
a flying speed of the first mobile camera device is equal to an average speed of the plurality of targets to be tracked.
|
|||||||||||||||||||||||||
The subject matter herein generally relates to target tracking methods, and more particularly to a target tracking method for tracking a plurality of targets.
In the existing drone tracking methods, a drone can only track one target at a time. When a large number of drones are needed to track a plurality of targets, mutual interference or collision accidents may occur with the drones. Thus, a method for tracking a plurality of targets is desired.
Implementations of the present disclosure will now be described, by way of embodiments, with reference to the attached figures.
It will be appreciated that for simplicity and clarity of illustration, where appropriate, reference numerals have been repeated among the different figures to indicate corresponding or analogous elements. Additionally, numerous specific details are set forth in order to provide a thorough understanding of the embodiments described herein. However, it will be understood by those of ordinary skill in the art that the embodiments described herein can be practiced without these specific details. In other instances, methods, procedures and components have not been described in detail so as not to obscure the related relevant feature being described. The drawings are not necessarily to scale and the proportions of certain parts may be exaggerated to better illustrate details and features. The description is not to be considered as limiting the scope of the embodiments described herein.
Several definitions that apply throughout this disclosure will now be presented.
The term “comprising” means “including, but not necessarily limited to”; it specifically indicates open-ended inclusion or membership in a so-described combination, group, series and the like.
In general, the word “module” as used hereinafter refers to logic embodied in hardware or firmware, or to a collection of software instructions, written in a programming language such as, for example, Java, C, or assembly. One or more software instructions in the modules may be embedded in firmware such as in an erasable-programmable read-only memory (EPROM). It will be appreciated that the modules may comprise connected logic units, such as gates and flip-flops, and may comprise programmable units, such as programmable gate arrays or processors. The modules described herein may be implemented as either software and/or hardware modules and may be stored in any type of computer-readable medium or other computer storage device.
The target tracking method is applied to a computing device 1 which establishes a communication connection with at least two mobile camera devices 2 through a network. The computing device 1 can receive a video collected by a first mobile camera device, identify targets to be tracked in the video, and determine whether to control at least one second mobile camera device to track at least one target that is no longer in a tracking range of the first mobile camera device. The mobile camera devices 2 are capable of moving and tracking a target to be tracked. The network may be a wireless network, such as radio, wireless fidelity (WIFI), cellular, satellite, broadcast, and the like.
The computing device 1 may be an electronic device, such as a personal computer, a server, or the like in which target tracking software is installed. The server may be a single server, a server cluster, or a cloud server.
In another embodiment, the target tracking method may be directly applied to the first mobile camera device, that is, the first mobile camera device implements the functions of collecting a video, identifying targets to be tracked in the video, and determining whether to control the at least one second mobile camera device to track at least one target that is no longer in the tracking range of the first mobile camera device. For example, the first mobile camera device in which the target tracking software is installed establishes a communication connection with the at least one second mobile camera device through a wireless network. The first mobile camera device is used to track multiple targets. When at least one target is no longer in the tracking range of the first mobile camera device, the first mobile camera device sends feature information of the at least one target to the at least one second mobile camera device. The feature information of the at least one target is then tracked by the at least one second mobile camera device.
The mobile camera device 2 may be an unmanned aerial vehicle having a function of flying and tracking, or an electronic device such as a camera or a monitor having a function of moving and tracking.
Block S1: An initial video of a plurality of targets to be tracked acquired by the first mobile camera device is received.
In one embodiment, the computing device 1 receives the initial video of the plurality of targets to be tracked collected by the first mobile camera device, and the initial video may be transmitted through a fifth-generation mobile communication technology or a WIFI network.
For example, at a starting point of a marathon, the first mobile camera device is located above the starting point and captures an initial video of multiple runners at the starting point, and sends the initial video of the multiple runners to the computing device 1.
Block S2: The plurality of targets to be tracked in the initial video is identified.
The computing device 1 identifies the plurality of targets to be tracked in the initial video according to an image recognition method. For example, in a marathon, the computing device 1 receives an initial video from a starting point of the marathon and identifies feature information of different runners in the initial video. The feature information can be number tags of the runners in the initial video. In another example, in a race car competition, the computing device 1 receives an initial video from a starting point and identifies feature information of different race cars in the initial video. The feature information includes one or more types of information such as a license plate, color, and text of the race car.
Block S3: The plurality of targets to be tracked is tracked, and whether all of the plurality of targets to be tracked are within a tracking range of the first mobile camera device is determined.
In one embodiment, a method of tracking the plurality of targets to be tracked and determining whether all of the plurality of targets to be tracked are within the tracking range of the first mobile camera device may include the following:
Receiving first tracking videos captured by the first mobile camera device at preset time intervals, and searching for feature information of the plurality of targets to be tracked in an image frame of the first tracking videos to determine whether all of the plurality of targets to be tracked are within the tracking range of the first mobile camera device. In one embodiment, a flying/moving speed of the first mobile camera device is equal to an average speed of the plurality of targets to be tracked.
For example, the computing device 1 receives an initial video from the first mobile camera device from a starting position of a marathon, identifies number tags of runners in the initial video, receives first tracking videos from the first mobile camera device at preset time intervals, and searches for the number tags of all of the runners in an image frame of the first tracking videos to determine whether all of the runners to be tracked are within the tracking range of the first mobile camera device. In order to track the most targets in the first tracking videos, a flying speed of the first mobile camera device is equal to an average speed of the runners to be tracked.
Block S4: If at least one target to be tracked is no longer found in the first tracking videos, the at least one target to be tracked is determined to be not within the tracking range of the first mobile camera device, and the at least one second mobile camera device is controlled to track the at least one target to be tracked that is not within the tracking range of the first mobile camera device.
In one embodiment, the computing device 1 sends the feature information of the at least one target to be tracked that is no longer within the tracking range of the first mobile camera device to the at least one second mobile camera device to track the at least one target to be tracked that is no longer within the tracking range of the first mobile camera device.
In another embodiment, the computing device 1 further sends a movement direction of the at least one target to be tracked to the at least one second mobile camera device. The movement direction is a direction of movement of the at least one target to be tracked relative to the first mobile camera device centered on an orientation of the first mobile camera device. If the at least one second mobile camera device does not obtain an instruction to track a target to be tracked, the at least one second mobile camera device maintains a preset distance from the first mobile camera device.
In another embodiment, when the at least one second mobile camera device is controlled to track the at least one target to be tracked that is no longer within the tracking range of the first mobile camera device, the method further includes:
Sending a second tracking video acquired by the at least one second mobile camera device to the computing device 1, and determining according to the second tracking video whether a target in the second tracking video is the same as the at least one target to be tracked that is not within the tracking range of the first mobile camera device.
For example, the computing device 1 receives the second tracking video acquired by the at least one second mobile camera device flying in accordance with the movement direction of the at least one target to be tracked, identifies feature information in an image frame of the second tracking video, and compares the feature information of the second tracking video received from the at least one second mobile camera device to the feature information of the at least one target to be tracked received from the first mobile camera device. If the feature information of the second tracking video received from the at least one second mobile camera device is the same as the feature information of the at least one target to be tracked received from the first mobile camera device, the at least one second mobile camera device is controlled to continue to acquire the second tracking videos of the at least one target to be tracked in real time. If the feature information of the second tracking video received from the at least one second mobile camera device is not the same as the feature information of the at least one target to be tracked received from the first mobile camera device, the feature information of the at least one target to be tracked received from the first mobile camera device is searched in videos acquired by other second mobile camera devices in communication with the first mobile camera device.
For example, the computing device 1 determines that a first runner with number tag 5 and a second runner with number tag 65 are not within the tracking range of the first mobile camera device. Feature information and movement directions of the first and second runners are sent to a second mobile camera device 001 and a second mobile camera device 002, respectively. The feature information includes at least one of the number tag, appearance, and clothing characteristics of the runner. The movement direction of the first runner is 35° in front to the right of the first mobile camera device, and the movement direction of the second runner is 30° behind to the left of the first mobile camera device.
An example of a method of tracking the first runner by the second mobile camera device 001 is described.
The second mobile camera device 001 obtains the movement direction of the first runner and flies in accordance with the movement direction, acquires a second tracking video of the first runner during flight, and sends the acquired second tracking video to the computing device 1. The computing device 1 searches for the feature information of the first runner in an image frame of the second tracking video. If the second tracking video contains the feature information of the first runner, the computing device 1 sends an instruction to the second mobile camera device 001 to continuously track the first runner at every preset time interval. If the computing device 1 does not find the feature information of the first runner in the second tracking video within a preset time, the computing device 1 searches for the feature information of the first runner in videos acquired by other second mobile camera devices. If the feature information of the first runner is still not found, a prompt is sent by SMS, instant messaging, phone, email, or the like.
A method of tracking the second runner by the second mobile camera device 002 is the same as described above, and will not be discussed further.
The receiving module 101 is configured to receive the initial video of the plurality of targets to be tracked acquired by the first mobile camera device. Functions of the receiving module 101 are described in block S1, and will not be discussed further.
The tracking module 102 is configured to identify the plurality of targets to be tracked in the initial video. Functions of the tracking module 102 are described in block S2, and will not be discussed further.
The determination module 103 is configured to determine whether all of the plurality of targets to be tracked are within the tracking range of the first mobile camera device. Functions of the determination module 103 are described in block S3, and will not be discussed further.
The execution module 104 is configured to determine that at least one target to be tracked is not within the tracking range of the first mobile camera device if the at least one target to be tracked is no longer found in the first tracking videos, and control the at least one second mobile camera device to track the at least one target to be tracked that is not within the tracking range of the first mobile camera device. Functions of the execution module 104 are described in block S4, and will not be discussed further.
Those skilled in the art should understand that the schematic diagram of the computing device 1 does not constitute a limitation of the computing device 1. The computing device 1 may include more or fewer components than shown, or may combine some components. For example, the computing device 1 may further include an input-output device, a network access device, a bus, and the like.
The processor 30 may be a central processing unit (CPU), or may be other general-purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), a Field-Programmable Gate Array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor, or the processor 30 may be any conventional processor, etc. The processor 30 is a control center of the computing device 1 and uses various interfaces and lines to connect various parts of the computing device 1.
The memory 20 may be configured to store the computer program 40, and the processor 30 may execute the computer program 40. The data in the memory 20 may realize various functions of the computing device 1. The memory 20 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, at least one application required by a function (such as a sound playback function, an image playback function, etc.). The storage data area may store data (such as audio data) and the like created according to the use of the computing device 1. In addition, the memory 20 may include a high-speed random access memory, and may also include a non-volatile memory, such as a hard disk, an internal memory, a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, flash card, at least one disk storage device, flash memory device, or other non-volatile solid-state storage device.
The embodiments shown and described above are only examples. Even though numerous characteristics and advantages of the present technology have been set forth in the foregoing description, together with details of the structure and function of the present disclosure, the disclosure is illustrative only, and changes may be made in the detail, including in matters of shape, size and arrangement of the parts within the principles of the present disclosure up to, and including, the full extent established by the broad general meaning of the terms used in the claims.
| Patent | Priority | Assignee | Title |
| Patent | Priority | Assignee | Title |
| 10055853, | Aug 07 2017 | STANDARD COGNITION, CORP | Subject identification and tracking using image recognition |
| 10354407, | Mar 15 2013 | LABLANS, PETER, MR | Camera for locating hidden objects |
| 10798302, | Dec 25 2017 | GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD. | Method of capturing based on usage status of electronic device and related products |
| 8063945, | Mar 07 2007 | Casio Computer Co., Ltd. | Camera apparatus, which controls a displacement and size of a frame region in a captured subject image, recording medium in which a camera apparatus control program is recorded, and method for controlling the camera apparatus |
| 9785147, | Aug 13 2014 | DRAGANFLY INNOVATIONS INC | Pixel based image tracking system for unmanned aerial vehicle (UAV) action camera system |
| 9967470, | May 15 2014 | ZOPTIC, LLC | Automated camera tracking system for tracking objects |
| 20050063566, | |||
| 20070035627, | |||
| 20070039030, | |||
| 20110249101, | |||
| 20120249802, | |||
| 20160189391, | |||
| 20170019574, | |||
| 20170180636, | |||
| 20170330346, | |||
| 20180362185, | |||
| 20200013181, | |||
| 20200336722, | |||
| 20210044756, | |||
| CA2723983, | |||
| CA3011476, | |||
| CN104581083, | |||
| CN109960145, | |||
| CN109996039, | |||
| CN110166600, | |||
| JP2005012556, | |||
| WO2011004681, | |||
| WO2006089776, | |||
| WO2011004681, | |||
| WO2017008422, | |||
| WO2020085524, |
| Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
| Jul 20 2020 | LI, NIEN-CHE | HON HAI PRECISION INDUSTRY CO , LTD | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 053279 | /0353 | |
| Jul 22 2020 | Hon Hai Precision Industry Co., Ltd. | (assignment on the face of the patent) | / |
| Date | Maintenance Fee Events |
| Jul 22 2020 | BIG: Entity status set to Undiscounted (note the period is included in the code). |
| Date | Maintenance Schedule |
| Jul 05 2025 | 4 years fee payment window open |
| Jan 05 2026 | 6 months grace period start (w surcharge) |
| Jul 05 2026 | patent expiry (for year 4) |
| Jul 05 2028 | 2 years to revive unintentionally abandoned end. (for year 4) |
| Jul 05 2029 | 8 years fee payment window open |
| Jan 05 2030 | 6 months grace period start (w surcharge) |
| Jul 05 2030 | patent expiry (for year 8) |
| Jul 05 2032 | 2 years to revive unintentionally abandoned end. (for year 8) |
| Jul 05 2033 | 12 years fee payment window open |
| Jan 05 2034 | 6 months grace period start (w surcharge) |
| Jul 05 2034 | patent expiry (for year 12) |
| Jul 05 2036 | 2 years to revive unintentionally abandoned end. (for year 12) |