The present invention is a security monitoring system which effectively monitors a large number of areas in a cost effective manner using already existing communications infrastructure. More specifically, the method and apparatus of the present invention warns at least one security post of an undesired condition at a monitored area by sending a fax of an image of the monitored area via a phone line and/or by sending an E-mail of a color image via a global telecommunications network such as the Internet. Generally, the present invention includes a camera for creating a first image of the monitored area at a first time point and for creating a second image of the monitored area at a second time point. In addition, a data storage device stores the first image and the second image, and an image processor, coupled to the data storage device, compares the first image with the second image. A modem, coupled to the image processor, sends a fax of the second image to the at least one security post if the second image is substantially different from the first image. The present invention may further send via the modem a JPEG color image of the second image as an electronic mail to a predetermined security post if the second image is substantially different from the first image.

Patent
   RE38908
Priority
Mar 05 1999
Filed
May 05 2004
Issued
Dec 06 2005
Expiry
Mar 05 2019
Assg.orig
Entity
Small
9
9
all paid

REINSTATED
13. An apparatus for notifying at least one security post of an undesired condition at a monitored area, the apparatus comprising:
means for creating a first image of said monitor area at a first time point and for creating a second image of said monitored area at a second time point, said first image divided into a plurality of first image blocks using a predefined grid and said second image divided into a plurality of second image blocks using said predefined grid;
means for storing said first image blocks and said second image blocks;
means for determining whether the first image is sufficiently different from the second image by comparing a said each of at least one of said plurality of first image block blocks with a the corresponding said second image block, wherein said means for comparing, when comparing said first image block with said corresponding second image block, calculates by calculating the following parameters,
a first average pixel value of said that first image block;
a second average pixel value of said corresponding second image block;
a first standard deviation pixel value of said that first image block;
a second standard deviation pixel value of said corresponding a second image block;
a first x-coordinate pixel massive center of said that first image block;
a second xcoordinate x-coordinate pixel massive center of said corresponding second image block;
a first y-coordinate pixel massive center of said that first image block; and
a second y-coordinate pixel massive center of said corresponding second image block; and
means for sending a fax of said second image to said at least one security post said corresponding second image block is substantially different from said first image block, wherein said first image is substantially different from said second image if said determining that the first image is sufficiently different from the second image if, for each first image block of at least a predetermined number thereof thereby compared, the first average pixel value calculated therefor is substantially sufficiently different from said the corresponding second average pixel value or if said the first standard deviation pixel value calculated therefor is substantially sufficiently different from said the corresponding second standard deviation pixel value or if said the first x-coordinate pixel massive center calculated therefor is substantially sufficiently different from said the corresponding second x-coordinate pixel massive center or if said the first y-coordinate massive center calculated therefor is substantially sufficiently different from said the corresponding second y-coordinate pixel massive center; and
means for sending signals representative of said second image to said at least one security post if the second image is thereby determined to be sufficiently different from the first image.
1. A method for notifying at least one security post of an undesired condition at a monitored area, the method including the steps of comprising:
A. creating a first image of said monitored area at a first time point, said first image divided into a plurality of first image blocks using a predefined predetermined grid;
B. creating a second image of said monitored area at a second time point, said second image divided into a plurality of second image blocks using said predetermined grid so that each of the second image blocks corresponds to a respective one of the first image blocks;
C. comparing a said performing a comparison of each of at least one of said plurality of first image block blocks with a the corresponding said second image block by performing the steps of
calculating a first average pixel value of said that first image block;
calculating a second average pixel value of said corresponding second image block;
calculating a first standard deviation pixel value of said that first image block;
calculating a second standard deviation pixel value of said corresponding second image block;
calculating a first x-coordinate pixel massive center of said that first image block;
calculating a second x-coordinate pixel massive center of said corresponding second image block;
calculating a first y-coordinate pixel massive center of said that first image block; and
calculating a second y-coordinate pixel massive center of said corresponding second image block; and
D. sending a fax of said second image to said at least one security post making a determination in response to the comparison that the first image is sufficiently different from the second image if, for each first image block of at least a predetermined number thereof thereby compared, said corresponding second image block is substantially different from said first image block, wherein said first image block is substantially different from said corresponding second image block if said the first average pixel value calculated therefor is substantially sufficiently different from said the corresponding second average pixel value or if said the first standard deviation pixel value calculated therefor is substantially sufficiently different from said the corresponding second standard deviation pixel value or if said the first x-coordinate pixel massive center calculated therefor is substantially sufficiently different from said the corresponding second x-coordinate pixel massive center or if said the first y-coordinate pixel massive center calculated therefor is substantially sufficiently different from said the corresponding second ycoordinate y-coordinate pixel massive center; and
E. sending signals representing the second image to the at least one security post in response to the comparison if the first image is thereby determined to be sufficiently different from the second image.
6. A method for notifying at least one security post of an undesired condition at a monitored area, the method including the steps of comprising:
A. creating a first image of said monitored area at a first time point, said first image divided into a plurality of first image blocks using a predefined predetermined grid;
B. creating a second image of said monitored area at a second time point, said second image divided into a plurality of second image blocks using said predetermined grid so that each of the second image blocks corresponds to a respective one of the first image blocks;
C. comparing a said performing a comparison of each of at least one of said plurality of first image block blocks with a the corresponding said second image block, said step of comparing further including the steps of by:
calculating a first average pixel value of said that first image block;
calculating a second average pixel value of said corresponding second image block;
calculating a first standard deviation pixel value of said that first image block;
calculating a second standard deviation pixel value of said corresponding second image block;
calculating a first x-coordinate pixel massive center of said that first image block;
calculating a second x-coordinate pixel massive center of said corresponding second image block;
calculating a first y-coordinate pixel massive center of said that first image block; and
calculating a second y-coordinate pixel massive center of said corresponding second image block;
wherein said D. making a determination in response to the comparison that the first image is substantially sufficiently different from said second image if said , for each first image block of at least a predetermined number thereof thereby compared, the first average pixel value calculated therefor is substantially sufficiently different from said the corresponding second average pixel value or if said the first standard deviation pixel value calculated therefor is substantially sufficiently different from said the corresponding second standard deviation pixel value or if said the first x-coordinate pixel massive center calculated therefor is substantially sufficiently different from said the corresponding second x-coordinate pixel massive center or if said the first y-coordinate pixel massive center calculated therefor is substantially sufficiently different from said the corresponding second y-coordinate pixel massive center;
D. E. sending a fax of signals representing said second image to said at least one security post in response to the determination if said second image is substantially sufficiently different from said first image;
E. sending a JPEG color image of said second image as an electronic mail to a predetermined security post if said second image is substantially different from said first image;
F. detecting a remote request for a requested fax of an image of said monitored area;
G. accepting a fax number remote address to which said requested fax is signals representing that image are to be sent;
H. sending a fax of said image of said monitored area the signals representing that image to said accepted fax number remote address; and
I. repeating steps operations A, B, C, D, and E, F, G, and H every predetermined time period.
7. An apparatus for notifying at least one security post of an undesired condition at a monitored area, the apparatus comprising:
a camera for creating a first image of said monitored area at a first time point and for creating a second image of said monitored area at a second time point, said first image divided into a plurality of first image blocks using a predefined grid and said second image divided into a plurality of second image blocks using said predefined grid so that each of the plurality of second image blocks corresponds to a respective one of the plurality first image blocks;
a data storage device for storing said first image blocks and said second image blocks;
an image processor, coupled to said data storage device, for comparing a said determining whether the first image is sufficiently different from the second image by performing a comparison of each of at least one of said plurality of first image block blocks with a the corresponding said second image block, wherein said image processor, when comparing said performing the comparison of that first image block with said the corresponding second image block, calculates the following parameters,
a first average pixel value of said that first image block;
a second average pixel value of said corresponding second image block;
a first standard deviation pixel value of said that first image block;
a second standard deviation pixel value of said corresponding second image block;
a first x-coordinate pixel massive center of said that first image block;
a second x-coordinate pixel massive center of said corresponding second image block;
a first y-coordinate pixel massive center of said that first image block; and
a second y-coordinate pixel massive center of said corresponding second image block; and
a modem, coupled to said image processor, for sending a fax of said second image to said at least one security post if the image processor determining that said corresponding second image block is substantially sufficiently different from said first image block, wherein said first image is substantially different from said second image if said , for each image block of at least a predetermined number thereof thereby compared, the first average pixel value calculated therefor is substantially sufficiently different from said the corresponding second average pixel value or if said the first standard deviation pixel value calculated therefor is substantially sufficiently different from said the corresponding second standard deviation pixel value or if said the first x-coordinate pixel massive center calculated therefor is substantially sufficiently different from said the corresponding second x-coordinate pixel massive center or if said the first y-coordinate pixel massive center calculated therefor is substantially sufficiently different from said the corresponding second y-coordinate pixel massive center; and
a transmitter, coupled to said image processor, for sending signals representing said second image to said at least one security post in response to the comparison if the image processor has thereby determined that the second image is sufficiently different from the first image.
12. An apparatus for notifying at least one security post of an undesired condition at a monitored area, the method including the steps of the apparatus comprising:
a camera for creating a first image of said monitored area at a first time point and for creating a second image of said monitored area at a second time point, said first image divided into a plurality of firs first image blocks using a predefined grid and said second image divided into a plurality of second image blocks using said predefined grid so that each of the plurality of second image blocks corresponds to a respective one of the plurality of first image blocks;
a data storage device for storing said first image blocks and said second image blocks;
an image processor, coupled to said data storage device, for determining whether the first image is sufficiently different from the second image by comparing a said at least one of said plurality of first image block blocks with a the corresponding said second image block;
a modem transmitter, coupled to said image processor, for sending a fax of signals representing said second image to said at least one security post if said corresponding second image block is substantially determined by the image processor to be sufficiently different from said first image block ;
wherein said modem sends a JPEG color image of said second image as an electronic mail to a predetermined security post if said corresponding second image block is substantially different from said first image block;
a dual tone multi-frequency detector for detecting a remote request via a phone communications line for a requested fax of an image of said monitored area and for accepting a fax number remote address entered via a phone said communications line to which said requested fax is signals representing that image are to be sent, and wherein said image processor sends a fax of said image of said monitored area the signals representing that image to said accepted fax number remote address;
and wherein said image processor repeats comparing another first image to another second image every predetermined time period;
and wherein said image processor when comparing said one of the first image block with said the corresponding second image block calculates the following parameters:
a first average pixel value of said that first image block;
a second average pixel value of said corresponding second image block;
a first standard deviation pixel value of said that first image block;
a second standard deviation pixel value of said corresponding second image block;
a first x-coordinate pixel massive center of said that first image block;
a second x-coordinate pixel massive center of said corresponding second image block;
a first y-coordinate pixel massive center of said that first image block; and
a second y-coordinate pixel massive center of said corresponding second image block;
and wherein the image processor determines that said first image is substantially sufficiently different from said second image if said , for each first image block of at least a predetermined number thereof thereby compared, the first average pixel value calculated therefor is substantially sufficiently different from said the corresponding second average pixel value or if said the first standard deviation pixel value calculated therefor is substantially sufficiently different from said the corresponding second standard deviation pixel value or if said the first x-coordinate pixel massive center calculated therefor is substantially sufficiently different from said the corresponding second x-coordinate pixel massive center or if said the first y-coordinate pixel massive center calculated therefor is substantially sufficiently different from said the corresponding second y-coordinate pixel massive center.
2. The method of claim 1, further comprising the step of :
sending a JPEG color image of said second image as an electronic mail to a predetermined security post if the determination is that said corresponding second image block is substantially sufficiently different from said first image block .
3. The method of claim 1, further comprising the steps of :
detecting a remote request for a requested fax of an image of said monitored area;
accepting a fax number remote address to which said requested fax is signals representing that image are to be sent; and
sending a fax of said image of said monitored area the signals representing that image to said accepted fax number remote address.
4. The method of claim 1, further including the steps of :
repeating steps operations A, B, C, and D every predetermined time period.
5. The method of claim 1, further comprising the steps of :
selecting one of a plurality of cameras for comparing said first image block and with said corresponding second image block from said selected one of said plurality of cameras to detect said undesired condition at a respective monitored area of said selected one of said plurality of cameras.
8. The apparatus of claim 7, wherein said modem transmitter sends a JPEG color image of said second image as an electronic mail to a predetermined security post if said corresponding second image block is substantially determined by the image processor to be sufficiently different from said first image block .
9. The apparatus of claim 7, further comprising:
a dual tone multi-frequency detector for detecting a remote request via a phone communications line for a requested fax of an image of said monitored area and for accepting a fax number remote address entered via a phone said communications line to which said requested fax is signals representing that image are to be sent, and wherein said image processor sends a fax of said image of said monitored area the signals representing that image to said accepted fax number remote address.
10. The apparatus of claim 7, wherein said image processor repeats comprising another first image to another second image every predetermined time period.
11. The apparatus of claim 7, further comprising:
a plurality of cameras, each camera generating a respective first image at said first time point and a respective second image at said second time point to be compared for detecting said undesired condition at a respective monitored area; and
an I/O controller for selecting one of said plurality of cameras for analyzing the respective first image and the respective second image from said selected one of the plurality of cameras for detecting said undesired condition at said respective monitored area.
14. The apparatus of claim 13, further comprising:
means for sending a JPEG color image of said second image as an electronic mail to a predetermined security post if said corresponding the means for determining whether the first image is sufficiently different from the second image determines that second image block is substantially sufficiently different from said first image block .
15. The apparatus of claim 13, further comprising:
means for detecting a remote request via a phone communications line for a requested fax of an image of said monitored area and for accepting a fax number remote address entered via a phone said communications line to which said requested fax is signals representing that image are to be sent, and wherein said image processor means for sending signals representative of said second image sends a fax of said image of said monitored area the signals representing that image to said accepted fax number remote address.
16. The apparatus of claim 13, further comprising:
means for selecting one of a plurality of cameras for comparing a respective first image and a respective second image from said selected one of said plurality of cameras to detect said undesired condition at a respective monitored area of said selected one of said plurality of cameras.
0. 17. The method of claim 1, wherein said signals representing the second image are sent to a fax machine.
0. 18. The method of claim 3, wherein said remote address is a fax number that represents a fax machine to which the signals representing that image are sent.
0. 19. The method of claim 6, wherein said signals representing said second image are sent to a fax machine.
0. 20. The method of claim 6, wherein said signals representing said second image are JPEG signals.
0. 21. The method of claim 20, wherein said JPEG signals are sent to said at least one security post as an electronic mail.
0. 22. The method of claim 6, wherein said remote address is a fax machine number, and the signals representing that image are sent to a fax machine identified by that fax machine number.
0. 23. The apparatus of claim 7, wherein said signals representing said second image are readable by a fax machine located at the at least one security post.
0. 24. The apparatus of claim 7, wherein said transmitter is a modem.
0. 25. The apparatus of claim 9, wherein said detector is a dual-tone multi-frequency detector, said communications line is a phone line, said remote address is a fax machine number, and the signals representing that image are readable by a fax machine located at the at least one security post.
0. 26. The Apparatus of claim 12, wherein said transmitter is a modem.
0. 27. The apparatus of claim 12, wherein said signals representing said second image are readable by a fax machine.
0. 28. The apparatus of claim 12, wherein said signals representing said second image are JPEG signals.
0. 29. The apparatus of claim 12, wherein said transmitter sends the JPEG signals to said at least one security post as an electronic mail.
0. 30. The apparatus of claim 12, wherein said detector is a dual-tone multi-frequency detector, said communications line is a phone line, said remote address is a fax machine number, and the signals representing that image are readable by a fax machine identified by said fax machine number.
0. 31. The apparatus of claim 13, wherein said signals representing said second image are readable by a fax machine.
0. 32. The apparatus of claim 15, wherein said communications line is a phone line, said remote address is a fax machine number, and the signals representing that image are readable by a fax machine identified by said fax machine number.

The present invention relates generally to security systems that monitor for undesired conditions at a monitored area, and more particularly to an efficient and low cost method and apparatus for notifying at least one security post of an undesired condition at a monitored area with low incidence of false alarms.

Security monitoring systems now commonly use a video camera for monitoring an area. In some cases, the image of the monitored area stays constant with time for a relatively long time period. Thus, some security systems detect for a change in the image of the monitored area with time for detecting movement within the monitored area. For example, U.S. Pat. No. 3,812,287 to Lemelson, U.S. Pat. No. 3,828,125 to Fagan et al., and U.S. Pat. No. 4,777,526 to Saitoh et al. discloses a security system that detects for a change in the image of the monitored area with time for detecting undesired movement within the monitored area.

Unfortunately, with the prior art security systems, when an undesired movement within the monitored area is detected, the means for dealing with this detection may not be effective for quickly preventing damage to the monitored area. In order to minimize false alarms, a security guard typically views the image of the monitored area before travelling to the monitored area when an undesired condition has been described. U.S. Pat. No. 3,812,287 and U.S. Pat. No. 3,828,125 discloses a security system having a monitor that displays an image and that generates an alarm to draw the attention of a security guard to the monitor when an undesired condition has been detected. However, such a system is not effective for monitoring a large number of areas by one security guard. For example, it may be desired to monitor a neighborhood of hundreds of houses. In that case, a monitor for each of the houses would be needed with these prior art security systems which would be costly.

U.S. Pat. No. 4,777,526 discloses a security monitor system which is designed to transmit video signals from a plurality of video information sources via a common transmission line using modulation techniques. Although this security system is amenable for monitoring a large number of areas, additional infrastructure including the modulators, transmitters, and receiving circuitry is needed which adds to the complexity and cost of the system.

Thus, an improved security monitor system wherein one or a few security guards can monitor a large number of areas in a cost effective manner is desired.

Accordingly, the present invention is a security monitor system which effectively monitors a large number of areas in a cost effective manner using already existing communications infrastructure. More specifically, the method and apparatus of the present invention warns at least one security post of an undesired condition at a monitored area by sending a fax via a phone line and/or by sending an E-mail with an attachment of a JPEG color image of the monitored area via a global telecommunications network such as the Internet.

Generally, the present invention includes a camera for creating a first image of the monitored area at a first time point and for creating a second image of the monitored area at a second time point. In addition, a data storage device stores the first image and the second image, and an image processor, coupled to the data storage device, compares the first image with the second image. A fax modem, coupled to the image processor, sends a fax of the second image to the at least one security post if the second image is substantially different from the first image.

The present invention may further include an Internet modem, coupled to the image processor, for sending a JPEG file of the second image as an electronic mail to a predetermined security post if the second image is substantially different from the first image.

The present invention may be used to particular advantage when a dual tone multi-frequency detector detects a remote request via a phone line for a requested fax of the second image and for accepting a fax number entered via the phone line to which the requested fax is to be sent. The image processor then sends a fax of the second image to that accepted fax number.

The image processor within the security system of the present invention repeats comparing another first image to another second image every predetermined time period.

The present invention may be used to particular advantage when the algorithm for comparing the second image to the first image includes determining and comparing the following four parameters of the first image and the second image: an average pixel value, a standard deviation pixel value, an x-coordinate pixel massive center, and a y-coordinate pixel massive center. The first image is substantially different from the second image if the average pixel value of an image block in the first image is substantially different from the average pixel value of the image block in the second image or if the standard deviation pixel value of the image block in the first image is substantially different from the standard deviation pixel value of the image block in the second image or if the x-coordinate pixel massive center of the image block in the first image is substantially different from the x-coordinate pixel massive center of the image block in the second image of if the y-coordinate pixel massive center of the image block in the first image is substantially different from the y-coordinate pixel massive center of the image block in the second image.

In another embodiment of the present invention, the security monitoring system further includes a plurality of cameras with each camera monitoring a respective monitored area. The plurality of cameras are coupled to a computer having an image processor which multiplexes between the plurality of cameras to detect an undesired condition at the respective monitored area of any selected one of the plurality of cameras at a given time.

In this manner, the present invention upon detecting an undesired condition at the monitored area uses already available technology such as fax over the phone lines or electronic mail over the Internet for alerting at least one security post of the undesired condition. As a result, the present invention is a cost effective security system which may monitor a large number of areas. Any area may fax or E-mail an image to a security post such as the police station. The security guard views the faxed and/or electronically mailed image to ensure that a trip to the monitored area is warranted. Thus, false alarms are minimized with the present invention.

These and other features and advantages of the present invention will be better understood by considering the following detailed description of the invention which is presented with the attached drawings.

FIG. 1 shows a block diagram of the components of a security monitoring system according to one embodiment of the present invention;

FIG. 2 shows a flowchart of the steps of operation of the security monitoring system of FIG. 1, according to another embodiment of the present invention;

FIG. 3, including FIGS. 3a, 3b, 3c, 3d, and 3e, illustrates an algorithm for comparing a first image with a second image of the monitored area, according to another embodiment of the present invention;

FIG. 4 illustrates how a large number of areas may be monitored by a security post with the security monitoring system of the present invention; and

FIG. 5 shows a block diagram of the components of a security monitoring system using a plurality of cameras, according to another embodiment of the present invention.

The figures referred to herein are drawn for clarity of illustration and are not necessarily drawn to scale. Elements having the same reference number in FIGS. 1, 2, 3, 4, and 5 refer to elements having similar structure and function.

Referring to FIG. 1, a security monitoring system 100 of the present invention includes a CCD (Charge Coupled Device) video camera 102 for generating video images of the monitored area. The CCD video camera 102 is coupled to a data storage device 104 which stores images generated by the CCD video camera 102. An image processor 106 is coupled to the data storage device 104 and determines whether any undesired condition exists at the monitored area.

If an undesired condition exists at the monitored area, then the image processor 106 informs at least one security post of that undesired condition via a modem 108. The modem 108 has the capability of faxing an image from the video camera 102 to a plurality of fax lines over the public telephone network. The modem 108 also has the capability of sending an electronic mail of a JPEG color image from the video camera 102 via the Internet 112. Preferably, processor 106 provides, with an image to be faxed by a method and apparatus known in the facsimile art, the telephone number, the time and the date and other indicia, as required, for identifying the location of monitor system 100 which has detected a disturbance. In addition, processor 106 also provides, with the image to be emailed by a known method and apparatus of a known system, the time, the date and the email address to an image to be emailed and other indicia, as required, for identifying the location of the security system 100 which has detected a disturbance.

The security monitoring system 100 of the present invention further includes a DTMF (Dual Tone Multi Frequency) detector 114 coupled to the image processor 106. The DTMF detector 114 detects from a remote security post a remote request for a requested fax of an image from the CCD video camera 102. The remote security post dials in this request over the public telephone system and also dials in a fax number to which the requested fax is to be sent. The DTMF detector accepts this fax number such that the image processor 106 may send the requested fax to this fax number.

Referring to FIG. 2, a flowchart of the steps of operation of the security monitoring system 100 of the present invention includes a step of generating by the CCD video camera 102 and storing by the data storage device 104 a first image of the monitored area at a first time point (step 202 in FIG. 2). The present invention also includes a step of generating by the CCD video camera 102 and storing by the data storage device 104 a second image of the monitored area at a second time point (step 204 in FIG. 2).

The image processor 106 then compares the first image with the second image (step 206 in FIG. 2). If the first image is substantially similar to the second image, then the image processor 106 controls the CCD video camera 102 to generate another first image and another second image by returning to step 202.

If the first image is substantially different from the second image, then movement in the monitored area has been detected. Such a movement typically indicates an undesired condition at the monitored area. The image processor 106 then saves the second image for further processing (step 207 of FIG. 2). For example, the image processor 106 controls the modem 108 to send a fax of the second image to at least one security post (step 208 of FIG. 2). The modem 108 is designed to be coupled to a plurality of fax lines as known to one of ordinary skill the art such that a fax may be sent to a plurality of fax machines simultaneously. Each of the plurality of fax lines is coupled to a respective security post. For example, if a monitored area is a place of business, one of the fax lines may be coupled to a fax machine at a police station and another of the fax lines may be coupled to a fax machine at the residence of the business owner. The operator of the security monitor system may program the image processor 106 with at least one fax number to which the second image should be faxed when the first image is substantially different from the second image.

In addition, if any E-mail address has been programmed into the image processor 106 (step 210 of FIG. 2), then a JPEG color image of the second image is E-mailed to that E-mail address (step 212 of FIG. 2) via the modem 108. Technology for generation of a JPEG color image from the second image stored in the data storage device 104 and a modem which sends such an E-mail via the Internet 112 are known to one of ordinary skill in the art. The security monitoring system 100 then returns to. generating another first image and another second image by returning to step 202 in FIG. 2. In this manner, the generation of the first image and the second image and the comparison of the first image with the second image is typically repeated every predetermined time period.

Referring to FIG. 3, an algorithm within the image processor 106 for comparing the first image with the second image is illustrated. Referring to FIG. 3e, an image 302 is divided into a grid of image blocks. In the example of FIG. 3e, the image 302 is divided into a grid of three rows by four columns of image blocks. However, the present invention may be used with any number of image blocks for an image.

Within each image block, parameters related to pixel values are calculated. Referring to FIG. 3a, pixel values are assigned to each pixel within an image block. A pixel within an image block may be any number of colors. However, for simplicity of illustration, example pixel values for three colors are described herein for a dark shake, a gray shade, and a light shade. Referring to FIG. 3a, for example, if a pixel has a dark shade, then a pixel value of “2” is assigned. If a pixel has a gray shade, then a pixel value of “1” is assigned. If a pixel has light shade, then a pixel value of “0” is assigned.

An example algorithm for comparing the first image with the second image determines the following four parameters for each image block within an image: an average pixel value, a standard deviation pixel value, an x-coordinate pixel massive center, and a y-coordinate pixel massive center. The average pixel value (AV) for an image block is calculated as follows:
AV=ΣPi/n
where Pi is the pixel value of each pixel within that image block and n is the total number of pixels within that image block.

Referring to FIG. 3b and FIG. 3c, the average pixel value of the image block of FIG. 3b is 1, and the average pixel value of the image block of FIG. 3c is also 1, even though the image blocks of FIGS. 3b and 3c are visibly different. Thus, an additional parameter that is compared is the standard deviation pixel value (SD) for an image block which is calculated as follows:
SD=sqrt (Σ(Pi−AV)2/n)
where “sqrt” denotes the square root function, Pi is the pixel value of each pixel within that image block, AV is the average pixel value for that image block, and n is the total number of pixels within that image block. Referring to FIGS. 3b and 3c, the standard deviation pixel value of the image block of FIG. 3b is 0 but the standard deviation pixel value of the image block of FIG. 3c is greater than 0.

Referring to FIG. 3c and FIG. 3d, the average pixel value of the image block of FIG. 3c is 1, and the average pixel value of the image block of FIG. 3d is also 1. In addition, the standard deviation pixel value of the image block of FIG. 3c is equal to the standard deviation pixel value of the image block of FIG. 3d, even though the image blocks of FIGS. 3c and 3d are visibly different.

To differentiate between the image blocks of FIGS. 3c and 3d, the x-coordinate pixel massive center and a y-coordinate pixel massive center for an image block are also determined. The x-coordinate pixel massive center (X) is calculated as follows:
X=ΣxiPi/ΣPi
where xi is the respective x-coordinate of each pixel and Pi is the respective pixel value of each pixel within an image block. Similarly, the y-coordinate pixel massive center (Y) is calculated as follows:
Y=ΣyiPi/ΣPi
where yi is the respective y-coordinate of each pixel and Pi is the respective pixel value of each pixel within an image block.

Referring to the example of FIG. 3, the x-coordinate pixel massive center and the y-coordinate pixel massive center of the image block of FIG. 3b are the coordinates of the point 304 of FIG. 3b. The x-coordinate pixel massive center and the y-coordinate pixel massive center of the image block of FIG. 3b are toward the center of the image block since the image block of FIG. 3b is relatively uniform throughout.

The x-coordinate pixel massive center and the y-coordinate pixel massive center of the image block of FIG. 3c are then coordinates of the point 306 of FIG. 3c. Comparing FIGS. 3b and 3c, the x-coordinate pixel massive center and the y-coordinate pixel massive center of the image block of FIG. 3c is situated more toward the left of the image block since a darker pixel is present toward the left of the image block in FIG. 3c.

The x-coordinate pixel massive center and the y-coordinate pixel massive center of the image block of FIG. 3d are the coordinates of the point 308 of FIG. 3d. Comparing FIGS. 3b and 3d, the x-coordinate pixel massive center and the y-coordinate pixel massive center of the image block of FIG. 3d is situated more toward the top of the image block since a darker pixel is present toward the top of the image block in FIG. 3d.

Thus, with the x-coordinate pixel massive center and the y-coordinate pixel massive center, the image blocks of FIGS. 3b, 3c, and 3d are correctly deemed to be substantially different. The algorithm within the image processor 106 of the present invention determines the four parameters of an average pixel value, a standard deviation pixel value, an xcoordinate pixel massive center, and a y-coordinate pixel massive center for each image block within an image. Then, these parameters are compared for each respective image block of the first image and of the second image.

If these parameters are sufficiently different for a first respective image block within the first image and a second respective image block within the second image, then those respective image blocks are deemed to be sufficiently different. If more than a predetermined number of respective image blocks are sufficiently different for the first image and the second image, then the algorithm of the present invention deems the first image to be sufficiently different from the second image.

In this manner, the present invention effectively monitors for an undesired condition at a monitored area. When an undesired condition is detected at a monitored area, at least one security post, such as the police station or an owner of the monitored area, is apprised of the undesired condition using already existing communication infrastructure. A security post is notified by being faxed or E-mailed the image of the monitored area when an undesired condition is detected.

In addition, because the existing infrastructure of the telephone lines or the Internet is used with the present invention, a relatively large number of areas may be cost effectively monitored by one security post. Referring to FIG. 4, a first monitored area 402, a second monitored area 404, a third monitored area 406, a fourth monitored area 408, a fifth monitored area 410, a sixth monitored area 412, a seventh monitored area 414, and an eighth monitored area 416 each has a respective security monitoring system 100 of the present invention.

When an undesired condition at any of the monitored areas in FIG. 4 is detected by the respective security monitoring system 100, the image of that monitored area is faxed to a security post 418 such as a police station assigned to those areas. A security guard at the police station 418 examines the faxed image to determine whether travel to that monitored area is warranted. Thus, wasted time in travel to a monitored area from a false alarm is minimized with the present invention. Because any number of monitored areas may easily send a fax to the police station 418, one security post such as the police station 418 may monitor a large number of areas.

In addition, the image from a monitored area may be faxed to a plurality of security posts further ensuring prompt response to an undesired condition. If the monitored area 414 is a place of business for example, a fax of the image of the monitored area may be faxed to both the police station 418 and to an owner of the business 420. With multiple security posts being apprised of the undesired condition, the chances of a more prompt response is enhanced in case one security post is not occupied by a security guard.

In addition, the present invention may also send a JPEG colored image file via E-mail. Such a replication of the image is likely to be a higher quality image with color and better resolution than just a faxed image. Thus, the undesired condition at a monitored area may be better resolved with the E-mailed JPEG file.

Referring to FIG. 5, a security system 500, according to another embodiment of the present invention, includes a plurality of CCD video cameras including a first camera 502, a second camera 504, and up to an nth camera 506. Each of the plurality of cameras monitors a respective monitored area. For example, the plurality of cameras may monitor a respective room or a respective field of view within a large department store. The output from the first camera 502 is coupled to a first AND gate 512, the output from the second camera 504 is coupled to a second AND gate 514, and the output from the third camera 506 is coupled to a third AND gate 516. The outputs from the first, second, and third AND gates 512, 514, and 516 go through a first OR gate 517.

A respective input to each of the first, second, and third AND gates 512, 514, and 516 is coupled to a respective output of a first decoder 518 which is coupled to a first I/O (Input/Output) controller 519 of a first computer 520. The first computer 520 selects the output from one of the plurality of cameras 502, 504, and 506 for analyzing the image from that one camera via the first I/O controller 519. A control signal from the first I/O controller 519 is decoded by the first decoder 518 to gate the output from one of the plurality of cameras 502, 504, and 506. The output of the first OR gate 517 is coupled to the first computer 520.

In this manner, the first computer 520 selects via the first I/O controller 519, the output from one of the plurality of cameras 502, 504, and 506 for analyzing the image from that one camera. The first computer 520 includes an image processor similar to that shown in FIG. 1 for analyzing the images from that one selected camera. Thus, the first computer 520 may select any one of the plurality of cameras 502, 504, and 506 for analyzing the images from that one selected camera at any given time.

Similarly, the output from the first camera 502 is coupled to a fourth AND gate 522, the output from the second camera 504 is coupled to a fifth AND gate 524, and the output from the third camera 506 is coupled to a sixth AND gate 526. The outputs from the first, second, and third AND gates 522, 524, and 526 go through a second OR gate 527.

A respective input to each of the fourth, fifth, and third AND gates 522, 524, and 526 is coupled to a respective output of a second decoder 528 which is coupled to a second I/O (Input/Output) controller 529 of a second computer 530. The second computer 530 selects the output from one of the plurality of cameras 502, 504, and 506 for analyzing the image from that one camera via the second I/O controller 529. A control signal from the second I/O controller 529 is decoded by the second decoder 528 to gate the output from one of the plurality of cameras 502, 504, and 506. The output of the second OR gate 527 is coupled to the second computer 530.

In this manner, the second computer 530 selects via the second I/O controller 529, the output from one of the plurality of cameras 502, 504, and 506 for analyzing the image from that one camera. The second computer 530 includes an image processor similar to that shown in FIG. 1 for analyzing the images from that one selected camera. Thus, the second computer 530 may select any one of the plurality of cameras 502, 504, and 506 for analyzing the images from that one selected camera at any given time.

The first computer 520 and the second computer 530 are coupled to a phone jack 532 which is coupled to a central office 534 of a public telephone network. Either the first computer 520 and the second computer 530 may send a fax to a plurality of fax machines including a first fax machine 536 and a second fax machine 538. Alternatively, either the first computer 520 and the second computer 530 may send a JPEG color image as an E-mail via the Internet 540 to a computer 542 at a security post.

By using both the first computer 520 and the second computer 530, a redundant detection of an undesired condition at an monitored area further ensures minimization of false alarms. In addition, if one of the first computer 520 and the second computer 530 is inoperative, then the other computer is ensured of detecting the undesired condition at the monitored area.

The foregoing is by way of example only and is not intended to be limiting. For example, the present invention has been described within the example image blocks of FIG. 3. However, the present invention may be practiced for any number of image blocks within an image, any number of pixel values, and any number of pixels within an image block, as would be apparent to one of ordinary skill in the art from the description herein. In addition, the algorithm described herein for comparing the first image with the second image is by way of example only and any other types of algorithms for comparing images may be used with the present invention.

The present invention is limited only as defined in the following claims and equivalents thereof.

Ho, Shu-Kuang, Zhao, Xiu-Wei

Patent Priority Assignee Title
7365884, Sep 22 1988 Catch Curve, Inc. Facsimile telecommunications system and method
7446906, Oct 15 1996 OPENPRINT LLC Facsimile to E-mail communication system with local interface
7710452, Mar 16 2005 Eric, Lindberg Remote video monitoring of non-urban outdoor sites
8224909, Aug 30 2000 UNWIRED BROADBAND, INC Mobile computing device facilitated communication system
8488207, Oct 15 1996 OPENPRINT LLC Facsimile to E-mail communication system with local interface
8533278, Aug 30 2000 UNWIRED BROADBAND, INC Mobile computing device based communication systems and methods
8547601, Oct 15 1996 OPENPRINT LLC Facsimile to E-mail communication system
8941888, Oct 15 1996 OPENPRINT LLC Facsimile to E-mail communication system with local interface
9123227, Oct 13 2008 The Boeing Company System for checking security of video surveillance of an area
Patent Priority Assignee Title
3812287,
3828125,
4249207, Feb 20 1979 Senstar Corporation Perimeter surveillance system
4777526, Jun 23 1986 Sony Corporation Security monitor system
5202759, Jan 24 1991 RPX CLEARINGHOUSE LLC Surveillance system
5500904, Apr 22 1992 Texas Instruments Incorporated System and method for indicating a change between images
6271752, Oct 02 1998 Lucent Technologies, INC Intelligent multi-access system
6298144, May 20 1998 The United States of America as represented by The National Security Agency Device for and method of detecting motion in an image
GB2258579,
///
Executed onAssignorAssigneeConveyanceFrameReelDoc
May 05 2004Biscom, Inc.(assignment on the face of the patent)
Dec 20 2023CONCORD III, L L C MARANON CAPITAL, L P , AS AGENTSECURITY INTEREST SEE DOCUMENT FOR DETAILS 0659180344 pdf
Dec 20 2023BISCOM, INC MARANON CAPITAL, L P , AS AGENTSECURITY INTEREST SEE DOCUMENT FOR DETAILS 0659180344 pdf
Date Maintenance Fee Events
Sep 08 2006M2551: Payment of Maintenance Fee, 4th Yr, Small Entity.
Sep 08 2006M2554: Surcharge for late Payment, Small Entity.
Jul 19 2010REM: Maintenance Fee Reminder Mailed.
Dec 10 2010EXPX: Patent Reinstated After Maintenance Fee Payment Confirmed.
May 02 2011M1558: Surcharge, Petition to Accept Pymt After Exp, Unintentional.
May 02 2011M2552: Payment of Maintenance Fee, 8th Yr, Small Entity.
May 02 2011PMFP: Petition Related to Maintenance Fees Filed.
Jul 21 2011PMFG: Petition Related to Maintenance Fees Granted.
May 14 2014M2553: Payment of Maintenance Fee, 12th Yr, Small Entity.


Date Maintenance Schedule
Dec 06 20084 years fee payment window open
Jun 06 20096 months grace period start (w surcharge)
Dec 06 2009patent expiry (for year 4)
Dec 06 20112 years to revive unintentionally abandoned end. (for year 4)
Dec 06 20128 years fee payment window open
Jun 06 20136 months grace period start (w surcharge)
Dec 06 2013patent expiry (for year 8)
Dec 06 20152 years to revive unintentionally abandoned end. (for year 8)
Dec 06 201612 years fee payment window open
Jun 06 20176 months grace period start (w surcharge)
Dec 06 2017patent expiry (for year 12)
Dec 06 20192 years to revive unintentionally abandoned end. (for year 12)