A method, apparatus and system are disclosed for capturing an image of an item identifier by a wearable sensor. The item identifier can be analyzed to identify a specific item. The specific item can then be referenced to display information on the specific item, and display the results of analysis made with reference to the specific item.
|
9. A wearable electronic device comprising:
a controller configured to:
receive at least one image captured by an image capturing device;
automatically analyze the at least one captured image;
recognize one or more merchants that are within a field of view of the image capturing device;
obtain internet browsing information corresponding to a user of the wearable electronic device;
identify a purchasable item that the user has searched for within the user's internet browsing information;
identify a target merchant from the one or more merchants recognized from the field of view that offer the purchasable item identified within the user's internet browsing information; and
control, after recognition of a gesture command, a display unit to superimpose information identifying the target merchant as offering the purchasable item identified within the user's internet browsing information;
wherein the controller is further configured to:
recognize an item identifier from the at least one captured image based on the analysis;
obtain information corresponding to an item represented by the item identifier;
receive a location of the wearable electronic device identified by a positioning system;
obtain merchant information identifying a merchant that offers the same item, the merchant being located at a different location within a specified distance from the location of the wearable electronic device;
automatically analyze the at least one captured image and recognize, based on the analysis, that the merchant that offers the same item has a location within the field of view of the wearable electronic device; and
control the display unit to display, to the wearer of the wearable electronic device:
a location icon superimposed on the location within the field of view of the wearable electronic device, and
in association with the location icon, the merchant information identifying the merchant that offers the same item;
wherein the item identifier is one of a barcode, QR code, recognized item shape, or recognized item name.
1. A wearable electronic device, comprising:
an image capturing device configured to capture at least one image within a field of view of the image capturing device in response to an input from a wearer of the wearable electronic device;
a positioning system configured to identify a location of the electronic device;
a display unit configured to display; and
a controller, in communication with the image capturing device, positioning system and display unit, and configured to:
recognize one or more merchants that are within the field of view of the image capturing device;
obtain internet browsing information corresponding to a user of the wearable electronic device;
identify a purchasable item that the user has searched for within the user's internet browsing information;
identify a target merchant from one or more merchants recognized from the field of view that offer the purchasable item identified within the user's internet browsing information; and
control, after recognition of a gesture command, the display unit to superimpose information identifying the target merchant as offering the purchasable item identified within the user's internet browsing information;
wherein the controller is further configured to:
automatically analyze the at least one captured image and recognize an item identifier from the at least one captured image based on the analysis;
obtain information corresponding to an item represented by the item identifier;
obtain merchant information identifying a merchant that offers the same item, the merchant being located at a different location within a specified distance from the location of the wearable electronic device;
automatically analyze the at least one captured image and recognize, based on the analysis, that the merchant that offers the same item has a location within the field of view of the wearable electronic device; and
control the display unit to display, to the wearer of the wearable electronic device:
a location icon superimposed on the location within the field of view of the wearable electronic device, and
in association with the location icon, the merchant information identifying the merchant that offers the same item;
wherein the item identifier is one of a barcode, QR code, recognized item shape, or recognized item name.
2. The wearable electronic device of
transmitting a request for identifying an item corresponding to the item identifier; and
receiving information identifying the item in response to the request.
3. The wearable electronic device of
receive price information for the item at a first merchant corresponding to the location of the electronic device, wherein the first merchant is different from the merchant located within the specified distance;
receive price information for the item being sold at the merchant located within the specified distance, and
control the display unit to display the price information for the item at the first merchant and display the price information for the item at the merchant located within the specified distance.
4. The wearable electronic device of
compare the price information for the item at the first merchant and the merchant located within the specified distance, and
control the display unit to display the price information for the item in an order from cheapest to most expensive, based on the comparison.
5. The wearable electronic device of
control the display unit to display the information identifying the item being sold at the merchant, located within the specified distance, by overlaying the price information for the item to correspond to the merchant located within the specified distance and within the field of view of the image capturing device.
6. The wearable electronic device of
recognize one or more merchants that are within the field of view of the image capturing device;
obtain promotional deal information from the one or more merchants, and control the display unit to superimpose the promotional deal information to identify the one or more merchants that are within the field of view of the image capturing device.
7. The wearable electronic device of
obtain alert information identifying a transaction corresponding to a financial account of a user of the wearable electronic device has occurred outside a predetermined distance from the location of the wearable electronic device, and
control the display unit to display the alert information.
8. The wearable electronic device of
10. The wearable electronic device of
transmitting a request for identifying an item corresponding to the item identifier; and
receiving information identifying the item in response to the request.
11. The wearable electronic device of
receive price information for the item at a first merchant corresponding to the location of the electronic device, wherein the first merchant is different from the merchant located within the specified distance;
receive price information for the item being sold at the merchant located within the specified distance, and
control the display unit to display the price information for the item at the first merchant and display the price information for the item at the merchant located within the specified distance.
12. The wearable electronic device of
compare the price information for the item at the first merchant and the merchant located within the specified distance, and
control the display unit to display the price information for the item in an order from cheapest to most expensive, based on the comparison.
13. The wearable electronic device of
control the display unit to display the information identifying the item being sold at the merchant, located within the specified distance, by overlaying the price information for the item to correspond to the merchant located within the specified distance and within the field of view of the image capturing device.
14. The wearable electronic device of
recognize one or more merchants that are within the field of view of the image capturing device;
obtain promotional deal information from the one or more merchants, and
control the display unit to superimpose the promotional deal information to identify the one or more merchants that are within the field of view of the image capturing device.
15. The wearable electronic device of
obtain alert information identifying a transaction corresponding to a financial account of a user of the wearable electronic device has occurred outside a predetermined distance from the location of the wearable electronic device, and
control the display unit to display the alert information.
16. The wearable electronic device of
|
This application claims the benefit of U.S. Provisional Patent Application Ser. No. 61/986,797, filed on Apr. 30, 2014, which is hereby incorporated by reference herein in its entirety.
Shopping has been known to be a tedious endeavor for even the most experienced shoppers. The risk of getting lost while en route to a new shopping center, or getting lost within a new shopping center was a real possibility that costs the shopper valuable time and effort. Also, bargain shoppers could not be sure that the merchandise they were buying was the best deal currently available to them.
Therefore, there is a need for an apparatus and method that will assist a shopper during various shopping experiences.
An aspect of the present disclosure relates to an electronic device that is wearable by a user such as a shopper engaged in one or more shopping activities. This wearable device may be in the form of eyewear that the user may wear over their eyes. Additionally, the wearable device may include one or more sensors, one or more input components, and one or more output components.
According to an aspect of the present invention, a wearable electronic device is disclosed that may include an image capturing device configured to capture an image within a field of view of the image capturing device in response to an input from a wearer of the wearable electronic device, a positioning system configured to identify a location of the electronic device, a display unit configured to display information to a wearer of the wearable electronic device and a controller. The controller may be configured to automatically analyze the captured image and recognize an item identifier from the captured image based on the analysis, and obtain information corresponding to an item represented by the item identifier. The controller may further obtain merchant information identifying a merchant that offers a same item where the merchant is located at a different location within a specified distance from the location of the wearable electronic device. The controller may then be configured to control the display unit to display to the wearer of the wearable electronic device the merchant information that offers the same item. In other aspects, a shopping list may be generated with, or displayed by, the wearable electronic device, and budget information, item location information, nutritional values for food items and comparisons with items available at competing stores may be displayed and manipulated on the wearable device while the wearer is shopping.
Other systems, methods, and features will be, or will become apparent to one with skill in the art upon examination of the following figures and detailed description. It is intended that all such additional systems, methods, and features included within this description, be within the scope of the disclosure, and be protected by the following claims.
The present invention may be better understood with reference to the following drawings and description. Non-limiting and non-exhaustive descriptions are described with reference to the following drawings. The components in the figures are not necessarily to scale, emphasis instead being placed upon illustrating principles. In the figures, like referenced numerals may refer to like parts throughout the different figures unless otherwise specified.
The present invention as described herein may be embodied in a number of different forms. Not all of the depicted components may be required, however, and some implementations may include additional, different, or fewer components from those expressly described in this disclosure. Variations in the arrangement and type of the components may be made without departing from the spirit or scope of the claims as set forth herein.
The foregoing descriptions of embodiments of the invention have been presented for purposes of illustration and description only. They are not intended to be exhaustive or to limit the invention to the forms disclosed. Accordingly, the above disclosure is not intended to limit the invention; the scope of the invention is defined by the appended claims.
In the system illustrated in
At some time either before or after communicating with the merchant's transmitter/receiver device 240, the wearable device 100 may capture an image of an object 230 within the merchant storefront. The object may be, for example, an item identifier (for example, QR code, barcode), merchandise item, or some other recognizable object as described herein. After capturing the image of the object 230, the wearable device 100 may transmit information on the object 230 to the merchant server 250, either directly or via the merchant transmitter/receiver device 240. The information transmitted to the merchant server 250 may be the captured image of the object 230, or additional information corresponding to the object 230 as obtained by the wearable device 100 according to any one or more of the processes described herein (for example, pricing information on the object 230).
In addition or alternatively, the information transmitted to the merchant server 250 may include a request to purchase the object 230 from the merchant. In such cases, the merchant server 250 may communicate a payment request to a shopping server 260. The shopping server 260 may be a financial institution server that belongs to a financial institution at which a shopper utilizing the wearable device 100 holds one or more financial accounts (for example, checking account, savings account, retirement account, etc.) at. By communicating with the shopping server 260, the merchant server 250 may request payment from the shopper via the shopper's financial account with the financial institution. When such a request is received from the merchant server 250, the shopping server 260 may locate the shopper's financial account and process the sales transaction to debit the appropriate amount of funds from the shopper's account to credit the merchant's account. After the sales transaction is completed between the shopping server 260 and the merchant server 250, a confirmation message of the successful sales transaction may be transmitted back to the wearable device 100 to be presented to the shopper. This confirmation message may be generated either by the shopping server 260 or the merchant server 250.
In addition or alternatively, the shopping server 260 may correspond to a shopping vendor that previously distributed a shopping tool to shoppers to run on the wearable device 100. In this way, the shopping vendor may communicate with a computer system running the shopping tool to allow the shopping tool to accomplish desired features. The features of such a shopping tool are provided throughout this disclosure. For example, the shopping server 260 may be capable of receiving a digital image or digital video files captured and transmitted by a computer system running the shopping tool, and analyzing the digital image or digital video files in order to recognize one or more objects from the captured image or digital video file as requested by the shopping tool. Information corresponding to the recognized objects may also be stored on the shopping server 260 such that the information may be transmitted back to the computer system running the shopping tool in response to a request for such information from the shopping tool.
The shopping vendor's shopping server 260 may communicate with the merchant server 250 to obtain current shopping promotions being offered to the shopper based on previously negotiated deals between the shopping vendor and the merchant. For example, when the wearable device 100 transmits a request for more information on the object 230 to the merchant server 250, the merchant server 250 may in turn transmit a request for more information on the object 230 to the shopping server 260. The shopping server 260 may receive such a request from the merchant server 250 and initiate a procedure to obtain information related to the object 230, and/or the merchant offering the object 230 for sale. After obtaining such information, the shopping server 260 may transmit the resulting information back to the merchant server 250, and the merchant server 250 may transmit the information back to the wearable device 100 for presentation to the shopper either directly, or via the transmitting/receiving device 240. Alternatively, the shopping server 260 may transmit the information back to the wearable device 100 for presentation to the shopper either directly, or via the transmitting/receiving device 240.
In some embodiments, the wearable device 100 may communicate with the shopping server 260 directly to obtain information on an object 230. Similarly, a computing device 270 (for example, laptop computer) or smartphone type device 280 (for example, smartphone, tablet, phablet, personal digital assistant, etc.) may communicate with the shopping server 260 directly in order to obtain information on an object 230 according to any one of the processes described herein. For example, the request for information on the object 230 that is transmitted to the shopping server 260 may include a captured image of the object 230 along with a request for information. The shopping server 260 may receive such request for information and analyze the captured image in order to identify the object 230. After identifying the object 230 from the captured image, the shopping server 260 may parse a database of object information stored on a memory of the shopping server 260 to obtain information corresponding to the identified object 230 as identified in the request, or as corresponding to the object 230 in general. After obtaining the information from the database the shopping server 260 may transmit the information back to the wearable device 100, computing device 270, or smartphone type device 280.
The wearable device 100 may communicate with the merchant server 250 or shopping server 260 via any number of communication methods, such as those described above. In some implementations, the wearable device 100 may utilize the communication capability of any number of additional or alternative electronic devices. For example, the wearable device may establish a direct communication link with a mobile device of a user, for example, a smartphone, tablet, or mobile phone carried by a user of the wearable device 100. Example communication links may include Bluetooth, any 802.11 connection, NFC, and more. The electronic device may have increased communication capabilities compared to the wearable device 100, and may be an intermediate communication device through which the wearable device 100 transmits or receives data for any of the shopping or budget analysis described herein. For example, the wearable device 100 may communicate with a smartphone that is in communication with the merchant server 250 and/or shopping server 260 through a wireless communication link, such as a cellular, 802.11 Wi-Fi, or any other type of communication link. In this example, the wearable device 100 may bypass or forego communication through the merchant's transmitter/receiver device 240, instead establishing a communication link with external servers or devices (such as the merchant server 250 or shopping server 260) through one or more intermediate communication devices or a direct communication link.
Additional descriptions for other processes involving one or more of the components as illustrated by the system in
Referring to
The computer system 200 can include a set of instructions 224 that can be executed to cause the computer system 200 to perform any one or more of the methods, processes or computer-based functions disclosed herein. For example, a shopping tool as described herein may be a program comprised of a set of instructions 224 that are executed by the controller 202 to cause the wearable device 100 to perform any one or more of the methods, processes or computer-based functions described herein. Such a program may be stored in whole, or in any combination of parts, on one or more of the exemplary memory components illustrated in
As described, the computer system 200 may be mobile device such as the wearable device 100. The computer system 200 may also be connected using a network 226, to other computer systems or peripheral devices. In a networked deployment, the computer system 200 may operate in the capacity of a server or as a client user computer in a server-client user network environment, or as a peer computer system in a peer-to-peer (or distributed) network environment. In addition to embodiments in which the computer system 200 is implemented as a wearable device, the computer system 200 may also be implemented as, or incorporated into, various devices, such as a personal computer (“PC”), a tablet PC, a set-top box (“STB”), a personal digital assistant (“PDA”), a mobile device such as a smart phone or tablet, a palmtop computer, a laptop computer, a desktop computer, a network router, switch or bridge, or any other machine capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken by that machine. In a particular embodiment, the computer system 200 can be implemented using electronic devices that provide voice, video or data communication. Further, while a single computer system 200 is illustrated, the term “system” shall also be taken to include any collection of systems or sub-systems that individually or jointly execute a set, or multiple sets, of instructions to perform one or more computer functions.
As illustrated in
The computer system 200 may additionally include a GPS (Global Positioning System) component 229 for identifying a location of the computer system 200. The positioning system 229 may be a hardware received or software for working in conjunction with a remotely located received. In alternative embodiments, the positioning system may be an IPS (Indoor Positioning System) to assist with accurate location of the computer system inside of buildings, where GPS reception may not be as reliable and accurate. A combination of both GPS and IPS functionality may be integrated in the positioning system 229. Additionally, the computer system 200 may include an inertial orientation unit 228 that includes any combination of one or more gyroscope(s) and accelerometer(s).
The computer system 200 may also include a network interface device 220 to allow the computer system 200 to communicate via wireless, or wired, communication channels with other devices. The network interface device 220 may be an interface for communicating with another computer system via a Wi-Fi connection, Bluetooth connection, Near Frequency Communication connection, telecommunications connection, internet connection, wired Ethernet connection, or the like. The computer system 200 may also optionally include a disk drive unit 216 for accepting a computer readable medium 222. The computer readable medium 222 may include a set of instructions that are executable by the controller 202, and/or the computer readable medium 222 may be utilized by the computer system 200 as additional memory storage.
In a particular embodiment, as depicted in
In an alternative embodiment, dedicated hardware implementations, including application specific integrated circuits, programmable logic arrays and other hardware devices, can be constructed to implement one or more of the methods described herein. Applications that may include the apparatus and systems of various embodiments can broadly include a variety of electronic and computer systems. One or more embodiments described herein may implement functions using two or more specific interconnected hardware modules or devices with related control and data signals that can be communicated between and through the modules, or as portions of an application-specific integrated circuit. Accordingly, the present computer system 200 may encompass software, firmware, and hardware implementations.
In accordance with various embodiments of the present disclosure, the methods described herein may be implemented by software programs executable by a computer system. Further, in an exemplary, non-limited embodiment, implementations can include distributed processing, component/object distributed processing, and parallel processing. Alternatively, virtual computer system processing can be constructed to implement one or more of the methods or functionality as described herein.
The present disclosure contemplates a computer-readable medium 222 that includes instructions 224 or receives and executes instructions 224 responsive to a propagated signal; so that a device connected to a network 226 can communicate voice, video or data over the network 226. Further, the instructions 224 may be transmitted or received over the network 226 via the network interface device 220.
While the computer-readable medium 224 is shown to be a single medium, the term “computer-readable medium” includes a single medium or multiple media, such as a centralized or distributed database, and/or associated caches and servers that store one or more sets of instructions. The term “computer-readable medium” shall also include any tangible medium that is capable of storing, encoding or carrying a set of instructions for execution by a processor or that cause a computer system to perform any one or more of the methods or operations disclosed herein.
In a particular non-limiting, exemplary embodiment, the computer-readable medium 222 can include a solid-state memory such as a memory card or other package that houses one or more non-volatile read-only memories, such as flash memory. Further, the computer-readable medium 222 can be a random access memory or other volatile re-writable memory. Additionally, the computer-readable medium 222 can include a magneto-optical or optical medium, such as a disk or tapes or other storage device to capture information communicated over a transmission medium. A digital file attachment to an e-mail or other self-contained information archive or set of archives may be considered a distribution medium that is equivalent to a tangible storage medium. Accordingly, the disclosure is considered to include any one or more of a computer-readable medium 222 or a distribution medium and other equivalents and successor media, in which data or instructions may be stored.
Although the present specification describes components and functions that may be implemented in particular embodiments with reference to particular standards and protocols commonly used by financial institutions, the invention is not limited to such standards and protocols. For example, standards for Internet and other packet switched network transmission (for example, TCP/IP, UDP/IP, HTML, HTTP) represent examples of the state of the art. Such standards are periodically superseded by faster or more efficient equivalents having essentially the same functions. Accordingly, replacement standards and protocols having the same or similar functions as those disclosed herein are considered equivalents thereof.
At 301, an image within a field of view of the wearable device 100 may be captured. For example,
The image capturing may be initiated by the shopper's input command via any one or more of the components described as part of the input control unit 212. For example, the shopper's input command may be a push button input into a keyboard or push button, a turn of a scroll wheel, a specific gesture command captured by an image capture or video capture device, a touch input into a touch pad, or a voice command received by a microphone. With respect to the gesture command recognition, an image capturing device of the wearable device 100 may be capturing images or video of objects within the field of view of the wearable device 100 in order to monitor the field of view for specific gesture commands by the shopper. The captured images or videos may be analyzed by the shopping tool in order to recognize one or more of the specific gesture commands that may be identified in a database memory of the wearable device 100. For example, a gesture by the shopper to point to a specific object (for example, item identifier or merchandise item) with a digit (for example, finger or other pointed object) may be recognized by the shopping tool as a gesture command to capture an image or begin video recording by the image capturing device of the wearable device 100. The image capturing device may further be configured to capture an image within a specified radius, box, or other area within relation to a proximity to the recognized digit. For example, the image capturing device may focus on capturing an image within a specified radius, box, or other area within relation to a tip of the shopper's finger as recognized from the field of view.
In addition or alternatively, the captured images or videos may be analyzed by the shopping tool in order to recognize a specified object within the field of view of the wearable device 100 that may be referenced for further processing according to the process described by flow chart 300. For example, the recognition of an item identifier (for example, QR code or barcode) within the field of view may be recognized by the shopping tool such that an image or video segment that includes an image of the item identifier will be identified for further reference by the process described in flow chart 300.
In addition, the image capturing device may also include the capability to capture images of the shopper's eyes. In this way, the recognition by the shopping tool of a specified gesture by one or more of the shopper's eyes (for example, single eye blink, double eye blink, single eye specified series of blinks, double eye specified series of blinks) may initiate an image capture or video segment capture by the image capturing device of the wearable device 100 of a field of view of the wearable device 100.
At 302, a current location of the wearable device 100 is identified by a location identifying component of the wearable device 100. For example, a location identifying component may be a GPS component as described in this disclosure. The determination of the current location at 302 may include a determination of a current merchant in which the shopper wearing the wearable device 100 is presently located. In some embodiments the current location information may further be transmitted to an off-site server tasked with keeping track of the wearable device 100. For example, the off-site server may be the merchant server 250 or shopping server 260 as illustrated in
At 303, the image captured at 301 is analyzed in order to recognize an item identifier from the captured image. For example, the item identifier may be a barcode and/or QR code 3 as illustrated in
At 304, the item identifier is analyzed in order to determine the merchandise item that corresponds to the item identifier. For example, in embodiments where the item identifier is a barcode, QR code, or some other easily identifiable type of item identifier, the item identifier may be referenced against a database of known item identifiers in order to determine the merchandise item that corresponds to the analyzed item identifier. In other embodiments where the item identifier is determined to be a recognizable title, label, or other type of item identifier that requires additional image recognition processing, the process at 304 may include an image recognition process for identifying the title, label or other type of item identifier in order to determine the corresponding merchandise item.
Based on the identification of the merchandise item corresponding to the captured item identifier at 304, the pricing of the merchandise item may also be determined as part of the analysis at 304.
At 305, identification of another merchant that offers the same merchandise item identified at 304 is obtained. For example, obtaining the identification of the other merchant may include transmitting a request to an off-site server. For example, the off-site server may be the merchant server 250 or shopping server 260 as illustrated in
In addition or alternatively, this request may be transmitted internally within the wearable device 100 itself. For example, the wearable device 100 may store a look up table in a memory of the wearable device 100, where the look up table includes merchandise item inventory information for a number of merchants, as well as location information for each of the merchants. This way, even when the request is made within the wearable device 100, a process may be implemented for obtaining information on another merchant that carries the same merchandise item as identified at 304, which may also be located less than a predetermined distance from the current location.
In addition or alternatively, the merchant information obtained at 305 may correspond to a list of merchants that have previously signed up for a cross promotional relationship with an entity that corresponds to the shopping tool. For example, the shopping tool may have been developed by a financial institution and downloaded onto the wearable device from a financial institution server. The financial institution may, for example, correspond to a financial account (for example, credit card, debit card, reward card) of the shopper running the shopping tool on the wearable device 100. The cross promotional relationship may have been agreed upon between the financial institution and one or more merchants to provide customers of the financial institution (for example, the shopper) additional discounts or other beneficial promotions when shopping at the merchants included in the cross promotional relationship. Alternatively, the cross promotional relationship may have been agreed upon between the financial institution customer (for example, the shopper) and one or more merchants by the customer signing up with the merchants included in the cross promotional relationship.
At 306, the new merchant information obtained at 305 will be displayed. For example, the information may be displayed on the display unit 30 of the wearable device 100.
In addition or alternatively, each additional new merchant included in the list 4 may be displayed along with a corresponding message. The corresponding message may have been generated by the shopping tool at 305 after obtaining the merchant identification information. For example, the corresponding message may identify a difference in price of the merchandise item as sold by the current merchant versus the new merchant(s) obtained from the process at 305. The message itself may identify the difference in price in terms of a monetary, or percentage, difference. In another example, the corresponding message may identify additional benefits that may be available at one or more of the new merchants identified at 305. Exemplary additional benefits may include promotional deals that are being offered by the new merchant for buying the merchandise item (for example, buy the merchandise item and also receive an additional item).
Display 7 is comprised of a location icon (‘x’) and a corresponding message that identifies store 1 as selling the same merchandise item for a price that is a specified percentage less than the merchandise item being sold at the current merchant.
Display 5 is comprised of a location icon (‘x’) and a corresponding message that identifies store 2 as selling the same merchandise item for a price that is a specified percentage more than the merchandise item being sold at the current merchant.
Display 6 is comprised of a location icon (‘x’) and a corresponding message that identifies store 3 as selling the same merchandise item for a price that is the same as the merchandise item being sold at the current merchant. However, display 6 additionally includes a corresponding message that identifies an additional benefit to buying the same merchandise item at store 3 that may be an added incentive over the buying from the current merchant.
Although not specifically illustrated, the shopping tool described by flow chart 300 may include a process for generating a “worth it” score. The “worth it” score may be generated by inputting pricing information for the merchandise item at different merchants as well as each of the different merchant's distance from the shopper's current location (such as a distance from current merchant). Then, the input information may be compared with the price for the merchandise item being offered by the current merchant to determine the “worth it” score for the particular merchandise item. If one of the different merchants is found to offer the same merchandise item at a much cheaper price than the current merchant, and this particular different merchant is located very close to the current merchant, this different merchant may be assigned a high “worth it” score because it would be highly worth it for the shopper to travel to the different merchant to purchase the same merchandise item at the much lower price. Conversely, if one of the different merchants if found to offer the same merchandise item at a much higher price than the current merchant, and this particular different merchant is located very far from the current merchant, this different merchant may be assigned a low “worth it” score because it would not be worth it for the shopper to travel to the different merchant to purchase the same merchandise item at the much higher price.
Further, the parameters described as being utilized by the shopping tool during the processes described by flow chart 300 may be revised. For example, the shopper may input revised parameters into the wearable device 100 via any one or more of the input control devices that comprise the input control unit 212 of the wearable device 100. The revised parameters may then be referenced by the shopping tool to implement the process described by flow chart 300 in accordance to the new revised parameters. An exemplary parameter that may be revisable includes the predetermined distance from the current location at which the shopping tool will display new merchant information. For example, the shopper may set this predetermined distance parameter such that only merchants that are within 100 ft. from the current location are eligible for display on the display unit 30 at 306. After initially setting this predetermined distance, the shopper may increase or decrease this distance. Another exemplary parameter that may be revisable includes the difference in merchandise item pricing that allows a new merchant eligible for display on the display unit 30. For example, the shopper may set the differential pricing such that only new merchants that sell the same merchandise item at a cheaper price are displayed on the display unit 30 at 306. After initially setting this differential pricing, the shopper may revise this parameter to include merchants that sell the same merchandise item at a price that is within a specified amount, or percentage, (for example, $4 or 10%) of the current merchant's price.
In addition, the process described by flow chart 300 may have an additional step where the shopping tool automatically communicates with the current merchant to negotiate a new, cheaper (or otherwise better incentivized), deal. For example, after obtaining the identification information of merchants that offer the same merchandise item at 305 (or alternatively at the same, or nearly same, time as controlling the display unit at 306), the shopping tool running on the wearable device 100 may transmit a communication signal to a receiving device corresponding to the current merchant. This receiving device may, for example, be the current merchant's server 250 as illustrated in the system of
At 401, an image within a field of view of the wearable device 100 may be captured. For example,
At 402, a current location of the wearable device 100 may be identified by a location identifying component of the wearable device 100. For example, a location identifying component may be a GPS component as described, at least, elsewhere in this disclosure. The determination of the current location at 402 may include a determination of a current merchant in which the user wearing the wearable device 100 is presently located. In some embodiments the current location information may further be transmitted to an off-site server tasked with keeping track of the wearable device 100. For example, the off-site server may be the merchant server 250 or shopping server 260 as illustrated in
At 403, the image captured at 401 is analyzed in order to recognize one or more merchants that are within the field of view of the wearable device 100. For example,
In addition or alternatively, recognizing the merchants at 403 may include an image recognition process where the wearable device 100 is able to analyze the captured image from 401, and in case the image does not include the characters that describe the merchant's name, the analysis may be able to determine the merchant's identity based on the look and/or dress of the merchant's storefront captured in the image. In such cases where the wearable device 100 analyzes the captured image in order to recognize the look and/or dress of the merchant's storefront, a number of suggested merchant identities may be generated by the wearable device 100 based on the analysis of the captured image. This list of suggested merchant identities may have been calculated by the wearable device 100 as a prediction for the real identify of the merchant(s) included in the captured image. The user may then select one or more merchant identities from the list of generated merchant suggestions by inputting a command via one or more of the input devices of the input control unit 212 described herein.
Although the above description of the process at 403 above has been provided as being executed by the wearable device 100, it is within the scope of the shopping tool described herein that in some embodiments the process at 403 may be outsourced to an off-site server. The off-site server may, for example, correspond to the merchant server 250 or shopping server 260 as illustrated within the system described in
After receiving the identification information for the one or more merchants at 403, at 404 the wearable device 100 will transmit an inquiry about the identified merchants. This inquiry may be transmitted to an off-site server configured to receive the inquiry, analyze the identified merchants, and locate information corresponding to the identified merchants stored within its own memory component. For example, the off-site server may be the merchant server 250 or shopping server 260 as illustrated in
In addition or alternatively, the inquiry may be transmitted internally within the wearable device 100 itself. For example, the wearable device 100 may store a look up table in a memory that has been updated with current information corresponding to merchants. The look up table may be updated with the current information periodically via communication with off-site servers such as those corresponding to the merchants. In this way, the inquiry at 404 may be kept within the wearable device 100.
At 405, the information corresponding to the identified merchants at 404 is obtained. This information may have been transmitted back to the wearable device 100 from the off-site server describe above with reference to process 404. This information may also have been received internally within the wearable device 100 following the internal inquiry described above with reference to process 404.
The information obtained at 405 may include current promotional deals being offered by the merchants, additional information related to the merchants (for example, merchant name, merchant address, merchant contact information, merchant hiring opportunities, directions, recent news related to the merchant), and/or other information related to the corresponding merchant recognized from the field of view of the wearable device 100.
At 406, a display unit of the wearable device 100 (for example, display unit 30) may be controlled to display the information received at 405. For example,
Display 41 is comprised of a location icon (‘x’) as well as a corresponding message. The location icon identifies store 1 within the field of view of the wearable device 100, and the corresponding message presents additional information related to store 1 (for example, the information on the merchant received at 405). In this exemplary illustration, the corresponding message identifies a promotional deal 1 currently being run by store 1.
Display 42 is comprised of a location icon (‘x’) as well as a corresponding message. The location icon identifies store 2 within the field of view of the wearable device 100, and the corresponding message presents additional information related to store 2 (for example, the information on the merchant received at 405). In this exemplary illustration, the corresponding message identifies a promotional deal 2 currently being run by store 2.
Display 43 is comprised of a location icon (‘x’) as well as a corresponding message. The location icon identifies store 3 within the field of view of the wearable device 100, and the corresponding message presents additional information related to store 3 (for example, the information on the merchant received at 405). In this exemplary illustration, the corresponding message identifies a promotional deal 3 currently being run by store 3.
Display 44 is comprised of a location icon (‘x’) as well as a corresponding message. The location icon identifies store 4 within the field of view of the wearable device 100, and the corresponding message presents additional information related to store 4 (for example, the information on the merchant received at 405). In this exemplary illustration, the corresponding message identifies a promotional deal 4 currently being run by store 4.
At 501, an image within a field of view of the wearable device 100 may be captured. For example, the wearable device 100 may capture an image of a barcode and/or QR code 3 within the field of view of the wearable device 100. The captured image may be a still digital image, or a part of a digital video such as a frame, or segment, from the digital video. The captured image may be a still digital image, or part of a digital video such as a frame, or segment, from the digital video. The process for initiating the image capturing may correspond to any one or more of the processes described herein (for example, as described with reference to flow chart 300).
At 502, a current location of the wearable device 100 is identified by a location identifying component of the wearable device 100. For example, a location identifying component may be a GPS component as described, at least, elsewhere in this disclosure. The determination of the current location at 502 may include a determination of a current merchant in which the shopper wearing the wearable device 100 is presently located. In some embodiments the current location information may further be transmitted to an off-site server tasked with keeping track of the wearable device 100. For example, the off-site server may be the merchant server 250 or shopping server 260 as illustrated in
At 503, the image captured at 501 is analyzed in order to recognize an item identifier from the captured image. For example, the item identifier may be a barcode and/or QR code. In addition or alternatively, the item identifier may be a recognizable title, label, or some other similar distinguishing characteristic of the merchandise item. The item identifier may be written on a packaging for the merchandise item, or may otherwise be located to correspond to the merchandise item (for example, the item identifier may be located on a tag attached to the merchandise item.
At 504, the item identifier is analyzed in order to determine the merchandise item that corresponds to the item identifier. For example, in embodiments where the item identifier is a barcode, QR code, or some other easily identifiable type of item identifier, the item identifier may be referenced against a database of known item identifiers in order to determine the merchandise item that corresponds to the analyzed item identifier. In other embodiments where the item identifier is determined to be a recognizable title, label, or other type of item identifier that requires additional image recognition processing, the process at 504 may include an image recognition process for identifying the title, label or other type of item identifier in order to determine the corresponding merchandise item.
In addition to identifying the merchandise item that corresponds to the captured item identifier, the pricing of the merchandise item may also be determined based on the analysis of the item identifier at 504.
At 505, a determination is made as to whether the merchandise item identified at 504 has been previously recognized. For example, the merchandise item may have been recognized at another merchant store during a prior running of the shopping tool. If so, the shopping tool may have previously saved information corresponding to the merchandise item from the prior running of the shopping tool within a memory of the wearable device 100. The information may include a time/date at which the merchandise item was previously recognized, identification information of the merchandise item, identification information for the merchant at which the merchandise item was previously recognized, and a location at which the merchandise item was previously recognized. It follows that the wearable device 100 may reference previously stored merchandise information at 505 in order to determine whether the merchandise item has been previously recognized. Although 505 has been described as the shopping tool previously saving the merchandise information within a memory of the wearable device 100, it is also within the scope of the shopping tool described herein to have previously stored such information on an off-site server. For example, the off-site server may be the merchant server 250 or shopping server 260 as illustrated in
If it is determined at 505 that the merchandise item was previously recognized, then at 506 a message may be generated based on the previously recognized merchandise item. The message may include information corresponding to the previously recognized merchandise item, as described above. In addition or alternatively, the message may include information on a current promotion being offered by the merchant in which the shopper is currently located.
At 507, the message generated at 506 may be displayed on a display unit 30 of the wearable device, as illustrated in
With regards to the display illustrated by
Display 51 is comprised of a location icon (‘x’) and a corresponding message. The location icon is superimposed over the recognized merchandise item. The corresponding message in display 51 may be generated at 506 to provide current promotional information pertaining to the merchandise item being offered by the merchant in which the shopper is currently located. For example, the corresponding message within display 51 recites, “We noticed you were recently browsing for item 1. You can find item 1 here at location 1.” In this way, display 51 recognizes that the shopper previously recognized the merchandise item, and therefore presents a message informing the shopper that the same merchandise item is also currently available at the merchant in which the shopper is currently located.
The wearable device 100 may also identify another merchant within its field of view that also sells the same merchandise item as previously recognized. Display 52 exemplifies such a scenario where a second merchant is recognized within the field of view of the wearable device 100. The wearable device 100 may then run a merchant identification process to determine an identity of the second merchant. After determining the identity of the second merchant, the wearable device 100 may further determine whether the second merchant sells the same merchandise item as previously recognized at the first merchant and/or the current merchant. Because the merchandise item was previously recognized, there may exist information stored on a memory of the wearable device 100 that describes the merchandise item being sold at the first merchant and/or current merchant. It follows that a comparison may be made during the generation of the message at 506 that generates a message that includes information that compares the merchandise item as being sold at the second merchant versus the merchandise item as being sold by the first and/or current merchant. This is exemplified by display 52 that recites, “Item 1 can also be found at location 2 located x ft. further away for $x.xx, which is less than the price at location 1.”
Going back to flow chart 500, if the merchandise item is determined not to have been previously recognized at 505, then at 508 a request may be transmitted to request an identity of a merchant that sells the merchandise item identified at 504. This request transmission may be similar, if not the same, as the request transmission provided at 305 in the process described by flow chart 300 herein.
At 601, an image within a field of view of the wearable device 100 may be captured. For example,
At 602, a current location of the wearable device 100 is identified by a location identifying component of the wearable device 100. For example, a location identifying component may be a GPS component as described, at least, elsewhere in this disclosure. The determination of the current location at 602 may include a determination of a current merchant in which the shopper wearing the wearable device 100 is presently located. In some embodiments the current location information may further be transmitted to an off-site server tasked with keeping track of the wearable device 100. For example, the off-site server may be the merchant server 250 or shopping server 260 as illustrated in
At 603, the image captured at 601 is analyzed in order to recognize one or more merchants from the captured image. For example,
In addition or alternatively, recognizing the merchants at 603 may include an image recognition process where the wearable device 100 is able to analyze the captured image from 601, and in case the image does not include the characters that describe the merchant's name, the analysis may be able to determine the merchant's identity based on the look and/or dress of the merchant's storefront as recognized from the image. In such cases where the wearable device 100 analyzes the captured image in order to recognize the look and/or dress of the merchant's storefront, a number of suggested merchant identities may be generated by the wearable device 100 based on the analysis of the captured image. This list of suggested merchant identities may have been calculated by the wearable device 100 as a prediction for the real identify of the merchant(s) included in the captured image. The user may then select one or more merchant identities from the list of generated merchant suggestions.
Although the above description of the process at 603 above has been provided as being executed by the wearable device 100, it is within the scope of the shopping tool described herein that in some embodiments this process at 603 may be outsourced to an off-site server. For example, the off-site server may be the merchant server 250 or shopping server 260 as illustrated in
After identifying the merchant at 603, at 604 the wearable device 100 may obtain information corresponding to the identified merchant. In some embodiments, the wearable device 100 may store information corresponding to merchants on one or more local memory components of the wearable device 100. In such embodiments, the information corresponding to the merchants may be updated periodically by receiving updates from off-site sources (for example, merchant servers) via network communications. For example, the off-site server may be the merchant server 250 or shopping server 260 as illustrated in
Then at 605, the wearable device 100 may control a display unit 30 to display the information obtained at 604. For example, displays 61-64 exemplify merchants that may have been found within the field of view of the wearable device 100 according to the process described in flow chart 600.
Display 61 comprises a location identifier (‘x’) superimposed over merchant 1 and a message that includes information corresponding to the merchant 1. The message recites that, “Merchant 1 here participates in promotional deal L.”
Display 62 comprises a location identifier (‘x’) superimposed over merchant 2 and a message that includes information corresponding to the merchant 2. The message recites that, “Merchant 2 here participates in promotional deal 2.”
Display 63 comprises a location identifier (‘x’) superimposed over merchant 3 and a message that includes information corresponding to the merchant 3. The message recites that, “Merchant 3 here does not participate in promotional deal 1.”
Display 64 comprises a location identifier (‘x’) superimposed over merchant 4 and a message that includes information corresponding to the merchant 4. The message recites that, “Merchant 4 here does not participate in promotional deal 1.”
At 701, a current location of the wearable device 100 is identified by a location identifying component of the wearable device 100. For example, a location identifying component may be a GPS component as described, at least, elsewhere in this disclosure. In some embodiments the current location information may further be transmitted to an off-site server tasked with keeping track of the wearable device 100. For example, the off-site server may be the merchant server 250 or shopping server 260 as illustrated in
In the meantime, an in-person transaction may be detected by a financial institution that identifies a financial account (for example, credit card, debit card, gift card, etc.) belonging to the shopper being involved in an in-person transaction. Information identifying the detection of the in-person transaction, as well as a location of the in-person transaction, may then be transmitted from the financial institution and received by the wearable device 100 owned by the shopper at 702.
At 703, a determination may be made whether the location of the in-person transaction is further away than a threshold distance away from the current location of the shopper (as identified from the location of the wearable device 100 identified at 701).
If the determination at 703 finds that the location of the recent transaction is not further away than the threshold distance, then a warning message is not generated at 706.
However, if the determination at 703 finds that the location of the recent transaction is further away than the threshold distance, then a warning message is generated at 704. This is because there is a high likelihood that the recent transaction involving the shopper's financial account was fraudulent. This is based on the shopper being located at the current location, while the transaction was detected at a location that is further away than the threshold distance away from the shopper's current location. The threshold distance may be a predetermined distance that is considered to be greater than a safe distance which does not trigger concerns of a fraudulent transaction.
At 705, the display unit 30 of the wearable device may be controlled to display the warning message generated at 704. For example,
At 801, an image within a field of view of the wearable device 100 may be captured. For example,
At 802, the image captured at 801 is analyzed in order to recognize an item identifier from the captured image. For example, the item identifier may be a barcode and/or QR code 81 as illustrated in
At 803, the item identifier is analyzed in order to determine the merchandise item that corresponds to the item identifier. For example, in embodiments where the item identifier is a barcode, QR code, or some other easily identifiable type of item identifier, the item identifier may be referenced against a database of known item identifiers in order to determine the merchandise item that corresponds to the analyzed item identifier. In other embodiments where the item identifier is determined to be a recognizable title, label, or other type of item identifier that requires additional image recognition processing, the process at 803 may include an image recognition process for identifying the title, label or other type of item identifier in order to determine the corresponding merchandise item.
In addition to identifying the merchandise item that corresponds to the captured item identifier, additional information corresponding to the merchandise item may be identified at 803 following the identification of the merchandise item. For example, food safety alert information pertaining to the identified merchandise item may be obtained at 803 following the identification of the merchandise item. In addition, nutritional facts information pertaining to the identified merchandise item may be obtained at 803 following the identification of the merchandise item. In addition, ingredient information pertaining to the identified merchandise item may be obtained at 803 following the identification of the merchandise item. In addition, financial transaction information pertaining to the identified merchandise item and the shopper may be obtained at 803 following the identification of the merchandise item. In addition, pricing information of the merchandise item pertaining to the identified merchandise item may be obtained at 803 following the identification of the merchandise item.
At 804, an application is initiated that references the item. More specifically, the application initiated at 804 may reference information corresponding to the item identified at 803. For example,
At 901, a shopping list application may be running on the wearable device 100. The shopping list application may reference a shopping list previously prepared by the shopper and stored on a memory of the wearable device or on the shopping server 260. The shopping list may include information identifying items (for example, merchandise items, food items, etc.) input by the shopper. In additionally, the shopping list may be a preloaded shopping list included as part of the shopping list application. For example, the shopping list application may include preloaded shopping lists that include the ingredients needed for specific food dish recipes. The shopping list application may also include preloaded shopping lists that include the items needed for a specific building project (for example, items needed to install kitchen backsplash). In some embodiments, the preloaded shopping lists may be revised by the shopper. Also, it should be noted that in some embodiments the shopping list may be stored on an off-site server such that the shopping list application running on the wearable device 100 may transmit a request for the shopping list to the off-site server in order to retrieve the shopping list for use in the shopping list application. The off-site server may, for example, correspond to the merchant server 250 or shopping server 260 as illustrated within the system described in
In order to generate the shopping list, a shopper may have entered a desired list from a computing device the shopper has (such as home PC, tablet or portable computing device) and uploaded it to the shopping server 260. The current status of what the shopper needs may then be determined by the shopper using the wearable device 100 to scan the shopper's refrigerator and/or cabinets to automatically check what needs to be purchased and what already exists in the shopper's home in sufficient quantities. The labels and descriptions of the items in the shopper's home may be analyzed with an OCR or other recognition software, or the barcode or QR code information can be analyzed, and then compared to the complete list that the shopper maintains locally or in the shopping server 260. The items not scanned by the wearable device 100, but present on the master shopping list, may then be placed on the current shopping list. Alternatively, the shopping list may be manually input from a computing device of the shopper and uploaded into the wearable device directly, or via the shopping server, without any comparison to a master shopping list. Similarly, a shopping list may be automatically generated at the shopper's home computer or the shopping server based on a recipe and the totality of the ingredients placed in a shopping list, or just those missing items not currently scanned at the shopper's home may be placed on the shopping list.
At 902, a current location of the wearable device 100 is identified by a location identifying component of the wearable device 100. For example, a location identifying component may be a GPS/IPS component 229 as described, at least, elsewhere in this disclosure. This information may be referenced to determine a current merchant storefront in which the shopper (wearable device) is located. In addition, based on obtaining the identity of the current merchant storefront in which the shopper is located, the shopping list application may further obtain layout information describing the mapping layout of the current merchant storefront. This layout information may be stored within a memory of the wearable device 100. By comparing at least the current location information and the layout information, the shopping list application may determine the location of the shopper within the current merchant storefront.
In one embodiment, a shopping server 260 or merchant server 250 may learn (or fine tune) the internal layout of a particular store by monitoring where shoppers with a wearable device 100 scan in different items. Once the internal layout of the store is learned, or revised, based on this data, the shoppers may be able to access general maps of where items are located in the store and the shopping list may be automatically reordered for each particular shopper based on which items are currently closest to the shopper.
In some embodiments the current location information may be transmitted to an off-site server tasked with keeping track of the wearable device 100. The off-site server may, for example, correspond to the merchant server 250 or shopping server 260 as illustrated within the system described in
At 903, an image within a field of view of the wearable device 100 may be captured. For example,
At 904, the image captured at 903 may be analyzed to further specify a location of the shopper (the wearable device 100) within the merchant storefront. For example,
In some embodiments, the analysis at 904 may be accomplished by the wearable device 100 transmitting the captured image to an off-site server for analysis. For example, the off-site server may be the merchant server 250 or shopping server 260 as illustrated in
At 905, the additional information is obtained by the wearable device 100 according to any one or more of the processes described above with reference to 904.
At 906, the wearable device 100 may reference the additional information to identify a location of an item from the shopping list. This is illustrated by
After capturing the one or more item identifiers 1010 within its field of view, the wearable device 100 may further analyze the item identifiers 1010 to obtain information on the item corresponding to the item identifiers. This analysis may be implemented in accordance to any one or more of the processes described throughout this disclosure.
For example, two or more objects within the field of view of the wearable device 100 (for example, the item identifiers or merchandise items) may be compared according to a gesture command recognized by the shopping tool analyzing images captured from within the field of view of the wearable device 100. The gesture command may correspond to the shopper pointing to a first object (for example, a first item identifier) within the field of view with a first digit (for example, finger or other pointed object), and then pointing to a second object (for example, a second item identifier) within the field of view with a second digit (for example, finger or other pointed object). The two digits (for example, fingers on a same hand, or different hands) may be recognized by the shopping tool as a gesture command to capture an image or begin video recording by the image capturing device of the wearable device 100. The image capturing device may further be configured to capture an image within a specified radius, box, or other area within relation to a proximity to the recognized digit. For example, the image capturing device may focus on capturing an image within a specified radius, box, or other area within relation to a tip of the shopper's finger as recognized from the field of view. After capturing the image of the two or more objects, the shopping tool may analyze the image in order to recognize the two objects. After recognizing the two or more objects, the shopping tool may obtain information corresponding to the two objects from a database stored on a memory of the wearable device 100. In addition or alternatively, the shopping tool may transmit a request to an off-site server to obtain information corresponding to the two objects recognized from the captured image. For example, the off-site server may be the merchant server 250 or shopping server 260 as illustrated in
According to another example, in some embodiments the wearable device 100 may detect a current location of the wearable device 100 according to any one or more of the processes described herein, for example via an, indoor positioning system (IPS), global positioning system (GPS) or combination of both. Based on the location detection, the wearable device 100 may determine a current merchant in which the wearable device is located. The user of the wearable device may order their shopping list based on their current location and the distance they are from that item and display the list or item to the wearer. For example, all produce items will show up next in the shopping list when in the produce section of the store. Alternatively, the wearable device 100 may obtain information on the current merchant by communicating with a device (for example, via Near Frequency Communication, Bluetooth, or other similar standard) corresponding to the current merchant, such that coming within a vicinity of the device will inform the wearable device 100 the identity of the current merchant. This device may, for example, be the current merchant's server 250 as illustrated in the system of
In addition or alternatively, checking out the merchandise item may also include checking the merchandise item off a shopping list managed and stored by the shopping tool. For example,
In addition or alternatively, the shopping tool running on the wearable device 100 may output an audio response describing the information on the item corresponding to the item identifiers. This feature of the shopping tool may be beneficial to sight impaired shoppers that may not be able to clearly read information displayed on the display unit 30 of the wearable device 100. This audio response feature is also applicable to any of the information identified as described throughout this disclosure.
The foregoing descriptions of embodiments of the invention have been presented for purposes of illustration and description only. They are not intended to be exhaustive or to limit the invention to the forms disclosed. Accordingly, the above disclosure is not intended to limit the invention; the scope of the invention is defined by the appended claims.
For example, although the wearable device 100 is describe in
Although the processes described by flow charts 300-900 are provided in a particular order, it is within the scope of the innovation described herein to have one or more of the processes implemented in another order.
Although this disclosure describes merchants offering merchandise items, the items may by physical items, or services offered by the merchant.
McQuarrie, Michael Scott, Fernandez, Gabriel C., Hernandez, Heather, Johnson, Zakery L., Ethington, Seth, Marquez, Amy R., Pickrel, Corey, Haverlah, Sharon K.
Patent | Priority | Assignee | Title |
11694242, | Dec 19 2018 | MERCARI, INC. | Wearable terminal, information processing terminal, and product information display method |
Patent | Priority | Assignee | Title |
20070073592, | |||
20100262554, | |||
20120209773, | |||
20130290145, | |||
20130293530, | |||
20130317912, | |||
20130346168, | |||
20140218269, | |||
20150012426, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Apr 29 2015 | United Services Automobile Association (USAA) | (assignment on the face of the patent) | / | |||
Sep 09 2021 | FERNANDEZ, GABRIEL C | UNITED SERVICES AUTOMOBILE ASSOCIATION USAA | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 057761 | /0915 | |
Sep 13 2021 | ETHINGTON, SETH | UNITED SERVICES AUTOMOBILE ASSOCIATION USAA | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 057761 | /0915 | |
Sep 13 2021 | MCQUARRIE, MICHAEL SCOTT | UNITED SERVICES AUTOMOBILE ASSOCIATION USAA | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 057761 | /0915 | |
Oct 08 2021 | HERNANDEZ, HEATHER | UNITED SERVICES AUTOMOBILE ASSOCIATION USAA | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 057761 | /0915 | |
Oct 11 2021 | HAVERLAH, SHARON K | UNITED SERVICES AUTOMOBILE ASSOCIATION USAA | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 057761 | /0915 |
Date | Maintenance Fee Events |
Date | Maintenance Schedule |
May 10 2025 | 4 years fee payment window open |
Nov 10 2025 | 6 months grace period start (w surcharge) |
May 10 2026 | patent expiry (for year 4) |
May 10 2028 | 2 years to revive unintentionally abandoned end. (for year 4) |
May 10 2029 | 8 years fee payment window open |
Nov 10 2029 | 6 months grace period start (w surcharge) |
May 10 2030 | patent expiry (for year 8) |
May 10 2032 | 2 years to revive unintentionally abandoned end. (for year 8) |
May 10 2033 | 12 years fee payment window open |
Nov 10 2033 | 6 months grace period start (w surcharge) |
May 10 2034 | patent expiry (for year 12) |
May 10 2036 | 2 years to revive unintentionally abandoned end. (for year 12) |