Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.
1. A method for providing target object information, the method comprising: recognizing, via a mobile computing device processor, which objects in an image captured by a mobile device correspond to a consumer product related object; determining, via the mobile computing device processor, which of one or more recognized objects corresponding to the consumer product related object have associated target object information available via at least one information address; and presenting, via the mobile device, one or more target object information indicators representing the target object information available via the at least one information address.
A mobile app identifies objects in a captured image, specifically consumer products. For recognized products, the app checks if additional information is available online. If so, it displays indicators (like icons or labels) overlaid on the image, linking to this information. This lets users quickly access details related to items seen in the real world via their phone's camera.
2. The method of claim 1 , wherein the mobile device comprises an audio communication device.
The method of claim 1, where the mobile device also has audio capabilities, likely for providing auditory feedback or interacting with the user through voice commands in addition to visual display.
3. The method of claim 1 , wherein the mobile device comprises a display configured to present at least one of real-time provisioned content, communication information, and transaction information related to the one or more of the target object information indicators, each target object information indicator presented in relation to the one or more recognized objects determined to have associated target object information.
The method of claim 1, where the mobile app's display shows real-time content (e.g., updated prices), communication options (e.g., a "call support" button), or transaction details (e.g., "add to cart"). These options are related to the identified product and are shown near the corresponding indicator on the screen.
4. The method of claim 1 , wherein the target object information comprises information related to a point of sale or completing a transaction at a point of sale.
The method of claim 1, where the information available for target objects specifically includes information relevant to purchases, such as point-of-sale details or options for completing a transaction at a store.
5. The method of claim 1 , wherein the target object information comprises transaction information.
The method of claim 1, where the available information for target objects is purely transaction-related information such as pricing and payment options.
6. The method of claim 5 , further comprising: completing a transaction, using the mobile device as a transaction device with a point of sale terminal.
The method of claim 5, which involves using the mobile device as a payment method to complete a transaction at a point-of-sale terminal after the target object information is retrieved.
7. The method of claim 1 , wherein determining which of the one or more recognized objects has associated target object information comprises: receiving, from a retail device via wireless communication, some or all of the target object information.
The method of claim 1, where the app determines which products have information available by receiving that information wirelessly from a retail device (e.g., a store's server or beacon).
8. The method of claim 7 , wherein the consumer product related object comprises the transaction terminal.
The method of claim 7, where the consumer product recognized by the device is a transaction terminal itself, such as a payment kiosk.
9. The method of claim 1 , wherein the consumer product related object comprises at least one of the following: a product, a product sign, a product advertisement, a product poster, a product billboard, a point of sale terminal, and a transaction terminal.
The method of claim 1, where the consumer product being identified can be a physical product, a product sign, an advertisement, a poster, a billboard, a point of sale terminal, or a transaction terminal.
10. The method of claim 1 , wherein the target object information comprises at least one of the following: product information, product identity, product position, product orientation, and product status.
The method of claim 1, where the information presented to the user includes product details, identity, position, orientation, or status.
11. The method of claim 1 , wherein the target object information comprises product information comprising at least one of the following: product identification information, product feature information, product pricing information, product packaging information, and product manufacturer information.
The method of claim 1, where the target object information presented includes product identification, features, pricing, packaging, or manufacturer details.
12. The method of claim 1 , wherein the target object information comprises at least one of the following: product location, product position, product status, and product orientation.
The method of claim 1, where the target object information comprises product location, position, status, and orientation details.
13. The method of claim 1 , wherein the target object information comprises information pertinent to the consumer product related object and available to a visually impaired person.
The method of claim 1, where the available product information is tailored for visually impaired users (e.g., audio descriptions).
14. An apparatus for providing target object information, the apparatus comprising: a mobile computing platform having a processor, a memory in communication with the processor, and an image capture algorithm stored in the memory, executable by the processor and configured to capture an image via a mobile device, and a consumer product related object identification algorithm stored in the memory, executable by the processor and configured to recognize which objects in the image captured by the mobile device correspond to a consumer product related object, and a target object information algorithm stored in the memory, executable by the processor and configured to determine which of one or more recognized objects in the image corresponding to the consumer product related object has associated target object information available via at least one information address; and a target object information presentation algorithm stored in the memory, executable by the processor and configured to present, on a display of the mobile device, one or more target object information indicators representing the target object information available via the at least one information address, each target object information indicator presented in relation to at least one of the one or more recognized objects determined to have associated target object information.
A mobile system identifies objects in a camera image, specifically consumer products, using algorithms stored in memory and executed by a processor. These algorithms capture images, recognize products, and determine if those products have associated target object information (product name, price, etc.). If available, the system displays indicators on the mobile device screen, overlaid on the image near the recognized products to access target object information.
15. The apparatus of claim 14 , wherein the mobile device comprises an audio communication device.
The apparatus of claim 14, where the mobile device also includes audio communication capabilities, implying possible spoken alerts or voice control functionality.
16. The apparatus of claim 14 , wherein the mobile device comprises a display configured to present at least one of real-time provisioned content, communication information, and transaction information related to the one or more target object information indicators.
The apparatus of claim 14, where the mobile device's display shows real-time content, communication options, or transaction details tied to the displayed information indicators.
17. The apparatus of claim 14 , wherein the target object information comprises information related to a point of sale terminal or completing a transaction at a point of sale.
The apparatus of claim 14, where the information presented relates to point-of-sale systems or completing a transaction at a store.
18. The apparatus of claim 14 , wherein the target object information comprises transaction information.
The apparatus of claim 14, where the available information relates purely to transaction data.
19. The apparatus of claim 18 , wherein the mobile device is configured to complete a transaction, using the mobile device as a transaction device, with point of sale terminal.
The apparatus of claim 18, where the mobile device can complete transactions with a point-of-sale terminal.
20. The apparatus of claim 14 , wherein the target object information algorithm is configured to receive, from a retail device via wireless communication, some or all of the target object information.
The apparatus of claim 14, where target object information is wirelessly received from a retail device (e.g., a store's beacon).
21. The apparatus of claim 20 , wherein the consumer product related object comprises the transaction terminal.
The apparatus of claim 20, where the consumer product being identified is a transaction terminal itself.
22. The apparatus of claim 14 , wherein the consumer product related object comprises at least one of the following: a product, a product sign, a product advertisement, a product poster, a product billboard, a point of sale terminal, and a transaction terminal.
The apparatus of claim 14, where the consumer product is a physical product, a sign, advertisement, poster, billboard, a point-of-sale terminal, or a transaction terminal.
23. The apparatus of claim 14 , wherein the target object information comprises at least one of the following: product information, product identity, product position, product orientation, and product status.
The apparatus of claim 14, where the information presented includes product details, identity, position, orientation, or status.
24. The apparatus of claim 14 , wherein the target object information comprises product information comprising at least one of the following: product identification information, product feature information, product pricing information, product packaging information, and product manufacturer information.
The apparatus of claim 14, where the product information includes identification, features, pricing, packaging, or manufacturer details.
25. The apparatus of claim 14 , wherein the target object information comprises at least one of the following: product location, product position, product status, and product orientation.
The apparatus of claim 14, where the target object information includes the product location, position, status, and orientation.
26. The apparatus of claim 14 , wherein the target object information comprises information pertinent to the consumer product related object and available to a visually impaired person.
The apparatus of claim 14, where the target object information is tailored for visually impaired users (e.g., audio descriptions).
27. A computer program product comprising a non-transitory computer-readable medium storing software instructions that configure a mobile device processor to execute the steps of: recognizing which objects in an image captured by a mobile device correspond to a consumer product related object; determining which of one or more recognized object in the image corresponding to the consumer product related object have associated target object information available via at least one information address; and presenting one or more target object information indicators with an image displayed on the mobile device, where the target object indicators represent the target object information available via the at least one information address, each target object information indicator presented in relation to at least one of the one or more recognized object determined to have associated target object information.
A computer program stored on a non-transitory medium that enables a mobile device to identify objects in a captured image, specifically consumer products. The program determines if recognized products have associated information online. If found, the program presents indicators, such as icons, overlaid on the displayed image, allowing users to access the identified product information through these indicators.
28. A method of providing target object information, the method comprising: recognizing, via a recognition server in communication with a mobile device, which objects in an image captured on the mobile device correspond to a consumer product related object; determining, via the recognition server, which of one or more recognized objects in the image corresponding to the consumer product related object have associated target object information available via at least one information address; and communicating instructions to the mobile device, via the recognition server, for presenting on a display of the mobile device, one or more target object information indicators representing the target object information available via the at least one information address, each target object information indicator presented in relation to at least one of the one or more recognized objects determined to have associated target object information.
A system identifies objects in a mobile device's camera image using a remote server. The server recognizes consumer products in the image and checks if they have associated information. If so, the server sends instructions to the mobile device to display indicators on the screen, overlaid on the image near the recognized products, allowing users to access more information.
29. The method of claim 28 , wherein the mobile device comprises an audio communication device.
The method of claim 28, where the mobile device comprises an audio communication device. This may be used to read out the product information detected in the image, or enable voice-activated commands.
30. The method of claim 28 , wherein the mobile device comprises a display configured to present at least one of real-time provisioned content, communication information, and transaction information related to the one or more target object information indicators.
The method of claim 28, where the mobile device display shows real-time content, communication options, or transaction information related to the displayed target object information indicators.
31. The method of claim 28 , wherein the target object information comprises information related to a point of sale terminal or completing a transaction at a point of sale.
The method of claim 28, where the target object information specifically includes information related to the point-of-sale terminal or completing a transaction at a point of sale.
32. The method of claim 28 , wherein the target object information comprises transaction information.
The method of claim 28, where the target object information comprises transaction information such as pricing and payment options.
33. The method of claim 32 , further comprising: completing a transaction, using the mobile device as a transaction device with a point of sale terminal.
The method of claim 32, which involves completing a transaction at a point-of-sale terminal, using the mobile device as a transaction device after the target object information is identified and retrieved.
34. The method of claim 28 , wherein determining whether the consumer product related object has associated target object information comprises: receiving, from a retail terminal via wireless communication, some or all of the target object information.
The method of claim 28, where the server receives product information from a retail terminal via a wireless communication such as Bluetooth or Wi-Fi.
35. The method of claim 34 , wherein the consumer product related object comprises at least one of the following: a product, a product sign, a product advertisement, a product poster, a product billboard, a point of sale, and a transaction terminal.
The method of claim 34, where the recognized consumer product object comprises a product, a product sign, a product advertisement, a product poster, a product billboard, a point of sale terminal, or a transaction terminal.
36. The method of claim 28 , wherein the consumer product related object comprises at least one of the following: a product, a product sign, a product advertisement, a product poster, a product billboard, a point of sale, and a transaction terminal.
The method of claim 28, where the consumer product being identified is a product, a sign, advertisement, poster, billboard, a point-of-sale terminal, or a transaction terminal.
37. The method of claim 28 , wherein the target object information comprises at least one of the following: product information, product identity, product position, product orientation, and product status.
The method of claim 28, where the information presented includes product details, identity, position, orientation, or status.
38. The method of claim 28 , wherein the target object information comprises product information comprising at least one of the following: product identification information, product feature information, product pricing information, product packaging information, and product manufacturer information.
The method of claim 28, where the product information includes identification, features, pricing, packaging, or manufacturer details.
39. The method of claim 28 , wherein the target object information comprises at least one of the following: product location, product position, product status, and product orientation.
The method of claim 28, where the target object information includes the product location, position, status, and orientation.
40. The method of claim 28 , wherein the target object information comprises information pertinent to the consumer product related object available to a visually impaired person.
The method of claim 28, where the available product information is tailored for visually impaired users (e.g., audio descriptions).
41. An apparatus comprising: a recognition server having a processor, a memory in communication with the processor, and a communication algorithm stored in the memory, executable by the processor and configured to receive data from a mobile device, the data corresponding to one or more objects in an image captured by the mobile device; a consumer product related object recognition algorithm stored in the memory, executable by the processor and configured to recognize which objects in the image captured by the mobile device correspond to a consumer product related object; a target object information algorithm stored in the memory, executable by the processor and configured to determine which of one or more recognized objects in the image corresponding to the consumer product related object has associated target object information available via at least one information address; and, a target object information presentation algorithm stored in the memory, executable by the processor and configured to communicate instructions for presenting, on a display of the mobile device, one or more target object information indicators representing the target object information available via the information address, each target object information indicator presented in relation to at least one of the one or more recognized objects determined to have associated target object information.
A system uses a remote server to identify objects in images captured by a mobile device. The server receives image data, recognizes consumer products, and determines if associated information is available. If so, the server sends instructions to the mobile device to display information indicators on the screen, overlaid on the image next to identified products, using a communication algorithm.
42. The apparatus of claim 41 , wherein the mobile device comprises an audio communication device.
The apparatus of claim 41, wherein the mobile device comprises an audio communication device to present information to the user.
43. The apparatus of claim 41 , wherein the mobile device comprises a display configured to present at least one of real-time provisioned content, communication information, and transaction information related to the one or more target object information indicators.
The apparatus of claim 41, wherein the mobile device comprises a display to show real-time content, communication options, or transaction information related to the displayed target object information indicators.
44. The apparatus of claim 41 , wherein the target object information comprises information related to a point of sale or completing a transaction at a point of sale.
The apparatus of claim 41, wherein the target object information includes point-of-sale information, such as price and completing the transaction.
45. The apparatus of claim 41 , wherein the target object information comprises transaction information.
The apparatus of claim 41, wherein the target object information comprises transaction information, such as supported payment methods.
46. The apparatus of claim 45 , wherein the mobile device is configured to complete a transaction, using the mobile device as a transaction device, with the point of sale terminal.
The apparatus of claim 45, where the mobile device can complete transactions with the point-of-sale terminal.
47. The apparatus of claim 41 , wherein the target object information algorithm is further configured to receive, from a retail device via wireless communication, some or all of the target object information.
The apparatus of claim 41, where the target object information algorithm wirelessly receives data from a retail device, such as a beacon at the point of sale.
48. The apparatus of claim 47 , wherein the consumer product related object comprises the transaction terminal.
The apparatus of claim 47, where the consumer product being identified is the transaction terminal itself.
49. The apparatus of claim 41 , wherein the consumer product related object comprises at least one of the following: a product, a product sign, a product advertisement, a product poster, a product billboard, a point of sale terminal, and a transaction terminal.
The apparatus of claim 41, where the consumer product is a product, a sign, advertisement, poster, billboard, a point-of-sale terminal, or a transaction terminal.
50. The apparatus of claim 41 , wherein the target object information comprises at least one of the following: product information, product identity, product position, product orientation, and product status.
The apparatus of claim 41, where the information presented includes product details, identity, position, orientation, or status.
51. The apparatus of claim 41 , wherein the target object information comprises product information comprising at least one of the following: product identification information, product feature information, product pricing information, product packaging information, and product manufacturer information.
The apparatus of claim 41, where the product information includes identification, features, pricing, packaging, or manufacturer details.
52. The apparatus of claim 41 , wherein the target object information comprises at least one of the following: product location, product position, product status, and product orientation.
The apparatus of claim 41, where the target object information includes the product location, position, status, and orientation.
53. The apparatus of claim 41 , wherein the target object information comprises information pertinent to the consumer product related object and available to a visually impaired person.
The apparatus of claim 41, where the target object information is tailored for visually impaired users (e.g., audio descriptions).
54. A computer program product comprising a non-transitory computer-readable medium comprising computer-executable instructions that include the steps of: recognizing which objects in an image captured on a mobile device correspond to a consumer product related object; determining which of one or more recognized object in the image corresponding to the consumer product related objects have associated target object information available via at least one information address; and communicating instructions to the mobile device for presenting one or more target object information indicators with the image on a display of the mobile device, the target object information indicators representing the target object information available via the at least one information address, each target object information indicator presented in relation to at least one of the one or more recognized objects determined to have associated target object information.
A computer program on a non-transitory medium enables a mobile device, in conjunction with a remote server, to identify objects in a captured image, specifically consumer products. The program recognizes consumer products and determines if they have associated information. Instructions are sent to the mobile device to display indicators overlaid on the image, allowing users to access product information through these indicators.
Unknown
November 11, 2014
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.