A searching apparatus comprising: a storage unit that stores therein indexes for searching for an object included in an image and cooperative information indicating a function of cooperating with the object in association with each other; a receiving unit that receives a captured image; an extracting unit that extracts an object included in the captured image; a calculating unit that calculates a degree of similarity between the object searched for by an index stored in the storage unit and the object extracted from the captured image by the extracting unit; a searching unit that searches for one or more objects based on the degree of similarity from the storage unit; and a presenting unit that presents the cooperative information associated with the index corresponding to the object as a search result of the searching unit to a source of the captured image.
Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.
1. A searching apparatus comprising: a memory configured to store therein one or more image data of which each includes respectively one or more cooperative object, and one or more pieces of cooperative information associated with one cooperative object; and a processor configured to, receive a captured image including a captured object that is a capturing target of a user, search for, out of the image data, an image data that includes the same object as the captured object included in the received captured image, determine, when a plurality of image data that includes the same object as the captured object have been searched for, a priority among a plurality of the searched image data based on a first ratio of a size of the captured object with respect to a size of the received captured image, present the cooperative information associated with the cooperative object included in at least one of the plurality of the searched image data that includes the same object as the captured object based on the determined priority, extract the captured object from the received captured image, determine the first ratio based on the size of extracted captured object and the received captured image, and determine the priority among the plurality of the searched image data based on a relation between the first ratio and a second ratio of a size of the same object included in one of the plurality of the searched image data with respect to a size of the one of the plurality of the searched image data.
A searching apparatus identifies objects in captured images and provides related cooperative information. It stores image data containing "cooperative objects" (objects with associated information like URLs or phone numbers). When a user captures an image, the system identifies objects within that image. It then searches its database for matching image data containing the same object. If multiple matches are found, it prioritizes results based on the relative size of the captured object within the captured image compared to the relative size of the same object in the stored image data. Finally, it presents the "cooperative information" linked to the object from the prioritized image data to the user.
2. The searching apparatus according to claim 1 , wherein the processor is configured to present, when a plurality of image data that include the same object as the captured object have been searched for, a message that prompts the selection of one image data out of the plurality of the searched image data to the source of the captured image.
In the searching apparatus described in Claim 1, if multiple image data matches are found for a captured object, the system presents a prompt to the user, allowing them to select which of the matching image data they are most interested in. This enables the user to refine the search and receive the most relevant cooperative information.
3. The searching apparatus according to claim 1 , wherein the memory is further configured to store therein index data obtained by analyzing the image data, and the processor is further configured to, calculate a degree of similarity between the image data and the captured image data based on feature data obtained by analyzing the captured image data and the index data, and search the image data based on the calculated degree of similarity.
The searching apparatus described in Claim 1 also analyzes stored image data to create index data (feature vectors). When a captured image is received, it's similarly analyzed to extract feature data. The system then calculates a similarity score between the captured image's feature data and the stored image data's index data. The image data search is then performed based on this similarity score, improving search accuracy and speed.
4. The searching apparatus according to claim 1 , wherein the processor is further configured to, present, when one piece of cooperative information is associated with the same object included in one of the searched image data being the highest priority, the one piece of cooperative information by executing a function indicated by the one piece of cooperative information, and present, when a plurality of pieces of cooperative information are associated with the same object included in the one of the searched image data being the highest priority, the plurality of pieces of cooperative information by displaying a selection screen that prompts the selection of one piece of cooperative information from the plurality of pieces of cooperative information to the source of the captured image.
In the searching apparatus described in Claim 1, when the highest priority image data match contains a single piece of cooperative information for the identified object, the system automatically executes the function associated with that information (e.g., directly opening a URL). If, however, the highest priority match contains multiple pieces of cooperative information, the system displays a selection screen, allowing the user to choose which piece of information they want to use (e.g., choosing between a URL and a phone number).
5. The searching apparatus according to claim 1 , wherein the cooperative information is configured to include at least URL and telephone number, and the processor is configured to present, when the searched image data includes a plurality of the cooperative objects, the plurality of pieces of the cooperative information of which each is associated with any one of the plurality of the cooperative objects.
In the searching apparatus described in Claim 1, the cooperative information includes at least URLs and telephone numbers. If a searched image data contains multiple cooperative objects, the system presents all the associated cooperative information, with each piece of information linked to its corresponding cooperative object in the image.
6. The searching apparatus according to claim 1 , wherein the cooperative information is information that includes an access method for accessing an attribute information of the cooperative object.
In the searching apparatus described in Claim 1, the cooperative information provides an access method to the cooperative object's attribute information. This means the cooperative information can provide details or methods to access additional information or functions related to the object (e.g., a link to product details, a function to add the object to a shopping cart).
7. A searching method comprising: storing one or more image data of which each includes respectively one or more cooperative object, and one or more pieces of cooperative information associated with one cooperative object; receiving a captured image including a captured object that is a capturing target of a user; searching, out of the image data, an image data that includes the same object as the captured object included in the received captured image; determining, when a plurality of image data that includes the same object as the captured object have been searched for, a priority among a plurality of the searched image data based on a first ratio of a size of the captured object with respect to a size of the received captured image; presenting the cooperative information associated with the cooperative object included in at least one of the plurality of the searched image data that includes the same object as the captured object based on the determined priority; extracting the captured object from the received captured image; determining the first ratio based on the size of extracted captured object and the received captures image; and determining the priority among the plurality of the searched image data based on a relation between the first ratio and a second ratio of a size of the same object included in one of the plurality of the searched image data with respect to a size of the one of the plurality of the searched image data.
A searching method identifies objects in captured images and provides related cooperative information. The method involves storing image data containing "cooperative objects" (objects with associated information like URLs or phone numbers). When a user captures an image, the system identifies objects within that image. It then searches its database for matching image data containing the same object. If multiple matches are found, it prioritizes results based on the relative size of the captured object within the captured image compared to the relative size of the same object in the stored image data. Finally, it presents the "cooperative information" linked to the object from the prioritized image data to the user.
8. The searching method according to claim 7 , further comprising: presenting a message that prompts the selection of one image data out of the plurality of the searched image data to the source of the captured image when a plurality of image data that include the same object as the captured object have been searched for.
The searching method from Claim 7 further includes presenting a prompt to the user if multiple image data matches are found for a captured object. This prompt allows the user to select which of the matching image data they are most interested in, enabling them to refine the search and receive the most relevant cooperative information.
9. The searching method according to claim 7 , further comprising: calculating a degree of similarity between the image data and the captured image data based on feature data obtained by analyzing the captured image data and the index data; storing therein index data obtained by analyzing the image data; and searching the image data based on the calculated degree of similarity.
The searching method from Claim 7 further analyzes stored image data to create index data (feature vectors). When a captured image is received, it's similarly analyzed to extract feature data. The system then calculates a similarity score between the captured image's feature data and the stored image data's index data. The image data search is then performed based on this similarity score, improving search accuracy and speed.
10. The searching method according to claim 7 , further comprising: presenting a function indicated by the one piece of cooperative information when one piece of cooperative information is associated with the same object included in one of the searched image data being the highest priority; and presenting the plurality of pieces of cooperative information by displaying a selection screen that prompts the selection of one piece of cooperative information from the plurality of pieces of cooperative information to the source of the captured image when a plurality of pieces of cooperative information are associated with the same object included in the one of the searched image data being the highest priority.
The searching method from Claim 7 further includes automatically executing the function associated with the cooperative information if the highest priority image data match contains a single piece of cooperative information for the identified object (e.g., directly opening a URL). If, however, the highest priority match contains multiple pieces of cooperative information, the system displays a selection screen, allowing the user to choose which piece of information they want to use (e.g., choosing between a URL and a phone number).
11. The searching method according to claim 7 , further comprising: presenting, when the searched image data includes a plurality of the cooperative objects, the plurality of pieces of the cooperative information of which each is associated with any one of the plurality of the cooperative objects, wherein the cooperative information is configured to include at least URL and telephone number.
The searching method from Claim 7 further includes presenting all the associated cooperative information if a searched image data contains multiple cooperative objects, with each piece of information linked to its corresponding cooperative object in the image. The cooperative information includes at least URLs and telephone numbers.
12. An information presenting system, comprising: a searching system; a terminal; at least one memory configured to store therein one or more image data of which each includes respectively one or more cooperative object, and one or more pieces of cooperative information associated with one cooperative object; and at least one processor configured to: send, from the terminal to the searching system, a search request based on an image captured by the terminal, the captured image including a captured object that is a capturing target of a user, search for, out of the image data, an image data that includes the same object as the captured object included in the received captured image, determine, when a plurality of image data that includes the same object as the captured object have been searched for, priority among a plurality of the searched image data based on a first ratio of a size of the captured object with respect to a size of the received captured image, send, from the searching system to the terminal, the cooperative information associated with the cooperative object included in at least one of the plurality of the searched image data that includes the same object as the captured object, present, to the user, the cooperative information sent from the searching system based on the determined priority, extract the captured object from the received captured image, determine the first ratio based on the size of extracted captured object and the received captures image, and determine the priority among the plurality of the searched image data based on a relation between the first ratio and a second ratio of a size of the same object included in one of the plurality of the searched image data with respect to a size of the one of the plurality of the searched image data.
An information presenting system uses a searching system and a terminal to identify objects in captured images and provide related information. The terminal sends a search request based on a captured image. The searching system stores image data of "cooperative objects" (objects with associated information). It searches for matching image data containing the same object as in the captured image. If multiple matches are found, it prioritizes results based on the relative size of the captured object compared to its size in the stored image data. It sends the cooperative information to the terminal, which presents it to the user based on the determined priority.
13. The information presenting system according to claim 12 , wherein the at least one processor is configured to present, when a plurality of image data that include the same object as the captured object have been searched for, a message that prompts the selection of one image data out of the plurality of the searched image data to the source of the captured image.
In the information presenting system from Claim 12, if multiple image data matches are found for a captured object, the system presents a prompt to the user, allowing them to select which of the matching image data they are most interested in. This enables the user to refine the search and receive the most relevant cooperative information.
14. The information presenting system according to claim 12 , wherein the at least one memory is further configured to store therein index data obtained by analyzing the image data, and the at least one processor is further configured to, calculate a degree of similarity between the image data and the captured image data based on feature data obtained by analyzing the captured image data and the index data, and search the image data based on the calculated degree of similarity.
In the information presenting system from Claim 12, the system analyzes stored image data to create index data (feature vectors). When a captured image is received, it's similarly analyzed to extract feature data. The system then calculates a similarity score between the captured image's feature data and the stored image data's index data. The image data search is then performed based on this similarity score, improving search accuracy and speed.
15. The information presenting system according to claim 12 , wherein the at least one processor is configured to, present, when one piece of cooperative information is associated with the same object included in one of the searched image data being the highest priority, the one piece of cooperative information by executing a function indicated by the one piece of cooperative information, and present, when a plurality of pieces of cooperative information are associated with the same object included in the one of the searched image data being the highest priority, the plurality of pieces of cooperative information by displaying a selection screen that prompts the selection of one piece of cooperative information from the plurality of pieces of cooperative information to the source of the captured image.
In the information presenting system from Claim 12, if the highest priority image data match contains a single piece of cooperative information for the identified object, the system automatically executes the function associated with that information (e.g., directly opening a URL). If, however, the highest priority match contains multiple pieces of cooperative information, the system displays a selection screen, allowing the user to choose which piece of information they want to use (e.g., choosing between a URL and a phone number).
16. The information presenting system according to claim 12 , wherein the cooperative information is configured to include at least URL and telephone number, and the at least one processor is configured to present, when the searched image data includes a plurality of the cooperative objects, the plurality of pieces of the cooperative information of which each is associated with any one of the plurality of the cooperative objects.
In the information presenting system from Claim 12, if a searched image data contains multiple cooperative objects, the system presents all the associated cooperative information, with each piece of information linked to its corresponding cooperative object in the image. The cooperative information includes at least URLs and telephone numbers.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
June 5, 2013
April 25, 2017
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.