A method for controlling an information terminal causes a computer of the information terminal to receive, from a case retrieval system, a plurality of similar medical images having a feature quantity of a region of interest and a certain degree of similarity in accordance with the region of interest included in a target medical image, displays a display screen displaying the plurality of received similar medical images on a touch panel display, the display screen including a display region in which at least some of the plurality of received similar medical images are displayed, displays, if selection of a first similar medical image from among the at least some of the plurality of received similar medical images displayed in the display region is detected, the first similar medical image across the display region, and displays, if a swipe operation performed on the first similar medical image is detected, a second similar medical image, which has second highest similarity next to the first similar medical image among the plurality of similar medical images, in the display region such that a corresponding region of interest included in the second similar medical image is located at a certain position in the display region.
Legal claims defining the scope of protection, as filed with the USPTO.
1. A method for controlling an information terminal that includes a touch panel display, the method comprising: displaying a target medical image on the touch panel display, the target medical image being a medical image to be read; causing a computer of the information terminal to detect information indicating a region of interest in the target medical image; displaying a plurality of thumbnail images in a predetermined area included in the touch panel display, the plurality of thumbnail images respectively corresponding to a plurality of similar medical images, the plurality of thumbnail images being displayed in descending order of similarity between an image feature in the corresponding similar medical image and an image feature in the region of interest in the target medical image, the plurality of thumbnail images including a first thumbnail image and a second thumbnail image, the first thumbnail image and the second thumbnail image being display adjacent to one another; when detecting selection of the first thumbnail image, (i) removing display of the plurality of thumbnail images from the predetermined area and (ii) displaying an enlarged first thumbnail image in the predetermined area without displaying the plurality of thumbnail images in the predetermined area, the enlarged first thumbnail image being generated based on a first similar medical image corresponding to the first thumbnail image, a size of the enlarged first thumbnail image being larger than a size of the first thumbnail image; and when detecting a swipe operation performed on the enlarged first thumbnail image displayed in the predetermined area, (i) removing display of the enlarged first thumbnail image from the predetermined area and (ii) displaying a part of an enlarged second thumbnail image in the predetermined area without displaying the enlarged first thumbnail image, the enlarged second thumbnail image being generated based on a second similar medical image corresponding to the second thumbnail image, a size of the enlarged second thumbnail image being larger than a size of the second thumbnail image, wherein in the displaying the part of the enlarged second thumbnail image, a region of interest of the enlarged second thumbnail image is located in a predetermined position in the predetermined area.
2. The method according to claim 1 , further comprising: when detecting a swipe operation performed on the part of the enlarged second thumbnail image displayed in the predetermined area, (i) removing displaying of the part of the enlarged second thumbnail image from the predetermined area and (ii) displaying a part of an enlarged third thumbnail image in the predetermined area without displaying the part of the enlarged second thumbnail image, the enlarged third thumbnail image being generated based on a third similar medical image corresponding to a third thumbnail image from among the plurality of thumbnail images, a size of the enlarged third thumbnail image being larger than a size of the third thumbnail image, wherein in the displaying the part of the enlarged third thumbnail image, a region of interest of the enlarged third thumbnail image is located in the predetermined position in the predetermined area, and wherein in the displaying the plurality of thumbnail images, the third thumbnail image is displayed adjacent to the second thumbnail image.
3. The method according to claim 1 , wherein, when the enlarged first thumbnail image is displayed in the predetermined area, a region of interest included in the enlarged first thumbnail image is located in the predetermined position.
4. The method according to claim 1 , wherein the predetermined position is a center of the predetermined area.
5. The method according to claim 1 , wherein, when the predetermined area includes an area not displaying the part of the enlarged second thumbnail image, the area not displaying the part of the enlarged second thumbnail image is filled out with a background image.
6. The method according to claim 5 , wherein, when a swipe operation performed on the part of the enlarged second thumbnail image is not detected for a predetermined period of time after the part of the enlarged second thumbnail image is displayed in the predetermined area, the enlarged second thumbnail image is displayed in the predetermined area without the background image instead of the part of the enlarged second thumbnail image and the background image.
7. The method according to claim 1 , further comprising: causing the computer to transmit information indicating the image feature of the region of interest to a case retrieval system; and causing the computer to receive, from the case retrieval system, the similar medical images.
8. The method according to claim 1 , further comprising: causing the computer to transmit the target medical image and the information indicating the region of interest to a case retrieval system; and causing the computer to receive, from the case retrieval system, the similar medical images.
9. A method for controlling an information terminal that includes a touch panel display, the method comprising; displaying a target medical image on a touch panel display, the target medical image being a medical image to be read; causing a computer of the information terminal to detect information indicating a region of interest in the target medical image; displaying a plurality of thumbnail images in a predetermined area included in the touch panel display, the plurality of thumbnail images respectively corresponding to a plurality of similar medical images, the plurality of thumbnail images being displayed in descending order of similarity between an image feature in the corresponding similar medical image and an image feature in the region of interest in the target medical image, the plurality of thumbnail images including a first thumbnail image and a second thumbnail image, the first thumbnail image and the second thumbnail image being display adjacent to one another; when detecting selection of the first thumbnail image, (i) removing display of the plurality of thumbnail images from the predetermined area and (ii) displaying an enlarged first thumbnail image in the predetermined area without displaying the plurality of thumbnail images in the predetermined area, the enlarged first thumbnail image being generated based on a first similar medical image corresponding to the first thumbnail image, a size of the enlarged first thumbnail image being larger than a size of the first thumbnail image; and when detecting an enlargement operation to further enlarge the enlarged first thumbnail image by a ratio, (i) removing display of the enlarged first thumbnail image from the predetermined area and (ii) displaying a further enlarged first thumbnail image in the predetermined area without displaying the enlarged first thumbnail image, the further enlarged first thumbnail image being generated by further enlarging the enlarged first thumbnail image by the ratio, the further enlarged first thumbnail image including an enlarged region of interest generated by enlarging a region of interest of the enlarged first thumbnail image by the ratio; when detecting a swipe operation performed on the further enlarged first thumbnail image displayed in the predetermined area, (i) removing display of the further enlarged first thumbnail image from the predetermined area and (ii) displaying a further enlarged second thumbnail image in the predetermined area without displaying the further enlarged first thumbnail image, the further enlarged second thumbnail image being generated by further enlarging an enlarged second thumbnail image by the ratio, the further enlarged second thumbnail image being generated based on a second similar medical image corresponding to the second thumbnail image, a size of the enlarged second thumbnail image being larger than a size of the second thumbnail image, the further enlarged second thumbnail image including an enlarged region of interest generated by enlarging a region of interest of the enlarged second thumbnail image by the ratio; wherein in the displaying the further enlarged first thumbnail image, the enlarged region of interest of the further enlarged first thumbnail image is displayed in a center of the predetermined area, and wherein in the displaying the further enlarged second thumbnail image, the enlarged region of interest of the further enlarged second thumbnail image is displayed in the center of the predetermined area.
10. The method according to claim 9 , further comprising: when detecting a swipe operation performed on the further enlarged second thumbnail image displayed in the predetermined area, (i) removing display of the further enlarged second thumbnail image from the predetermined area and (ii) displaying a further enlarged third thumbnail image in the predetermined area without displaying the further enlarged second thumbnail image, the further enlarged third thumbnail image being generated by further enlarging an enlarged third thumbnail image by the ratio, the further enlarged third thumbnail image being generated based on a third similar medical image corresponding to a third thumbnail image from among the plurality of thumbnail images, a size of the enlarged third thumbnail image being larger than a size of the third thumbnail image, the further enlarged third thumbnail image including an enlarged region of interest generated by enlarging a region of interest of the enlarged third thumbnail image by the ratio, wherein in the displaying the further enlarged third thumbnail image, the enlarged region of interest of the further enlarged third thumbnail image is located in the center in the predetermined area, and wherein in the displaying the plurality of thumbnail images, the third thumbnail image is displayed adjacent to the second thumbnail image.
11. The method according to claim 9 , further comprising: causing the computer to transmit information indicating the image feature of the region of interest to a case retrieval system; and causing the computer to receive, from the case retrieval system, the similar medical images.
12. The method according to claim 9 , further comprising: causing the computer to transmit the target medical image and the information indicating the region of interest to a case retrieval system; and causing the computer to receive, from the case retrieval system, the similar medical images.
13. A nonvolatile recording medium storing a program executed by an information terminal that includes a touch panel display, the program causing the information terminal to perform: displaying a target medical image on the touch panel display, the target medical image being a medical image to be read; causing a computer of the information terminal to detect information indicating a region of interest in the target medical image; displaying a plurality of thumbnail images in a predetermined area included in the touch panel display, the plurality of thumbnail images respectively corresponding to a plurality of similar medical images, the plurality of thumbnail images being displayed in descending order of similarity between an image feature in the corresponding similar medical image and an image feature in the region of interest in the target medical image, the plurality of thumbnail images including a first thumbnail image and a second thumbnail image, the first thumbnail image and the second thumbnail image being display adjacent to one another; when detecting selection of the first thumbnail image, (i) removing display of the plurality of thumbnail images from the predetermined area and (ii) displaying an enlarged first thumbnail image in the predetermined area without displaying the plurality of thumbnail images in the predetermined area, the enlarged first thumbnail image being generated based on a first similar medical image corresponding to the first thumbnail image, a size of the enlarged first thumbnail image being larger than a size of the first thumbnail image; and when detecting a swipe operation performed on the enlarged first thumbnail image displayed in the predetermined area, (i) removing display of the enlarged first thumbnail image from the predetermined area and (ii) displaying a part of an enlarged second thumbnail image in the predetermined area without displaying the enlarged first thumbnail image, the enlarged second thumbnail image being generated based on a second similar medical image corresponding to the second thumbnail image, a size of the enlarged second thumbnail image being larger than a size of the second thumbnail image, wherein in the displaying the part of the enlarged second thumbnail image, a region of interest of the enlarged second thumbnail image is located in a predetermined position in the predetermined area.
14. A nonvolatile recording medium storing a program executed by an information terminal that includes a touch panel display, the program causing the information terminal to perform: displaying a target medical image on the touch panel display, the target medical image being a medical image to be read; causing a computer of the information terminal to detect information indicating a region of interest in the target medical image; displaying a plurality of thumbnail images in a predetermined area included in the touch panel display, the plurality of thumbnail images respectively corresponding to a plurality of similar medical images, the plurality of thumbnail images being displayed in descending order of similarity between an image feature in the corresponding similar medical image and an image feature in the region of interest in the target medical image, the plurality of thumbnail images including a first thumbnail image and a second thumbnail image, the first thumbnail image and the second thumbnail image being display adjacent to one another; when detecting selection of the first thumbnail image, (i) removing display of the plurality of thumbnail images from the predetermined area and (ii) displaying an enlarged first thumbnail image in the predetermined area without displaying the plurality of thumbnail images in the predetermined area, the enlarged first thumbnail image being generated based on a first similar medical image corresponding to the first thumbnail image, a size of the enlarged first thumbnail image being larger than a size of the first thumbnail image; and when detecting an enlargement operation to further enlarge the enlarged first thumbnail image by a ratio, (i) removing display of the enlarged first thumbnail image from the predetermined area and (ii) displaying a further enlarged first thumbnail image in the predetermined area without displaying the enlarged first thumbnail image, the further enlarged first thumbnail image being generated by further enlarging the enlarged first thumbnail image by the ratio, the further enlarged first thumbnail image including an enlarged region of interest generated by enlarging a region of interest of the enlarged first thumbnail image by the ratio; when detecting a swipe operation performed on the further enlarged first thumbnail image displayed in the predetermined area, (i) removing display of the further enlarged thumbnail image from the predetermined area and (ii) displaying a further enlarged second thumbnail image in the predetermined area without displaying the further enlarged first thumbnail image, the further enlarged second thumbnail image being generated by further enlarging an enlarged second thumbnail image by the ratio, the further enlarged second thumbnail image being generated based on a second similar medical image corresponding to the second thumbnail image, a size of the enlarged second thumbnail image being larger than a size of the second thumbnail image, the further enlarged second thumbnail image including an enlarged region of interest generated by enlarging a region of interest of the enlarged second thumbnail image by the ratio; wherein in the displaying the further enlarged first thumbnail image, the enlarged region of interest of the further enlarged first thumbnail image is displayed in a center of the predetermined area, and wherein in the displaying the further enlarged second thumbnail image, the enlarged region of interest of the further enlarged second thumbnail image is displayed in the center of the predetermined area.
15. The method according to claim 1 , wherein for each of the plurality of thumbnail images, the similarity between the image feature in the corresponding similar medical image and the image feature in the region of interest in the target medical image is a Euclidean distance between the image feature in the corresponding similar medical image and the image feature in the region of interest in the target medical image.
16. The method according to claim 1 , wherein for each of the plurality of thumbnail images, the similarity between the image feature in the corresponding similar medical image and the image feature in the region of interest in the target medical image is a cosine similarity between the image feature in the corresponding similar medical image and the image feature in the region of interest in the target medical image.
17. The method according to claim 1 , wherein the displaying the part of the enlarged second thumbnail image is made without detecting selection of the second thumbnail image.
18. The method according to claim 1 , wherein selection of the first thumbnail image is detected in response to a user performing a double tap operation on the first thumbnail image using an object.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
May 27, 2015
March 24, 2020
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.