Patentable/Patents/US-11151117
US-11151117

Increasing the accuracy of a statement by analyzing the relationships between entities in a knowledge graph

PublishedOctober 19, 2021
Assigneenot available in USPTO data we have
Inventorsnot available in USPTO data we have
Technical Abstract

A cognitive system improves the accuracy of a natural language statement by analyzing relationships between entities in a knowledge graph for the statement. A natural language processing engine extracts entities and relationships in the statement, and a yes/no pipeline gauges the accuracy of the statement. If a statement is deemed inaccurate, the knowledge graph is used to identify a predominant relationship between certain entities, and a candidate phrase representing the predominant relationship is generated and presented to the user as a suggested replacement for a target phrase in the statement representing the relationship. The yes/no pipeline computes an accuracy score for the statement, and the statement is deemed inaccurate when the score is below a programmable threshold. The assertiveness of the system can be tuned by requiring the accuracy score of a proposed modified statement to be greater than the score of the original statement plus some tuning factor.

Patent Claims
19 claims

Legal claims defining the scope of protection, as filed with the USPTO.

1

1. A method of improving the accuracy of a natural language statement comprising: receiving the natural language statement from a user in computer-readable form, by executing first instructions in a computer system; extracting from the natural language statement a plurality of entities and at least one stated relationship using a natural language processing engine including a machine learning model, wherein the stated relationship is between at least a first one of the entities and a second one of the entities and is based on a target phrase in the statement, by executing instructions in the computer system; determining that the natural language statement is inaccurate, by executing third instructions in the computer system, based, at least in part, on a first numeric accuracy score representing an overall accuracy of the natural language statement; identifying a predominant relationship between the first and second entities using a knowledge base wherein the predominant relationship is different from the stated relationship, by executing fourth instructions in the computer system; generating a candidate phrase representing the predominant relationship using natural language processing, by executing fifth instructions in the computer system; computing a second numeric accuracy score representing an overall accuracy of the candidate statement, by executing instructions in the computer system; establishing that the second numeric accuracy score is greater than a sum of the first numeric accuracy score and a predetermined tuning value, by executing instructions in the computer system; and presenting the candidate phrase to the user as a suggested replacement for the target phrase in the natural language statement, by executing instructions in the computer system.

2

2. The method of claim 1 wherein said identifying includes: constructing a knowledge graph using the knowledge base wherein the knowledge graph includes a plurality of vertices representing the entities in the natural language statement and a plurality of edges representing relationships between the entities; and the predominant relationship is based on a statistically significant number of occurrences of a candidate relationship along a particular one of the edges of the knowledge graph, where statistically significant corresponds to more colocations of the predominant relationship than any other relationships.

3

3. The method of claim 1 wherein: said identifying identifies multiple predominant relationships between the first and second entities; said generating generates multiple candidate phrases representing the multiple predominant relationships; and said presenting presents the multiple candidate phrases to the user as suggested replacements for the target phrase in the natural language statement.

4

4. The method of claim 1 wherein said first numeric accuracy score is computed using a yes/no pipeline which uses cognitive analysis of the natural language statement based on information contained in the knowledge base.

5

5. The method of claim 4 wherein: the natural language statement is determined to be inaccurate when the numeric accuracy score is below a programmable threshold.

6

6. The method of claim 1 wherein the natural language statement is a query for submission to a deep question answering system, and further comprising: automatically replacing the target phrase in the natural language statement with the candidate phrase to form a modified statement; and submitting the modified statement to the deep question answering system.

7

7. A computer system comprising: one or more processors which process program instructions; a memory device connected to said one or more processors; and program instructions residing in said memory device for improving the accuracy of a natural language statement by: receiving the natural language statement from a user in computer-readable form, extracting from the natural language statement a plurality of entities and at least one stated relationship using a natural language processing engine including a machine learning model, wherein the stated relationship is between at least a first one of the entities and a second one of the entities and is based on a target phrase in the statement, determining that the natural language statement is inaccurate, based, at least in part, on a first numeric accuracy score representing an overall accuracy of the natural language statement, identifying a predominant relationship between the first and second entities using a knowledge base wherein the predominant relationship is different from the stated relationship, generating a candidate phrase representing the predominant relationship using natural language processing, computing a second numeric accuracy score representing an overall accuracy of the candidate phrase, establishing that the second numeric accuracy score is greater than a sum of the first numeric accuracy score and a predetermined tuning value, and presenting the candidate phrase to the user as a suggested replacement for the target phrase in the natural language statement.

8

8. The computer system of claim 7 wherein said program instructions further construct a knowledge graph using the knowledge base, the knowledge graph including a plurality of vertices representing the entities in the natural language statement and a plurality of edges representing relationships between the entities, and the predominant relationship is based on a statistically significant number of occurrences of a candidate relationship along a particular one of the edges of the knowledge graph, where statistically significant corresponds to more colocations of the predominant relationship than any other relationships.

9

9. The computer system of claim 7 wherein said program instructions identify multiple predominant relationships between the first and second entities, generate multiple candidate phrases representing the multiple predominant relationships, and present the multiple candidate phrases to the user as suggested replacements for the target phrase in the natural language statement.

10

10. The computer system of claim 7 wherein said first numeric accuracy score is computed using a yes/no pipeline which uses cognitive analysis of the natural language statement based on information contained in the knowledge base.

11

11. The computer system of claim 10 wherein the natural language statement is determined to be inaccurate when the numeric accuracy score is below a programmable threshold.

12

12. The computer system of claim 11 wherein said program instructions further generate a candidate statement by substituting the candidate phrase for the target phrase in the natural language statement.

13

13. The computer system of claim 7 wherein the natural language statement is a query for submission to a deep question answering system, and said program instructions further automatically replace the target phrase in the natural language statement with the candidate phrase to form a modified statement, and submit the modified statement to the deep question answering system.

14

14. A computer program product comprising: a computer readable storage medium; and program instructions residing in said storage medium for improving the accuracy of a natural language statement by: receiving the natural language statement from a user in computer-readable form, extracting from the natural language statement a plurality of entities and at least one stated relationship using a natural language processing engine including a machine learning model, wherein the stated relationship is between at least a first one of the entities and a second one of the entities and is based on a target phrase in the statement, determining that the natural language statement is inaccurate, based, at least in part, on a first numeric accuracy score representing an overall accuracy of the natural language statement, identifying a predominant relationship between the first and second entities using a knowledge base wherein the predominant relationship is different from the stated relationship, generating a candidate phrase representing the predominant relationship using natural language processing, computing a second numeric accuracy score representing an overall accuracy of the candidate phrase, establishing that the second numeric accuracy score is greater than a sum of the first numeric accuracy score and a predetermined tuning value, and presenting the candidate phrase to the user as a suggested replacement for the target phrase in the natural language statement.

15

15. The computer program product of claim 14 wherein said program instructions further construct a knowledge graph using the knowledge base, the knowledge graph including a plurality of vertices representing the entities in the natural language statement and a plurality of edges representing relationships between the entities, and the predominant relationship is based on a statistically significant number of occurrences of a candidate relationship along a particular one of the edges of the knowledge graph.

16

16. The computer program product of claim 14 wherein said program instructions identify multiple predominant relationships between the first and second entities, generate multiple candidate phrases representing the multiple predominant relationships, and present the multiple candidate phrases to the user as suggested replacements for the target phrase in the natural language statement.

17

17. The computer program product of claim 14 wherein said first numeric accuracy score is computed using a yes/no pipeline which uses cognitive analysis of the natural language statement based on information contained in the knowledge base.

18

18. The computer program product of claim 17 wherein the natural language statement is determined to be inaccurate when the numeric accuracy score is below a programmable threshold.

19

19. The computer program product of claim 18 wherein said program instructions further generate a candidate statement by substituting the candidate phrase for the target phrase in the natural language statement.

Classification Codes (CPC)

Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.

Patent Metadata

Filing Date

July 30, 2018

Publication Date

October 19, 2021

Want to explore more patents?

Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.

Citation & reuse

Analysis on this page is generated by Patentable — an AI-powered patent intelligence platform. AI-generated summaries, explanations, and analysis may be reused with attribution and a visible link back to the canonical URL below. Patent abstracts and claims are USPTO public domain.

Cite as: Patentable. “Increasing the accuracy of a statement by analyzing the relationships between entities in a knowledge graph” (US-11151117). https://patentable.app/patents/US-11151117

© 2026 Patentable. All rights reserved.

Patentable is a research and drafting-assistant tool, not a law firm, and does not provide legal advice. Documents we generate are drafts for review by a licensed patent attorney.