A processing system deployed in a cellular network may exchange communications with a network device for a predefined period of time, may generate a custom machine learning model based on messages contained in the communications, and may execute a network function on the processing system using the custom machine learning model for interacting with the network device.
Legal claims defining the scope of protection, as filed with the USPTO.
exchanging, by a processing system including at least one processor deployed in a cellular network, communications with a network device for a predefined period of time; generating, by the processing system, a custom machine learning model based on messages contained in the communications; and executing, by the processing system, a network function on the processing system using the custom machine learning model for interacting with the network device. . A method comprising:
claim 1 exchanging, by the processing system, a second set of communications with a second network device for the predefined period of time; generating, by the processing system, a second custom machine learning model based on messages contained in the second set of communications, wherein the second custom machine learning model is different than the custom machine learning model associated with the network device; and executing, by the processing system, a second network function on the processing system using the second custom machine learning model for interacting with the second network device. . The method of, further comprising:
claim 1 . The method of, wherein the network function comprises authenticating the network device using the custom machine learning model.
claim 1 . The method of, wherein the network function comprises improving an operation of the network device using the custom machine learning model.
claim 1 . The method of, wherein the network function comprises encrypting data exchanged with the network device using the custom machine learning model.
claim 5 receiving, by the processing system, a request from a third party server to receive a subsequent communication between the processing system and the network device; and decrypting, by the processing system, the subsequent communication before transmitting the subsequent communication to the third party server. . The method of, further comprising:
claim 6 . The method of, wherein the third party server comprises a commission on accreditation for law enforcement agencies server.
claim 1 transmitting, by the processing system, the custom machine learning model to a central server to generate a key to the custom machine learning model for monitoring subsequent communications between the processing system and the network device that use the custom machine learning model. . The method of, further comprising:
claim 8 receiving, by the processing system, a control signal from the central server to halt use of the custom machine learning model when plain text of the subsequent communications encrypted with the custom machine learning model that is decrypted using the key fail to match the plain text that is not encrypted with the custom machine learning model. . The method of, further comprising:
claim 9 receiving, by the processing system, a control signal from the central server to repeat the exchanging communications with the network device for another predefined period of time to generate an updated custom machine learning model. . The method of, further comprising:
claim 1 . The method of, wherein the predefined period of time is set by a central server.
claim 1 . The method of, wherein the generating the custom machine learning model is performed within a set of constraints set by a central server, wherein the custom machine learning model comprises a custom large language model, and wherein the custom large language model is solely used for interacting with the network device.
claim 12 . The method of, wherein the set of constraints comprises at least one of: a length of each word, a maximum number of non-human readable words that can be used, a minimum number of human readable words that must be used, or a reset time frequency.
claim 1 . The method of, wherein the processing system comprises at least one of: a user endpoint device, a radio access network, a user plane function, or an authentication server.
exchanging communications with a network device for a predefined period of time; generating a custom machine learning model based on messages contained in the communications; and executing a network function on the processing system using the custom machine learning model for interacting with the network device. . A non-transitory computer-readable medium storing instructions which, when executed by a processing system including at least one processor deployed in a cellular network, cause the processing system to perform operations, the operations comprising:
claim 15 exchanging a second set of communications with a second network device for the predefined period of time; generating a second custom machine learning model based on messages contained in the second set of communications, wherein the second custom machine learning model is different than the custom machine learning model associated with the network device; and executing a second network function on the processing system using the second custom machine learning model for interacting with the second network device. . The non-transitory computer-readable medium of, wherein the operations further comprise:
claim 15 transmitting the custom machine learning model to a central server to generate a key to the custom machine learning model for monitoring subsequent communications between the processing system and the network device that use the custom machine learning model. . The non-transitory computer-readable medium of, wherein the operations further comprise:
claim 17 receiving a control signal from the central server to halt use of the custom machine learning model when plain text of the subsequent communications encrypted with the custom machine learning model that is decrypted using the key fail to match the plain text that is not encrypted with the custom machine learning model. . The non-transitory computer-readable medium of, wherein the operations further comprise:
claim 18 receiving a control signal from the central server to repeat the exchanging communications with the network device for another predefined period of time to generate an updated custom machine learning model. . The non-transitory computer-readable medium of, wherein the operations further comprise:
a processing system including at least one processor; and exchanging communications with a network device for a predefined period of time; generating a custom machine learning model based on messages contained in the communications; and executing a network function on the processing system using the custom machine learning model for interacting with the network device. a non-transitory computer-readable medium storing instructions which, when executed by the processing system when deployed in a cellular network, cause the processing system to perform operations, the operations comprising: . An apparatus comprising:
Complete technical specification and implementation details from the patent document.
The present disclosure relates generally to cellular networks, and more particularly to methods, non-transitory computer-readable media, and apparatuses for executing network functions via custom large language models.
Machine learning models such as Large language models (LLMs) can be used for natural language processing and artificial intelligence (AI) technologies. LLMs can be used to allow users to interact with devices in a natural manner. For example, a user may simply talk naturally with a device as he or she would in every day conversations with another person to interact with and/or control the device. A library of terms can be used to train the LLMs over a period of time. The LLMs can be updated and evolve overtime to become more immersive for the user.
In one example, the present disclosure discloses a method, computer-readable medium, and apparatus for executing network functions via custom large language models. For example, a processing system including at least one processor deployed in a cellular network may exchange communications with a network device for a predefined period of time, may generate a custom machine learning model based on messages contained in the communications, and may execute a network function on the processing system using the custom machine learning model for interacting with the network device.
To facilitate understanding, similar reference numerals have been used, where possible, to designate elements that are common to the figures.
The present disclosure broadly discloses methods, non-transitory computer-readable media, and apparatuses for executing network functions via custom machine learning models, e.g., large language models. Currently, network devices may communicate with each other using known standard protocols to execute various network functions. The standard protocols may use programming languages or formats that are known and can be easily hacked. Thus, network security may be a concern.
For example, authentication functions may use a username and password, a pair of keys, and the like to authenticate a network device with another network device when accessing a network. The passwords and/or keys can be stolen.
As discussed above, machine learning models, e.g., large language models (LLMs) can be used for natural language processing and artificial intelligence (AI) technologies. LLMs can be used to allow users to interact with devices. For example, a library of terms can be used to train the LLMs over a period of time.
In addition, the LLMs can be updated and evolve overtime to become more immersive. However, the ability for the LLMs to evolve can create issues if the LLMs are allowed to evolve without constraints or coordination.
In accordance with the present disclosure, network devices may create a custom LLM that can be used between only the two devices that created and/or utilized the custom LLM. In other words, pairs of network devices can create their own custom LLM that is not used by other network devices in the network. This may make it difficult for the custom LLM to be hacked. The custom LLMs can be created over a period of time based on communications exchanged between the two network devices. The custom LLMs may be based on unique messages or words, or unique context around the communications that are not accessible by any other network devices within the network. The custom LLMs may eliminate the use of existing authentication methods that can be hacked or stolen. Rather, the network devices may simply “converse” with one another to perform various network functions in a secure way without additional security elements or procedures.
In one embodiment, the network device may monitor itself to ensure that the custom LLM does not evolve to a point that the custom LLM has gone “rogue” or undecipherable by a central server, i.e., the custom LLM's behavior has deviated from the expectation of the central server. In one embodiment, the central server may monitor all network devices to ensure that none of the custom LLMs developed by any of the network devices goes “rogue.” In one embodiment, a combination of self-monitoring by each network device and centralized monitoring by a central server may be deployed.
In addition, the central server may monitor all network devices and provide constraints with regard to how the custom LLMs can be created. For example, the central server may set a predefined time period for how long communications are to be exchanged between network devices to train the custom LLM and which communications are to be used for the training (e.g., a subset of the communications conveyed during the predefined time period). The central server may also set guidelines with respect to how many characters may be included in each “word” in the custom LLM, how many human readable words (e.g., words that use a combination of American Standard Code for Information Interchange (ASCII) text or numbers) can be used, whether a minimum or maximum number of human readable words is required, whether the custom LLM may include non-human readable words (e.g., audible tones, a range of frequencies for the audible tones, images, and/or a range of colors or patterns for the images), whether a minimum or maximum number of non-human readable words is required, and the like.
1 6 FIGS.- Furthermore, the central server may determine when the network devices should halt the use of the custom LLMs for encryption. For example, the central server may have an override switch or a “kill switch” that terminates the use of the custom LLMs if the network devices evolve the custom LLMs to a point where the central server no longer understands or deciphers the custom LLM that is being used between two network devices. This may prevent the custom LLM from evolving continuously, which can lead to the network devices becoming rogue and becoming a security threat to the network. These and other aspects of the present disclosure are described in greater detail below in connection with the examples of.
1 FIG. 100 100 101 101 110 140 150 100 180 101 180 180 195 195 180 illustrates an example network, or systemin which examples of the present disclosure may operate. In one example, the systemincludes a communication service provider network. The communication service provider networkmay comprise a cellular network(e.g., a 5G network, a 4G/Long Term Evolution (LTE)/5G hybrid network, or the like), a service network, and an IP Multimedia Subsystem (IMS) network. The systemmay further include a third party serverconnected to the communication service provider network. In an example, the third party servermay be a commission on accreditation for law enforcement agencies (CALEA) server (e.g., an emergency 911 call center). As discussed in further details below, in some instances, the third party servermay request access to communications between network devices or elements that are encrypted with the custom LLM. As a result, an application server (AS)(also referred to as the central server) may control a network element to halt use of the custom LLM, or may decrypt the encrypted communications before sending the communications to the third party server.
110 120 130 120 120 121 122 126 126 121 122 121 122 126 121 122 1 FIG. In one example, the cellular networkcomprises an access networkand a cellular core network. In one example, the access networkcomprises a cloud RAN. For instance, a cloud RAN is part of the 3GPP 5G specifications for mobile networks. As part of the migration of cellular networks towards 5G, a cloud RAN may be coupled to an Evolved Packet Core (EPC) network until new cellular core networks are deployed in accordance with 5G specifications. In one example, access networkmay include cell sitesandand a baseband unit (BBU) pool. Althoughillustrates a BBU pool, it should be noted that each cell siteandmay have their own BBU. In other words, a single BBU may be deployed with each cell siteandrather than deploying a BBU poolassigned to multiple cell sitesand.
126 121 122 126 In a cloud RAN, radio frequency (RF) components, referred to as remote radio heads (RRHs) or radio units (RUs), may be deployed remotely from baseband units, e.g., atop cell site masts, buildings, and so forth. In one example, the BBU poolmay be located at distances as far as 20-80 kilometers or more away from the antennas/remote radio heads of cell sitesandthat are serviced by the BBU pool. It should also be noted in accordance with efforts to migrate to 5G networks, cell sites may be deployed with new antenna and radio infrastructures such as multiple input multiple output (MIMO) antennas, and millimeter wave antennas. In this regard, a cell, e.g., the footprint or coverage area of a cell site may in some instances be smaller than the coverage provided by NodeBs or eNodeBs of 3G-4G RAN infrastructure. For example, the coverage of a cell site utilizing one or more millimeter wave antennas may be 1000 feet or less.
123 123 121 122 121 122 126 Although cloud RAN infrastructure may include distributed RRHs and centralized baseband units, a heterogeneous network may include cell sites where RRH and BBU components remain co-located at the cell site. For instance, cell sitemay include RRH and BBU components. Thus, cell sitemay comprise a self-contained “base station.” With regard to cell sitesand, the “base stations” may comprise RRHs at cell sitesandcoupled with respective baseband units of BBU pool. In one example, baseband unit functionality may be split into a centralized unit (CU) and a distributed unit (DU). In addition, the CU and the DU may be physically separate from one another. For instance, a DU may be situated with an RU/RRH at a cell site, while a CU may be in a centralized location hosting multiple CUs. Alternatively, or in addition, a single CU may serve multiple DUs and/or RUs/RRHs. In accordance with the present disclosure a “base station” may therefore comprise at least a BBU (e.g., in one example, a CU and/or a DU), and may further include at least one RRH/RU.
121 123 121 123 126 600 6 FIG. Any one or more of cell sites-may be deployed with antenna and radio infrastructures, including multiple input multiple output (MIMO) and millimeter wave antennas. Furthermore, a base station (e.g., cell sites-and/or baseband units within BBU pool) may comprise all or a portion of a computing system, such as computing systemas depicted in, and may be configured to perform steps, functions, and/or operations in connection with examples of the present disclosure.
120 120 124 120 123 130 120 In one example, access networkmay include both 4G/LTE and 5G/NR radio access network infrastructure. For example, access networkmay include cell site, which may comprise 4G/LTE base station equipment, e.g., an eNodeB. In addition, access networkmay include cell sites comprising both 4G and 5G base station equipment, e.g., respective antennas, feed networks, baseband equipment, and so forth. For instance, cell sitemay include both 4G and 5G base station equipment and corresponding connections to 4G and 5G components in cellular core network. Although access networkis illustrated as including both 4G and 5G components, in another example, 4G and 5G components may be considered to be contained within different access networks. Nevertheless, such different access networks may have a same wireless coverage area, or fully or partially overlapping coverage areas.
130 130 121 122 120 130 126 In one example, the cellular core networkprovides various functions that support wireless services in the LTE environment. In one example, cellular core networkis an Internet Protocol (IP) packet core network that supports both real-time and non-real-time service delivery across a LTE network, e.g., as specified by the 3GPP standards. In one example, cell sitesandin the access networkare in communication with the cellular core networkvia baseband units in BBU pool.
130 195 195 195 195 195 In one embodiment, the cellular core networkmay include the AS, which may also be referred as a central server. The central servermay monitor communications encrypted with the custom LLM between network devices. The central servermay provide a control signal to halt use of the custom LLM when the custom LLM evolves outside of the predefined parameters or constraints set by the central server, as discussed in further details below.
195 180 180 104 195 104 In one embodiment, the central servermay also provide translation or decryption services for the third party server. As noted above, the third party servermay be a CALEA server that requests access to communications from one of the network elements, such as a user endpoint (UE). The central servermay decrypt communications that are encrypted by the custom LLM of the UE.
130 131 132 110 131 121 123 131 132 In addition, in the cellular core network, network devices such as Mobility Management Entity (MME)and Serving Gateway (SGW)support various functions as part of the cellular network. For example, MMEis the control node for LTE access network components, e.g., eNodeB aspects of cell sites-. In one embodiment, MMEis responsible for UE (User Equipment) tracking and paging (e.g., such as retransmissions), bearer activation and deactivation process, selection of the SGW, and authentication of a user. In one embodiment, SGWroutes and forwards user data packets, while also acting as the mobility anchor for the user plane during inter-cell handovers and as an anchor for mobility between 5G, LTE and other wireless technologies, such as 2G and 3G wireless networks.
130 133 130 134 130 140 150 180 In addition, cellular core networkmay comprise a Home Subscriber Server (HSS)that contains subscription-related information (e.g., subscriber profiles), performs authentication and authorization of a wireless service user, and provides information about the subscriber's location. The cellular core networkmay also comprise a packet data network (PDN) gateway (PGW)which serves as a gateway that provides access between the cellular core networkand various packet data networks (PDNs), e.g., service network, IMS network, networks associated with the third party server, and the like.
130 130 130 135 136 137 138 139 1 FIG. The foregoing describes long term evolution (LTE) cellular core network components (e.g., EPC components). In accordance with the present disclosure, cellular core networkmay further include other types of wireless network components e.g., 5G network components, 3G network components, etc. Thus, cellular core networkmay comprise an integrated network, e.g., including any two or more of 2G-5G infrastructures and technologies (or any future infrastructures and technologies to be deployed, e.g., 6G), and the like. For example, as illustrated in, cellular core networkfurther comprises 5G components, including: an access and mobility management function (AMF), a network slice selection function (NSSF), a session management function (SMF), a unified data management function (UDM), and a user plane function (UPF).
135 131 136 135 136 136 135 135 135 In one example, AMFmay perform registration management, connection management, endpoint device reachability management, mobility management, access authentication and authorization, security anchoring, security context management, coordination with non-5G components, e.g., MME, and so forth. NSSFmay select a network slice or network slices to serve an endpoint device, or may indicate one or more network slices that are permitted to be selected to serve an endpoint device. For instance, in one example, AMFmay query NSSFfor one or more network slices in response to a request from an endpoint device to establish a session to communicate with a PDN. The NSSFmay provide the selection to AMF, or may provide one or more permitted network slices to AMF, where AMFmay select the network slice from among the choices. A network slice may comprise a set of cellular network components, such as AMF(s), SMF(s), UPF(s), and so forth that may be arranged into different network slices which may logically be considered to be separate cellular networks. In one example, different network slices may be preferentially utilized for different types of services. For instance, a first network slice may be utilized for sensor data communications, Internet of Things (IoT), and machine-type communication (MTC), a second network slice may be used for streaming video services, a third network slice may be utilized for voice calling, a fourth network slice may be used for gaming services, and so forth.
137 138 138 133 138 133 138 133 138 133 1 FIG. In one example, SMFmay perform endpoint device IP address management, UPF selection, UPF configuration for endpoint device traffic routing to an external packet data network (PDN), charging data collection, quality of service (QoS) enforcement, and so forth. UDMmay perform user identification, credential processing, access authorization, registration management, mobility management, subscription management, and so forth. As illustrated in, UDMmay be tightly coupled to HSS. For instance, UDMand HSSmay be co-located on a single host device, or may share a same processing system comprising one or more host devices. In one example, UDMand HSSmay comprise interfaces for accessing the same or substantially similar information stored in a database on a same shared device or one or more different devices, such as subscription information, endpoint device capability information, endpoint device location information, and so forth. For instance, in one example, UDMand HSSmay both access subscription information or the like that is stored in a unified data repository (UDR) (not shown).
139 139 139 134 UPFmay provide an interconnection point to one or more external packet data networks (PDN(s)) and perform packet routing and forwarding, QoS enforcement, traffic shaping, packet inspection, and so forth. In one example, UPFmay also comprise a mobility anchor point for 4G-to-5G and 5G-to-4G session transfers. In this regard, it should be noted that UPFand PGWmay provide the same or substantially similar functions, and in one example, may comprise the same device, or may share a same processing system comprising one or more host devices.
130 135 131 135 131 1 FIG. 1 FIG. It should be noted that other examples may comprise a cellular network with a “non-stand alone” (NSA) mode architecture where 5G radio access network components, such as a “new radio” (NR), “gNodeB” (or “gNB”), and so forth are supported by a 4G/LTE core network (e.g., an EPC network), or a 5G “standalone” (SA) mode point-to-point or service-based architecture where components and functions of an EPC network are replaced by a 5G core network (e.g., an “NC”). For instance, in non-standalone (NSA) mode architecture, LTE radio equipment may continue to be used for cell signaling and management communications, while user data may rely upon a 5G new radio (NR), including millimeter wave communications, for example. However, examples of the present disclosure may also relate to a hybrid, or integrated 4G/LTE-5G cellular core network such as cellular core networkillustrated in. In this regard,illustrates a connection between AMFand MME, e.g., an “N26” interface which may convey signaling between AMFand MMErelating to endpoint device tracking as endpoint devices are served via 4G or 5G components, respectively, signaling relating to handovers between 4G and 5G components, and so forth.
140 101 140 101 180 140 180 150 130 In one example, service networkmay comprise one or more devices for providing services to subscribers, customers, and or users. For example, communication service provider networkmay provide a cloud storage service, web server hosting, and other services. As such, service networkmay represent aspects of communication service provider networkwhere infrastructure for supporting such services may be deployed. In one example, the third party servermay be connected via other networks, such as an enterprise networks, a circuit switched network (e.g., a public switched telephone network (PSTN)), a cable network, a digital subscriber line (DSL) network, a metropolitan area network (MAN), an Internet service provider (ISP) network, and the like. In this regard, it should be noted that any one or more of service network, other networks associated with the third party server, or IMS networkmay comprise a packet data network (PDN) to which an endpoint device may establish a connection via cellular core networkin accordance with the present disclosure.
130 131 132 135 136 137 138 139 130 130 131 132 121 124 134 135 136 137 138 139 100 1 FIG. In one example, any one or more of the components of cellular core networkmay comprise network function virtualization infrastructure (NFVI), e.g., SDN host devices (i.e., physical devices) configured to operate as various virtual network functions (VNFs), such as a virtual MME (vMME), a virtual HHS (vHSS), a virtual serving gateway (vSGW), a virtual packet data network gateway (vPGW), and so forth. For instance, MMEmay comprise a vMME, SGWmay comprise a vSGW, and so forth. Similarly, AMF, NSSF, SMF, UDM, and/or UPFmay also comprise NFVI configured to operate as VNFs. In addition, when comprised of various NFVI, the cellular core networkmay be expanded (or contracted) to include more or less components than the state of cellular core networkthat is illustrated in. It should be noted that intermediate devices and links between MME, SGW, cell sites-, PGW, AMF, NSSF, SMF, UDM, and/or UPF, and other components of systemare also omitted for clarity, such as additional routers, switches, gateways, and the like.
1 FIG. 6 FIG. 1 FIG. 104 104 104 600 104 161 126 121 162 195 163 135 165 161 162 163 165 also illustrates various endpoint devices, e.g., the UE. UEmay comprise a cellular telephone, a smartphone, a tablet computing device, a laptop computer, a pair of computing glasses, a wireless enabled wristwatch, a wireless transceiver for a fixed wireless broadband (FWB) deployment, or any other cellular-capable mobile telephony and computing device (broadly, “an endpoint device”). In one example, the UEmay comprise all or a portion of a computing system, such as computing systemas depicted in, and may be configured to perform steps, functions, and/or operations in connection with examples of the present disclosure As illustrated in, UEmay include a large language model (LLM) module, the BBUof the cell sitemay include an LLM module, the central servermay include an LLM module, and the AMFmay include an LLM module. Although only four network devices are shown with LLM modules, it should be noted that more, or all, of the network devices may have their own LLM module. The LLM modules,,, andmay include one or more custom LLMs, as described in further details below. For example, each custom LLM may be deployed as an encryption module and a reverse/decryption module.
161 162 163 165 126 121 162 In addition, multiple custom LLMs may be deployed in each LLM module,,, anddepending on how many other network devices a network device may communicate with. For example, if the BBUof the cell sitecommunicates with four other network devices, the LLM modulemay include four different custom LLMs deployed as a pair of custom LLM encryption modules and reverse custom LLM modules.
104 121 195 161 162 104 121 104 121 In one embodiment, the UEmay communicate with the cell siteover a period of time. For example, the central servermay set a predefined period of three months to train the LLMand the LLM, e.g., concurrently. Over the predefined period of time, the UEand the cell sitemay generate a custom or “custom trained” LLM based on unique text or contexts e.g., contained only in the communications over the three month time period between the UEand the cell site.
104 121 104 121 104 121 104 121 161 162 1 FIG. For example, the UEand the cell site(or another UE (not shown in)) may exchange communications over the three month time period. The communications may include information including the amount of data transmitted from the UEto the cell site, the frequency or bandwidth used to transmit messages on a regular basis, a number of messages that are transmitted on average per day, and the like. Overtime the UEand the cell sitemay develop a custom LLM that is based on the unique information associated with the communications between the UEand the cell site. The custom LLM may then be stored as part of the LLMand the LLM.
161 162 161 162 121 121 104 121 Subsequently after the LLMandare trained, the LLMand LLMcan be used to execute a network function, such as an authentication function or an encryption function. For example, for authentication, instead of using a public and private key pair, the cell sitemay provide a communication that includes an exact size of data transmitted on a particular day to the cell site. The information may be transmitted in a combination of audible tones and ASCII text that only the UEand the cell sitemay understand.
104 121 104 121 104 121 104 In another example, the UEand the cell sitemay exchange communications during the training period. The communications may include voice calls, text, emails, video, and the like. The communications may revolve around family members, favorite sports teams, vacations, and the like. In other words, the communications transmitted by the UEto the cell sitemay include unique information that only the UEand the cell sitemay know about. The custom LLM may be trained based on this unique information. The language used in the custom LLM may only include words included in the communications ever transmitted by the UE.
104 104 121 For example, communications from the UEmay have included names of family members Jane and John, sports teams such as Hurricanes, Phillies, and Wolverines, and vacation destinations comprising names of beaches, mountains, and islands. The custom LLM may have a library of words used in the communications with a key to provide a translation for each word used in the custom LLM. The custom LLM may create a language where the sentence “John Hurricanes beach” may be translated by the key to mean “I am UE XXXX providing authentication to cell site YYYY.” To a hacker, the sentence “John Hurricanes beach” may be unintelligible, but using the trained custom LLM the UEand the cell sitemay be able to decipher or decrypt the communications.
104 121 104 104 104 121 121 104 121 In another example, the UEand the cell site(or another UE) may exchange communications that include data from sensors. For example, the UEmay provide sensor data such as location, SSID of a Wi-Fi network, temperature, humidity, identification information associated with UE, processor utilization, memory usage, and the like. The UEmay receive sensor data from the cell siteas well. For example, the cell sitemay provide sensor data such as location, identification number, temperature, humidity, processor utilization, memory usage, average throughput, capacity utilization, and the like. The UEand the cell sitemay then generate a custom LLM based on the sensor data.
It should be noted that any combination of the above examples can be used to generate the custom LLM. For example, a combination of the data that is transmitted, word or context within each message or communication, and/or sensor data may be used to generate the custom LLM.
104 121 104 As noted above, the custom LLM may be used to perform other network functions, such as authentication, operation improvements, or encrypting data. For example, if the UEis on a busy frequency or bandwidth, the cell sitemay send a control signal in the custom LLM to the UEto change a connection to a different frequency (e.g., changing from 2.4 GHz channel on Wi-Fi to the 5.0 GHz channel).
121 121 104 121 104 104 104 104 121 In another example, the cell sitemay have custom LLMs set up with other user endpoint devices. The cell sitemay remember a particular application that improved compression for large amounts of data for another endpoint device. When the UEattempts to transmit a large data file, the cell sitemay use the custom LLM to send a control signal to automatically install the data compression application on the UEand have the UEuse the data compression application to compress the large data file before transmitting the large data file. Thus, the custom LLM may be used to change a configuration or parameter setting on the UEto improve operation of the UEor the cell site.
104 121 104 121 In another example, once the UEis authenticated to the network via the cell site, the UEmay encrypt all data using the custom LLM. The cell sitemay then use a key for the custom LLM to decrypt the data or may pass the data along to a destination that may also have the custom LLM to decrypt the data.
121 135 162 121 161 165 121 135 121 135 121 135 121 104 In one embodiment, the cell sitemay create a second custom LLM with another network device, such as the AMF. For example, LLM moduleof the cell sitemay be configured with multiple custom LLMs that can communicate with the LLM moduleand the LLM module. For example, the cell sitemay also exchange messages with the AMFfor a predefined period of time to train the custom LLM used between the cell siteand the AMF. The custom LLM used between the cell siteand the AMFmay be different than the custom LLM used between the cell siteand the UE.
121 135 121 104 121 135 162 165 162 165 121 135 The communications exchanged between the cell siteand the AMFmay include unique messages or context that is not included between the communications exchanged between the cell siteand the UE. For example, the cell siteand the AMFmay only exchange messages that include various machine code or programming languages. Thus, unique content within these messages may be used to train the custom LLM used by the LLM moduleand the LLM module. The custom LLM developed for the LLM moduleand the LLM modulemay then be used to execute a second network function between the cell siteand the AMF.
195 195 3 FIG. 5 FIG. The custom LLMs developed by the various network devices may all be transmitted to the central serverfor monitoring purposes, as discussed in further details below with respect toand. After the custom LLMs are initially set, the custom LLMs may bet set to establish a key to decrypt any encrypted messages exchanged between any two network devices. As the custom LLMs evolve between these two network devices, the evolved custom LLMs may also be periodically transmitted to the central serverfor monitoring. However, the key to decipher encrypted communications may be set with the initial custom LLM that was developed after the first training period between two network devices.
195 195 195 195 Thus, the central servermay monitor the custom LLMs, to ensure that the custom LLMs do not evolve to a point of being “rogue,” and the central servercan send control signals to particular network devices that have “rogue” custom LLMs to halt use of the “rogue” custom LLMs. The central servermay also send control signals to the network devices to retrain or reset the “rogue” custom LLMs and to create updated custom LLMs that fall back within the constraints and/or parameters set by the central server.
195 180 180 104 180 104 195 104 180 In one embodiment, the central servermay also provide “translation services” for the third party server. For example, the third party servermay be on a competitor network that does not use the custom LLMs. The UEmay be trying to communicate with the third party server. The UEmay still use the custom LLM to encrypt the data that is transmitted. The central serverhaving acquired the custom LLM from the UEmay then decrypt the encrypted data before transmitting the data to the third party server.
195 180 195 180 180 195 101 In one embodiment, the central servermay also send an over-ride control signal to a particular network device to turn the custom LLM on and off. Thus, when the request from the third party serveris received the central servermay transmit the over-ride control signal to the network device with the communications that the third party serveris requesting to stop encryption with the custom LLM. The network device may then send the unencrypted communication to the third party server. After the request is completed, the central servermay then send another control signal to the network device to re-activate the custom LLM. Thus, the custom LLM encryption/decryption may be provided as a subscription service to other network devices or elements outside of the communication service provider network.
100 100 100 100 100 100 The foregoing description of the systemis provided as an illustrative example only. In other words, the example of systemis merely illustrative of one network configuration that is suitable for implementing examples of the present disclosure. As such, other logical and/or physical arrangements for the systemmay be implemented in accordance with the present disclosure. For example, the systemmay be expanded to include additional networks, such as network operations center (NOC) networks, additional access networks, and so forth. The systemmay also be expanded to include additional network elements such as border elements, routers, switches, policy servers, security devices, gateways, a content distribution network (CDN) and the like, without altering the scope of the present disclosure. In addition, systemmay be altered to omit various elements, substitute elements for devices that perform the same or similar functions, combine elements that are illustrated as separate devices, and/or implement network elements as functions that are spread across several devices that operate collectively as the respective network elements.
130 130 100 150 136 135 130 121 123 123 135 131 132 For instance, in one example, the cellular core networkmay further include a Diameter routing agent (DRA) which may be engaged in the proper routing of messages between other elements within cellular core network, and with other components of the system, such as a call session control function (CSCF) (not shown) in IMS network. In another example, the NSSFmay be integrated within the AMF. In addition, cellular core networkmay also include additional 5G NG core components, such as: a policy control function (PCF), an authentication server function (AUSF), a network repository function (NRF), and other application functions (AFs). In one example, any one or more of cell sites-may comprise 2G, 3G, 4G and/or LTE radios, e.g., in addition to 5G new radio (NR), or gNB functionality. For instance, cell siteis illustrated as being in communication with AMFin addition to MMEand SGW. Thus, these and other modifications are all contemplated within the scope of the present disclosure.
2 FIG. 2 FIG. 3 FIG. 161 162 165 163 120 130 To aid in understanding the present disclosure,illustrates a block diagram of the LLM module.may also represent the LLM, the LLMor any other LLMs, other than the LLMillustrated inand discussed in further detail below, that may be included in the other network devices or elements in the access networkand the cellular core network.
161 195 161 202 204 206 208 161 204 104 121 206 In an example, the LLM modulemay include a self-monitoring loop to ensure that the custom LLM does not evolve to a point that cannot be controlled by the central server. For example, the LLM modulemay include a load balancer (LB), a custom LLM encryption module, a reversed custom LLM module, and a comparator. As noted above, the LLM modulemay be trained with a custom LLM. The custom LLM encryption modulemay include the current status of the custom LLM developed between the UEand the cell site. The reversed custom LLM modulemay include a key or the definitions for terms, symbols, images, audio tones, and the like that were set during after the first training period was completed for the custom LLM.
206 104 121 204 The key or definitions of the reversed custom LLM moduleare fixed and do not change over time. However, the custom LLM used between the UEand the cell sitemay evolve over time. Thus, the custom LLM encryption modulemay change dynamically over time as the custom LLM evolves.
161 202 204 202 208 204 206 206 208 In one example, input data may be fed to the LLM module. The input data may be any type of data, including a voice call, text messages, emails, images, videos, and the like. The input data may be fed to the LBand the custom LLM encryption module. The input data may also be fed directly from the LBwithout encryption to the comparator. The custom LLM encryption modulemay encrypt the input data with the custom LLM and feed the encrypted input data to the reversed custom LLM module. The reversed custom LLM modulemay decrypt the encrypted data back to the original form of the input data and feed the input data to the comparator.
208 202 206 161 195 208 202 204 161 The comparatormay then compare the input data received directly from the LBand the decrypted input data received from the reversed custom LLM module. If the two input data match, then the LLM moduleis operating properly and may continue to use the custom LLM. However, if the two input data do not match, then the custom LLM may have evolved outside of the allowable parameters or constraints set by the central server. As a result, the comparatormay send a control signal back to the LBto halt the use of the custom LLM encryption moduleor the custom LLM used by the LLM module.
195 161 104 204 195 104 121 195 The central servermay also be notified by the LLM modulevia the UEthat the custom LLM encryption modulehas gone “rogue” (or deviated from an acceptable norm) and operation has been halted. In response, the central servermay then instruct the UEand the cell siteto execute a training procedure again over the predefined time period to reset the custom LLM in accordance with the parameters or constraints set by the central server.
3 FIG. 1 FIG. 163 195 163 161 162 165 304 306 163 304 163 306 163 304 306 illustrates a block diagram of an LLM modulethat may be part of the central server. The LLM modulemay be slightly different than the LLM modules,, ordeployed on the network devices or elements. Although a single custom LLM encryption moduleand a single reversed custom LLM moduleis illustrated in, the LLM modulemay include a custom LLM encryption modulefor every network element or device (or every set of network elements or devices) that is being monitored. Similarly, the LLM modulemay include a reversed custom LLM modulefor every network element or device (or every set of network elements or devices) that is being monitored. In other words, the LLM modulemay include multiple instances of the custom LLM encryption moduleand multiple instances of the reversed custom LLM module.
306 304 204 161 162 165 195 100 As discussed above, the reversed custom LLM modulemay be fixed and may not change over time. The custom LLM encryption modulemay be periodically updated with the custom LLM encryption modulefrom the other network device LLM modules,and. Thus, the central servermay monitor the custom LLM activity of all network devices or elements within the system.
161 163 302 302 163 195 304 306 2 FIG. Similar to the LLM moduleillustrated in, the LLM modulemay have a load balancer (LB). The input data may be fed to the LB. The input data for the LLM modulemay indicate which network device transmitted the input data. The central servermay then apply the pertinent custom LLM encryption moduleand reversed custom LLM modulefor that particular network device.
308 304 306 308 308 195 195 The input data may be forwarded to a comparatorand the custom LLM encryption modulefor encryption. The reversed custom LLM modulemay decrypt the encrypted data and the decrypted input data may be fed to the comparator. The comparatormay then determine if the two input data match. If the two input data match, then the custom LLM for the particular network device that transmitted the input data may be operating properly. If the two input data do not match, then the custom LLM may have gone “rogue” and the central servermay transmit a control signal to the network device to halt use of the custom LLM. The central servermay further instruct the network device to re-execute a custom LLM training process to reset the custom LLM for the particular network device.
195 180 180 101 101 180 104 195 180 206 104 180 In one embodiment, the central servermay include an override switch/control signal for the third party server. For example, the third party servermay be outside of the communication service provider networkand not have access to the custom LLMs used by the network devices within the communication service provider network. The third party servermay be a CALEA server that requests access to communications from the UEduring an emergency. The central servermay initiate an override to a particular network device in response to the request from the third party serverand use the reversed custom LLM Moduleof the network device to decrypt input data from the UE. The decrypted input data may then be transmitted to the third party server(e.g., a CALEA server).
195 180 195 195 306 180 In another example, the central servermay provide translation for the third party server. For example, the encrypted data may arrive at the central server. The central servermay then apply the reversed custom LLM moduleassociated with the network device that transmitted the encrypted data to decrypt the data. The decrypted data may then be transmitted to the third party serverto fulfill the request.
4 FIG. 1 FIG. 1 FIG. 6 FIG. 400 400 104 195 137 131 136 135 139 134 126 121 124 195 137 131 136 135 126 121 124 400 600 602 400 400 600 400 602 illustrates a flowchart of an example methodfor executing a network function via a custom LLM, in accordance with the present disclosure. In one example, steps, functions and/or operations of the methodmay be performed by a device as illustrated in, e.g., any of the UE, AS, SMF, MME, NSSF, AMF, UPF, PGW, and so forth, or the BBUof the cell sites-, or any one or more components thereof, such as a processing system, or collectively via a plurality devices in, such as any one or more of AS, SMF, MME, NSSF, AMF, or the BBUof the cell sites-in conjunction with another of such components, or one or more other entities, such a network repository function, and so forth. In one example, the steps, functions, or operations of methodmay be performed by a computing device or system, and/or a processing systemas described in connection withbelow. Similarly, in one example, the steps, functions, or operations of methodmay be performed by a processing system comprising one or more computing devices collectively configured to perform various steps, functions, and/or operations of the method. For instance, multiple instances of the computing device or processing systemmay collectively function as a processing system. For illustrative purposes, the methodis described in greater detail below in connection with an example performed by a processing system, such as processing system.
400 402 404 The methodbegins in step. At step, the processing system may exchange communications with a network device for a predefined period of time. For example, a UE and a BBU of a cell site or RAN may exchange communications over a predefine period of time, e.g., a three month time period, defined by a central server. The communications may include information including the amount of data transmitted from the UE to the cell site, the frequency or bandwidth used to transmit messages on a regular basis, a number of messages that are transmitted on average per day, and the like. Overtime the UE and the cell site may develop a custom LLM that is based on the unique information associated with the communications between the UE and the cell site, where the custom LLM is solely used for interaction between the UE and the cell site. The custom LLM may then be stored as part of the LLM modules associated with the UE and the cell site, where this custom LLM is accessible by the UE, the cell site and the central server.
In another example, the communications may include voice calls, text, emails, video, and the like. The communications may revolve around family members, favorite sports teams, vacations, and the like. In other words, the communications transmitted by the UE to the cell site may include unique information that only the UE and the cell site may know about. The custom LLM may be trained based on this unique information. The language used in the custom LLM may only include words included in the communications ever transmitted by the UE.
406 At step, the processing system may generate a custom large language model (LLM) based on unique messages contained in the communications. For example, given the above examples the communications from the UE may have included names of family members Jane and John, sports teams such as Hurricanes, Phillies, and Wolverines, and vacation destinations of beaches, mountains, and islands. The custom LLM may have a library of words used in the communications with a key to provide a translation for each word used in the custom LLM. The custom LLM may create a language where the sentence “John Hurricanes beach” may be translated by the key to mean “I am UE XXXX providing authentication to cell site YYYY.” To a hacker, the sentence “John Hurricanes beach” may be unintelligible, but using the trained custom LLM the UE and the cell site may be able to decipher or decrypt the communications.
In one embodiment, the custom LLM can be transmitted to the central server to generate a key to the custom LLM for monitoring subsequent communications between the UE and the cell site that use the custom LLM.
408 At step, the processing system may execute a network function on the processing system (and the network device respectively) using the custom LLM for interacting with the network device. For example, the network function may be an authentication function, improving an operation of the processing system or the network device, improving operational efficiency, or an encryption function.
In an embodiment, the custom LLM may continue to evolve over time. The central server may monitor communications between the processing system and the network device. For example, the central server may receive input data or plain text from a network device. The central server may have a custom LLM encryption module and a reversed custom LLM module associated with the network device. The central server may periodically check to see if the input data or plain text received from the network device matches the input data or plain text that is encrypted and then decrypted to see if there is a mismatch. If a mismatch is detected, the central server may determine that the custom LLM has gone “rogue.”
410 400 In response, the processing system may receive a control signal from the central server to halt use of the custom LLM when the input data or plain text of the subsequent communications encrypted and decrypted with the custom LLM fail to match the input data or plain text that is not encrypted with the custom LLM. The processing system may further receive a control signal from the central server to repeat the training process by exchanging communications with the network device for another predefined period of time to generate an updated custom LLM that falls back in-line with the parameters and constraints for the custom LLM set by the central server. At step, the methodends.
5 FIG. 6 FIG. 500 500 195 500 600 602 500 500 600 500 602 illustrates a flowchart of an example methodfor monitoring conversations between network devices, in accordance with the present disclosure. In one example, steps, functions and/or operations of the methodmay be performed by the AS or central server. In one example, the steps, functions, or operations of methodmay be performed by a computing device or system, and/or a processing systemas described in connection withbelow. Similarly, in one example, the steps, functions, or operations of methodmay be performed by a processing system comprising one or more computing devices collectively configured to perform various steps, functions, and/or operations of the method. For instance, multiple instances of the computing device or processing systemmay collectively function as a processing system. For illustrative purposes, the methodis described in greater detail below in connection with an example performed by a processing system, such as processing system.
500 502 504 The methodbegins in step. At step, the central server may monitor communications encrypted with a custom large language (LLM) between a first network device and a second network device. For example, the central server may receive input data or plain text from a network device. The central server may have a custom LLM encryption module and a reversed custom LLM module associated with the network device. The central server may periodically check to see if the plain text received from the network device matches the plain text that is encrypted, and then decrypted, to see if there is a mismatch.
506 At step, the central server may detect a mismatch between plain text of the communications and plain text decrypted from the communications encrypted with the custom LLM. If a mismatch is detected, then the central server may determine that the custom LLM has gone “rogue” (e.g., deviated from an expected normal operation). In other words, the latest version of the custom LLM encryption module received from the network device can no longer be decrypted by the reversed custom LLM module that was set when the custom LLM was initially trained.
508 510 500 At step, the central server may transmit a control signal to the first network device and/or the second network device to halt use of the custom large language model. In one embodiment, the central server may also transmit a control signal to the first network device and/or the second network device to repeat the training process by exchanging communications with the network device for the predefined period of time to generate an updated custom LLM that falls back in-line with the parameters and constraints for the custom LLM set by the central server. At step, the methodends.
400 500 4 5 FIGS.and Although not specifically specified, one or more steps, functions, or operations of the example methodsandmay include a storing, displaying, and/or outputting step as required for a particular application. In other words, any data, records, fields, and/or intermediate results discussed in the method(s) can be stored, displayed, and/or outputted either on the device executing the method or to another device, as required for a particular application. Furthermore, steps, blocks, functions or operations inthat recite a determining operation or involve a decision do not necessarily require that both branches of the determining operation be practiced. In other words, one of the branches of the determining operation can be deemed as an optional step. Furthermore, steps, blocks, functions or operations of the above described method(s) can be combined, separated, and/or performed in a different order from that described above, without departing from the examples of the present disclosure.
6 FIG. 1 FIG. 2 3 FIGS.and 6 FIG. 600 600 602 604 605 606 606 depicts a high-level block diagram of a computing device or processing system specifically programmed to perform the functions described herein. For example, any one or more components or devices illustrated in, or described in connection with the examples of, respectively, may be implemented as the processing system. As depicted in, the processing systemcomprises one or more hardware processor elements(e.g., a microprocessor, a central processing unit (CPU) and the like), a memory, (e.g., random access memory (RAM), read only memory (ROM), a disk drive, an optical drive, a magnetic drive, and/or a Universal Serial Bus (USB) drive), a modulefor executing a network function via a custom LLM, and various input/output devices, e.g., a camera, a video camera, storage devices, including but not limited to, a tape drive, a floppy drive, a hard disk drive or a compact disk drive, a receiver, a transmitter, a speaker, a display, a speech synthesizer, an output port, and a user input device (such as a keyboard, a keypad, a mouse, and the like). In accordance with the present disclosure input/output devicesmay also include antenna elements, antenna arrays, remote radio heads (RRHs), baseband units (BBUs), transceivers, power units, and so forth.
602 602 Although only one processor element is shown, it should be noted that the computing device may employ a plurality of processor elements. Furthermore, although only one computing device is shown in the Figure, if the method(s) as discussed above is implemented in a distributed or parallel manner for a particular illustrative example, i.e., the steps of the above method(s) or the entire method(s) are implemented across multiple or parallel computing devices, e.g., a processing system, then the computing device of this Figure is intended to represent each of those multiple computers. Furthermore, one or more hardware processors can be utilized in supporting a virtualized or shared computing environment. The virtualized computing environment may support one or more virtual machines representing computers, servers, or other computing devices. In such virtualized virtual machines, hardware components such as hardware processors and computer-readable storage devices may be virtualized or logically represented. The hardware processorcan also be configured or programmed to cause other devices to perform one or more operations as discussed above. In other words, the hardware processormay serve the function of a central controller directing other devices to perform the one or more operations as discussed above.
605 604 602 400 500 It should be noted that the present disclosure can be implemented in software and/or in a combination of software and hardware, e.g., using application specific integrated circuits (ASIC), a programmable logic array (PLA), including a field-programmable gate array (FPGA), or a state machine deployed on a hardware device, a computing device, or any other hardware equivalents, e.g., computer readable instructions pertaining to the method(s) discussed above can be used to configure a hardware processor to perform the steps, functions and/or operations of the above disclosed method(s). In one example, instructions and data for the present module or processfor executing a network function via a custom LLM (e.g., a software program comprising computer-executable instructions) can be loaded into memoryand executed by hardware processor elementto implement the steps, functions or operations as discussed above in connection with the example methodsor. Furthermore, when a hardware processor executes instructions to perform “operations,” this could include the hardware processor performing the operations directly and/or facilitating, directing, or cooperating with another hardware device or component (e.g., a co-processor and the like) to perform the operations.
605 The processor executing the computer readable or software instructions relating to the above described method(s) can be perceived as a programmed processor or a specialized processor. As such, the present modulefor executing a network function via a custom LLM (including associated data structures) of the present disclosure can be stored on a tangible or physical (broadly non-transitory) computer-readable storage device or medium, e.g., volatile memory, non-volatile memory, ROM memory, RAM memory, magnetic or optical drive, device or diskette and the like. Furthermore, a “tangible” computer-readable storage device or medium comprises a physical device, a hardware device, or a device that is discernible by the touch. More specifically, the computer-readable storage device may comprise any physical devices that provide the ability to store information such as data and/or instructions to be accessed by a processor or a computing device such as a computer or an application server.
While various embodiments have been described above, it should be understood that they have been presented by way of example only, and not limitation. Thus, the breadth and scope of a preferred embodiment should not be limited by any of the above-described example embodiments, but should be defined only in accordance with the following claims and their equivalents.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
September 12, 2024
March 12, 2026
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.