In-Flight Building and Maintaining Dictionaries for Efficient Compression for Iot Data

1. A method comprising: sending, by a sender device in a network, a plurality of uncompressed messages to a receiver device in the network; generating, by the sender device, a sender-side compression dictionary based on the plurality of uncompressed messages, wherein the receiver device generates a receiver-side compression dictionary based on the plurality of uncompressed messages; requesting, by the sender device, an approval of the sender-side compression dictionary from the receiver device by sending a checksum of the sender-side compression dictionary to the receiver device, wherein the receiver device generates the approval or a rejection of the sender-side compression dictionary by comparing the checksum of the sender-side compression dictionary to a checksum of the receiver-side compression dictionary; in response to receiving the approval of the sender-side compression dictionary from the receiver device, sending, by the sender device, a compressed message to the receiver device that is compressed using the sender-side compression dictionary; in response to receiving the rejection of the sender-side compression dictionary from the receiver device: dropping, by the sender device, the sender-side compression dictionary, and using, by the sender device, a sender-side compression dictionary most recently approved by the receiver device for compression; generating, by the sender device, an updated sender-side compression dictionary based on a compression ratio associated with the sender-side compression dictionary; and sending, by the sender device, a checksum of the updated sender-side compression dictionary to the receiver device, to obtain approval of the updated sender-side compression dictionary.

2. The method as in claim 1 , wherein sending the compressed message to the receiver device further comprises: including a dictionary identifier for the sender-side compression dictionary as metadata for the compressed message.

3. The method as in claim 1 , further comprising: receiving, at the sender device, a rejection of the updated sender-side compression dictionary from the receiver device, based on a checksum of an updated receiver-side compression dictionary not matching the sent checksum for the updated sender-side compression dictionary; and dropping, by the sender device, the updated sender-side compression dictionary, based on the received rejection.

4. The method as in claim 1 , further comprising: receiving, at the sender device, an approval of the updated sender-side compression dictionary from the receiver device, based on a checksum of an updated receiver-side compression dictionary matching the sent checksum for the updated sender-side compression dictionary; and sending, by the sender device, a compressed message to the receiver device that is compressed using the updated sender-side compression dictionary, after receiving the approval of the updated sender-side compression dictionary from the receiver device.

5. The method as in claim 1 , wherein the sender device generates the updated sender-side compression dictionary after expiration of a timer.

6. The method as in claim 1 , wherein the sender device is a network gateway.

7. A method comprising: receiving, at a receiver device in a network, a plurality of uncompressed messages sent by a sender device in the network, wherein the sender device generates a sender-side compression dictionary based on the plurality of uncompressed messages; generating, by the receiver device, a receiver-side compression dictionary based on the plurality of uncompressed messages; receiving, at the receiver device, a request for an approval of the sender-side compression dictionary from the sender device, the request including a checksum of the sender-side compression dictionary; when a checksum of the receiver-side compression matches the checksum of the sender-side compression dictionary: sending, by the receiver device, the approval of the sender-side compression dictionary to the sender device, and decompressing, by the receiver device, a compressed message sent to the receiver device that is compressed using the sender-side compression dictionary, after sending the approval of the sender-side compression dictionary to the sender device; when the checksum of the receiver-side compression does not match the checksum of the sender-side compression dictionary: sending, by the receiver device, a rejection of the sender-side compression dictionary to the sender device, causing the sender device to drop the sender-side compression dictionary and use a sender-side compression dictionary most recently approved by the receiver device for compression, and using, by the receiver device, a receiver-side compression dictionary corresponding to the sender-side compression dictionary most recently approved by the receiver device for compression; and generating, by the receiver device, an updated receiver-side compression dictionary; and receiving, at the receiver device, a checksum for an updated sender-side compression dictionary from the sender device, to obtain approval of the updated sender-side compression dictionary from the receiver device, wherein the sender device generates the updated sender-side compression dictionary based on a compression ratio associated with the sender-side compression dictionary.

8. The method as in claim 7 , wherein the compressed message includes a dictionary identifier for the sender-side compression dictionary as metadata for the compressed message.

9. The method as in claim 7 , further comprising: sending, by the receiver device, a rejection of the updated sender-side compression dictionary to the sender device, based on a checksum of the updated receiver-side compression dictionary not matching the received checksum for the updated sender-side compression dictionary.

10. The method as in claim 7 , further comprising: sending, by the receiver device, an approval of the updated sender-side compression dictionary to the sender device, based on a checksum of the updated receiver-side compression dictionary matching the received checksum for the updated sender-side compression dictionary; and receiving, at the receiver device, a compressed message from the sender device that is compressed using the updated sender-side compression dictionary, after sending the approval of the updated sender-side compression dictionary to the sender device.

11. The method as in claim 7 , wherein the sender device generates the updated sender-side compression dictionary after expiration of a timer.

12. The method as in claim 7 , wherein the sender device is a network gateway.

13. An apparatus, comprising: one or more network interfaces to communicate with a network; a processor coupled to the network interfaces and configured to execute one or more processes; and a memory configured to store a process executable by the processor, the process when executed configured to: send a plurality of uncompressed messages to a receiver device in the network; generate a sender-side compression dictionary based on the plurality of uncompressed messages, wherein the receiver device generates a receiver-side compression dictionary based on the plurality of uncompressed messages; request an approval of the sender-side compression dictionary from the receiver device by sending a checksum of the sender-side compression dictionary to the receiver device, wherein the receiver device generates the approval or a rejection of the sender-side compression dictionary by comparing the checksum of the sender-side compression dictionary to a checksum of the receiver-side compression dictionary; in response to receiving the approval of the sender-side compression dictionary from the receiver device, send a compressed message to the receiver device that is compressed using the sender-side compression dictionary; in response to receiving the rejection of the sender-side compression dictionary from the receiver device: drop the sender-side compression dictionary, and use a sender-side compression dictionary most recently approved by the receiver device for compression; generate an updated sender-side compression dictionary based on a compression ratio associated with the sender-side compression dictionary; and send a checksum of the updated sender-side compression dictionary to the receiver device, to obtain approval of the updated sender-side compression dictionary.

14. The apparatus as in claim 13 , wherein the apparatus sends the compressed message to the receiver device by: including a dictionary identifier for the sender-side compression dictionary as metadata for the compressed message.

15. The apparatus as in claim 13 , wherein the process when executed is further configured to: receive a rejection of the updated sender-side compression dictionary from the receiver device, based on a checksum of an updated receiver-side compression dictionary not matching the sent checksum for the updated sender-side compression dictionary; and drop the updated sender-side compression dictionary, based on the received rejection.