Issue with Gossip Message Size in Data Transfer Between Nodes

[emnvn]

Hello,

I'm facing a problem where data transfer between two nodes fails. Here's the scenario:

Use Case:

• I'm using a gossip protocol for communication.
• I've set the max_message_size to 100 MB in the configuration:

let config = Config {
  membership: Default::default(),
  broadcast: Default::default(),
  max_message_size: 1024 * 1024 * 100,
};
let gossip = Gossip::from_endpoint(endpoint.clone(), config, &adr.info);

Application Details:

• My application uses an event store to keep track of events.
• Initially, there's only one node (Node A) holding all the data (around 600 events, each about 4 KB).
• When a second node (Node B) starts, it sends information about its latest events to Node A every 5 seconds.
• Node A then transmits a maximum of 20 events (approximately 80 KB message size) to Node B.
• Node B stores the received events in its local database.

The Problem:

The issue arises when Node B receives around 300 events from Node A. After this point, Node B cannot send messages to Node A anymore. However, Node B can still receive messages from Node A.

Possible Cause:

I suspect the connection between the nodes might have a buffer limit. If my application can't process data fast enough, this buffer could overflow, preventing further message exchange.

Question:

Does anyone have suggestions on how to resolve this issue? Is there a way to verify the buffer size or adjust it if possible?

Thanks for your help!