MemoryLogRecordsArrowBuilder resetWriterState can cause batch data loss

[swuferhong]

Search before asking

• I searched in the issues and found nothing similar.

Fluss version

main (development)

Please describe the bug 🐞

When MemoryLogRecordsArrowBuilder try to resetWriterState in case the produceLog request failed and the batch is re-enqueue to send with different write state, we will reset the bytesView to null, this is very dangerous. Because once we set bytesView to null, we won't be able to retrieve the data from arrowWriter while next build, which means data in this batch will be lost. The correct approach is to simply reset the batch header instead of reset the whole batch.

Solution

No response

Are you willing to submit a PR?

• I'm willing to submit a PR!

[wuchong]

fixed in #354