Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use synthetic recovery source by default for TSDB and LogsDB #119110

Open
wants to merge 44 commits into
base: main
Choose a base branch
from

Conversation

salvatore-campagna
Copy link
Contributor

@salvatore-campagna salvatore-campagna commented Dec 19, 2024

We experimented with using synthetic source for recovery and observed quite positive impact
on indexing throughput by means of our nightly Rally benchmarks. As a result, here we enable
it by default when synthetic source is used. To be more precise, if index.mapping.source.mode
setting is synthetic we enable recovery source by means of synthetic source.

I had to move the index.mapping.source.mode setting to IndexSettings because of dependecies
and because of the initialization order of static fields for classes IndexSettings and SourceFieldMapper.
Not initializing settings index.mode, index.mapping.source.mode, and index.recovery.use_synthetic_source
in the right order results in multiple NullPointerException.

@@ -655,9 +654,64 @@ public Iterator<Setting<?>> settings() {
Property.Final
);

/**
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This change is just a result of reordering settings in such a way that static initialization happens in the right order.

@salvatore-campagna salvatore-campagna self-assigned this Jan 10, 2025
@salvatore-campagna salvatore-campagna added the :StorageEngine/Logs You know, for Logs label Jan 10, 2025
@salvatore-campagna salvatore-campagna marked this pull request as ready for review January 13, 2025 11:45
@salvatore-campagna salvatore-campagna requested a review from a team as a code owner January 13, 2025 11:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants