We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
The following code is very time-consuming in FileSystemProvider like HDFSFileSystemProvider and needs to be optimized according to performance test:
HDFSFileSystemProvider
Configuration configuration = new Configuration(); config.forEach( (k, v) -> { configuration.set(k.replace(GRAVITINO_BYPASS, ""), v); });
The operation configuration.set() will take much time.
configuration.set()
We can convert the map to an XML stream and store the XML stream in the configuration only once.
The text was updated successfully, but these errors were encountered:
@yuqi1129 please assign it to me.
Sorry, something went wrong.
Optimize the configuration iterator in FileSystem provider apache#6563
7d4d1e4
429c0b8
8ca3484
42bc358
828c777
sunxiaojian
Successfully merging a pull request may close this issue.
The following code is very time-consuming in FileSystemProvider like
HDFSFileSystemProvider
and needs to be optimized according to performance test:The operation
configuration.set()
will take much time.We can convert the map to an XML stream and store the XML stream in the configuration only once.
The text was updated successfully, but these errors were encountered: