We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
目前在拜读源码的时候,从文件加载缓存的过程是通过openMP进行并行加速的,这样的话,如果是多节点运行,那每个节点在加载缓存阶段应该都会完整的读取一份数据,这样就会超出预估的内存使用上限了吧。
The text was updated successfully, but these errors were encountered:
每个节点只加载自己负责的部分数据。
Sorry, something went wrong.
多节点读写hdfs是不是会有问题
No branches or pull requests
目前在拜读源码的时候,从文件加载缓存的过程是通过openMP进行并行加速的,这样的话,如果是多节点运行,那每个节点在加载缓存阶段应该都会完整的读取一份数据,这样就会超出预估的内存使用上限了吧。
The text was updated successfully, but these errors were encountered: