Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Data service: aurora data tables dumps (schedule A, B, E and history tables) with tools for weekly and data-change-delta-based restore #4644

Open
dzhang-fec opened this issue Sep 29, 2020 · 0 comments

Comments

@dzhang-fec
Copy link
Contributor

@rjayasekera and DBA team has developed a new tool:
Data service: aurora data tables dumps (schedule A, B, E and history tables) weekly has been created. The tools for weekly and data-change-delta-based restore has been provided.

1)The weekly data dump zip files and post to s3 for end user to use.
2)It took 40 hours to restore the data *since the index) and it needed 4Tb storage.
3)it took about 5 hours for data only restore
4)to save the time, the client can request the time based data change dump. so it save the client time for 2nd data sync (not need xx hours to replace whole dataset but only the data that had change since their last time restore)
5)the scripts as tool and test metrics are in the README,txt. The restore time is up to the hardware power.

For details and request , please contact DBA team via @PaulClark2.
.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: No status
Development

No branches or pull requests

1 participant