Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature Request - Last Access Time #582

Open
devlucasc opened this issue Jan 13, 2021 · 2 comments
Open

Feature Request - Last Access Time #582

devlucasc opened this issue Jan 13, 2021 · 2 comments
Labels
acknowledged This issue has been read and acknowledged by Delta admins enhancement New feature or request

Comments

@devlucasc
Copy link

Is it possible to add a last access time property to identify the last time a table was accessed?

The advantage here is to identify and move a table for cold storage or to delete unused tables

@zsxwing
Copy link
Member

zsxwing commented Jan 28, 2021

This is a great feature. But the cost would be huge. We would need to store it in transaction logs. This means we would need to make a commit when a table is accessed. Alternatively, we can try to store the access time into Hive Metastore. But it won't work for people who access tables using a file path.

Do you have access logs for the storage? You can also use these logs to figure out the unused tables as well.

@devlucasc
Copy link
Author

Hi @zsxwing Generally I use hive tables, I was thinking of use Hive metastore, because it already have this metadata field.

@vkorukanti vkorukanti added acknowledged This issue has been read and acknowledged by Delta admins enhancement New feature or request labels Oct 7, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
acknowledged This issue has been read and acknowledged by Delta admins enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants