Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

juicefs summary stats incorrect. #5579

Closed
zhoucheng361 opened this issue Jan 20, 2025 · 2 comments
Closed

juicefs summary stats incorrect. #5579

zhoucheng361 opened this issue Jan 20, 2025 · 2 comments
Assignees
Labels
kind/bug Something isn't working

Comments

@zhoucheng361
Copy link
Contributor

zhoucheng361 commented Jan 20, 2025

What happened:

root@iZj6c46anp858xt8jhb9udZ:~/jfs# ./juicefs summary /jfs/mdtest/test-dir.0-0/mdtest_tree.0/mdtest_tree.0/mdtest_tree.6/mdtest_tree.9/ | head
+---------------------------------+---------+------+-------+
|               PATH              |   SIZE  | DIRS | FILES |
+---------------------------------+---------+------+-------+
| /                               |  45 MiB |   11 |  5786 |
| mdtest_tree.3/                  | 4.7 MiB |    1 |   600 |
| mdtest_tree.3/file.mdtest.38.11 | 8.0 KiB |    0 |     1 |
| mdtest_tree.3/file.mdtest.73.94 | 8.0 KiB |    0 |     1 |
| mdtest_tree.3/file.mdtest.51.49 | 8.0 KiB |    0 |     1 |
| mdtest_tree.3/file.mdtest.44.52 | 8.0 KiB |    0 |     1 |
| mdtest_tree.3/file.mdtest.44.48 | 8.0 KiB |    0 |     1 |
root@iZj6c46anp858xt8jhb9udZ:~/jfs# ./juicefs summary /jfs/mdtest/test-dir.0-0/mdtest_tree.0/mdtest_tree.0/mdtest_tree.6/ | grep " mdtest_tree.9/"
| mdtest_tree.9/               |  45 MiB |   11 |  5769 |
| mdtest_tree.9/mdtest_tree.3/ | 4.7 MiB |    1 |   600 |
| mdtest_tree.9/mdtest_tree.0/ | 4.4 MiB |    1 |   569 |
| mdtest_tree.9/mdtest_tree.8/ | 3.9 MiB |    1 |   500 |
| mdtest_tree.9/mdtest_tree.4/ | 3.9 MiB |    1 |   500 |
| mdtest_tree.9/mdtest_tree.6/ | 3.9 MiB |    1 |   500 |
| mdtest_tree.9/mdtest_tree.7/ | 3.9 MiB |    1 |   500 |
| mdtest_tree.9/mdtest_tree.2/ | 3.9 MiB |    1 |   500 |
| mdtest_tree.9/mdtest_tree.9/ | 3.9 MiB |    1 |   500 |
| mdtest_tree.9/mdtest_tree.5/ | 3.9 MiB |    1 |   500 |
| mdtest_tree.9/mdtest_tree.1/ | 3.9 MiB |    1 |   500 |
| mdtest_tree.9/...            | 4.7 MiB |    0 |   600 |

What you expected to happen:
files should be the same of both summary results.

How to reproduce it (as minimally and precisely as possible):

Anything else we need to know?

Environment:

  • JuiceFS version (use juicefs --version) or Hadoop Java SDK version:
  • Cloud provider or hardware configuration running JuiceFS:
  • OS (e.g cat /etc/os-release):
  • Kernel (e.g. uname -a):
  • Object storage (cloud provider and region, or self maintained):
  • Metadata engine info (version, cloud provider managed or self maintained):
  • Network connectivity (JuiceFS to metadata engine, JuiceFS to object storage):
  • Others:
@zhoucheng361 zhoucheng361 added the kind/bug Something isn't working label Jan 20, 2025
@anysql anysql self-assigned this Jan 21, 2025
@anysql
Copy link
Contributor

anysql commented Jan 21, 2025

What type of meta engine? And the mdtest command?

@davies
Copy link
Contributor

davies commented Jan 23, 2025

The summary is based on dir stats, which are updated async in background and not accurate.

@davies davies closed this as not planned Won't fix, can't repro, duplicate, stale Jan 23, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants