Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

-r 批量上传文件时,大文件丢失严重,尝试上传单个丢失的文件时。每过10%报一次500的错 #248

Open
shannaburns opened this issue May 29, 2024 · 0 comments

Comments

@shannaburns
Copy link

版本1.7.18
用-r上传 10多个g的文件夹 成功6104个文件 丢了1256个。
Total num: 88740, size: 142,084,483,830. Error num: 1256. OK num: 87484(upload 6104 files, skip 81380 files), OK size: 138,753,343,892(transfer: 18,230,971,399, skip: 120,522,372,493).
对比了一下找到个没上传的文件:xxxx.tgz,大小一个G,不用-r,采用单个文件上传,每上传10%左右就报以下错误,连续试了7次都是这样,最后断在72%的地方,不知道是代码哪里有限制。
retry count:9,multipart upload file:E:\1606.tgz.

Total num: 1, size: 1,104,783,720. Dealed num: 0, OK size: 441,913,600, Progress: 40.000%, Speed: 0.00KB/s

Total num: 1, size: 1,104,783,720. Dealed num: 0, Transfer size: 24,857,640. When error happens.

average speed 652000(byte/s)
Error: oss: service returned invalid response body, status = 500 Internal Server Error, RequestId = , File=E:\1606.tgz

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant