I think we've found an interesting bug in the s3 o...
# fluent-bit
c
I think we've found an interesting bug in the s3 output where multipart uploads fail because then
upload_timeout
is hit,
UploadPart
seems to be called before
CompleteMultipartUpload
meaning the 2nd-last part could be <5mb, causing the total upload to fail. We would expect that when
upload_timeout
is hit, only a single call to
CompleteMultipartUpload
would be called so that only the final part is <5mb. Anyone able to help me through this one?
e
hey Cameron, thanks for raising this issue and providing some good context. If I upload a patched branch, would you be able to give it a try ?
c
Sure, will give it a try. Thanks for the quick action!
e
@Cameron ping
c
Sorry wasn't able to test - we were seeing the issue in our production environment so can't test there
We've ended up switching to PutUpload for the time being
e
I hope at some point this can be tested, we did it in record time! 🙂