fcvr1010 commented on issue #2991:
URL: https://github.com/apache/iceberg/issues/2991#issuecomment-910400144
I tried to debug a bit more by inspecting which temp file was being created.
Given that the stack trace showed a failure at
org.apache.iceberg.aws.s3.S3OutputStream.newStream(S3OutputStream.java:178)
```java
currentStagingFile = File.createTempFile("s3fileio-", ".tmp",
stagingDirectory);
```
I tried to inspect the files being created with
```sh
sudo bpftrace -e 'kprobe:do_sys_open { printf("open: %s\n", str(arg1)); }' |
grep s3fileio
```
but I didn't get any output. I also verified that if I create a file with
prefix "s3fileio" with `touch` or a temp file in Python, it shows up in the
output of `bpftrace`. So, should I conclude that Iceberg tries to create that
file only when it's going to fail and in other cases follows a different code
path? I'm quite confused.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
