Stephan Ewen created FLINK-1115:
-----------------------------------
Summary: Spurious Test Failures due to failing file output streams
Key: FLINK-1115
URL: https://issues.apache.org/jira/browse/FLINK-1115
Project: Flink
Issue Type: Bug
Components: Distributed Runtime
Affects Versions: 0.7-incubating
Reporter: Stephan Ewen
Assignee: Stephan Ewen
Priority: Minor
Once in a while, a test fails with the stack trace blow, failing to open a file
output stream. I am not fully sure what causes that, but I suspect a race
between creating/clearing the output directory, and the file stream creation.
We could simply have one or two retries when the local file system' output
stream creation fails with "FileNotFoundException"
-----
23:39:57.272 [DataSink(Output) (1/4)] ERROR
org.apache.flink.runtime.operators.DataSinkTask - Error in user code:
/tmp/org.apache.flink.test.recordJobTests.TPCHQuery10ITCase-result.txt/1 (No
such file or directory): DataSink(Output) (1/4)
java.io.FileNotFoundException:
/tmp/org.apache.flink.test.recordJobTests.TPCHQuery10ITCase-result.txt/1 (No
such file or directory)
at java.io.FileOutputStream.open(Native Method) ~[na:1.8.0_05]
at java.io.FileOutputStream.<init>(FileOutputStream.java:206)
~[na:1.8.0_05]
at java.io.FileOutputStream.<init>(FileOutputStream.java:156)
~[na:1.8.0_05]
at
org.apache.flink.core.fs.local.LocalDataOutputStream.<init>(LocalDataOutputStream.java:50)
~[flink-core-0.7-incubating-SNAPSHOT.jar:0.7-incubating-SNAPSHOT]
at
org.apache.flink.core.fs.local.LocalFileSystem.create(LocalFileSystem.java:247)
~[flink-core-0.7-incubating-SNAPSHOT.jar:0.7-incubating-SNAPSHOT]
at
org.apache.flink.core.fs.local.LocalFileSystem.create(LocalFileSystem.java:254)
~[flink-core-0.7-incubating-SNAPSHOT.jar:0.7-incubating-SNAPSHOT]
at
org.apache.flink.api.common.io.FileOutputFormat.open(FileOutputFormat.java:239)
~[flink-core-0.7-incubating-SNAPSHOT.jar:0.7-incubating-SNAPSHOT]
at
org.apache.flink.runtime.operators.DataSinkTask.invoke(DataSinkTask.java:174)
~[flink-runtime-0.7-incubating-SNAPSHOT.jar:0.7-incubating-SNAPSHOT]
at
org.apache.flink.runtime.execution.RuntimeEnvironment.run(RuntimeEnvironment.java:235)
[flink-runtime-0.7-incubating-SNAPSHOT.jar:0.7-incubating-SNAPSHOT]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_05]
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
