Jira: https://issues.apache.org/jira/browse/OOZIE-3324
Build: https://builds.apache.org/job/PreCommit-OOZIE-Build/752/
###################################################################################
########################## LAST 100 LINES OF THE CONSOLE
###########################
[...truncated 1.13 MB...]
+1 There are no new bugs found in [sharelib/hcatalog].
+1 There are no new bugs found in [sharelib/streaming].
+1 There are no new bugs found in [sharelib/sqoop].
-1 There are [26] new bugs found below threshold in [sharelib/oozie] that must
be fixed, listing only the first [5] ones.
You can find the FindBugs diff here (look for the red and orange ones):
sharelib/oozie/findbugs-new.html
The top [5] most important FindBugs errors are:
At ActionStats.java:[line 37]: Unwritten public or protected field:
org.apache.oozie.action.hadoop.ActionStats.currentActionType
At LauncherAMUtils.java:[line 64]: Found reliance on default encoding in
org.apache.oozie.action.hadoop.LauncherAMUtils.getLocalFileContentStr(File,
String, int): new java.io.FileReader(File)
Obligation to clean up resource created at LauncherAMUtils.java:[line 64] is
not discharged:
org.apache.oozie.action.hadoop.LauncherAMUtils.getLocalFileContentStr(File,
String, int) may fail to clean up java.io.Reader on checked exception
Path continues at LauncherAMUtils.java:[line 67]: Path continues at
LauncherAMUtils.java:[line 65]
Found reliance on default encoding in
org.apache.oozie.action.hadoop.LauncherMain.getHadoopJobIds(String, Pattern[]):
new java.io.FileReader(String): Path continues at LauncherAMUtils.java:[line 68]
-1 There are [3] new bugs found below threshold in [sharelib/pig] that must be
fixed.
You can find the FindBugs diff here (look for the red and orange ones):
sharelib/pig/findbugs-new.html
The most important FindBugs errors are:
At PigMain.java:[line 258]: java/io/File.<init>(Ljava/lang/String;)V
reads a file whose location might be specified by user input
At PigMain.java:[line 141]: At PigMain.java:[line 131]
At PigMain.java:[line 245]: At PigMain.java:[line 199]
At PigMain.java:[line 137]: java/io/File.<init>(Ljava/lang/String;)V
reads a file whose location might be specified by user input
java/io/File.<init>(Ljava/lang/String;)V reads a file whose location
might be specified by user input: At PigMain.java:[line 131]
-1 There are [2] new bugs found below threshold in [sharelib/hive] that must
be fixed.
You can find the FindBugs diff here (look for the red and orange ones):
sharelib/hive/findbugs-new.html
The most important FindBugs errors are:
At HiveMain.java:[line 317]:
java/io/FileInputStream.<init>(Ljava/lang/String;)V reads a file whose
location might be specified by user input
At HiveMain.java:[line 226]: At HiveMain.java:[line 207]
At HiveMain.java:[line 210]: java/io/File.<init>(Ljava/lang/String;)V
reads a file whose location might be specified by user input
At HiveMain.java:[line 207]
-1 There are [5] new bugs found below threshold in [sharelib/spark] that must
be fixed.
You can find the FindBugs diff here (look for the red and orange ones):
sharelib/spark/findbugs-new.html
The most important FindBugs errors are:
At SparkMain.java:[line 133]:
java/io/File.<init>(Ljava/io/File;Ljava/lang/String;)V reads a file whose
location might be specified by user input
java/io/File.<init>(Ljava/lang/String;)V reads a file whose location
might be specified by user input: At SparkMain.java:[line 133]
At SparkMain.java:[line 166]: At SparkMain.java:[line 173]
The regular expression
"^spark-assembly((?:(-|_|(\\d+\\.))\\d+(?:\\.\\d+)*))*\\.jar$" is vulnerable to
a denial of service attack (ReDOS): At SparkMain.java:[line 172]
The regular expression
"^spark-yarn((?:(-|_|(\\d+\\.))\\d+(?:\\.\\d+)*))*\\.jar$" is vulnerable to a
denial of service attack (ReDOS): At SparkMain.java:[line 48]
-1 There are [60] new bugs found below threshold in [client] that must be
fixed, listing only the first [5] ones.
You can find the FindBugs diff here (look for the red and orange ones):
client/findbugs-new.html
The top [5] most important FindBugs errors are:
At CLIParser.java:[line 60]: new org.apache.oozie.cli.CLIParser(String,
String[]) may expose internal representation by storing an externally mutable
object into CLIParser.cliHelp
At CLIParser.java:[lines 83-107]: Should
org.apache.oozie.cli.CLIParser$Command be a _static_ inner class?
Obligation to clean up resource created at OozieCLI.java:[line 862] is not
discharged: org.apache.oozie.cli.OozieCLI.getConfiguration(OozieClient,
CommandLine) may fail to clean up java.io.InputStream
Path continues at OozieCLI.java:[line 872]: Path continues at
OozieCLI.java:[line 868]
At OozieCLI.java:[line 859]:
org.apache.oozie.cli.OozieCLI.getConfiguration(OozieClient, CommandLine) may
fail to close stream
-1 There are [3] new bugs found below threshold in [examples] that must be
fixed.
You can find the FindBugs diff here (look for the red and orange ones):
examples/findbugs-new.html
The most important FindBugs errors are:
At LocalOozieExample.java:[line 47]:
java/io/File.<init>(Ljava/lang/String;)V reads a file whose location
might be specified by user input
java/io/FileInputStream.<init>(Ljava/lang/String;)V reads a file whose
location might be specified by user input: At LocalOozieExample.java:[line 35]
At LocalOozieExample.java:[line 35]: At LocalOozieExample.java:[line 72]
At Repeatable.java:[line 175]:
org.apache.oozie.example.Repeatable.setBaseline(Date) may expose internal
representation by storing an externally mutable object into Repeatable.baseline
+1 There are no new bugs found in [docs].
-1 There are [1] new bugs found below threshold in [server] that must be fixed.
You can find the FindBugs diff here (look for the red and orange ones):
server/findbugs-new.html
The most important FindBugs errors are:
At JspHandlerProvider.java:[line 43]:
java/io/File.<init>(Ljava/lang/String;Ljava/lang/String;)V reads a file
whose location might be specified by user input
At JspHandlerProvider.java:[line 43]
+1 BACKWARDS_COMPATIBILITY
+1 the patch does not change any JPA Entity/Colum/Basic/Lob/Transient
annotations
+1 the patch does not modify JPA files
-1 TESTS
Tests run: 2918
Tests failed: 0
Tests errors: 3
The patch failed the following testcases:
Tests failing with errors:
testConcurrentCopyFromLocalHighThreadNr(org.apache.oozie.tools.TestConcurrentCopyFromLocal)
testConcurrentCopyFromLocalSameFileNrAndThreadNr(org.apache.oozie.tools.TestConcurrentCopyFromLocal)
testConcurrentCopyFromLocalMoreThreadsThanFiles(org.apache.oozie.tools.TestConcurrentCopyFromLocal)
Tests failed at first run:
TestCoordActionsKillXCommand#testActionKillCommandActionNumbers
For the complete list of flaky tests, see TEST-SUMMARY-FULL files.
+1 DISTRO
+1 distro tarball builds with the patch
----------------------------
-1 Overall result, please check the reported -1(s)
The full output of the test-patch run is available at
https://builds.apache.org/job/PreCommit-OOZIE-Build/752/
Adding comment to JIRA
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
0 12089 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0100
12290 0 201 100 12089 358 21571 --:--:-- --:--:-- --:--:-- 21549
{"errorMessages":["Unexpected character ('^' (code 94)): was expecting comma to
separate OBJECT entries\n at [Source:
org.apache.catalina.connector.CoyoteInputStream@2b3fd221; line: 1, column:
8221]"]}
test-patch exit code: 1
Build step 'Execute shell' marked build as failure
[description-setter] Description set: OOZIE-3324
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
###################################################################################
############################## FAILED TESTS (if any)
##############################
3 tests failed.
FAILED:
org.apache.oozie.tools.TestConcurrentCopyFromLocal.testConcurrentCopyFromLocalHighThreadNr
Error Message:
Could not install Oozie ShareLib properly.
Stack Trace:
java.io.IOException: Could not install Oozie ShareLib properly.
at
org.apache.oozie.tools.OozieSharelibCLI$ConcurrentCopyFromLocal.retryFailedCopyTasks(OozieSharelibCLI.java:539)
at
org.apache.oozie.tools.OozieSharelibCLI$ConcurrentCopyFromLocal.checkCopyResults(OozieSharelibCLI.java:504)
at
org.apache.oozie.tools.OozieSharelibCLI$ConcurrentCopyFromLocal.concurrentCopyFromLocal(OozieSharelibCLI.java:455)
at
org.apache.oozie.tools.TestConcurrentCopyFromLocal.performAndCheckConcurrentCopy(TestConcurrentCopyFromLocal.java:107)
at
org.apache.oozie.tools.TestConcurrentCopyFromLocal.testConcurrentCopyFromLocalHighThreadNr(TestConcurrentCopyFromLocal.java:98)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at junit.framework.TestCase.runTest(TestCase.java:176)
at junit.framework.TestCase.runBare(TestCase.java:141)
at junit.framework.TestResult$1.protect(TestResult.java:122)
at junit.framework.TestResult.runProtected(TestResult.java:142)
at junit.framework.TestResult.run(TestResult.java:125)
at junit.framework.TestCase.run(TestCase.java:129)
at junit.framework.TestSuite.runTest(TestSuite.java:255)
at junit.framework.TestSuite.run(TestSuite.java:250)
at
org.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:84)
at org.junit.runners.Suite.runChild(Suite.java:127)
at org.junit.runners.Suite.runChild(Suite.java:26)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.junit.runners.Suite.runChild(Suite.java:127)
at org.junit.runners.Suite.runChild(Suite.java:26)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at
org.apache.maven.surefire.junitcore.pc.Scheduler$1.run(Scheduler.java:410)
at
org.apache.maven.surefire.junitcore.pc.InvokerStrategy.schedule(InvokerStrategy.java:54)
at
org.apache.maven.surefire.junitcore.pc.Scheduler.schedule(Scheduler.java:367)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at
org.apache.maven.surefire.junitcore.pc.ParallelComputerBuilder$PC$1.run(ParallelComputerBuilder.java:593)
at org.apache.maven.surefire.junitcore.JUnitCore.run(JUnitCore.java:55)
at
org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:137)
at
org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107)
at
org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83)
at
org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75)
at
org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:159)
at
org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:373)
at
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:334)
at
org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:119)
at
org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:407)
FAILED:
org.apache.oozie.tools.TestConcurrentCopyFromLocal.testConcurrentCopyFromLocalSameFileNrAndThreadNr
Error Message:
Could not install Oozie ShareLib properly.
Stack Trace:
java.io.IOException: Could not install Oozie ShareLib properly.
at
org.apache.oozie.tools.OozieSharelibCLI$ConcurrentCopyFromLocal.retryFailedCopyTasks(OozieSharelibCLI.java:539)
at
org.apache.oozie.tools.OozieSharelibCLI$ConcurrentCopyFromLocal.checkCopyResults(OozieSharelibCLI.java:504)
at
org.apache.oozie.tools.OozieSharelibCLI$ConcurrentCopyFromLocal.concurrentCopyFromLocal(OozieSharelibCLI.java:455)
at
org.apache.oozie.tools.TestConcurrentCopyFromLocal.performAndCheckConcurrentCopy(TestConcurrentCopyFromLocal.java:107)
at
org.apache.oozie.tools.TestConcurrentCopyFromLocal.testConcurrentCopyFromLocalSameFileNrAndThreadNr(TestConcurrentCopyFromLocal.java:82)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at junit.framework.TestCase.runTest(TestCase.java:176)
at junit.framework.TestCase.runBare(TestCase.java:141)
at junit.framework.TestResult$1.protect(TestResult.java:122)
at junit.framework.TestResult.runProtected(TestResult.java:142)
at junit.framework.TestResult.run(TestResult.java:125)
at junit.framework.TestCase.run(TestCase.java:129)
at junit.framework.TestSuite.runTest(TestSuite.java:255)
at junit.framework.TestSuite.run(TestSuite.java:250)
at
org.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:84)
at org.junit.runners.Suite.runChild(Suite.java:127)
at org.junit.runners.Suite.runChild(Suite.java:26)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.junit.runners.Suite.runChild(Suite.java:127)
at org.junit.runners.Suite.runChild(Suite.java:26)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at
org.apache.maven.surefire.junitcore.pc.Scheduler$1.run(Scheduler.java:410)
at
org.apache.maven.surefire.junitcore.pc.InvokerStrategy.schedule(InvokerStrategy.java:54)
at
org.apache.maven.surefire.junitcore.pc.Scheduler.schedule(Scheduler.java:367)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at
org.apache.maven.surefire.junitcore.pc.ParallelComputerBuilder$PC$1.run(ParallelComputerBuilder.java:593)
at org.apache.maven.surefire.junitcore.JUnitCore.run(JUnitCore.java:55)
at
org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:137)
at
org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107)
at
org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83)
at
org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75)
at
org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:159)
at
org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:373)
at
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:334)
at
org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:119)
at
org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:407)
FAILED:
org.apache.oozie.tools.TestConcurrentCopyFromLocal.testConcurrentCopyFromLocalMoreThreadsThanFiles
Error Message:
Could not install Oozie ShareLib properly.
Stack Trace:
java.io.IOException: Could not install Oozie ShareLib properly.
at
org.apache.oozie.tools.OozieSharelibCLI$ConcurrentCopyFromLocal.retryFailedCopyTasks(OozieSharelibCLI.java:539)
at
org.apache.oozie.tools.OozieSharelibCLI$ConcurrentCopyFromLocal.checkCopyResults(OozieSharelibCLI.java:504)
at
org.apache.oozie.tools.OozieSharelibCLI$ConcurrentCopyFromLocal.concurrentCopyFromLocal(OozieSharelibCLI.java:455)
at
org.apache.oozie.tools.TestConcurrentCopyFromLocal.performAndCheckConcurrentCopy(TestConcurrentCopyFromLocal.java:107)
at
org.apache.oozie.tools.TestConcurrentCopyFromLocal.testConcurrentCopyFromLocalMoreThreadsThanFiles(TestConcurrentCopyFromLocal.java:90)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at junit.framework.TestCase.runTest(TestCase.java:176)
at junit.framework.TestCase.runBare(TestCase.java:141)
at junit.framework.TestResult$1.protect(TestResult.java:122)
at junit.framework.TestResult.runProtected(TestResult.java:142)
at junit.framework.TestResult.run(TestResult.java:125)
at junit.framework.TestCase.run(TestCase.java:129)
at junit.framework.TestSuite.runTest(TestSuite.java:255)
at junit.framework.TestSuite.run(TestSuite.java:250)
at
org.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:84)
at org.junit.runners.Suite.runChild(Suite.java:127)
at org.junit.runners.Suite.runChild(Suite.java:26)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.junit.runners.Suite.runChild(Suite.java:127)
at org.junit.runners.Suite.runChild(Suite.java:26)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at
org.apache.maven.surefire.junitcore.pc.Scheduler$1.run(Scheduler.java:410)
at
org.apache.maven.surefire.junitcore.pc.InvokerStrategy.schedule(InvokerStrategy.java:54)
at
org.apache.maven.surefire.junitcore.pc.Scheduler.schedule(Scheduler.java:367)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at
org.apache.maven.surefire.junitcore.pc.ParallelComputerBuilder$PC$1.run(ParallelComputerBuilder.java:593)
at org.apache.maven.surefire.junitcore.JUnitCore.run(JUnitCore.java:55)
at
org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:137)
at
org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107)
at
org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83)
at
org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75)
at
org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:159)
at
org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:373)
at
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:334)
at
org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:119)
at
org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:407)