[ 
https://issues.apache.org/jira/browse/OOZIE-3652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17479282#comment-17479282
 ] 

Ignite TC Bot commented on OOZIE-3652:
--------------------------------------


Testing JIRA OOZIE-3652

Cleaning local git workspace

----------------------------

{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:green}+1 RAW_PATCH_ANALYSIS{color}
.    {color:green}+1{color} the patch does not introduce any @author tags
.    {color:green}+1{color} the patch does not introduce any tabs
.    {color:green}+1{color} the patch does not introduce any trailing spaces
.    {color:green}+1{color} the patch does not introduce any star imports
.    {color:green}+1{color} the patch does not introduce any line longer than 
132
.    {color:green}+1{color} the patch adds/modifies 1 testcase(s)
{color:red}-1 RAT{color}
.    {color:red}-1{color} the patch seems to introduce 1 new RAT warning(s)
{color:green}+1 JAVADOC{color}
.    {color:green}+1{color} Javadoc generation succeeded with the patch
.    {color:green}+1{color} the patch does not seem to introduce new Javadoc 
warning(s)
{color:green}+1 COMPILE{color}
.    {color:green}+1{color} HEAD compiles
.    {color:green}+1{color} patch compiles
.    {color:green}+1{color} the patch does not seem to introduce new javac 
warnings
{color:red}-1{color} There are [6] new bugs found below threshold in total that 
must be fixed.
.    {color:green}+1{color} There are no new bugs found in [examples].
.    {color:green}+1{color} There are no new bugs found in 
[fluent-job/fluent-job-api].
.    {color:green}+1{color} There are no new bugs found in [sharelib/hive].
.    {color:green}+1{color} There are no new bugs found in [sharelib/hive2].
.    {color:green}+1{color} There are no new bugs found in [sharelib/git].
.    {color:green}+1{color} There are no new bugs found in [sharelib/distcp].
.    {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
.    {color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
.    {color:green}+1{color} There are no new bugs found in [sharelib/spark].
.    {color:red}-1{color} There are [1] new bugs found below threshold in 
[sharelib/oozie] that must be fixed.
.    You can find the SpotBugs diff here (look for the red and orange ones): 
sharelib/oozie/findbugs-new.html
.    The most important SpotBugs errors are:
.    At ShellMain.java:[line 93]: This usage of 
java/lang/ProcessBuilder.<init>(Ljava/util/List;)V can be vulnerable to 
Command Injection
.    At ShellMain.java:[line 91]: At ShellMain.java:[line 90]
.    At ShellMain.java:[line 92]
.    {color:green}+1{color} There are no new bugs found in [sharelib/pig].
.    {color:green}+1{color} There are no new bugs found in [sharelib/streaming].
.    {color:green}+1{color} There are no new bugs found in [server].
.    {color:green}+1{color} There are no new bugs found in [docs].
.    {color:green}+1{color} There are no new bugs found in [webapp].
.    {color:red}-1{color} There are [5] new bugs found below threshold in 
[core] that must be fixed.
.    You can find the SpotBugs diff here (look for the red and orange ones): 
core/findbugs-new.html
.    The most important SpotBugs errors are:
.    At BulkJPAExecutor.java:[line 206]: This use of 
javax/persistence/EntityManager.createQuery(Ljava/lang/String;)Ljavax/persistence/Query;
 can be vulnerable to SQL/JPQL injection
.    At BulkJPAExecutor.java:[line 176]: At BulkJPAExecutor.java:[line 175]
.    At BulkJPAExecutor.java:[line 205]: At BulkJPAExecutor.java:[line 199]
.    This use of 
javax/persistence/EntityManager.createQuery(Ljava/lang/String;)Ljavax/persistence/Query;
 can be vulnerable to SQL/JPQL injection: At BulkJPAExecutor.java:[line 206]
.    At BulkJPAExecutor.java:[line 111]: At BulkJPAExecutor.java:[line 127]
.    {color:green}+1{color} There are no new bugs found in [tools].
.    {color:green}+1{color} There are no new bugs found in [client].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.    {color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.    {color:green}+1{color} the patch does not modify JPA files
{color:green}+1 TESTS{color}
.    Tests run: 3216
.    {color:orange}Tests failed at first run:{color}
TestCoordActionInputCheckXCommand#testNone
.    For the complete list of flaky tests, see TEST-SUMMARY-FULL files.
{color:green}+1 DISTRO{color}
.    {color:green}+1{color} distro tarball builds with the patch 
{color:green}+1 MODERNIZER{color}

----------------------------
{color:red}*-1 Overall result, please check the reported -1(s)*{color}


The full output of the test-patch run is available at

. https://ci-hadoop.apache.org/job/PreCommit-OOZIE-Build/61/



> Oozie launcher should retry directory listing when NoSuchFileException occurs
> -----------------------------------------------------------------------------
>
>                 Key: OOZIE-3652
>                 URL: https://issues.apache.org/jira/browse/OOZIE-3652
>             Project: Oozie
>          Issue Type: Bug
>            Reporter: Akira Ajisaka
>            Priority: Major
>         Attachments: OOZIE-3652-001.patch
>
>
> Oozie launcher lists the CWD and prints the file name and directory name. 
> When there is a java agent attach to Oozie launcher JVM, a temporary 
> attach_pid<pid> file is created in the CWD by default. If the temporary file 
> is deleted between directory listing and printing, NoSuchFileException occurs.
> {code}
> 2022-01-13 06:11:05,569  WARN Hive2ActionExecutor:523 - SERVER[<host>] 
> USER[admin] GROUP[-] TOKEN[] APP[Hive Sample] 
> JOB[0000061-220113033638267-oozie-oozi-W] 
> ACTION[0000061-220113033638267-oozie-oozi-W@hive-dbea] Launcher exception: 
> ./.attach_pid1517
> java.nio.file.NoSuchFileException: ./.attach_pid1517
>     at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
>     at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
>     at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
>     at 
> sun.nio.fs.UnixFileAttributeViews$Basic.readAttributes(UnixFileAttributeViews.java:55)
>     at 
> sun.nio.fs.UnixFileSystemProvider.readAttributes(UnixFileSystemProvider.java:144)
>     at 
> sun.nio.fs.LinuxFileSystemProvider.readAttributes(LinuxFileSystemProvider.java:99)
>     at java.nio.file.Files.readAttributes(Files.java:1737)
>     at java.nio.file.FileTreeWalker.getAttributes(FileTreeWalker.java:225)
>     at java.nio.file.FileTreeWalker.visit(FileTreeWalker.java:276)
>     at java.nio.file.FileTreeWalker.next(FileTreeWalker.java:372)
>     at java.nio.file.Files.walkFileTree(Files.java:2706)
>     at 
> org.apache.oozie.action.hadoop.LocalFsOperations.printContentsOfDir(LocalFsOperations.java:59)
>     at 
> org.apache.oozie.action.hadoop.LauncherAM.printDebugInfo(LauncherAM.java:293)
>     at 
> org.apache.oozie.action.hadoop.LauncherAM.access$100(LauncherAM.java:55)
>     at org.apache.oozie.action.hadoop.LauncherAM$2.run(LauncherAM.java:221)
>     at java.security.AccessController.doPrivileged(Native Method)
>     at javax.security.auth.Subject.doAs(Subject.java:422)
>     at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1844)
>     at org.apache.oozie.action.hadoop.LauncherAM.run(LauncherAM.java:217)
>     at org.apache.oozie.action.hadoop.LauncherAM$1.run(LauncherAM.java:153)
>     at java.security.AccessController.doPrivileged(Native Method)
>     at javax.security.auth.Subject.doAs(Subject.java:422)
>     at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1844)
>     at org.apache.oozie.action.hadoop.LauncherAM.main(LauncherAM.java:141)
> {code}
> After the [log4j hotpatch provided by 
> Correto|https://github.com/corretto/hotpatch-for-apache-log4j2] enabled, we 
> faced this issue intermittently. Disabling the hotpatch will fix the issue, 
> however, there maybe another agent and it would use the CWD by default, so I 
> suppose it can be fixed in Oozie side.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to