[jira] [Commented] (OOZIE-2518) Oozie is creating many files and directories in /tmp per day
[ https://issues.apache.org/jira/browse/OOZIE-2518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16395802#comment-16395802 ] Hadoop QA commented on OOZIE-2518: -- PreCommit-OOZIE-Build started > Oozie is creating many files and directories in /tmp per day > > > Key: OOZIE-2518 > URL: https://issues.apache.org/jira/browse/OOZIE-2518 > Project: Oozie > Issue Type: Improvement >Affects Versions: 4.2.0 >Reporter: Sergey Svynarchuk >Assignee: Sergey Svynarchuk >Priority: Major > Labels: patch > Fix For: trunk > > Attachments: OOZIE-2518.patch > > > Oozie generate many tmp files, I have over 2000 files in /tmp from oozie, > that have been created over the last 7 days: > {code} > drwxr-xr-x 3 root root 22 Apr 22 14:19 /tmp/oozie-war-packing-24575 > drwxr-xr-x 3 root root 22 Apr 22 14:15 /tmp/oozie-war-packing-12211 > drwxr-xr-x 3 root root 22 Apr 22 14:10 /tmp/oozie-war-packing-32238 > drwxr-xr-x 2 test test6 Apr 22 13:54 > /tmp/oozie-test8457897583638353023.dir > -rw-r--r-- 1 test test0 Apr 22 13:54 /tmp/ooziedb-2680155694357966339.sql > drwxr-xr-x 2 test test6 Apr 22 13:53 /tmp/oozie-test142692242798969000.dir > -rw-r--r-- 1 test test0 Apr 22 13:53 /tmp/ooziedb-9104680045020610294.sql > drwxr-xr-x 2 test test6 Apr 22 13:53 > /tmp/oozie-test5885601734493698256.dir > -rw-r--r-- 1 test test0 Apr 22 13:53 /tmp/ooziedb-4675739133078261538.sql > drwxr-xr-x 2 test test6 Apr 22 13:53 > /tmp/oozie-test5565479595579419225.dir > [root@test-node ext-conf]# ls -ldt /tmp/ooz* | tail > drwxr-xr-x 3 root root 22 Apr 13 08:17 /tmp/oozie-war-packing-22705 > drwxr-xr-x 3 root root 22 Apr 13 08:16 /tmp/oozie-war-packing-18292 > drwxr-xr-x 3 root root 22 Apr 13 08:09 /tmp/oozie-war-packing-20289 > drwxr-xr-x 3 root root 22 Apr 13 08:09 /tmp/oozie-war-packing-18417 > drwxr-xr-x 3 root root 22 Apr 13 08:08 /tmp/oozie-war-packing-14712 > drwxr-xr-x 3 root root 22 Apr 13 08:05 /tmp/oozie-war-packing-25206 > drwxr-xr-x 3 root root 22 Apr 13 07:53 /tmp/oozie-war-packing-968 > drwxr-xr-x 3 root root 22 Apr 13 07:52 /tmp/oozie-war-packing-27771 > drwxr-xr-x 3 root root 22 Apr 13 07:45 /tmp/oozie-war-packing-30342 > drwxr-xr-x 3 root root 22 Apr 13 07:45 /tmp/oozie-war-packing-29086 > {code} > This files can be moved into oozie tmp dir (something like this > /tmp/oozieTmp) and also we could cleanup old files -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-2518) Oozie is creating many files and directories in /tmp per day
[ https://issues.apache.org/jira/browse/OOZIE-2518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16395813#comment-16395813 ] Hadoop QA commented on OOZIE-2518: -- Testing JIRA OOZIE-2518 Cleaning local git workspace {color:red}-1{color} Patch failed to apply to head of branch > Oozie is creating many files and directories in /tmp per day > > > Key: OOZIE-2518 > URL: https://issues.apache.org/jira/browse/OOZIE-2518 > Project: Oozie > Issue Type: Improvement >Affects Versions: 4.2.0 >Reporter: Sergey Svynarchuk >Assignee: Sergey Svynarchuk >Priority: Major > Labels: patch > Fix For: trunk > > Attachments: OOZIE-2518.patch > > > Oozie generate many tmp files, I have over 2000 files in /tmp from oozie, > that have been created over the last 7 days: > {code} > drwxr-xr-x 3 root root 22 Apr 22 14:19 /tmp/oozie-war-packing-24575 > drwxr-xr-x 3 root root 22 Apr 22 14:15 /tmp/oozie-war-packing-12211 > drwxr-xr-x 3 root root 22 Apr 22 14:10 /tmp/oozie-war-packing-32238 > drwxr-xr-x 2 test test6 Apr 22 13:54 > /tmp/oozie-test8457897583638353023.dir > -rw-r--r-- 1 test test0 Apr 22 13:54 /tmp/ooziedb-2680155694357966339.sql > drwxr-xr-x 2 test test6 Apr 22 13:53 /tmp/oozie-test142692242798969000.dir > -rw-r--r-- 1 test test0 Apr 22 13:53 /tmp/ooziedb-9104680045020610294.sql > drwxr-xr-x 2 test test6 Apr 22 13:53 > /tmp/oozie-test5885601734493698256.dir > -rw-r--r-- 1 test test0 Apr 22 13:53 /tmp/ooziedb-4675739133078261538.sql > drwxr-xr-x 2 test test6 Apr 22 13:53 > /tmp/oozie-test5565479595579419225.dir > [root@test-node ext-conf]# ls -ldt /tmp/ooz* | tail > drwxr-xr-x 3 root root 22 Apr 13 08:17 /tmp/oozie-war-packing-22705 > drwxr-xr-x 3 root root 22 Apr 13 08:16 /tmp/oozie-war-packing-18292 > drwxr-xr-x 3 root root 22 Apr 13 08:09 /tmp/oozie-war-packing-20289 > drwxr-xr-x 3 root root 22 Apr 13 08:09 /tmp/oozie-war-packing-18417 > drwxr-xr-x 3 root root 22 Apr 13 08:08 /tmp/oozie-war-packing-14712 > drwxr-xr-x 3 root root 22 Apr 13 08:05 /tmp/oozie-war-packing-25206 > drwxr-xr-x 3 root root 22 Apr 13 07:53 /tmp/oozie-war-packing-968 > drwxr-xr-x 3 root root 22 Apr 13 07:52 /tmp/oozie-war-packing-27771 > drwxr-xr-x 3 root root 22 Apr 13 07:45 /tmp/oozie-war-packing-30342 > drwxr-xr-x 3 root root 22 Apr 13 07:45 /tmp/oozie-war-packing-29086 > {code} > This files can be moved into oozie tmp dir (something like this > /tmp/oozieTmp) and also we could cleanup old files -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-2518) Oozie is creating many files and directories in /tmp per day
[ https://issues.apache.org/jira/browse/OOZIE-2518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263908#comment-15263908 ] Hadoop QA commented on OOZIE-2518: -- Testing JIRA OOZIE-2518 Cleaning local git workspace {color:green}+1 PATCH_APPLIES{color} {color:green}+1 CLEAN{color} {color:red}-1 RAW_PATCH_ANALYSIS{color} .{color:green}+1{color} the patch does not introduce any @author tags .{color:green}+1{color} the patch does not introduce any tabs .{color:green}+1{color} the patch does not introduce any trailing spaces .{color:green}+1{color} the patch does not introduce any line longer than 132 .{color:red}-1{color} the patch does not add/modify any testcase {color:green}+1 RAT{color} .{color:green}+1{color} the patch does not seem to introduce new RAT warnings {color:green}+1 JAVADOC{color} .{color:green}+1{color} the patch does not seem to introduce new Javadoc warnings {color:green}+1 COMPILE{color} .{color:green}+1{color} HEAD compiles .{color:green}+1{color} patch compiles .{color:green}+1{color} the patch does not seem to introduce new javac warnings {color:green}+1 BACKWARDS_COMPATIBILITY{color} .{color:green}+1{color} the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations .{color:green}+1{color} the patch does not modify JPA files {color:green}+1 TESTS{color} .Tests run: 1777 {color:green}+1 DISTRO{color} .{color:green}+1{color} distro tarball builds with the patch {color:red}*-1 Overall result, please check the reported -1(s)*{color} The full output of the test-patch run is available at . https://builds.apache.org/job/oozie-trunk-precommit-build/2852/ > Oozie is creating many files and directories in /tmp per day > > > Key: OOZIE-2518 > URL: https://issues.apache.org/jira/browse/OOZIE-2518 > Project: Oozie > Issue Type: Improvement >Affects Versions: 4.2.0 >Reporter: Sergey Svinarchuk >Assignee: Sergey Svinarchuk > Labels: patch > Fix For: trunk > > Attachments: OOZIE-2518.patch > > > Oozie generate many tmp files, I have over 2000 files in /tmp from oozie, > that have been created over the last 7 days: > {code} > drwxr-xr-x 3 root root 22 Apr 22 14:19 /tmp/oozie-war-packing-24575 > drwxr-xr-x 3 root root 22 Apr 22 14:15 /tmp/oozie-war-packing-12211 > drwxr-xr-x 3 root root 22 Apr 22 14:10 /tmp/oozie-war-packing-32238 > drwxr-xr-x 2 test test6 Apr 22 13:54 > /tmp/oozie-test8457897583638353023.dir > -rw-r--r-- 1 test test0 Apr 22 13:54 /tmp/ooziedb-2680155694357966339.sql > drwxr-xr-x 2 test test6 Apr 22 13:53 /tmp/oozie-test142692242798969000.dir > -rw-r--r-- 1 test test0 Apr 22 13:53 /tmp/ooziedb-9104680045020610294.sql > drwxr-xr-x 2 test test6 Apr 22 13:53 > /tmp/oozie-test5885601734493698256.dir > -rw-r--r-- 1 test test0 Apr 22 13:53 /tmp/ooziedb-4675739133078261538.sql > drwxr-xr-x 2 test test6 Apr 22 13:53 > /tmp/oozie-test5565479595579419225.dir > [root@test-node ext-conf]# ls -ldt /tmp/ooz* | tail > drwxr-xr-x 3 root root 22 Apr 13 08:17 /tmp/oozie-war-packing-22705 > drwxr-xr-x 3 root root 22 Apr 13 08:16 /tmp/oozie-war-packing-18292 > drwxr-xr-x 3 root root 22 Apr 13 08:09 /tmp/oozie-war-packing-20289 > drwxr-xr-x 3 root root 22 Apr 13 08:09 /tmp/oozie-war-packing-18417 > drwxr-xr-x 3 root root 22 Apr 13 08:08 /tmp/oozie-war-packing-14712 > drwxr-xr-x 3 root root 22 Apr 13 08:05 /tmp/oozie-war-packing-25206 > drwxr-xr-x 3 root root 22 Apr 13 07:53 /tmp/oozie-war-packing-968 > drwxr-xr-x 3 root root 22 Apr 13 07:52 /tmp/oozie-war-packing-27771 > drwxr-xr-x 3 root root 22 Apr 13 07:45 /tmp/oozie-war-packing-30342 > drwxr-xr-x 3 root root 22 Apr 13 07:45 /tmp/oozie-war-packing-29086 > {code} > This files can be moved into oozie tmp dir (something like this > /tmp/oozieTmp) and also we could cleanup old files -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (OOZIE-2518) Oozie is creating many files and directories in /tmp per day
[ https://issues.apache.org/jira/browse/OOZIE-2518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15397017#comment-15397017 ] Hadoop QA commented on OOZIE-2518: -- Testing JIRA OOZIE-2518 Cleaning local git workspace {color:green}+1 PATCH_APPLIES{color} {color:green}+1 CLEAN{color} {color:red}-1 RAW_PATCH_ANALYSIS{color} .{color:green}+1{color} the patch does not introduce any @author tags .{color:green}+1{color} the patch does not introduce any tabs .{color:green}+1{color} the patch does not introduce any trailing spaces .{color:green}+1{color} the patch does not introduce any line longer than 132 .{color:red}-1{color} the patch does not add/modify any testcase {color:green}+1 RAT{color} .{color:green}+1{color} the patch does not seem to introduce new RAT warnings {color:green}+1 JAVADOC{color} .{color:green}+1{color} the patch does not seem to introduce new Javadoc warnings {color:red}-1 COMPILE{color} .{color:red}-1{color} HEAD does not compile .{color:red}-1{color} patch does not compile .{color:green}+1{color} the patch does not seem to introduce new javac warnings {color:green}+1 BACKWARDS_COMPATIBILITY{color} .{color:green}+1{color} the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations .{color:green}+1{color} the patch does not modify JPA files {color:red}-1 TESTS{color} - patch does not compile, cannot run testcases {color:green}+1 DISTRO{color} .{color:green}+1{color} distro tarball builds with the patch {color:red}*-1 Overall result, please check the reported -1(s)*{color} The full output of the test-patch run is available at . https://builds.apache.org/job/oozie-trunk-precommit-build/3118/ > Oozie is creating many files and directories in /tmp per day > > > Key: OOZIE-2518 > URL: https://issues.apache.org/jira/browse/OOZIE-2518 > Project: Oozie > Issue Type: Improvement >Affects Versions: 4.2.0 >Reporter: Sergey Svinarchuk >Assignee: Sergey Svinarchuk > Labels: patch > Fix For: trunk > > Attachments: OOZIE-2518.patch > > > Oozie generate many tmp files, I have over 2000 files in /tmp from oozie, > that have been created over the last 7 days: > {code} > drwxr-xr-x 3 root root 22 Apr 22 14:19 /tmp/oozie-war-packing-24575 > drwxr-xr-x 3 root root 22 Apr 22 14:15 /tmp/oozie-war-packing-12211 > drwxr-xr-x 3 root root 22 Apr 22 14:10 /tmp/oozie-war-packing-32238 > drwxr-xr-x 2 test test6 Apr 22 13:54 > /tmp/oozie-test8457897583638353023.dir > -rw-r--r-- 1 test test0 Apr 22 13:54 /tmp/ooziedb-2680155694357966339.sql > drwxr-xr-x 2 test test6 Apr 22 13:53 /tmp/oozie-test142692242798969000.dir > -rw-r--r-- 1 test test0 Apr 22 13:53 /tmp/ooziedb-9104680045020610294.sql > drwxr-xr-x 2 test test6 Apr 22 13:53 > /tmp/oozie-test5885601734493698256.dir > -rw-r--r-- 1 test test0 Apr 22 13:53 /tmp/ooziedb-4675739133078261538.sql > drwxr-xr-x 2 test test6 Apr 22 13:53 > /tmp/oozie-test5565479595579419225.dir > [root@test-node ext-conf]# ls -ldt /tmp/ooz* | tail > drwxr-xr-x 3 root root 22 Apr 13 08:17 /tmp/oozie-war-packing-22705 > drwxr-xr-x 3 root root 22 Apr 13 08:16 /tmp/oozie-war-packing-18292 > drwxr-xr-x 3 root root 22 Apr 13 08:09 /tmp/oozie-war-packing-20289 > drwxr-xr-x 3 root root 22 Apr 13 08:09 /tmp/oozie-war-packing-18417 > drwxr-xr-x 3 root root 22 Apr 13 08:08 /tmp/oozie-war-packing-14712 > drwxr-xr-x 3 root root 22 Apr 13 08:05 /tmp/oozie-war-packing-25206 > drwxr-xr-x 3 root root 22 Apr 13 07:53 /tmp/oozie-war-packing-968 > drwxr-xr-x 3 root root 22 Apr 13 07:52 /tmp/oozie-war-packing-27771 > drwxr-xr-x 3 root root 22 Apr 13 07:45 /tmp/oozie-war-packing-30342 > drwxr-xr-x 3 root root 22 Apr 13 07:45 /tmp/oozie-war-packing-29086 > {code} > This files can be moved into oozie tmp dir (something like this > /tmp/oozieTmp) and also we could cleanup old files -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (OOZIE-2518) Oozie is creating many files and directories in /tmp per day
[ https://issues.apache.org/jira/browse/OOZIE-2518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15399136#comment-15399136 ] abhishek bafna commented on OOZIE-2518: --- +1 {{non-binding}} > Oozie is creating many files and directories in /tmp per day > > > Key: OOZIE-2518 > URL: https://issues.apache.org/jira/browse/OOZIE-2518 > Project: Oozie > Issue Type: Improvement >Affects Versions: 4.2.0 >Reporter: Sergey Svinarchuk >Assignee: Sergey Svinarchuk > Labels: patch > Fix For: trunk > > Attachments: OOZIE-2518.patch > > > Oozie generate many tmp files, I have over 2000 files in /tmp from oozie, > that have been created over the last 7 days: > {code} > drwxr-xr-x 3 root root 22 Apr 22 14:19 /tmp/oozie-war-packing-24575 > drwxr-xr-x 3 root root 22 Apr 22 14:15 /tmp/oozie-war-packing-12211 > drwxr-xr-x 3 root root 22 Apr 22 14:10 /tmp/oozie-war-packing-32238 > drwxr-xr-x 2 test test6 Apr 22 13:54 > /tmp/oozie-test8457897583638353023.dir > -rw-r--r-- 1 test test0 Apr 22 13:54 /tmp/ooziedb-2680155694357966339.sql > drwxr-xr-x 2 test test6 Apr 22 13:53 /tmp/oozie-test142692242798969000.dir > -rw-r--r-- 1 test test0 Apr 22 13:53 /tmp/ooziedb-9104680045020610294.sql > drwxr-xr-x 2 test test6 Apr 22 13:53 > /tmp/oozie-test5885601734493698256.dir > -rw-r--r-- 1 test test0 Apr 22 13:53 /tmp/ooziedb-4675739133078261538.sql > drwxr-xr-x 2 test test6 Apr 22 13:53 > /tmp/oozie-test5565479595579419225.dir > [root@test-node ext-conf]# ls -ldt /tmp/ooz* | tail > drwxr-xr-x 3 root root 22 Apr 13 08:17 /tmp/oozie-war-packing-22705 > drwxr-xr-x 3 root root 22 Apr 13 08:16 /tmp/oozie-war-packing-18292 > drwxr-xr-x 3 root root 22 Apr 13 08:09 /tmp/oozie-war-packing-20289 > drwxr-xr-x 3 root root 22 Apr 13 08:09 /tmp/oozie-war-packing-18417 > drwxr-xr-x 3 root root 22 Apr 13 08:08 /tmp/oozie-war-packing-14712 > drwxr-xr-x 3 root root 22 Apr 13 08:05 /tmp/oozie-war-packing-25206 > drwxr-xr-x 3 root root 22 Apr 13 07:53 /tmp/oozie-war-packing-968 > drwxr-xr-x 3 root root 22 Apr 13 07:52 /tmp/oozie-war-packing-27771 > drwxr-xr-x 3 root root 22 Apr 13 07:45 /tmp/oozie-war-packing-30342 > drwxr-xr-x 3 root root 22 Apr 13 07:45 /tmp/oozie-war-packing-29086 > {code} > This files can be moved into oozie tmp dir (something like this > /tmp/oozieTmp) and also we could cleanup old files -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (OOZIE-2518) Oozie is creating many files and directories in /tmp per day
[ https://issues.apache.org/jira/browse/OOZIE-2518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15404938#comment-15404938 ] Robert Kanter commented on OOZIE-2518: -- The only way to run into this problem is if you rebuild Oozie and/or the database very frequently. Normal users shouldn't run into this, right? The files should eventually be cleaned up by the OS. > Oozie is creating many files and directories in /tmp per day > > > Key: OOZIE-2518 > URL: https://issues.apache.org/jira/browse/OOZIE-2518 > Project: Oozie > Issue Type: Improvement >Affects Versions: 4.2.0 >Reporter: Sergey Svinarchuk >Assignee: Sergey Svinarchuk > Labels: patch > Fix For: trunk > > Attachments: OOZIE-2518.patch > > > Oozie generate many tmp files, I have over 2000 files in /tmp from oozie, > that have been created over the last 7 days: > {code} > drwxr-xr-x 3 root root 22 Apr 22 14:19 /tmp/oozie-war-packing-24575 > drwxr-xr-x 3 root root 22 Apr 22 14:15 /tmp/oozie-war-packing-12211 > drwxr-xr-x 3 root root 22 Apr 22 14:10 /tmp/oozie-war-packing-32238 > drwxr-xr-x 2 test test6 Apr 22 13:54 > /tmp/oozie-test8457897583638353023.dir > -rw-r--r-- 1 test test0 Apr 22 13:54 /tmp/ooziedb-2680155694357966339.sql > drwxr-xr-x 2 test test6 Apr 22 13:53 /tmp/oozie-test142692242798969000.dir > -rw-r--r-- 1 test test0 Apr 22 13:53 /tmp/ooziedb-9104680045020610294.sql > drwxr-xr-x 2 test test6 Apr 22 13:53 > /tmp/oozie-test5885601734493698256.dir > -rw-r--r-- 1 test test0 Apr 22 13:53 /tmp/ooziedb-4675739133078261538.sql > drwxr-xr-x 2 test test6 Apr 22 13:53 > /tmp/oozie-test5565479595579419225.dir > [root@test-node ext-conf]# ls -ldt /tmp/ooz* | tail > drwxr-xr-x 3 root root 22 Apr 13 08:17 /tmp/oozie-war-packing-22705 > drwxr-xr-x 3 root root 22 Apr 13 08:16 /tmp/oozie-war-packing-18292 > drwxr-xr-x 3 root root 22 Apr 13 08:09 /tmp/oozie-war-packing-20289 > drwxr-xr-x 3 root root 22 Apr 13 08:09 /tmp/oozie-war-packing-18417 > drwxr-xr-x 3 root root 22 Apr 13 08:08 /tmp/oozie-war-packing-14712 > drwxr-xr-x 3 root root 22 Apr 13 08:05 /tmp/oozie-war-packing-25206 > drwxr-xr-x 3 root root 22 Apr 13 07:53 /tmp/oozie-war-packing-968 > drwxr-xr-x 3 root root 22 Apr 13 07:52 /tmp/oozie-war-packing-27771 > drwxr-xr-x 3 root root 22 Apr 13 07:45 /tmp/oozie-war-packing-30342 > drwxr-xr-x 3 root root 22 Apr 13 07:45 /tmp/oozie-war-packing-29086 > {code} > This files can be moved into oozie tmp dir (something like this > /tmp/oozieTmp) and also we could cleanup old files -- This message was sent by Atlassian JIRA (v6.3.4#6332)