Re: Oozie job in PREP state for a long time

2017-06-06 Thread Dongying Jiao
Hi Andras and Attila: Thanks for your advice. I will check the cluster utility when this job runs next time, but I find some warning in oozie.log: 2017-06-05 02:18:18,952 WARN CallableQueueService:523 - SERVER[ 363748lpp2mn006.geicoddc.net] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] max

[jira] [Commented] (OOZIE-2867) Timezone handling for Coordinators: emphasize "Continent/City" format

2017-06-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-2867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16039563#comment-16039563 ] Hadoop QA commented on OOZIE-2867: -- Testing JIRA OOZIE-2867 Cleaning local git workspace

Build failed in Jenkins: oozie-trunk-precommit-build #3865

2017-06-06 Thread Apache Jenkins Server
See -- [...truncated 1.01 MB...] [INFO] Copying jetty-rewrite-9.2.19.v20160908.jar to

[jira] [Updated] (OOZIE-2867) Timezone handling for Coordinators: emphasize "Continent/City" format

2017-06-06 Thread Artem Ervits (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-2867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Artem Ervits updated OOZIE-2867: Attachment: OOZIE-2867-4.patch [~rkanter] thank you for the advice, I applied your recommendations

Re: Oozie job in PREP state for a long time

2017-06-06 Thread Attila Sasvari
Hi Dong Ying, Many thanks Andras, these are good ideas. In addition, can you confirm that you have enough vcores / memory in your cluster for containers? You can check and try to adjust the following YARN settings: - yarn.nodemanager.resource.cpu-vcores - yarn.nodemanager.resource.memory-mb

[jira] [Commented] (OOZIE-2796) oozie.action.keep.action.dir not getting noticed

2017-06-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-2796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16038812#comment-16038812 ] Hadoop QA commented on OOZIE-2796: -- Testing JIRA OOZIE-2796 Cleaning local git workspace

Build failed in Jenkins: oozie-trunk-precommit-build #3864

2017-06-06 Thread Apache Jenkins Server
See -- [...truncated 836.94 KB...] [INFO] Copying commons-collections-3.2.1.jar to

Re: Oozie job in PREP state for a long time

2017-06-06 Thread Andras Piros
Hi Dong Ying, do you see any logs having this snippet queue is full within the Oozie webapp logs? What are the values of these parameters: - oozie.service.CallableQueueService.queue.size - oozie.service.CallableQueueService.threads -

[jira] [Commented] (OOZIE-2796) oozie.action.keep.action.dir not getting noticed

2017-06-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-2796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16038728#comment-16038728 ] Hadoop QA commented on OOZIE-2796: -- Testing JIRA OOZIE-2796 Cleaning local git workspace

[jira] [Commented] (OOZIE-2923) Improve Spark options parsing

2017-06-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-2923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16038633#comment-16038633 ] Hadoop QA commented on OOZIE-2923: -- Testing JIRA OOZIE-2923 Cleaning local git workspace

Jenkins build is back to normal : oozie-trunk-precommit-build #3862

2017-06-06 Thread Apache Jenkins Server
See

[jira] [Updated] (OOZIE-2796) oozie.action.keep.action.dir not getting noticed

2017-06-06 Thread Attila Sasvari (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-2796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Sasvari updated OOZIE-2796: -- Attachment: OOZIE-2796-6.patch rebased patch - tests of TestJavaActionExecutor locally passed

[jira] [Updated] (OOZIE-2923) Improve Spark options parsing

2017-06-06 Thread Andras Piros (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-2923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Piros updated OOZIE-2923: Attachment: OOZIE-2923.005.patch Addressing RB comment. > Improve Spark options parsing >

Re: Review Request 59635: OOZIE-2923 Improve Spark options parsing

2017-06-06 Thread AndrĂ¡s Piros
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/59635/ --- (Updated June 6, 2017, 8:59 a.m.) Review request for oozie. Repository:

[jira] [Commented] (OOZIE-2796) oozie.action.keep.action.dir not getting noticed

2017-06-06 Thread Attila Sasvari (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-2796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16038335#comment-16038335 ] Attila Sasvari commented on OOZIE-2796: --- [~zhengxb2005] could you please rebase the patch? It does

Oozie job in PREP state for a long time

2017-06-06 Thread Dongying Jiao
Hi: I have a oozie coordinator job run at 02:00 o'clock everyday, sometimes, the job can run smoothly, but sometimes, the job is stuck in PREP state for a long time. This is my part of my coordinator.xml: 10 1 . This is part of the workflow.xml: ..

[jira] Subscription: Oozie Patch Available

2017-06-06 Thread jira
Issue Subscription Filter: Oozie Patch Available (99 issues) Subscriber: ooziedaily Key Summary OOZIE-2927 Append new line character for Hive2 query using query tag https://issues.apache.org/jira/browse/OOZIE-2927 OOZIE-2924 ./bin/mkdistro.sh reports a number instances of