Re: Oozie tests seems to be requiring umask 022

2012-10-15 Thread Johannes Schwenk
Hi Jarcek, this is known behaviour. I ran into the same issue - see https://issues.apache.org/jira/browse/PIG-2734 Greetings, Johannes Am 12.10.2012 20:27, schrieb Jarek Jarcec Cecho: Hi Oozie developers, I've recently worked on OOZIE-1012 and I've noticed that on my box oozie tests seems

[jira] [Created] (OOZIE-1021) Update build doc to set umask to 0022

2012-10-15 Thread Mohammad Kamrul Islam (JIRA)
Mohammad Kamrul Islam created OOZIE-1021: Summary: Update build doc to set umask to 0022 Key: OOZIE-1021 URL: https://issues.apache.org/jira/browse/OOZIE-1021 Project: Oozie Issue

Re: Oozie tests seems to be requiring umask 022

2012-10-15 Thread Mohammad Islam
My previous reply was for another email. Sorry for the confusion. I found my umask also defaulted to 0022. That's why we never experienced the issue. I agree we should update that Oozie doc. Created a JIRA: https://issues.apache.org/jira/browse/OOZIE-1021 Regards, Mohammad

Re: Oozie tests seems to be requiring umask 022

2012-10-15 Thread Jarek Jarcec Cecho
Thank you sir, I appreciate your help! Do you think that it would make sense to also add try-catch block in the setUp method for NullPointerException and print out some warning message that hadoop was not correctly initialized and thus there will be failures in the tests? I believe that it

Re: Oozie tests seems to be requiring umask 022

2012-10-15 Thread Robert Kanter
Catching the NPE exception and printing a more useful message is a good idea, but if there's other possible things that could cause an NPE, the useful message would be misleading. Perhaps a better solution might be to explicitly check the umask somehow and print/log a warning or something.

Re: Oozie tests seems to be requiring umask 022

2012-10-15 Thread Alejandro Abdelnur
shouldnt the fix be done in hdfs? Alejandro On Oct 15, 2012, at 9:37 AM, Robert Kanter rkan...@cloudera.com wrote: Catching the NPE exception and printing a more useful message is a good idea, but if there's other possible things that could cause an NPE, the useful message would be

[jira] [Created] (OOZIE-1022) Maven runs out of heap memory when building the docs

2012-10-15 Thread Robert Kanter (JIRA)
Robert Kanter created OOZIE-1022: Summary: Maven runs out of heap memory when building the docs Key: OOZIE-1022 URL: https://issues.apache.org/jira/browse/OOZIE-1022 Project: Oozie Issue

Re: move from SVN to GIT

2012-10-15 Thread Robert Kanter
Will the git mirror repo (git://git.apache.org/oozie.git) continue to work? thanks - Robert On Mon, Oct 15, 2012 at 11:58 AM, Alejandro Abdelnur tuc...@gmail.comwrote: INFRA is ready to pull the trigger on moving from SVN to GIT. https://issues.apache.org/jira/browse/INFRA-5279 The new

Re: move from SVN to GIT

2012-10-15 Thread Jarek Jarcec Cecho
I've driven effort to migrate SVN to GIT in two other projects and we always ensured that git repo on git.apache.org is being in sync (in read only mode) including sync to github. I can't tell if there are planned differences to Oozie though. Jarcec On Mon, Oct 15, 2012 at 12:33:05PM -0700,

Re: move from SVN to GIT

2012-10-15 Thread Alejandro Abdelnur
I'd guess not as we don't need it anymore, we'd just change the remote ref or do a new clone. On Mon, Oct 15, 2012 at 12:33 PM, Robert Kanter rkan...@cloudera.comwrote: Will the git mirror repo (git://git.apache.org/oozie.git) continue to work? thanks - Robert On Mon, Oct 15, 2012 at

Re: Oozie tests seems to be requiring umask 022

2012-10-15 Thread Jarek Jarcec Cecho
That actually make complete sense, thank you for pointing it out Alejandro. I'll try to extract the use case and report this bug in upstream Hadoop (HDFS) project. I would still recommend documenting this requirement on Oozie web pages thought. Jarcec On Mon, Oct 15, 2012 at 10:47:08AM -0700,

[jira] [Created] (OOZIE-1023) Docs list OOZIE_CONF instead of OOZIE_CONFIG env var

2012-10-15 Thread Robert Kanter (JIRA)
Robert Kanter created OOZIE-1023: Summary: Docs list OOZIE_CONF instead of OOZIE_CONFIG env var Key: OOZIE-1023 URL: https://issues.apache.org/jira/browse/OOZIE-1023 Project: Oozie Issue

[jira] [Updated] (OOZIE-1023) Docs list OOZIE_CONF instead of OOZIE_CONFIG env var

2012-10-15 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-1023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated OOZIE-1023: - Attachment: OOZIE-1023.patch Docs list OOZIE_CONF instead of OOZIE_CONFIG env var

[jira] [Commented] (OOZIE-1023) Docs list OOZIE_CONF instead of OOZIE_CONFIG env var

2012-10-15 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-1023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13476434#comment-13476434 ] Alejandro Abdelnur commented on OOZIE-1023: --- +1 Docs list

[jira] [Created] (OOZIE-1024) ooziedb.sh script should keep OOZIE_CONFIG, OOZIE_LOG, and OOZIE_DATA if previously set

2012-10-15 Thread Robert Kanter (JIRA)
Robert Kanter created OOZIE-1024: Summary: ooziedb.sh script should keep OOZIE_CONFIG, OOZIE_LOG, and OOZIE_DATA if previously set Key: OOZIE-1024 URL: https://issues.apache.org/jira/browse/OOZIE-1024

[jira] [Assigned] (OOZIE-1024) ooziedb.sh script should keep OOZIE_CONFIG, OOZIE_LOG, and OOZIE_DATA if previously set

2012-10-15 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter reassigned OOZIE-1024: Assignee: Robert Kanter ooziedb.sh script should keep OOZIE_CONFIG, OOZIE_LOG, and

[jira] [Updated] (OOZIE-1024) ooziedb.sh script should keep OOZIE_CONFIG, OOZIE_LOG, and OOZIE_DATA if previously set

2012-10-15 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated OOZIE-1024: - Attachment: OOZIE-1024.patch The patch removes the custom code from ooziedb.sh and makes it

[jira] [Commented] (OOZIE-1024) ooziedb.sh script should keep OOZIE_CONFIG, OOZIE_LOG, and OOZIE_DATA if previously set

2012-10-15 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13476498#comment-13476498 ] Robert Kanter commented on OOZIE-1024: -- Also, to test the change, I built Oozie and

[jira] [Commented] (OOZIE-1023) Docs list OOZIE_CONF instead of OOZIE_CONFIG env var

2012-10-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-1023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13476501#comment-13476501 ] Hadoop QA commented on OOZIE-1023: -- Testing JIRA OOZIE-1023 Cleaning local svn workspace

[jira] [Commented] (OOZIE-1023) Docs list OOZIE_CONF instead of OOZIE_CONFIG env var

2012-10-15 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-1023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13476506#comment-13476506 ] Robert Kanter commented on OOZIE-1023: -- docs only change so no testcase(s) to

Re: move from SVN to GIT

2012-10-15 Thread Alejandro Abdelnur
Forgot to mention, Oozie committers, please hold off on commits until we are through with this sometime tomorrow morning. Thx. On Mon, Oct 15, 2012 at 3:13 PM, Alejandro Abdelnur t...@cloudera.comwrote: Jarcec, Good to know. Just wondering, what is the motivation for keeping git.apache.org

Re: Welcoming Mona Chitnis as Oozie committer

2012-10-15 Thread Alejandro Abdelnur
Congratulations Mona, well deserved On Mon, Oct 15, 2012 at 4:56 PM, Mohammad Islam misla...@yahoo.com wrote: Hi, On behalf of the Oozie PPMC, I am pleased to announce that Mona Chitnis has been elected as a committer in the Apache Oozie project. We appreciate all the work Mona has put into

Re: Welcoming Mona Chitnis as Oozie committer

2012-10-15 Thread Robert Kanter
Congrats! - Robert On Mon, Oct 15, 2012 at 5:14 PM, Alejandro Abdelnur t...@cloudera.comwrote: Congratulations Mona, well deserved On Mon, Oct 15, 2012 at 4:56 PM, Mohammad Islam misla...@yahoo.com wrote: Hi, On behalf of the Oozie PPMC, I am pleased to announce that Mona Chitnis

Re: Welcoming Mona Chitnis as Oozie committer

2012-10-15 Thread Jarek Jarcec Cecho
Yeah, congratulations! Jarcec On Mon, Oct 15, 2012 at 05:22:28PM -0700, Robert Kanter wrote: Congrats! - Robert On Mon, Oct 15, 2012 at 5:14 PM, Alejandro Abdelnur t...@cloudera.comwrote: Congratulations Mona, well deserved On Mon, Oct 15, 2012 at 4:56 PM, Mohammad Islam

[jira] [Commented] (OOZIE-561) Integrate Oozie with HCatalog

2012-10-15 Thread Mohammad Kamrul Islam (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13476611#comment-13476611 ] Mohammad Kamrul Islam commented on OOZIE-561: - High-level Requirements: •

[jira] [Updated] (OOZIE-561) Integrate Oozie with HCatalog

2012-10-15 Thread Mohammad Kamrul Islam (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mohammad Kamrul Islam updated OOZIE-561: Attachment: Oozie-HCatHighLevel.pptx This presentation is relevant to design of

Feedback solicited: Oozie HCatalog integration design

2012-10-15 Thread Mohammad Islam
Hi,  Oozie team at Y! is going to implement the non-polling based data dependency using HCatalog metadata system. This is expected to impact a lot of performance issues. We created a JIRA and upload the high-level requirements and design. A quick presentation slides are also attached. JIRA: