Re: Capture the output of a Hive query?

2013-03-13 Thread Felix . 徐
Seems I find the solution here : http://blog.cloudera.com/blog/2012/12/how-to-use-the-sharelib-in-apache-oozie/ and http://grokbase.com/p/cloudera/cdh-user/125h1188yv/oozie-cant-find-hive-action-xsd 2013/3/13 Felix.徐 > Ok thanks! > > If oozie runs every task as a Mapreduce, does it mean that

Re: Capture the output of a Hive query?

2013-03-12 Thread Felix . 徐
Ok thanks! If oozie runs every task as a Mapreduce, does it mean that I have to install Hive on every machine if I want to execute Hive action? Oozie failed with NoClassDefFoundError: org/apache/hadoop/hive/cli/CliDriver currently. 2013/3/12 Alejandro Abdelnur > Felix, > > On #1, you typicall

Re: Capture the output of a Hive query?

2013-03-12 Thread Alejandro Abdelnur
Felix, On #1, you typically don't want to run user code (apps) in the oozie server. Also, by using an MR job for the shell action we get automatic load distribution. If you need to run an action outside of the cluster, then look at the SSH action. On #2, whatever you print in an action will be in

Re: Capture the output of a Hive query?

2013-03-12 Thread Alejandro Abdelnur
Felix, On #1, Hive actions don't produce output back to oozie. If you need the next action to handle the output, you should point to the next action the output directory of the hive action. ON #2, definitely, you can add ${VAR} in your workflow configs, and provide the the VAR=VALUE in the job.pr

Re: Capture the output of a Hive query?

2013-03-12 Thread Felix . 徐
I have 2 more questions: 1.Why is shell action performed as a mapreduce? Isn't it supposed to run as a shell script on master node? 2.Is there any way to print some log within actions which can be shown in the web console , current log seems meaningless to me .. Thanks! 2013/3/12 Felix.徐 > Hi

Capture the output of a Hive query?

2013-03-11 Thread Felix . 徐
Hi, I have 2 questions: 1.How can I capture the output(a few lines) of a Hive query and pass it to the next action(e.g. a shell script) for further processing? The capture-output seems only supports a properties file. 2.Is it possible to manually trigger the same workflow with different parameters