Re: Cascading and Oozie

2013-10-17 Thread mpeterson2
Probably - that's my blog. I wrote that after getting it to work! :-) On Thu, Oct 17, 2013 at 12:58 PM, Mohammad Islam wrote: > Do you think this could be helpful? > > http://thornydev.blogspot.com/2013/10/launching-cascading-job-from-apache.html > > > I think shell action could be a choice.

Re: Cascading and Oozie

2013-10-17 Thread Mohammad Islam
Do you think this could be helpful? http://thornydev.blogspot.com/2013/10/launching-cascading-job-from-apache.html I think shell action could be a choice. Regards, Mohammad On Thursday, October 17, 2013 6:11 AM, "mpeters...@gmail.com" wrote: Yes, thanks everyone.  I have it working now as

Re: Cascading and Oozie

2013-10-17 Thread mpeterson2
Yes, thanks everyone. I have it working now as a Java action. That works because Oozie (nicely) puts all the hadoop jars in the classpath before running the java code. On Thu, Oct 17, 2013 at 1:37 AM, Som Satpathy wrote: > I have been running crunch/cascading jobs as oozie java actions, no >

Re: Cascading and Oozie

2013-10-16 Thread Som Satpathy
I have been running crunch/cascading jobs as oozie java actions, no problems so far. On Tue, Oct 8, 2013 at 4:47 PM, Alejandro Abdelnur wrote: > I would suggest looking at how Pig/Hive/Sqoop/Distcp actions works if you > want to have a custom action. Which, BTW, it would be a great > contributi

Re: Cascading and Oozie

2013-10-08 Thread Alejandro Abdelnur
I would suggest looking at how Pig/Hive/Sqoop/Distcp actions works if you want to have a custom action. Which, BTW, it would be a great contribution to Oozie. If you are going this path, you'll have to write a CascadingActionExecutor class that runs in the Oozie server and you'll e corhave to wri

Re: Cascading and Oozie

2013-10-08 Thread mpeterson2
Follow up. I've tried to run a Cascading job in oozie a couple of ways, but they all fail for various reasons. I tried to put it in a map-reduce action with oozie.launcher.action.main.class defined pointing to my Cascading class, but I can't see any way to pass all the arguments to it that it nee

Cascading and Oozie

2013-10-08 Thread mpeterson2
Apologies if this has been asked before, but I can't figure out how to search the archives of this mailing list and 20 minutes of googling yielded no useful results. I'm on a team that uses Cascading to do our MapReduce flows. However, we are investigating using Oozie to do additional types of ac