Re: ssh action on AWS EMR
Can you pass ssh -i <.pem> file? On Thu, Feb 2, 2017 at 10:37 AM, Rishav Rohit wrote: > Hi, > > I want to set-up SSH action workflow on AWS EMR cluster which is inside a > VPC. For connecting to the master node through SSH, AWS provided private > key (.pem) file is required. > I have tried executing “hello world” SSH action with > localhost / hadoop@localhost options, but it is > giving me below error – > > org.apache.oozie.action.ActionExecutorException: AUTH_FAILED: Not able to > perform operation [ssh -o PasswordAuthentication=no -o > KbdInteractiveDevices=no -o StrictHostKeyChecking=no -o ConnectTimeout=20 > hadoop@localhost mkdir -p oozie-oozi/000- > 170202180741904-oozie-oozi-W/ssh--ssh/ ] | ErrorStream: Warning: > Permanently added localhost (ECDSA) to the list of known hosts. > Permission denied (publickey). > > How can I use AWS .pem file with the SSH action ? > > Thanks & Regards, > Rishav Rohit > >
Re: Getting Permission denied to run shell action
So by changing disk mount options this issue disappeared not sure how mount
options causing permissions denied issue for oozie or yarn.
/dev/md0 on /data type ext4
(rw,nosuid,nodev,noexec,relatime,stripe=128,data=ordered)
I have changed mount options from above to below and it worked.
/dev/md0 on /data type ext4 (rw,relatime,stripe=128,data=ordered)
Do you guys know any disk/mount best practices?
Ram
On Fri, Oct 21, 2016 at 8:31 AM, rammohan ganapavarapu <
rammohanga...@gmail.com> wrote:
> I have rwx, I actually have 777 on that dir.
>
> On Oct 21, 2016 2:21 AM, wrote:
>
>> Depends if /data is an directory or an mountpoint. Note, you need rwx for
>> directories
>>
>>
>>
>> --alex
>>
>>
>>
>> --
>> B: mapredit.blogspot.com
>>
>>
>>
>> *From: *rammohan ganapavarapu
>> *Sent: *Friday, October 21, 2016 8:27 AM
>> *To: *user@oozie.apache.org
>> *Cc: *u...@hadoop.apache.org
>> *Subject: *Re: Getting Permission denied to run shell action
>>
>>
>>
>> I am running oozie and yarn apps with same user and yes user can rw to
>> that directory.
>>
>>
>>
>> On Oct 20, 2016 11:17 PM, "Peter Cseh" wrote:
>>
>> Hi Ram,
>>
>> Can the yarn/oozie user write to /data/tmp?
>>
>> Check the permissions and ownership of /data/tmp.
>> Hope it helps
>> Gp
>>
>>
>> On Fri, Oct 21, 2016 at 1:32 AM, rammohan ganapavarapu <
>> rammohanga...@gmail.com> wrote:
>>
>> > Hi,
>> >
>> > I have changed the yarn.nodemanager.local-dirs from default /tmp/ to
>> > /data/tmp dir and from then i am getting this error
>> >
>> >
>> >
>> > Cannot run program "test.sh" (in directory
>> > "/data/tmp/nm-local-dir/usercache/hadoop/appcache/
>> > application_1476931300239_0003/container_1476931300239_0003_
>> 01_02"):
>> > error=13, Permission denied
>> >
>> > Property in yarn-site.xml
>> >
>> > ${hadoop.tmp.dir}=/data/tmp/
>> >
>> > yarn.nodemanager.local-dirs
>> > ${hadoop.tmp.dir}/nm-local-dir
>> >
>> >
>> > Not sure why i am getting this error, i am submitting job wtih the same
>> > user a directory owner,i have changed the ${hadoop.tmp.dir}=/tmp/ but
>> oozie
>> > still saying /data/* permission denied, i am not sure whats going on
>> here,
>> > can some one help me to figure it out?
>> >
>> > Thanks,
>> > Ram
>> >
>>
>>
>>
>> --
>> Peter Cseh
>> Software Engineer
>> <http://www.cloudera.com>
>>
>>
>>
>
RE: Getting Permission denied to run shell action
I have rwx, I actually have 777 on that dir.
On Oct 21, 2016 2:21 AM, wrote:
> Depends if /data is an directory or an mountpoint. Note, you need rwx for
> directories
>
>
>
> --alex
>
>
>
> --
> B: mapredit.blogspot.com
>
>
>
> *From: *rammohan ganapavarapu
> *Sent: *Friday, October 21, 2016 8:27 AM
> *To: *user@oozie.apache.org
> *Cc: *u...@hadoop.apache.org
> *Subject: *Re: Getting Permission denied to run shell action
>
>
>
> I am running oozie and yarn apps with same user and yes user can rw to
> that directory.
>
>
>
> On Oct 20, 2016 11:17 PM, "Peter Cseh" wrote:
>
> Hi Ram,
>
> Can the yarn/oozie user write to /data/tmp?
>
> Check the permissions and ownership of /data/tmp.
> Hope it helps
> Gp
>
>
> On Fri, Oct 21, 2016 at 1:32 AM, rammohan ganapavarapu <
> rammohanga...@gmail.com> wrote:
>
> > Hi,
> >
> > I have changed the yarn.nodemanager.local-dirs from default /tmp/ to
> > /data/tmp dir and from then i am getting this error
> >
> >
> >
> > Cannot run program "test.sh" (in directory
> > "/data/tmp/nm-local-dir/usercache/hadoop/appcache/
> > application_1476931300239_0003/container_1476931300239_0003_01_02"):
> > error=13, Permission denied
> >
> > Property in yarn-site.xml
> >
> > ${hadoop.tmp.dir}=/data/tmp/
> >
> > yarn.nodemanager.local-dirs
> > ${hadoop.tmp.dir}/nm-local-dir
> >
> >
> > Not sure why i am getting this error, i am submitting job wtih the same
> > user a directory owner,i have changed the ${hadoop.tmp.dir}=/tmp/ but
> oozie
> > still saying /data/* permission denied, i am not sure whats going on
> here,
> > can some one help me to figure it out?
> >
> > Thanks,
> > Ram
> >
>
>
>
> --
> Peter Cseh
> Software Engineer
> <http://www.cloudera.com>
>
>
>
Re: Getting Permission denied to run shell action
I am running oozie and yarn apps with same user and yes user can rw to that
directory.
On Oct 20, 2016 11:17 PM, "Peter Cseh" wrote:
> Hi Ram,
>
> Can the yarn/oozie user write to /data/tmp?
>
> Check the permissions and ownership of /data/tmp.
> Hope it helps
> Gp
>
>
> On Fri, Oct 21, 2016 at 1:32 AM, rammohan ganapavarapu <
> rammohanga...@gmail.com> wrote:
>
> > Hi,
> >
> > I have changed the yarn.nodemanager.local-dirs from default /tmp/ to
> > /data/tmp dir and from then i am getting this error
> >
> >
> >
> > Cannot run program "test.sh" (in directory
> > "/data/tmp/nm-local-dir/usercache/hadoop/appcache/
> > application_1476931300239_0003/container_1476931300239_0003_01_02"):
> > error=13, Permission denied
> >
> > Property in yarn-site.xml
> >
> > ${hadoop.tmp.dir}=/data/tmp/
> >
> > yarn.nodemanager.local-dirs
> > ${hadoop.tmp.dir}/nm-local-dir
> >
> >
> > Not sure why i am getting this error, i am submitting job wtih the same
> > user a directory owner,i have changed the ${hadoop.tmp.dir}=/tmp/ but
> oozie
> > still saying /data/* permission denied, i am not sure whats going on
> here,
> > can some one help me to figure it out?
> >
> > Thanks,
> > Ram
> >
>
>
>
> --
> Peter Cseh
> Software Engineer
> <http://www.cloudera.com>
>
Getting Permission denied to run shell action
Hi,
I have changed the yarn.nodemanager.local-dirs from default /tmp/ to
/data/tmp dir and from then i am getting this error
Cannot run program "test.sh" (in directory
"/data/tmp/nm-local-dir/usercache/hadoop/appcache/application_1476931300239_0003/container_1476931300239_0003_01_02"):
error=13, Permission denied
Property in yarn-site.xml
${hadoop.tmp.dir}=/data/tmp/
yarn.nodemanager.local-dirs
${hadoop.tmp.dir}/nm-local-dir
Not sure why i am getting this error, i am submitting job wtih the same
user a directory owner,i have changed the ${hadoop.tmp.dir}=/tmp/ but oozie
still saying /data/* permission denied, i am not sure whats going on here,
can some one help me to figure it out?
Thanks,
Ram
Re: jobTracker value
I am not using cloudera, i am using core hadoop, but i dont see 8050 listening all i see is 8031 and 8032 ports. Ram On Thu, Aug 18, 2016 at 6:03 PM, Youzha wrote: > If you use cloudera, the port is 8032. If you're not using cloudera, the > port is 8050 > On Aug 19, 2016 7:03 AM, "rammohan ganapavarapu" > wrote: > > > Hi, > > > > What is the value of jobTracker in oozie workflow? is it RM_HOST:8032 or > > 8031? > > > > Ram > > >
jobTracker value
Hi, What is the value of jobTracker in oozie workflow? is it RM_HOST:8032 or 8031? Ram
Re: ShareLibService Error
One more question in the same context, so do i have to create the sharelib path in hdfs prior to create sharelib using oozie-setup.sh or that path will automatically get create when i run that command? for me if i dont have that path in hdfs i am getting bellow error. ./oozie-setup.sh sharelib create -fs hdfs://localhost:8020 SLF4J: Actual binding is of type [org.slf4j.impl.SimpleLoggerFactory] the destination path for sharelib is: hdfs:/user/hadoop/share/lib/lib_20160616173312 Error: Wrong FS: hdfs:/user/hadoop/share/lib/lib_20160616173312, expected: hdfs://localhost:8020 Stack trace for the error was (for debug purposes): -- java.lang.IllegalArgumentException: Wrong FS: hdfs:/user/hadoop/share/lib/lib_20160616173312, expected: hdfs://eqp049wo:8020 But in config i use "hdfs://eqp049wo:8020/user/hadoop/share/lib, and run that command that dir is getting created but i am getting this error, so not sure what is the right way to do this sharelib thingy, any of you know what is the best way to do this? [ShareLib update status] host = http://localhost:11000/oozie status = java.io.FileNotFoundException: File /user/hadoop/share/lib does not exist Ram On Wed, Jun 15, 2016 at 3:03 PM, rammohan ganapavarapu < rammohanga...@gmail.com> wrote: > Ok by adding bellow config it worked. > > > > oozie.service.WorkflowAppService.system.libpath > hdfs:///user/hadoop/share/lib/ > > > > > oozie.service.HadoopAccessorService.hadoop.configurations > *=/usr/hadoop/etc/hadoop/ > > Comma separated AUTHORITY=HADOOP_CONF_DIR, where AUTHORITY is > the HOST:PORT of > the Hadoop service (JobTracker, YARN, HDFS). The wildcard '*' > configuration is > used when there is no exact match for an authority. The > HADOOP_CONF_DIR contains > the relevant Hadoop *-site.xml files. If the path is relative > is looked within > the Oozie configuration directory; though the path can be > absolute (i.e. to point > to Hadoop client conf/ directories in the local filesystem. > > > > On Wed, Jun 15, 2016 at 2:55 PM, rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > >> But i still have a question, is this sharelib path points to local FS or >> HDFS? >> >> oozie.service.WorkflowAppService.system.libpath <-- what is the correct >> syntax for this property in my case it worked if i point it to local FS >> where i have sharelibs extracted, if i give hdfs:// its not working. any >> idea what is the right way to do it? also when i create sharelib using >> oozie-setup.sh can i give static path? >> >> Ram >> >> On Wed, Jun 15, 2016 at 2:00 PM, rammohan ganapavarapu < >> rammohanga...@gmail.com> wrote: >> >>> I have updated the oozie config, when i ran create sharelib its creating >>> under "the destination path for sharelib is: >>> /uap/oozie/share/lib/lib_20160615205749" how can i make to create under >>> just /uap/oozie/share/lib ? >>> >>> >>> >>> oozie.service.WorkflowAppService.system.libpath >>> /uap/oozie/share/lib/ >>> >>> >>> I think its working now :) >>> >>> >>> >>> oozie admin -sharelibupdate -oozie http://localhost:11000/oozie >>> [ShareLib update status] >>> host = http://localhost:11000/oozie >>> status = Successful >>> sharelibDirOld = /uap/oozie/share/lib >>> sharelibDirNew = /uap/oozie/share/lib >>> >>> >>> [hadoop@localhost bin]$ oozie admin -shareliblist -oozie >>> http://localhost:11000/oozie >>> [Available ShareLib] >>> oozie >>> hive >>> distcp >>> hcatalog >>> sqoop >>> mapreduce-streaming >>> spark >>> hive2 >>> pig >>> >>> >>> Ram >>> >>> On Wed, Jun 15, 2016 at 1:51 PM, Peter Cseh >>> wrote: >>> >>>> Check your configuration, oozie is looking for the sharelib under >>>> /user/hadoop/share/lib instead of /user/oozie/share/lib >>>> >>>> Where is your sharelib installed on hdfs? >>>> >>>> >>>> On Wed, Jun 15, 2016 at 10:43 PM, rammohan ganapavarapu < >>>> rammohanga...@gmail.com> wrote: >>>> >>>> > Yes, i did that after i send my previous email now i am not seeing >>>> that 500 >>>> > error but still dont see any thing in sharelib list. >>>> > >>>> > oozie admin -sharelibupd
Re: ShareLibService Error
Ok by adding bellow config it worked. oozie.service.WorkflowAppService.system.libpath hdfs:///user/hadoop/share/lib/ oozie.service.HadoopAccessorService.hadoop.configurations *=/usr/hadoop/etc/hadoop/ Comma separated AUTHORITY=HADOOP_CONF_DIR, where AUTHORITY is the HOST:PORT of the Hadoop service (JobTracker, YARN, HDFS). The wildcard '*' configuration is used when there is no exact match for an authority. The HADOOP_CONF_DIR contains the relevant Hadoop *-site.xml files. If the path is relative is looked within the Oozie configuration directory; though the path can be absolute (i.e. to point to Hadoop client conf/ directories in the local filesystem. On Wed, Jun 15, 2016 at 2:55 PM, rammohan ganapavarapu < rammohanga...@gmail.com> wrote: > But i still have a question, is this sharelib path points to local FS or > HDFS? > > oozie.service.WorkflowAppService.system.libpath <-- what is the correct > syntax for this property in my case it worked if i point it to local FS > where i have sharelibs extracted, if i give hdfs:// its not working. any > idea what is the right way to do it? also when i create sharelib using > oozie-setup.sh can i give static path? > > Ram > > On Wed, Jun 15, 2016 at 2:00 PM, rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > >> I have updated the oozie config, when i ran create sharelib its creating >> under "the destination path for sharelib is: >> /uap/oozie/share/lib/lib_20160615205749" how can i make to create under >> just /uap/oozie/share/lib ? >> >> >> >> oozie.service.WorkflowAppService.system.libpath >> /uap/oozie/share/lib/ >> >> >> I think its working now :) >> >> >> >> oozie admin -sharelibupdate -oozie http://localhost:11000/oozie >> [ShareLib update status] >> host = http://localhost:11000/oozie >> status = Successful >> sharelibDirOld = /uap/oozie/share/lib >> sharelibDirNew = /uap/oozie/share/lib >> >> >> [hadoop@localhost bin]$ oozie admin -shareliblist -oozie >> http://localhost:11000/oozie >> [Available ShareLib] >> oozie >> hive >> distcp >> hcatalog >> sqoop >> mapreduce-streaming >> spark >> hive2 >> pig >> >> >> Ram >> >> On Wed, Jun 15, 2016 at 1:51 PM, Peter Cseh >> wrote: >> >>> Check your configuration, oozie is looking for the sharelib under >>> /user/hadoop/share/lib instead of /user/oozie/share/lib >>> >>> Where is your sharelib installed on hdfs? >>> >>> >>> On Wed, Jun 15, 2016 at 10:43 PM, rammohan ganapavarapu < >>> rammohanga...@gmail.com> wrote: >>> >>> > Yes, i did that after i send my previous email now i am not seeing >>> that 500 >>> > error but still dont see any thing in sharelib list. >>> > >>> > oozie admin -sharelibupdate -oozie http://localhost:11000/oozie >>> > [ShareLib update status] >>> > host = http://localhost:11000/oozie >>> > status = java.io.FileNotFoundException: File /user/hadoop/share/lib >>> > does not exist >>> > >>> > On Wed, Jun 15, 2016 at 1:40 PM, Peter Cseh >>> wrote: >>> > >>> > > Based on that e-mail thread: >>> > > >>> > > An update of the library from 2.1 to 2.4 into >>> > > oozie_webapp_folder/WEB-INF/lib solved my problem >>> > > >>> > > >>> > > Try copiing the jar there and restart oozie afterwards >>> > > >>> > > gp >>> > > >>> > > >>> > > >>> > > On Wed, Jun 15, 2016 at 10:35 PM, rammohan ganapavarapu < >>> > > rammohanga...@gmail.com> wrote: >>> > > >>> > > > Peter, >>> > > > >>> > > > What is the processes to upgrade common-io-lib? i already have ( >>> > manually >>> > > > copied) that jar under $OOZIE_HOME/lib dir but still having issues. >>> > > > >>> > > > Thanks, >>> > > > Ram >>> > > > >>> > > > On Wed, Jun 15, 2016 at 12:10 PM, Peter Cseh < >>> gezap...@cloudera.com> >>> > > > wrote: >>> > > > >>> > > > > You could try updating the common-io library to 2.4, that helped >>> a >>> > >
Re: ShareLibService Error
But i still have a question, is this sharelib path points to local FS or HDFS? oozie.service.WorkflowAppService.system.libpath <-- what is the correct syntax for this property in my case it worked if i point it to local FS where i have sharelibs extracted, if i give hdfs:// its not working. any idea what is the right way to do it? also when i create sharelib using oozie-setup.sh can i give static path? Ram On Wed, Jun 15, 2016 at 2:00 PM, rammohan ganapavarapu < rammohanga...@gmail.com> wrote: > I have updated the oozie config, when i ran create sharelib its creating > under "the destination path for sharelib is: > /uap/oozie/share/lib/lib_20160615205749" how can i make to create under > just /uap/oozie/share/lib ? > > > > oozie.service.WorkflowAppService.system.libpath > /uap/oozie/share/lib/ > > > I think its working now :) > > > > oozie admin -sharelibupdate -oozie http://localhost:11000/oozie > [ShareLib update status] > host = http://localhost:11000/oozie > status = Successful > sharelibDirOld = /uap/oozie/share/lib > sharelibDirNew = /uap/oozie/share/lib > > > [hadoop@localhost bin]$ oozie admin -shareliblist -oozie > http://localhost:11000/oozie > [Available ShareLib] > oozie > hive > distcp > hcatalog > sqoop > mapreduce-streaming > spark > hive2 > pig > > > Ram > > On Wed, Jun 15, 2016 at 1:51 PM, Peter Cseh wrote: > >> Check your configuration, oozie is looking for the sharelib under >> /user/hadoop/share/lib instead of /user/oozie/share/lib >> >> Where is your sharelib installed on hdfs? >> >> >> On Wed, Jun 15, 2016 at 10:43 PM, rammohan ganapavarapu < >> rammohanga...@gmail.com> wrote: >> >> > Yes, i did that after i send my previous email now i am not seeing that >> 500 >> > error but still dont see any thing in sharelib list. >> > >> > oozie admin -sharelibupdate -oozie http://localhost:11000/oozie >> > [ShareLib update status] >> > host = http://localhost:11000/oozie >> > status = java.io.FileNotFoundException: File /user/hadoop/share/lib >> > does not exist >> > >> > On Wed, Jun 15, 2016 at 1:40 PM, Peter Cseh >> wrote: >> > >> > > Based on that e-mail thread: >> > > >> > > An update of the library from 2.1 to 2.4 into >> > > oozie_webapp_folder/WEB-INF/lib solved my problem >> > > >> > > >> > > Try copiing the jar there and restart oozie afterwards >> > > >> > > gp >> > > >> > > >> > > >> > > On Wed, Jun 15, 2016 at 10:35 PM, rammohan ganapavarapu < >> > > rammohanga...@gmail.com> wrote: >> > > >> > > > Peter, >> > > > >> > > > What is the processes to upgrade common-io-lib? i already have ( >> > manually >> > > > copied) that jar under $OOZIE_HOME/lib dir but still having issues. >> > > > >> > > > Thanks, >> > > > Ram >> > > > >> > > > On Wed, Jun 15, 2016 at 12:10 PM, Peter Cseh > > >> > > > wrote: >> > > > >> > > > > You could try updating the common-io library to 2.4, that helped a >> > > > similar >> > > > > issue before: >> > > > > >> > > > > >> > > > >> > > >> > >> http://mail-archives.apache.org/mod_mbox/oozie-user/201507.mbox/%3CCALBGZ8o4n27S8w6fn3HFxfzJmZbA9Gsz71Ewg%2Br6XEFCZTFpPQ%40mail.gmail.com%3E >> > > > > >> > > > > gp >> > > > > >> > > > > On Wed, Jun 15, 2016 at 8:54 PM, rammohan ganapavarapu < >> > > > > rammohanga...@gmail.com> wrote: >> > > > > >> > > > > > I am getting this for update. >> > > > > > >> > > > > > oozie admin -sharelibupdate -oozie >> http://localhost:11000/oozie >> > > > > > Error: HTTP error code: 500 : Internal Server Error >> > > > > > >> > > > > > and log from oozie.log >> > > > > > >> > > > > > >> > > > > > 2016-06-15 18:54:04,974 WARN AuthenticationFilter:509 - >> > > > > SERVER[localhost] >> > > > > > AuthenticationToken ignored: >> > > > > > org.apache.hadoop.security.authentication.util.SignerException
Re: ShareLibService Error
I have updated the oozie config, when i ran create sharelib its creating under "the destination path for sharelib is: /uap/oozie/share/lib/lib_20160615205749" how can i make to create under just /uap/oozie/share/lib ? oozie.service.WorkflowAppService.system.libpath /uap/oozie/share/lib/ I think its working now :) oozie admin -sharelibupdate -oozie http://localhost:11000/oozie [ShareLib update status] host = http://localhost:11000/oozie status = Successful sharelibDirOld = /uap/oozie/share/lib sharelibDirNew = /uap/oozie/share/lib [hadoop@localhost bin]$ oozie admin -shareliblist -oozie http://localhost:11000/oozie [Available ShareLib] oozie hive distcp hcatalog sqoop mapreduce-streaming spark hive2 pig Ram On Wed, Jun 15, 2016 at 1:51 PM, Peter Cseh wrote: > Check your configuration, oozie is looking for the sharelib under > /user/hadoop/share/lib instead of /user/oozie/share/lib > > Where is your sharelib installed on hdfs? > > > On Wed, Jun 15, 2016 at 10:43 PM, rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > > > Yes, i did that after i send my previous email now i am not seeing that > 500 > > error but still dont see any thing in sharelib list. > > > > oozie admin -sharelibupdate -oozie http://localhost:11000/oozie > > [ShareLib update status] > > host = http://localhost:11000/oozie > > status = java.io.FileNotFoundException: File /user/hadoop/share/lib > > does not exist > > > > On Wed, Jun 15, 2016 at 1:40 PM, Peter Cseh > wrote: > > > > > Based on that e-mail thread: > > > > > > An update of the library from 2.1 to 2.4 into > > > oozie_webapp_folder/WEB-INF/lib solved my problem > > > > > > > > > Try copiing the jar there and restart oozie afterwards > > > > > > gp > > > > > > > > > > > > On Wed, Jun 15, 2016 at 10:35 PM, rammohan ganapavarapu < > > > rammohanga...@gmail.com> wrote: > > > > > > > Peter, > > > > > > > > What is the processes to upgrade common-io-lib? i already have ( > > manually > > > > copied) that jar under $OOZIE_HOME/lib dir but still having issues. > > > > > > > > Thanks, > > > > Ram > > > > > > > > On Wed, Jun 15, 2016 at 12:10 PM, Peter Cseh > > > > wrote: > > > > > > > > > You could try updating the common-io library to 2.4, that helped a > > > > similar > > > > > issue before: > > > > > > > > > > > > > > > > > > > > http://mail-archives.apache.org/mod_mbox/oozie-user/201507.mbox/%3CCALBGZ8o4n27S8w6fn3HFxfzJmZbA9Gsz71Ewg%2Br6XEFCZTFpPQ%40mail.gmail.com%3E > > > > > > > > > > gp > > > > > > > > > > On Wed, Jun 15, 2016 at 8:54 PM, rammohan ganapavarapu < > > > > > rammohanga...@gmail.com> wrote: > > > > > > > > > > > I am getting this for update. > > > > > > > > > > > > oozie admin -sharelibupdate -oozie > http://localhost:11000/oozie > > > > > > Error: HTTP error code: 500 : Internal Server Error > > > > > > > > > > > > and log from oozie.log > > > > > > > > > > > > > > > > > > 2016-06-15 18:54:04,974 WARN AuthenticationFilter:509 - > > > > > SERVER[localhost] > > > > > > AuthenticationToken ignored: > > > > > > org.apache.hadoop.security.authentication.util.SignerException: > > > Invalid > > > > > > signature > > > > > > > > > > > > On Wed, Jun 15, 2016 at 5:28 AM, Peter Cseh < > gezap...@cloudera.com > > > > > > > > wrote: > > > > > > > > > > > > > Hi Ram, > > > > > > > > > > > > > > Have you told oozie to update the sharelibs with the command: > > > > > > > > > > > > > > oozie admin -sharelibupdate -oozie > http://localhost:11000/oozie > > > > > > > > > > > > > > > > > > > > > BRs > > > > > > > > > > > > > > gezapeti > > > > > > > > > > > > > > On Wed, Jun 15, 2016 at 1:06 AM, rammohan ganapavarapu < > > > > > > > rammohanga...@gmail.com> wrote: > > > > > > > > > > > > > > > Hi, &
Re: ShareLibService Error
Yes, i did that after i send my previous email now i am not seeing that 500 error but still dont see any thing in sharelib list. oozie admin -sharelibupdate -oozie http://localhost:11000/oozie [ShareLib update status] host = http://localhost:11000/oozie status = java.io.FileNotFoundException: File /user/hadoop/share/lib does not exist On Wed, Jun 15, 2016 at 1:40 PM, Peter Cseh wrote: > Based on that e-mail thread: > > An update of the library from 2.1 to 2.4 into > oozie_webapp_folder/WEB-INF/lib solved my problem > > > Try copiing the jar there and restart oozie afterwards > > gp > > > > On Wed, Jun 15, 2016 at 10:35 PM, rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > > > Peter, > > > > What is the processes to upgrade common-io-lib? i already have ( manually > > copied) that jar under $OOZIE_HOME/lib dir but still having issues. > > > > Thanks, > > Ram > > > > On Wed, Jun 15, 2016 at 12:10 PM, Peter Cseh > > wrote: > > > > > You could try updating the common-io library to 2.4, that helped a > > similar > > > issue before: > > > > > > > > > http://mail-archives.apache.org/mod_mbox/oozie-user/201507.mbox/%3CCALBGZ8o4n27S8w6fn3HFxfzJmZbA9Gsz71Ewg%2Br6XEFCZTFpPQ%40mail.gmail.com%3E > > > > > > gp > > > > > > On Wed, Jun 15, 2016 at 8:54 PM, rammohan ganapavarapu < > > > rammohanga...@gmail.com> wrote: > > > > > > > I am getting this for update. > > > > > > > > oozie admin -sharelibupdate -oozie http://localhost:11000/oozie > > > > Error: HTTP error code: 500 : Internal Server Error > > > > > > > > and log from oozie.log > > > > > > > > > > > > 2016-06-15 18:54:04,974 WARN AuthenticationFilter:509 - > > > SERVER[localhost] > > > > AuthenticationToken ignored: > > > > org.apache.hadoop.security.authentication.util.SignerException: > Invalid > > > > signature > > > > > > > > On Wed, Jun 15, 2016 at 5:28 AM, Peter Cseh > > > wrote: > > > > > > > > > Hi Ram, > > > > > > > > > > Have you told oozie to update the sharelibs with the command: > > > > > > > > > > oozie admin -sharelibupdate -oozie http://localhost:11000/oozie > > > > > > > > > > > > > > > BRs > > > > > > > > > > gezapeti > > > > > > > > > > On Wed, Jun 15, 2016 at 1:06 AM, rammohan ganapavarapu < > > > > > rammohanga...@gmail.com> wrote: > > > > > > > > > > > Hi, > > > > > > > > > > > > I am getting this error in oozie-error.log, i have created > sharelib > > > > using > > > > > > setup script it got successful but when i do shareliblist i am > > > getting > > > > > > empty output but i can list it from hdfs FS, any help? > > > > > > > > > > > > > > > > > > 1. ./oozie-setup.sh sharelib create -fs hdfs://localhost:8020 > > > > > > the destination path for sharelib is: > > > > > > /user/hadoop/share/lib/lib_20160614225830 > > > > > > > > > > > > > > > > > > 2. oozie admin -shareliblist -oozie > http://localhost:11000/oozie > > > > > > [Available ShareLib] > > > > > > > > > > > > 3. hadoop fs -ls /uap/oozie/share/lib/lib_20160614164826/ > > > > > > Found 10 items > > > > > > drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 > > > > > > /uap/oozie/share/lib/lib_20160614164826/distcp > > > > > > drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 > > > > > > /uap/oozie/share/lib/lib_20160614164826/hcatalog > > > > > > drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 > > > > > > /uap/oozie/share/lib/lib_20160614164826/hive > > > > > > drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 > > > > > > /uap/oozie/share/lib/lib_20160614164826/hive2 > > > > > > drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 > > > > > > /uap/oozie/share/lib/lib_20160614164826/mapreduce-streaming > > > > > > drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 > > > > > > /uap/oozie/share/lib/lib_20160614164826/oozie > > > >
Re: ShareLibService Error
Peter, What is the processes to upgrade common-io-lib? i already have ( manually copied) that jar under $OOZIE_HOME/lib dir but still having issues. Thanks, Ram On Wed, Jun 15, 2016 at 12:10 PM, Peter Cseh wrote: > You could try updating the common-io library to 2.4, that helped a similar > issue before: > > http://mail-archives.apache.org/mod_mbox/oozie-user/201507.mbox/%3CCALBGZ8o4n27S8w6fn3HFxfzJmZbA9Gsz71Ewg%2Br6XEFCZTFpPQ%40mail.gmail.com%3E > > gp > > On Wed, Jun 15, 2016 at 8:54 PM, rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > > > I am getting this for update. > > > > oozie admin -sharelibupdate -oozie http://localhost:11000/oozie > > Error: HTTP error code: 500 : Internal Server Error > > > > and log from oozie.log > > > > > > 2016-06-15 18:54:04,974 WARN AuthenticationFilter:509 - > SERVER[localhost] > > AuthenticationToken ignored: > > org.apache.hadoop.security.authentication.util.SignerException: Invalid > > signature > > > > On Wed, Jun 15, 2016 at 5:28 AM, Peter Cseh > wrote: > > > > > Hi Ram, > > > > > > Have you told oozie to update the sharelibs with the command: > > > > > > oozie admin -sharelibupdate -oozie http://localhost:11000/oozie > > > > > > > > > BRs > > > > > > gezapeti > > > > > > On Wed, Jun 15, 2016 at 1:06 AM, rammohan ganapavarapu < > > > rammohanga...@gmail.com> wrote: > > > > > > > Hi, > > > > > > > > I am getting this error in oozie-error.log, i have created sharelib > > using > > > > setup script it got successful but when i do shareliblist i am > getting > > > > empty output but i can list it from hdfs FS, any help? > > > > > > > > > > > > 1. ./oozie-setup.sh sharelib create -fs hdfs://localhost:8020 > > > > the destination path for sharelib is: > > > > /user/hadoop/share/lib/lib_20160614225830 > > > > > > > > > > > > 2. oozie admin -shareliblist -oozie http://localhost:11000/oozie > > > > [Available ShareLib] > > > > > > > > 3. hadoop fs -ls /uap/oozie/share/lib/lib_20160614164826/ > > > > Found 10 items > > > > drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 > > > > /uap/oozie/share/lib/lib_20160614164826/distcp > > > > drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 > > > > /uap/oozie/share/lib/lib_20160614164826/hcatalog > > > > drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 > > > > /uap/oozie/share/lib/lib_20160614164826/hive > > > > drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 > > > > /uap/oozie/share/lib/lib_20160614164826/hive2 > > > > drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 > > > > /uap/oozie/share/lib/lib_20160614164826/mapreduce-streaming > > > > drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 > > > > /uap/oozie/share/lib/lib_20160614164826/oozie > > > > drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 > > > > /uap/oozie/share/lib/lib_20160614164826/pig > > > > -rw-r--r-- 3 hadoop hadoop 1361 2016-06-14 16:48 > > > > /uap/oozie/share/lib/lib_20160614164826/sharelib.properties > > > > drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 > > > > /uap/oozie/share/lib/lib_20160614164826/spark > > > > drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 > > > > /uap/oozie/share/lib/lib_20160614164826/sqoop > > > > [hadoop@eqp049wo bin]$ > > > > > > > > > > > > > > > > > > > > org.apache.oozie.service.ServiceException: E0104: Could not fully > > > > initialize service [org.apache.oozie.service.ShareLibService], Not > able > > > to > > > > cache sharelib. An Admin needs to install the sharelib with > > > oozie-setup.sh > > > > and issue the 'oozie admin' CLI command to update the sharelib > > > > org.apache.oozie.service.ServiceException: E0104: Could not fully > > > > initialize service [org.apache.oozie.service.ShareLibService], Not > able > > > to > > > > cache sharelib. An Admin needs to install the sharelib with > > > oozie-setup.sh > > > > and issue the 'oozie admin' CLI command to update the sharelib > > > > at > > > > > org.apache.oozie.service.ShareLibService.init(Sha
Re: ShareLibService Error
I am getting this for update. oozie admin -sharelibupdate -oozie http://localhost:11000/oozie Error: HTTP error code: 500 : Internal Server Error and log from oozie.log 2016-06-15 18:54:04,974 WARN AuthenticationFilter:509 - SERVER[localhost] AuthenticationToken ignored: org.apache.hadoop.security.authentication.util.SignerException: Invalid signature On Wed, Jun 15, 2016 at 5:28 AM, Peter Cseh wrote: > Hi Ram, > > Have you told oozie to update the sharelibs with the command: > > oozie admin -sharelibupdate -oozie http://localhost:11000/oozie > > > BRs > > gezapeti > > On Wed, Jun 15, 2016 at 1:06 AM, rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > > > Hi, > > > > I am getting this error in oozie-error.log, i have created sharelib using > > setup script it got successful but when i do shareliblist i am getting > > empty output but i can list it from hdfs FS, any help? > > > > > > 1. ./oozie-setup.sh sharelib create -fs hdfs://localhost:8020 > > the destination path for sharelib is: > > /user/hadoop/share/lib/lib_20160614225830 > > > > > > 2. oozie admin -shareliblist -oozie http://localhost:11000/oozie > > [Available ShareLib] > > > > 3. hadoop fs -ls /uap/oozie/share/lib/lib_20160614164826/ > > Found 10 items > > drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 > > /uap/oozie/share/lib/lib_20160614164826/distcp > > drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 > > /uap/oozie/share/lib/lib_20160614164826/hcatalog > > drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 > > /uap/oozie/share/lib/lib_20160614164826/hive > > drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 > > /uap/oozie/share/lib/lib_20160614164826/hive2 > > drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 > > /uap/oozie/share/lib/lib_20160614164826/mapreduce-streaming > > drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 > > /uap/oozie/share/lib/lib_20160614164826/oozie > > drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 > > /uap/oozie/share/lib/lib_20160614164826/pig > > -rw-r--r-- 3 hadoop hadoop 1361 2016-06-14 16:48 > > /uap/oozie/share/lib/lib_20160614164826/sharelib.properties > > drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 > > /uap/oozie/share/lib/lib_20160614164826/spark > > drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 > > /uap/oozie/share/lib/lib_20160614164826/sqoop > > [hadoop@eqp049wo bin]$ > > > > > > > > > > org.apache.oozie.service.ServiceException: E0104: Could not fully > > initialize service [org.apache.oozie.service.ShareLibService], Not able > to > > cache sharelib. An Admin needs to install the sharelib with > oozie-setup.sh > > and issue the 'oozie admin' CLI command to update the sharelib > > org.apache.oozie.service.ServiceException: E0104: Could not fully > > initialize service [org.apache.oozie.service.ShareLibService], Not able > to > > cache sharelib. An Admin needs to install the sharelib with > oozie-setup.sh > > and issue the 'oozie admin' CLI command to update the sharelib > > at > > org.apache.oozie.service.ShareLibService.init(ShareLibService.java:139) > > at > > org.apache.oozie.service.Services.setServiceInternal(Services.java:386) > > at org.apache.oozie.service.Services.setService(Services.java:372) > > at org.apache.oozie.service.Services.loadServices(Services.java:305) > > at org.apache.oozie.service.Services.init(Services.java:213) > > at > > > > > org.apache.oozie.servlet.ServicesLoader.contextInitialized(ServicesLoader.java:46) > > at > > > > > org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:5068) > > at > > > > > org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5584) > > at > org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:147) > > at > > > > > org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:899) > > at > > org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:875) > > at > > org.apache.catalina.core.StandardHost.addChild(StandardHost.java:652) > > at > > org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:1092) > > at > > > org.apache.catalina.startup.HostConfig$DeployWar.run(HostConfig.java:1984) > > at > > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > > at java.util.concurrent.Fu
Re: ShareLibService Error
Hi, I am getting this error in oozie-error.log, i have created sharelib using setup script it got successful but when i do shareliblist i am getting empty output but i can list it from hdfs FS, any help? 1. ./oozie-setup.sh sharelib create -fs hdfs://localhost:8020 the destination path for sharelib is: /user/hadoop/share/lib/lib_20160614225830 2. oozie admin -shareliblist -oozie http://localhost:11000/oozie [Available ShareLib] 3. hadoop fs -ls /uap/oozie/share/lib/lib_20160614164826/ Found 10 items drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 /uap/oozie/share/lib/lib_20160614164826/distcp drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 /uap/oozie/share/lib/lib_20160614164826/hcatalog drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 /uap/oozie/share/lib/lib_20160614164826/hive drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 /uap/oozie/share/lib/lib_20160614164826/hive2 drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 /uap/oozie/share/lib/lib_20160614164826/mapreduce-streaming drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 /uap/oozie/share/lib/lib_20160614164826/oozie drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 /uap/oozie/share/lib/lib_20160614164826/pig -rw-r--r-- 3 hadoop hadoop 1361 2016-06-14 16:48 /uap/oozie/share/lib/lib_20160614164826/sharelib.properties drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 /uap/oozie/share/lib/lib_20160614164826/spark drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 /uap/oozie/share/lib/lib_20160614164826/sqoop [hadoop@eqp049wo bin]$ org.apache.oozie.service.ServiceException: E0104: Could not fully initialize service [org.apache.oozie.service.ShareLibService], Not able to cache sharelib. An Admin needs to install the sharelib with oozie-setup.sh and issue the 'oozie admin' CLI command to update the sharelib org.apache.oozie.service.ServiceException: E0104: Could not fully initialize service [org.apache.oozie.service.ShareLibService], Not able to cache sharelib. An Admin needs to install the sharelib with oozie-setup.sh and issue the 'oozie admin' CLI command to update the sharelib at org.apache.oozie.service.ShareLibService.init(ShareLibService.java:139) at org.apache.oozie.service.Services.setServiceInternal(Services.java:386) at org.apache.oozie.service.Services.setService(Services.java:372) at org.apache.oozie.service.Services.loadServices(Services.java:305) at org.apache.oozie.service.Services.init(Services.java:213) at org.apache.oozie.servlet.ServicesLoader.contextInitialized(ServicesLoader.java:46) at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:5068) at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5584) at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:147) at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:899) at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:875) at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:652) at org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:1092) at org.apache.catalina.startup.HostConfig$DeployWar.run(HostConfig.java:1984) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.NoClassDefFoundError: org/apache/commons/io/Charsets at org.apache.hadoop.security.Credentials.(Credentials.java:222) at org.apache.hadoop.mapred.JobConf.(JobConf.java:334) at org.apache.oozie.service.HadoopAccessorService.createJobConf(HadoopAccessorService.java:297) at org.apache.oozie.service.ShareLibService.init(ShareLibService.java:125) ... 18 more Caused by: java.lang.ClassNotFoundException: org.apache.commons.io.Charsets at org.apache.catalina.loader.WebappClassLoaderBase.loadClass(WebappClassLoaderBase.java:1858) at org.apache.catalina.loader.WebappClassLoaderBase.loadClass(WebappClassLoaderBase.java:1701) ... 22 more Thanks, Ram
Re:Error: HTTP error code: 500 : Internal Server Error
Hi, I am trying to test my oozie setup, oozie is up and running and i can access webui but when i try to run a shell job from the examples i am getting 500 error, any idea? oozie job -oozie http://localhost:11000/oozie -config job.properties -run -debug -verbose Auth type : null POST http://localhost:11000/oozie/v2/jobs?action=start user.namehadoop oozie.use.system.libpathtrue oozie.wf.application.pathhdfs://localhost:8020/examples/examples/apps/shell queueNamedefault nameNodehdfs://localhost:8020 jobTrackerlocalhost:8032 Error: HTTP error code: 500 : Internal Server Error My job.properties file from shell dir: nameNode=hdfs://localhost:8020 jobTracker=localhost:8032 queueName=default oozie.use.system.libpath=true oozie.wf.application.path=hdfs://localhost:8020/examples/examples/apps/shell
Re: oozie webui giving 404
Yes, processes is running and i built it using ExtJS2.2 too. On Fri, Jun 10, 2016 at 3:04 PM, satish saley wrote: > Are you able to see oozie process using ps -eaf | grep oozie? > Have you added ExtJS? > > Have a look at > http://oozie.apache.org/docs/4.2.0/AG_Install.html#Oozie_Server_Setup > http://oozie.apache.org/docs/4.2.0/DG_QuickStart.html#Server_Installation > ExtJS library (optional, to enable Oozie webconsole) > >- ExtJS 2.2 <http://dev.sencha.com/deploy/ext-2.2.zip> > > > On Fri, Jun 10, 2016 at 2:44 PM, rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > > > Hi, > > > > I am getting 404 page not found error when i access oozie webui, oozie > > started with no errors but when i looked at work dir i dont see any *.jsp > > or *.java files, can some help me to fix this issue? > > > > > > > > [root@localhost oozie]# pwd > > /opt/oozie/oozie-server/work/Catalina/localhost/oozie > > > > [root@localhost oozie]# ls -ltr > > total 0 > > > > > > Ram > > >
oozie webui giving 404
Hi, I am getting 404 page not found error when i access oozie webui, oozie started with no errors but when i looked at work dir i dont see any *.jsp or *.java files, can some help me to fix this issue? [root@localhost oozie]# pwd /opt/oozie/oozie-server/work/Catalina/localhost/oozie [root@localhost oozie]# ls -ltr total 0 Ram
Re: How to build ozzie 4.2.0 with hadoop-2.7.1
So I rebuilt oozie with tomcat 7 in pom.xml but it was still failing as oozie source has tomcat6 config files, so I am going to update those files and see if it works. On Jun 6, 2016 1:42 PM, "Attila Sasvari" wrote: > Good job Ram! I am glad to hear you made it work. > > Regards, > Attila > > ps: I did not have the time to reproduce the error, but I would guess > dependency conflicts around jsp-api caused the trouble. > > Actually there is an open ticket about the future of Oozie server's > deployment: https://issues.apache.org/jira/browse/OOZIE-2317 > Among other options it is recommended to use Tomcat 7 or newer because > Tomcat 6 will be end of life on Dec 31 2016 in the future. > > On Mon, Jun 6, 2016 at 9:07 PM, rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > > > Ok, i was able to resolve this issue by using tomcat7. > > > > Thanks, > > Ram > > > > On Mon, Jun 6, 2016 at 10:58 AM, rammohan ganapavarapu < > > rammohanga...@gmail.com> wrote: > > > > > Hi, > > > > > > I am still not able to access web ui, can some one help me to fix it? I > > am > > > not using java-8. > > > > > > Thanks, > > > Ram > > > > > > On Thu, Jun 2, 2016 at 10:14 AM, rammohan ganapavarapu < > > > rammohanga...@gmail.com> wrote: > > > > > >> Peter, > > >> > > >> I am not using java-8 though, i am using java-7 > > >> > > >> hadoop 24108 1 22 17:06 pts/000:00:13 > > >> */usr/lib/jvm/java-1.7.0-**openjdk.x86_64//bin/java* > > >> > > > -Djava.util.logging.config.file=/uap/oozie/oozie-server/conf/logging.properties > > >> -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager > > -Xmx2048m > > >> -Dderby.stream.error.file=/var/log/hadoop/derby.log > > >> -Doozie.home.dir=/uap/oozie-4.2.0 > > >> > > >> What else could be the reason for this jsp error? > > >> > > >> Ram > > >> > > >> > > >> > > >> On Wed, Jun 1, 2016 at 3:30 PM, Peter Cseh > > wrote: > > >> > > >>> Hi, > > >>> > > >>> This seems like a java 8 issue: > > >>> https://issues.apache.org/jira/browse/OOZIE-2533 > > >>> We haven't figured out a solution to it yet, other that to change > java > > to > > >>> an older version. > > >>> > > >>> gp > > >>> > > >>> > > >>> > > >>> On Wed, Jun 1, 2016 at 3:28 PM, rammohan ganapavarapu < > > >>> rammohanga...@gmail.com> wrote: > > >>> > > >>> > When i try to access oozie web ui i am getting below error, any > idea? > > >>> > > > >>> > > > >>> > HTTP Status 500 - org.apache.jasper.JasperException: Unable to load > > >>> class > > >>> > for JSP > > >>> > -- > > >>> > > > >>> > *type* Exception report > > >>> > > > >>> > *message* *org.apache.jasper.JasperException: Unable to load class > > for > > >>> JSP* > > >>> > > > >>> > *description* *The server encountered an internal error that > > prevented > > >>> it > > >>> > from fulfilling this request.* > > >>> > > > >>> > *exception* > > >>> > > > >>> > org.apache.jasper.JasperException: > org.apache.jasper.JasperException: > > >>> > Unable to load class for JSP > > >>> > > > >>> > > > >>> > > > org.apache.jasper.servlet.JspServletWrapper.getServlet(JspServletWrapper.java:161) > > >>> > > > >>> > > > >>> > > > org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:340) > > >>> > > > >>> > > > >>> > > org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:313) > > >>> > > > >>> org.apache.jasper.servlet.JspServlet.service(JspServlet.java:260) > > >>> > > javax.servlet.http.HttpServlet.service(HttpServlet.java:723) > > >>> > > > >>> org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:171) > > >>> > > >
Re: How to build ozzie 4.2.0 with hadoop-2.7.1
Ok, i was able to resolve this issue by using tomcat7. Thanks, Ram On Mon, Jun 6, 2016 at 10:58 AM, rammohan ganapavarapu < rammohanga...@gmail.com> wrote: > Hi, > > I am still not able to access web ui, can some one help me to fix it? I am > not using java-8. > > Thanks, > Ram > > On Thu, Jun 2, 2016 at 10:14 AM, rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > >> Peter, >> >> I am not using java-8 though, i am using java-7 >> >> hadoop 24108 1 22 17:06 pts/000:00:13 >> */usr/lib/jvm/java-1.7.0-**openjdk.x86_64//bin/java* >> -Djava.util.logging.config.file=/uap/oozie/oozie-server/conf/logging.properties >> -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Xmx2048m >> -Dderby.stream.error.file=/var/log/hadoop/derby.log >> -Doozie.home.dir=/uap/oozie-4.2.0 >> >> What else could be the reason for this jsp error? >> >> Ram >> >> >> >> On Wed, Jun 1, 2016 at 3:30 PM, Peter Cseh wrote: >> >>> Hi, >>> >>> This seems like a java 8 issue: >>> https://issues.apache.org/jira/browse/OOZIE-2533 >>> We haven't figured out a solution to it yet, other that to change java to >>> an older version. >>> >>> gp >>> >>> >>> >>> On Wed, Jun 1, 2016 at 3:28 PM, rammohan ganapavarapu < >>> rammohanga...@gmail.com> wrote: >>> >>> > When i try to access oozie web ui i am getting below error, any idea? >>> > >>> > >>> > HTTP Status 500 - org.apache.jasper.JasperException: Unable to load >>> class >>> > for JSP >>> > -- >>> > >>> > *type* Exception report >>> > >>> > *message* *org.apache.jasper.JasperException: Unable to load class for >>> JSP* >>> > >>> > *description* *The server encountered an internal error that prevented >>> it >>> > from fulfilling this request.* >>> > >>> > *exception* >>> > >>> > org.apache.jasper.JasperException: org.apache.jasper.JasperException: >>> > Unable to load class for JSP >>> > >>> > >>> org.apache.jasper.servlet.JspServletWrapper.getServlet(JspServletWrapper.java:161) >>> > >>> > >>> org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:340) >>> > >>> > >>> org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:313) >>> > >>> org.apache.jasper.servlet.JspServlet.service(JspServlet.java:260) >>> > javax.servlet.http.HttpServlet.service(HttpServlet.java:723) >>> > >>> org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:171) >>> > >>> > >>> org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:595) >>> > >>> > >>> org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:554) >>> > >>> org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:176) >>> > >>> > >>> org.apache.oozie.servlet.HostnameFilter.doFilter(HostnameFilter.java:86) >>> > >>> > *root cause* >>> > >>> > org.apache.jasper.JasperException: Unable to load class for JSP >>> > >>> > >>> org.apache.jasper.JspCompilationContext.load(JspCompilationContext.java:630) >>> > >>> > >>> org.apache.jasper.servlet.JspServletWrapper.getServlet(JspServletWrapper.java:149) >>> > >>> > >>> org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:340) >>> > >>> > >>> org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:313) >>> > >>> org.apache.jasper.servlet.JspServlet.service(JspServlet.java:260) >>> > javax.servlet.http.HttpServlet.service(HttpServlet.java:723) >>> > >>> org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:171) >>> > >>> > >>> org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:595) >>> > >>> > >>> org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:554) >>> > >>> org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:176) >>&
Re: How to build ozzie 4.2.0 with hadoop-2.7.1
Hi, I am still not able to access web ui, can some one help me to fix it? I am not using java-8. Thanks, Ram On Thu, Jun 2, 2016 at 10:14 AM, rammohan ganapavarapu < rammohanga...@gmail.com> wrote: > Peter, > > I am not using java-8 though, i am using java-7 > > hadoop 24108 1 22 17:06 pts/000:00:13 */usr/lib/jvm/java-1.7.0-* > *openjdk.x86_64//bin/java* > -Djava.util.logging.config.file=/uap/oozie/oozie-server/conf/logging.properties > -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Xmx2048m > -Dderby.stream.error.file=/var/log/hadoop/derby.log > -Doozie.home.dir=/uap/oozie-4.2.0 > > What else could be the reason for this jsp error? > > Ram > > > > On Wed, Jun 1, 2016 at 3:30 PM, Peter Cseh wrote: > >> Hi, >> >> This seems like a java 8 issue: >> https://issues.apache.org/jira/browse/OOZIE-2533 >> We haven't figured out a solution to it yet, other that to change java to >> an older version. >> >> gp >> >> >> >> On Wed, Jun 1, 2016 at 3:28 PM, rammohan ganapavarapu < >> rammohanga...@gmail.com> wrote: >> >> > When i try to access oozie web ui i am getting below error, any idea? >> > >> > >> > HTTP Status 500 - org.apache.jasper.JasperException: Unable to load >> class >> > for JSP >> > -- >> > >> > *type* Exception report >> > >> > *message* *org.apache.jasper.JasperException: Unable to load class for >> JSP* >> > >> > *description* *The server encountered an internal error that prevented >> it >> > from fulfilling this request.* >> > >> > *exception* >> > >> > org.apache.jasper.JasperException: org.apache.jasper.JasperException: >> > Unable to load class for JSP >> > >> > >> org.apache.jasper.servlet.JspServletWrapper.getServlet(JspServletWrapper.java:161) >> > >> > >> org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:340) >> > >> > org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:313) >> > >> org.apache.jasper.servlet.JspServlet.service(JspServlet.java:260) >> > javax.servlet.http.HttpServlet.service(HttpServlet.java:723) >> > >> org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:171) >> > >> > >> org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:595) >> > >> > >> org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:554) >> > >> org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:176) >> > >> > org.apache.oozie.servlet.HostnameFilter.doFilter(HostnameFilter.java:86) >> > >> > *root cause* >> > >> > org.apache.jasper.JasperException: Unable to load class for JSP >> > >> > >> org.apache.jasper.JspCompilationContext.load(JspCompilationContext.java:630) >> > >> > >> org.apache.jasper.servlet.JspServletWrapper.getServlet(JspServletWrapper.java:149) >> > >> > >> org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:340) >> > >> > org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:313) >> > >> org.apache.jasper.servlet.JspServlet.service(JspServlet.java:260) >> > javax.servlet.http.HttpServlet.service(HttpServlet.java:723) >> > >> org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:171) >> > >> > >> org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:595) >> > >> > >> org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:554) >> > >> org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:176) >> > >> > org.apache.oozie.servlet.HostnameFilter.doFilter(HostnameFilter.java:86) >> > >> > *root cause* >> > >> > java.lang.ClassNotFoundException: org.apache.jsp.index_jsp >> > java.net.URLClassLoader$1.run(URLClassLoader.java:366) >> > java.net.URLClassLoader$1.run(URLClassLoader.java:355) >> > java.security.AccessController.doPrivileged(Native Method) >> > java.net.URLClassLoader.findClass(URLClassLoader.java:354) >> > >> > org.apache.jasper.servlet.JasperLoader.loadClass(JasperLoader.java:134) >> > >>
Re: How to build ozzie 4.2.0 with hadoop-2.7.1
Peter, I am not using java-8 though, i am using java-7 hadoop 24108 1 22 17:06 pts/000:00:13 */usr/lib/jvm/java-1.7.0-* *openjdk.x86_64//bin/java* -Djava.util.logging.config.file=/uap/oozie/oozie-server/conf/logging.properties -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Xmx2048m -Dderby.stream.error.file=/var/log/hadoop/derby.log -Doozie.home.dir=/uap/oozie-4.2.0 What else could be the reason for this jsp error? Ram On Wed, Jun 1, 2016 at 3:30 PM, Peter Cseh wrote: > Hi, > > This seems like a java 8 issue: > https://issues.apache.org/jira/browse/OOZIE-2533 > We haven't figured out a solution to it yet, other that to change java to > an older version. > > gp > > > > On Wed, Jun 1, 2016 at 3:28 PM, rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > > > When i try to access oozie web ui i am getting below error, any idea? > > > > > > HTTP Status 500 - org.apache.jasper.JasperException: Unable to load class > > for JSP > > -- > > > > *type* Exception report > > > > *message* *org.apache.jasper.JasperException: Unable to load class for > JSP* > > > > *description* *The server encountered an internal error that prevented it > > from fulfilling this request.* > > > > *exception* > > > > org.apache.jasper.JasperException: org.apache.jasper.JasperException: > > Unable to load class for JSP > > > > > org.apache.jasper.servlet.JspServletWrapper.getServlet(JspServletWrapper.java:161) > > > > > org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:340) > > > > org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:313) > > org.apache.jasper.servlet.JspServlet.service(JspServlet.java:260) > > javax.servlet.http.HttpServlet.service(HttpServlet.java:723) > > > org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:171) > > > > > org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:595) > > > > > org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:554) > > org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:176) > > > > org.apache.oozie.servlet.HostnameFilter.doFilter(HostnameFilter.java:86) > > > > *root cause* > > > > org.apache.jasper.JasperException: Unable to load class for JSP > > > > > org.apache.jasper.JspCompilationContext.load(JspCompilationContext.java:630) > > > > > org.apache.jasper.servlet.JspServletWrapper.getServlet(JspServletWrapper.java:149) > > > > > org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:340) > > > > org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:313) > > org.apache.jasper.servlet.JspServlet.service(JspServlet.java:260) > > javax.servlet.http.HttpServlet.service(HttpServlet.java:723) > > > org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:171) > > > > > org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:595) > > > > > org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:554) > > org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:176) > > > > org.apache.oozie.servlet.HostnameFilter.doFilter(HostnameFilter.java:86) > > > > *root cause* > > > > java.lang.ClassNotFoundException: org.apache.jsp.index_jsp > > java.net.URLClassLoader$1.run(URLClassLoader.java:366) > > java.net.URLClassLoader$1.run(URLClassLoader.java:355) > > java.security.AccessController.doPrivileged(Native Method) > > java.net.URLClassLoader.findClass(URLClassLoader.java:354) > > > > org.apache.jasper.servlet.JasperLoader.loadClass(JasperLoader.java:134) > > > > org.apache.jasper.servlet.JasperLoader.loadClass(JasperLoader.java:66) > > > > > org.apache.jasper.JspCompilationContext.load(JspCompilationContext.java:628) > > > > > org.apache.jasper.servlet.JspServletWrapper.getServlet(JspServletWrapper.java:149) > > > > > org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:340) > > > > org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:313) > > org.apache.jasper.servlet.JspServlet.service(JspServlet.java:260) > > javax.servlet.http.HttpServlet.service(HttpServlet.java:723) > > > org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthF
Re: How to build ozzie 4.2.0 with hadoop-2.7.1
Yes, i already did that but wanted to see if oozie build has such option. Thanks, Ram On Thu, Jun 2, 2016 at 8:19 AM, Attila Sasvari wrote: > Ram, > > To my knowledge there is no such option, so after running mkdistro > download the > ZIP file to the *libext/* directory and run setup to create war. > > ./bin/mkdistro.sh -P uber -P hadoop-2 -Dhadoop.version=2.7.1 -DskipTests > cd distro/target/oozie-*/oozie-*/ > mkdir libext > curl -o libext/ext-2.2.zip > http://archive.cloudera.com/gplextras/misc/ext-2.2.zip > bin/oozie-start.sh prepare-war > > Regards, > - Attila > > On Thu, Jun 2, 2016 at 12:30 AM, Peter Cseh wrote: > > > Hi, > > > > This seems like a java 8 issue: > > https://issues.apache.org/jira/browse/OOZIE-2533 > > We haven't figured out a solution to it yet, other that to change java to > > an older version. > > > > gp > > > > > > > > On Wed, Jun 1, 2016 at 3:28 PM, rammohan ganapavarapu < > > rammohanga...@gmail.com> wrote: > > > > > When i try to access oozie web ui i am getting below error, any idea? > > > > > > > > > HTTP Status 500 - org.apache.jasper.JasperException: Unable to load > class > > > for JSP > > > -- > > > > > > *type* Exception report > > > > > > *message* *org.apache.jasper.JasperException: Unable to load class for > > JSP* > > > > > > *description* *The server encountered an internal error that prevented > it > > > from fulfilling this request.* > > > > > > *exception* > > > > > > org.apache.jasper.JasperException: org.apache.jasper.JasperException: > > > Unable to load class for JSP > > > > > > > > > org.apache.jasper.servlet.JspServletWrapper.getServlet(JspServletWrapper.java:161) > > > > > > > > > org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:340) > > > > > > > org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:313) > > > > org.apache.jasper.servlet.JspServlet.service(JspServlet.java:260) > > > javax.servlet.http.HttpServlet.service(HttpServlet.java:723) > > > > > org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:171) > > > > > > > > > org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:595) > > > > > > > > > org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:554) > > > > org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:176) > > > > > > > org.apache.oozie.servlet.HostnameFilter.doFilter(HostnameFilter.java:86) > > > > > > *root cause* > > > > > > org.apache.jasper.JasperException: Unable to load class for JSP > > > > > > > > > org.apache.jasper.JspCompilationContext.load(JspCompilationContext.java:630) > > > > > > > > > org.apache.jasper.servlet.JspServletWrapper.getServlet(JspServletWrapper.java:149) > > > > > > > > > org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:340) > > > > > > > org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:313) > > > > org.apache.jasper.servlet.JspServlet.service(JspServlet.java:260) > > > javax.servlet.http.HttpServlet.service(HttpServlet.java:723) > > > > > org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:171) > > > > > > > > > org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:595) > > > > > > > > > org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:554) > > > > org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:176) > > > > > > > org.apache.oozie.servlet.HostnameFilter.doFilter(HostnameFilter.java:86) > > > > > > *root cause* > > > > > > java.lang.ClassNotFoundException: org.apache.jsp.index_jsp > > > java.net.URLClassLoader$1.run(URLClassLoader.java:366) > > > java.net.URLClassLoader$1.run(URLClassLoader.java:355) > > > java.security.AccessController.doPrivileged(Native Method) > > > java.net.URLClassLoader.findClass(URLClassLoader.java:354) > > > > > > org.apache.jasper.s
Re: How to build ozzie 4.2.0 with hadoop-2.7.1
When i try to access oozie web ui i am getting below error, any idea? HTTP Status 500 - org.apache.jasper.JasperException: Unable to load class for JSP -- *type* Exception report *message* *org.apache.jasper.JasperException: Unable to load class for JSP* *description* *The server encountered an internal error that prevented it from fulfilling this request.* *exception* org.apache.jasper.JasperException: org.apache.jasper.JasperException: Unable to load class for JSP org.apache.jasper.servlet.JspServletWrapper.getServlet(JspServletWrapper.java:161) org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:340) org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:313) org.apache.jasper.servlet.JspServlet.service(JspServlet.java:260) javax.servlet.http.HttpServlet.service(HttpServlet.java:723) org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:171) org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:595) org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:554) org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:176) org.apache.oozie.servlet.HostnameFilter.doFilter(HostnameFilter.java:86) *root cause* org.apache.jasper.JasperException: Unable to load class for JSP org.apache.jasper.JspCompilationContext.load(JspCompilationContext.java:630) org.apache.jasper.servlet.JspServletWrapper.getServlet(JspServletWrapper.java:149) org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:340) org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:313) org.apache.jasper.servlet.JspServlet.service(JspServlet.java:260) javax.servlet.http.HttpServlet.service(HttpServlet.java:723) org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:171) org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:595) org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:554) org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:176) org.apache.oozie.servlet.HostnameFilter.doFilter(HostnameFilter.java:86) *root cause* java.lang.ClassNotFoundException: org.apache.jsp.index_jsp java.net.URLClassLoader$1.run(URLClassLoader.java:366) java.net.URLClassLoader$1.run(URLClassLoader.java:355) java.security.AccessController.doPrivileged(Native Method) java.net.URLClassLoader.findClass(URLClassLoader.java:354) org.apache.jasper.servlet.JasperLoader.loadClass(JasperLoader.java:134) org.apache.jasper.servlet.JasperLoader.loadClass(JasperLoader.java:66) org.apache.jasper.JspCompilationContext.load(JspCompilationContext.java:628) org.apache.jasper.servlet.JspServletWrapper.getServlet(JspServletWrapper.java:149) org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:340) org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:313) org.apache.jasper.servlet.JspServlet.service(JspServlet.java:260) javax.servlet.http.HttpServlet.service(HttpServlet.java:723) org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:171) org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:595) org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:554) org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:176) org.apache.oozie.servlet.HostnameFilter.doFilter(HostnameFilter.java:86) Ram On Wed, Jun 1, 2016 at 10:17 AM, rammohan ganapavarapu < rammohanga...@gmail.com> wrote: > Attila, > > Thank you very much, seems like it is working, so if i want to include > ExtJS at the time of build what should i do? do build have any option to > include extjs libs as well or i have to download extjs to libext and run > setup to create war? > > ./bin/mkdistro.sh -P uber -P hadoop-2 -Dhadoop.version=2.7.1 -DskipTests < > this is working > > Ram > > On Wed, Jun 1, 2016 at 2:39 AM, Attila Sasvari > wrote: > >> That is strange. Oozie webapp/pom.xml shall contain uber profile, see >> https://github.com/apache/oozie/blob/master/webapp/pom.xml#L263 *. >> >> My first guess that it can be a copy-paste issue (i.e. accidently copied >> the above as ./bin/mkdistro.sh -P*uber*,hadoop-2 -Dhadoop.version=2.7.1 >> -DskipTests to your Bash terminal)? Anyway, what happens if you execute: >> >> ./bin/mkdistro.sh -P uber -P hadoop-2 -Dhadoop.version=2.7.1 -DskipTests >> >> If this does not help ei
Re: How to build ozzie 4.2.0 with hadoop-2.7.1
Attila, Thank you very much, seems like it is working, so if i want to include ExtJS at the time of build what should i do? do build have any option to include extjs libs as well or i have to download extjs to libext and run setup to create war? ./bin/mkdistro.sh -P uber -P hadoop-2 -Dhadoop.version=2.7.1 -DskipTests < this is working Ram On Wed, Jun 1, 2016 at 2:39 AM, Attila Sasvari wrote: > That is strange. Oozie webapp/pom.xml shall contain uber profile, see > https://github.com/apache/oozie/blob/master/webapp/pom.xml#L263 *. > > My first guess that it can be a copy-paste issue (i.e. accidently copied > the above as ./bin/mkdistro.sh -P*uber*,hadoop-2 -Dhadoop.version=2.7.1 > -DskipTests to your Bash terminal)? Anyway, what happens if you execute: > > ./bin/mkdistro.sh -P uber -P hadoop-2 -Dhadoop.version=2.7.1 -DskipTests > > If this does not help either (which would be really odd), then as a last > resort you can try to copy the Hadoop dependencies by yourself prior to > executing oozie-start.sh prepare-war: > > cp `find ~/.m2/repository/org/apache/hadoop/ -name "*2.7.1*.jar"` libtools > > Hope this helps, > - Attila > > > * You can also check the existence of the uber profile the following way > > $ mvn help:all-profiles | grep -B2 -A2 uber > > Listing Profiles for Project: > org.apache.oozie:oozie-webapp:war:4.3.0-SNAPSHOT > > Profile Id: generateDocs (Active: false , Source: pom) > > *Profile Id: uber (Active: false , Source: pom)* > > Profile Id: derby-test (Active: false , Source: pom) > > Profile Id: wfgen (Active: false , Source: pom) > > > On Tue, May 31, 2016 at 7:13 PM, rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > > > I wanted to build oozie-4.2.0 with hadoop shared libs and extJS support, > so > > please help me. > > > > Ram > > > > On Tue, May 31, 2016 at 9:24 AM, rammohan ganapavarapu < > > rammohanga...@gmail.com> wrote: > > > > > Hi Attila, > > > > > > Thanks for your suggestion, i have tried that command but getting > bellow > > > warning. > > > > > > [WARNING] The requested profile "*uber*" could not be activated because > > it > > > does not exist. > > > > > > Ram > > > > > > On Mon, May 30, 2016 at 4:08 AM, Attila Sasvari > > > > wrote: > > > > > >> Hi Ram, > > >> > > >> Have you tried to use the uber mode? > > >> > > >> ./bin/mkdistro.sh -P*uber*,hadoop-2 -Dhadoop.version=2.7.1 -DskipTests > > >> > > >> It will copy the Hadoop dependencies for you. > > >> > > >> Best regards, > > >> Attila > > >> > > >> > > >> Related > > >> > > >>- > > >> > > >> > > > https://mail-archives.apache.org/mod_mbox/oozie-dev/201501.mbox/%3cbe9ba7d6-30e4-41a8-95b9-9592408cc...@gmail.com%3E > > >>- https://issues.apache.org/jira/browse/OOZIE-2297 > > >> > > >> > > >> On Fri, May 27, 2016 at 11:34 PM, rammohan ganapavarapu < > > >> rammohanga...@gmail.com> wrote: > > >> > > >> > Peter, > > >> > > > >> > Build went successful but when i try to start oozie getting class > not > > >> found > > >> > error, it seems like oozie war doesnt have hadooplibs. > > >> > > > >> > How i build: > > >> > > > >> > 1. Downloaded oozie-4.2.0 source tar file. > > >> > 2. Updated global pom.xml to ( > > 2.7.1) > > >> > 3. ./mkdistro.sh -P hadoop-2 -DskipTests ( all components > successful) > > >> > 4. start oozie: > > >> > INFO: Oozie webconsole disabled, ExtJS library not specified > > >> > > > >> > New Oozie WAR file with added '' at > > >> > > > >> > > > >> > > > /home/rganapavarapu/oozie-4.2.0/distro/target/oozie-4.2.0-distro/oozie-4.2.0/oozie-server/webapps/oozie.war > > >> > > > >> > > > >> > INFO: Oozie is ready to be started > > >> > > > >> > > > >> > Setting up oozie DB > > >> > setting CATALINA_OPTS="$CATALINA_OPTS -Xmx1024m" > > >> > > > >> > Validate DB Connection > > >> > Exception in thread "main" java.lang.NoClassDefFoundError: > > >> > org/apache/hadoop/util/ReflectionUt
Re: How to build ozzie 4.2.0 with hadoop-2.7.1
I wanted to build oozie-4.2.0 with hadoop shared libs and extJS support, so please help me. Ram On Tue, May 31, 2016 at 9:24 AM, rammohan ganapavarapu < rammohanga...@gmail.com> wrote: > Hi Attila, > > Thanks for your suggestion, i have tried that command but getting bellow > warning. > > [WARNING] The requested profile "*uber*" could not be activated because it > does not exist. > > Ram > > On Mon, May 30, 2016 at 4:08 AM, Attila Sasvari > wrote: > >> Hi Ram, >> >> Have you tried to use the uber mode? >> >> ./bin/mkdistro.sh -P*uber*,hadoop-2 -Dhadoop.version=2.7.1 -DskipTests >> >> It will copy the Hadoop dependencies for you. >> >> Best regards, >> Attila >> >> >> Related >> >>- >> >> https://mail-archives.apache.org/mod_mbox/oozie-dev/201501.mbox/%3cbe9ba7d6-30e4-41a8-95b9-9592408cc...@gmail.com%3E >>- https://issues.apache.org/jira/browse/OOZIE-2297 >> >> >> On Fri, May 27, 2016 at 11:34 PM, rammohan ganapavarapu < >> rammohanga...@gmail.com> wrote: >> >> > Peter, >> > >> > Build went successful but when i try to start oozie getting class not >> found >> > error, it seems like oozie war doesnt have hadooplibs. >> > >> > How i build: >> > >> > 1. Downloaded oozie-4.2.0 source tar file. >> > 2. Updated global pom.xml to ( 2.7.1) >> > 3. ./mkdistro.sh -P hadoop-2 -DskipTests ( all components successful) >> > 4. start oozie: >> > INFO: Oozie webconsole disabled, ExtJS library not specified >> > >> > New Oozie WAR file with added '' at >> > >> > >> /home/rganapavarapu/oozie-4.2.0/distro/target/oozie-4.2.0-distro/oozie-4.2.0/oozie-server/webapps/oozie.war >> > >> > >> > INFO: Oozie is ready to be started >> > >> > >> > Setting up oozie DB >> > setting CATALINA_OPTS="$CATALINA_OPTS -Xmx1024m" >> > >> > Validate DB Connection >> > Exception in thread "main" java.lang.NoClassDefFoundError: >> > org/apache/hadoop/util/ReflectionUtils >> > at >> > org.apache.oozie.service.Services.setServiceInternal(Services.java:377) >> > at org.apache.oozie.service.Services.(Services.java:111) >> > at >> org.apache.oozie.tools.OozieDBCLI.getJdbcConf(OozieDBCLI.java:164) >> > at >> > org.apache.oozie.tools.OozieDBCLI.createConnection(OozieDBCLI.java:853) >> > at >> > >> org.apache.oozie.tools.OozieDBCLI.validateConnection(OozieDBCLI.java:861) >> > at org.apache.oozie.tools.OozieDBCLI.createDB(OozieDBCLI.java:182) >> > at org.apache.oozie.tools.OozieDBCLI.run(OozieDBCLI.java:126) >> > at org.apache.oozie.tools.OozieDBCLI.main(OozieDBCLI.java:77) >> > Caused by: java.lang.ClassNotFoundException: >> > org.apache.hadoop.util.ReflectionUtils >> > at java.net.URLClassLoader$1.run(URLClassLoader.java:366) >> > at java.net.URLClassLoader$1.run(URLClassLoader.java:355) >> > at java.security.AccessController.doPrivileged(Native Method) >> > at java.net.URLClassLoader.findClass(URLClassLoader.java:354) >> > at java.lang.ClassLoader.loadClass(ClassLoader.java:425) >> > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) >> > at java.lang.ClassLoader.loadClass(ClassLoader.java:358) >> > ... 8 more >> > >> > 5. SO i try to follow this link >> > >> > >> https://dwtobigdata.wordpress.com/2015/08/23/apache-oozie-configuration-with-hadoop-2-6-0/ >> > >> > but in 4.2.0 oozie i dont see hadoop-2 under hadooplibs dir, so not sure >> > how to resolve this issue. >> > >> > Ram >> > >> > On Fri, May 27, 2016 at 12:29 PM, Peter Cseh >> > wrote: >> > >> > > Hi, >> > > >> > > Can you provide the output of the build and the command you've run to >> > build >> > > oozie? >> > > Thank you >> > > >> > > Peter >> > > >> > > On Fri, May 27, 2016 at 9:35 AM, rammohan ganapavarapu < >> > > rammohanga...@gmail.com> wrote: >> > > >> > > > Any help?? >> > > > >> > > > On Wed, May 25, 2016 at 5:05 PM, rammohan ganapavarapu < >> > > > rammohanga...@gmail.com> wrote: >> > > > >> > > > > Hi, >> > > > > >> > > > > I am trying to build ozzie 2.4.0 with hadoop 2.7.1, build >> successful >> > > but >> > > > > it doesn't have hadoop-2 under hadooplibs to create war file. can >> > > someone >> > > > > help me? >> > > > > >> > > > > Ram >> > > > > >> > > > >> > > >> > > >> > > >> > > -- >> > > Peter Cseh >> > > Software Engineer >> > > <http://www.cloudera.com> >> > > >> > >> > >
Re: How to build ozzie 4.2.0 with hadoop-2.7.1
Hi Attila, Thanks for your suggestion, i have tried that command but getting bellow warning. [WARNING] The requested profile "*uber*" could not be activated because it does not exist. Ram On Mon, May 30, 2016 at 4:08 AM, Attila Sasvari wrote: > Hi Ram, > > Have you tried to use the uber mode? > > ./bin/mkdistro.sh -P*uber*,hadoop-2 -Dhadoop.version=2.7.1 -DskipTests > > It will copy the Hadoop dependencies for you. > > Best regards, > Attila > > > Related > >- > > https://mail-archives.apache.org/mod_mbox/oozie-dev/201501.mbox/%3cbe9ba7d6-30e4-41a8-95b9-9592408cc...@gmail.com%3E >- https://issues.apache.org/jira/browse/OOZIE-2297 > > > On Fri, May 27, 2016 at 11:34 PM, rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > > > Peter, > > > > Build went successful but when i try to start oozie getting class not > found > > error, it seems like oozie war doesnt have hadooplibs. > > > > How i build: > > > > 1. Downloaded oozie-4.2.0 source tar file. > > 2. Updated global pom.xml to ( 2.7.1) > > 3. ./mkdistro.sh -P hadoop-2 -DskipTests ( all components successful) > > 4. start oozie: > > INFO: Oozie webconsole disabled, ExtJS library not specified > > > > New Oozie WAR file with added '' at > > > > > /home/rganapavarapu/oozie-4.2.0/distro/target/oozie-4.2.0-distro/oozie-4.2.0/oozie-server/webapps/oozie.war > > > > > > INFO: Oozie is ready to be started > > > > > > Setting up oozie DB > > setting CATALINA_OPTS="$CATALINA_OPTS -Xmx1024m" > > > > Validate DB Connection > > Exception in thread "main" java.lang.NoClassDefFoundError: > > org/apache/hadoop/util/ReflectionUtils > > at > > org.apache.oozie.service.Services.setServiceInternal(Services.java:377) > > at org.apache.oozie.service.Services.(Services.java:111) > > at org.apache.oozie.tools.OozieDBCLI.getJdbcConf(OozieDBCLI.java:164) > > at > > org.apache.oozie.tools.OozieDBCLI.createConnection(OozieDBCLI.java:853) > > at > > org.apache.oozie.tools.OozieDBCLI.validateConnection(OozieDBCLI.java:861) > > at org.apache.oozie.tools.OozieDBCLI.createDB(OozieDBCLI.java:182) > > at org.apache.oozie.tools.OozieDBCLI.run(OozieDBCLI.java:126) > > at org.apache.oozie.tools.OozieDBCLI.main(OozieDBCLI.java:77) > > Caused by: java.lang.ClassNotFoundException: > > org.apache.hadoop.util.ReflectionUtils > > at java.net.URLClassLoader$1.run(URLClassLoader.java:366) > > at java.net.URLClassLoader$1.run(URLClassLoader.java:355) > > at java.security.AccessController.doPrivileged(Native Method) > > at java.net.URLClassLoader.findClass(URLClassLoader.java:354) > > at java.lang.ClassLoader.loadClass(ClassLoader.java:425) > > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) > > at java.lang.ClassLoader.loadClass(ClassLoader.java:358) > > ... 8 more > > > > 5. SO i try to follow this link > > > > > https://dwtobigdata.wordpress.com/2015/08/23/apache-oozie-configuration-with-hadoop-2-6-0/ > > > > but in 4.2.0 oozie i dont see hadoop-2 under hadooplibs dir, so not sure > > how to resolve this issue. > > > > Ram > > > > On Fri, May 27, 2016 at 12:29 PM, Peter Cseh > > wrote: > > > > > Hi, > > > > > > Can you provide the output of the build and the command you've run to > > build > > > oozie? > > > Thank you > > > > > > Peter > > > > > > On Fri, May 27, 2016 at 9:35 AM, rammohan ganapavarapu < > > > rammohanga...@gmail.com> wrote: > > > > > > > Any help?? > > > > > > > > On Wed, May 25, 2016 at 5:05 PM, rammohan ganapavarapu < > > > > rammohanga...@gmail.com> wrote: > > > > > > > > > Hi, > > > > > > > > > > I am trying to build ozzie 2.4.0 with hadoop 2.7.1, build > successful > > > but > > > > > it doesn't have hadoop-2 under hadooplibs to create war file. can > > > someone > > > > > help me? > > > > > > > > > > Ram > > > > > > > > > > > > > > > > > > > > > -- > > > Peter Cseh > > > Software Engineer > > > <http://www.cloudera.com> > > > > > >
Re: How to build ozzie 4.2.0 with hadoop-2.7.1
Peter, Build went successful but when i try to start oozie getting class not found error, it seems like oozie war doesnt have hadooplibs. How i build: 1. Downloaded oozie-4.2.0 source tar file. 2. Updated global pom.xml to ( 2.7.1) 3. ./mkdistro.sh -P hadoop-2 -DskipTests ( all components successful) 4. start oozie: INFO: Oozie webconsole disabled, ExtJS library not specified New Oozie WAR file with added '' at /home/rganapavarapu/oozie-4.2.0/distro/target/oozie-4.2.0-distro/oozie-4.2.0/oozie-server/webapps/oozie.war INFO: Oozie is ready to be started Setting up oozie DB setting CATALINA_OPTS="$CATALINA_OPTS -Xmx1024m" Validate DB Connection Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/util/ReflectionUtils at org.apache.oozie.service.Services.setServiceInternal(Services.java:377) at org.apache.oozie.service.Services.(Services.java:111) at org.apache.oozie.tools.OozieDBCLI.getJdbcConf(OozieDBCLI.java:164) at org.apache.oozie.tools.OozieDBCLI.createConnection(OozieDBCLI.java:853) at org.apache.oozie.tools.OozieDBCLI.validateConnection(OozieDBCLI.java:861) at org.apache.oozie.tools.OozieDBCLI.createDB(OozieDBCLI.java:182) at org.apache.oozie.tools.OozieDBCLI.run(OozieDBCLI.java:126) at org.apache.oozie.tools.OozieDBCLI.main(OozieDBCLI.java:77) Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.util.ReflectionUtils at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:425) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:358) ... 8 more 5. SO i try to follow this link https://dwtobigdata.wordpress.com/2015/08/23/apache-oozie-configuration-with-hadoop-2-6-0/ but in 4.2.0 oozie i dont see hadoop-2 under hadooplibs dir, so not sure how to resolve this issue. Ram On Fri, May 27, 2016 at 12:29 PM, Peter Cseh wrote: > Hi, > > Can you provide the output of the build and the command you've run to build > oozie? > Thank you > > Peter > > On Fri, May 27, 2016 at 9:35 AM, rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > > > Any help?? > > > > On Wed, May 25, 2016 at 5:05 PM, rammohan ganapavarapu < > > rammohanga...@gmail.com> wrote: > > > > > Hi, > > > > > > I am trying to build ozzie 2.4.0 with hadoop 2.7.1, build successful > but > > > it doesn't have hadoop-2 under hadooplibs to create war file. can > someone > > > help me? > > > > > > Ram > > > > > > > > > -- > Peter Cseh > Software Engineer > <http://www.cloudera.com> >
Re: How to build ozzie 4.2.0 with hadoop-2.7.1
Any help?? On Wed, May 25, 2016 at 5:05 PM, rammohan ganapavarapu < rammohanga...@gmail.com> wrote: > Hi, > > I am trying to build ozzie 2.4.0 with hadoop 2.7.1, build successful but > it doesn't have hadoop-2 under hadooplibs to create war file. can someone > help me? > > Ram >
How to build ozzie 4.2.0 with hadoop-2.7.1
Hi, I am trying to build ozzie 2.4.0 with hadoop 2.7.1, build successful but it doesn't have hadoop-2 under hadooplibs to create war file. can someone help me? Ram
