Re: zeppelin job is running all the time

2015-12-01 Thread Will Du
I have assigned an dedicate yarn queue to spark, the status of hive query becomes from ACCEPT to RUNNING. However, it sees running forever still. Everything is else is in default config of HDP sandbox. Do I need to set something else? The browser I saw status is from hue. Thanks, wd > On Nov 3

Re: zeppelin job is running all the time

2015-12-01 Thread Jeff Zhang
Which version of HDP do you use ? On Wed, Dec 2, 2015 at 11:23 AM, Will Du wrote: > I have assigned an dedicate yarn queue to spark, the status of hive query > becomes from ACCEPT to RUNNING. However, it sees running forever still. > Everything is else is in default config of HDP sandbox. Do I n

Re: zeppelin job is running all the time

2015-12-01 Thread Will Du
The latest HDP sandbox 2.3.2 > On Dec 1, 2015, at 10:38 PM, Jeff Zhang wrote: > > Which version of HDP do you use ? > > On Wed, Dec 2, 2015 at 11:23 AM, Will Du > wrote: > I have assigned an dedicate yarn queue to spark, the status of hive query > becomes from ACCEPT

Re: zeppelin job is running all the time

2015-12-01 Thread Jeff Zhang
>>> the status of hive query becomes from ACCEPT to RUNNING The status you see on the hue is the yarn app status which is used for spark. It should be running forever until you shutdown it in zeppelin On Wed, Dec 2, 2015 at 11:42 AM, Will Du wrote: > The latest HDP sandbox 2.3.2 > > On Dec 1, 20

Re: zeppelin job is running all the time

2015-12-01 Thread Will Du
Do I have to stop zeppelin to make hive job running? I am thinking to have one notebook have both spark and hive coding running. In addition, I am quite sure the first job in the picture is hive job. The 2nd one is zeppelin running spark. I wonder how to unblock hive job. > On Dec 1, 2015, at 10

RE: zeppelin job is running all the time

2015-12-02 Thread Felix Cheung
I don't know enough about HDP, but there should be a way to check user queue in YARN? Spark job shouldn't affect Hive job though. Have you tried running spark-shell (--master yarn-client) and a Hive job at the same time? From: will...@gmail.com Subject: Re: zeppelin job is running al

Re: zeppelin job is running all the time

2015-12-03 Thread Will Du
; spark-shell (--master yarn-client) and a Hive job at the same time? > > From: will...@gmail.com > Subject: Re: zeppelin job is running all the time > Date: Tue, 1 Dec 2015 22:56:55 -0500 > To: users@zeppelin.incubator.apache.org > > Do I have to stop zeppelin to make hive

Re: zeppelin job is running all the time

2015-12-03 Thread Felix Cheung
elin job is running all the time To: When I run spark-shell and hive cml, everything is good. One more thing I find is that when I run the hive CML, there is single hive job running (seen from hue job browser) all the time until I exit from hive cml. No matter how many HQL I su

Re: zeppelin job is running all the time

2015-12-03 Thread Will Du
> It can see how both jobs can be long lived in Spark & hive/Tez but they > should not block one or another. > > > _ > From: Will Du mailto:will...@gmail.com>> > Sent: Thursday, December 3, 2015 2:15 AM > Subject: Re: zeppelin jo

Re: zeppelin job is running all the time

2015-12-03 Thread Felix Cheung
further. _ From: Will Du Sent: Thursday, December 3, 2015 4:13 PM Subject: Re: zeppelin job is running all the time To: All is what’s by default Properties name valueargs master yarn

Re: zeppelin job is running all the time

2015-12-04 Thread Will Du
> Sent: Thursday, December 3, 2015 4:13 PM > Subject: Re: zeppelin job is running all the time > To: <mailto:users@zeppelin.incubator.apache.org>> > > > All is what’s by default > Properties > name value > args > masteryarn-client > spark.app.nam