RE: Cannot connect Precommit Jenkins job

[Li, Rui]

Shall we hold on the commits before Jenkins is back?

Cheers,
Rui Li

-Original Message-
From: Sergio Pena [mailto:sergio.p...@cloudera.com] 
Sent: Friday, April 22, 2016 12:48 AM
To: Thejas Nair
Cc: dev; sze...@apache.org
Subject: Re: Cannot connect Precommit Jenkins job

Hey Thejas,

The Jenkins server stopped working for other reasons unrelated to the patches 
committed, and the Jenkins jobs were lost.
I'm still working on it, and I almost have it ready to continue testing the 
master branch. Just a couple of tests more, and I'll release it to the public. 
I expect to have it ready by tomorrow.

On Wed, Apr 20, 2016 at 6:56 PM, Thejas Nair  wrote:

> Hi Sergio,
> I saw that once of the recent commits I reviewed was causing issues, 
> sorry about that.
> Are there other issues to be resolved to get it working ? Any estimate 
> of how much time it might take to get it running again ?
> Thanks again for your help!
>
> -Thejas
>
>
> On Tue, Apr 19, 2016 at 2:09 PM, Sergio Pena 
> 
> wrote:
> > Hey Thejas,
> >
> > We have some internal issues with the Jenkins server.
> > I'm working on the configuration.
> >
> > On Tue, Apr 19, 2016 at 3:35 PM, Thejas Nair 
> wrote:
> >>
> >> Hi Szehon, Sergio,
> >> Do you know what is going on with it ? Does it need a restart ?
> >> Thanks for your help!
> >> Thejas
> >>
> >>
> >> On Mon, Apr 18, 2016 at 1:58 PM, Wei Zheng 
> wrote:
> >> > Which one is down? AWS or our job?
> >> >
> >> >
> http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommi
> t-HIVE-TRUNK-Build/
> >> >
> >> > Thanks,
> >> > Wei
> >
> >
>

RE: problems running spark tests

[Li, Rui]

Other guys also run into this on Mac.
The spark binary is downloaded to itests/thirdparty and then unpacked and 
copied to itests/qtest-spark/target/spark. Maybe you can manually do the 
process and check if anything goes wrong.

Cheers,
Rui Li

-Original Message-
From: Sergey Shelukhin [mailto:ser...@hortonworks.com] 
Sent: Friday, July 03, 2015 6:32 AM
To: dev@hive.apache.org
Subject: Re: problems running spark tests

I was able to get the tests to run with the parameter Hari suggested, on a 
different (Linux) machine.
However, on my Mac laptop, the bin/ part of spark directory is not regenerated. 
I guess I will do the usual shamanic dances like nuking the maven repo, 
re-cloning the code, etc., next time I need it. If that doesn’t work I might 
file a bug or revive this thread.

On 15/7/2, 11:40, "Szehon Ho"  wrote:

>This works for me..
>
>mvn test -Dtest=TestSparkCliDriver -Dqfile=join1.q -Phadoop-2 For 
>multiple tests you might need to add quotes around the comma-separated 
>list.
>
>I haven't seen that error, did you run from itests directory?  There 
>are some steps in pom to copy over the spark scripts needed to run, 
>that look like they were skipped as that script is not available in your run.
>
>Thanks
>Szehon
>
>On Thu, Jul 2, 2015 at 10:31 AM, Sergey Shelukhin 
>
>wrote:
>
>> Hi. I am trying to run TestSparkCliDriver.
>>
>> 1) Spark tests do not appear to support specifying a query like other  
>>tests; when I run mvn test -Phadoop-2 -Dtest=TestSparkCliDriver tests 
>>run,  but with  mvn test -Phadoop-2 -Dtest=TestSparkCliDriver 
>>-Dqfile=foo.q,bar.q,..
>>test
>> just instantly succeeds w/o running any queries. Is there some other 
>>way  to specify those?
>>
>> 2) When I run all the test, they fail with the below exception  I’ve 
>>done a full regular build (mvn clean install … in root and then  
>>itests). Are more steps necessary?
>> The itests/qtest-spark/../../itests/qtest-spark/target/spark 
>>directory  exists and has bunch of stuff, but bin/ subdirectory that 
>>it tries to run  from is indeed empty.
>>
>> 2015-07-02 10:11:58,678 ERROR [main]: spark.SparkTask
>> (SessionState.java:printError(987)) - Failed to execute spark task, 
>> with exception 
>> 'org.apache.hadoop.hive.ql.metadata.HiveException(Failed to create spark 
>> client.)'
>> org.apache.hadoop.hive.ql.metadata.HiveException: Failed to create 
>> spark client.
>> at
>> 
>>org.apache.hadoop.hive.ql.exec.spark.session.SparkSessionImpl.open(Spa
>>rkS
>>es
>> sionImpl.java:57)
>> at
>> 
>>org.apache.hadoop.hive.ql.exec.spark.session.SparkSessionManagerImpl.g
>>etS
>>es
>> sion(SparkSessionManagerImpl.java:114)
>> at
>> 
>>org.apache.hadoop.hive.ql.exec.spark.SparkUtilities.getSparkSession(Sp
>>ark
>>Ut
>> ilities.java:127)
>> at
>> 
>>org.apache.hadoop.hive.ql.exec.spark.SparkTask.execute(SparkTask.java:
>>101
>>)
>> at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160)
>> at
>> 
>>org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.jav
>>a:8
>>9)
>> at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1672)
>> at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1431)
>> at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1212)
>> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1063)
>> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1053)
>> at
>>org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:21
>>3)  at 
>>org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165)
>> at 
>>org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376)
>> at 
>>org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:311)
>> at 
>>org.apache.hadoop.hive.ql.QTestUtil.createSources(QTestUtil.java:840)
>> at
>> 
>>org.apache.hadoop.hive.cli.TestSparkCliDriver.(TestSparkCliDri
>>ver
>>.j
>> ava:59)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  at
>> 
>>sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
>>ava
>>:6
>> 2)
>> at
>> 
>>sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccess
>>orI
>>mp
>> l.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:497)
>> at
>> 
>>org.junit.internal.runners.SuiteMethod.testFromSuiteMethod(SuiteMethod
>>.ja
>>va
>> :35)
>> at org.junit.internal.runners.SuiteMethod.(SuiteMethod.java:24)
>> at
>> 
>>org.junit.internal.builders.SuiteMethodBuilder.runnerForClass(SuiteMet
>>hod
>>Bu
>> ilder.java:11)
>> at
>> 
>>org.junit.runners.model.RunnerBuilder.safeRunnerForClass(RunnerBuilder
>>.ja
>>va
>> :59)
>> at
>> 
>>org.junit.internal.builders.AllDefaultPossibilitiesBuilder.runnerForCl
>>ass
>>(A
>> llDefaultPossibilitiesBuilder.java:26)
>> at
>> 
>>org.junit.runners.model.RunnerBuilder.safeRunnerForClass(RunnerBuilder
>>.ja
>>va
>> :59)
>> at
>>org.junit.internal.requests.ClassRequest.getRunner(ClassRequest.java:2
>>6)
>> at
>> 
>>org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider
>>.ja
>>va
>> :262)
>> at
>> 
>>org.apache.maven.

RE: YourKit open source license

[Li, Rui]

Thanks Alan! But I don't see Hive in the sponsored open source project list. 
I'll contact them anyway.

Cheers,
Rui Li

From: Alan Gates [mailto:alanfga...@gmail.com]
Sent: Tuesday, March 31, 2015 1:02 AM
To: dev@hive.apache.org
Subject: Re: YourKit open source license

See https://www.yourkit.com/customers/.

Alan.


[cid:image001.jpg@01D06B94.421AF860]
Li, Rui<mailto:rui...@intel.com>
March 30, 2015 at 0:54
Hi guys,

I want to use YourKit to profile hive performance. According to the 
wiki<https://cwiki.apache.org/confluence/display/Hive/Performance><https://cwiki.apache.org/confluence/display/Hive/Performance>
 hive has been granted open source license. Could anybody tell me how I can get 
the license? Thanks!

Cheers,
Rui Li

YourKit open source license

[Li, Rui]

Hi guys,

I want to use YourKit to profile hive performance. According to the 
wiki hive has 
been granted open source license. Could anybody tell me how I can get the 
license? Thanks!

Cheers,
Rui Li

RE: [ANNOUNCE] New Hive Committers -- Chao Sun, Chengxiang Li, and Rui Li

[Li, Rui]

Thanks guys. It's a great honor!

Cheers,
Rui Li


-Original Message-
From: Vaibhav Gumashta [mailto:vgumas...@hortonworks.com] 
Sent: Tuesday, February 10, 2015 6:12 AM
To: u...@hive.apache.org; dev@hive.apache.org
Subject: Re: [ANNOUNCE] New Hive Committers -- Chao Sun, Chengxiang Li, and Rui 
Li

Congratulations to all.

 wrote:

>Congratulations!
>
>> On Feb 9, 2015, at 1:57 PM, Na Yang  wrote:
>> 
>> Congratulations!
>> 
>> On Mon, Feb 9, 2015 at 1:06 PM, Vikram Dixit K 
>> wrote:
>> 
>>> Congrats guys!
>>> 
>>> On Mon, Feb 9, 2015 at 12:42 PM, Szehon Ho  wrote:
>>> 
 Congratulations guys !
 
 On Mon, Feb 9, 2015 at 3:38 PM, Jimmy Xiang 
wrote:
 
> Congrats!!
> 
> On Mon, Feb 9, 2015 at 12:36 PM, Alexander Pivovarov <
 apivova...@gmail.com
>> 
> wrote:
> 
>> Congrats!
>> 
>> On Mon, Feb 9, 2015 at 12:31 PM, Carl Steinbach 
 wrote:
>> 
>>> The Apache Hive PMC has voted to make Chao Sun, Chengxiang Li, and
>>> Rui
> Li
>>> committers on the Apache Hive Project.
>>> 
>>> Please join me in congratulating Chao, Chengxiang, and Rui!
>>> 
>>> Thanks.
>>> 
>>> - Carl
>>> 
>>> 
>> 
> 
 
>>> 
>>> 
>>> 
>>> --
>>> Nothing better than when appreciated for hard work.
>>> -Mark
>>> 
>