Re: spark-without-hive assembly for hive build/development purposes

2017-03-16 Thread Marcelo Vanzin
The solution to this is being tracked in https://issues.apache.org/jira/browse/HIVE-15302, although I haven't seen activity in a while. On Thu, Mar 16, 2017 at 3:42 PM, Zoltan Haindrich wrote: > Hello, > > Hive needs a spark assembly to execute the HoS tests. > Until now…this assembly have been d

Re: spark-without-hive assembly for hive build/development purposes

2017-03-16 Thread Zoltan Haindrich
Hive uses spark-submit to launch the spark jobs - that's why the assembly is needed. On 03/16/2017 11:54 PM, Reynold Xin wrote: Why do you need an assembly? Is there something preventing Hive from depending on normal jars like all other applications? On Thu, Mar 16, 2017 at 3:42 PM, Zoltan H

Re: spark-without-hive assembly for hive build/development purposes

2017-03-16 Thread Reynold Xin
Why do you need an assembly? Is there something preventing Hive from depending on normal jars like all other applications? On Thu, Mar 16, 2017 at 3:42 PM, Zoltan Haindrich wrote: > Hello, > > Hive needs a spark assembly to execute the HoS tests. > Until now…this assembly have been downloaded fr

spark-without-hive assembly for hive build/development purposes

2017-03-16 Thread Zoltan Haindrich
Hello, Hive needs a spark assembly to execute the HoS tests. Until now…this assembly have been downloaded from an S3 bucket - because this is not the best solution available, it sometimes causes troubles and inconveniences... We had a discussion about improving this; and the best option would