答复: 答复: 答复: 答复: Using Spark on Hive with Hive also using Spark as its execution engine

2016-07-14 Thread Wangwenli
I think you know what I said is relate to execution plan, right? My spark version is 1.5.X Regards Wenli 发件人: Mich Talebzadeh [mailto:mich.talebza...@gmail.com] 发送时间: 2016年7月14日 15:17 收件人: user 主题: Re: 答复: 答复: 答复: Using Spark on Hive with Hive also using Spark as its execution engine fine

Re: 答复: 答复: 答复: Using Spark on Hive with Hive also using Spark as its execution engine

2016-07-14 Thread Mich Talebzadeh
fine which version of spark are using for Hive execution/query engine please? Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw *

Re: 答复: 答复: Using Spark on Hive with Hive also using Spark as its execution engine

2016-07-14 Thread Mich Talebzadeh
Wjich version of Hive and Spark please? Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmich.wordpress.com *Disclaimer:* Use

答复: 答复: Using Spark on Hive with Hive also using Spark as its execution engine

2016-07-14 Thread Wangwenli
It is specific to HoS 发件人: Mich Talebzadeh [mailto:mich.talebza...@gmail.com] 发送时间: 2016年7月14日 11:55 收件人: user 主题: Re: 答复: Using Spark on Hive with Hive also using Spark as its execution engine Hi Wenli, You mentioned: Coming to HoS, I think the main problem now is many optimization should be

Re: 答复: Using Spark on Hive with Hive also using Spark as its execution engine

2016-07-13 Thread Mich Talebzadeh
Hi Wenli, You mentioned: Coming to HoS, I think the main problem now is many optimization should be done , but seems no progress. Like conditional task , union sql cann’t convert to mapjoin(hive-9044) etc, so many optimize feature is pending, no one working on them. Is this issue specific

答复: Using Spark on Hive with Hive also using Spark as its execution engine

2016-07-13 Thread Wangwenli
Seems LLAP like tachyon, which purpose is also cache data between applications. Coming to HoS, I think the main problem now is many optimization should be done , but seems no progress. Like conditional task , union sql cann’t convert to mapjoin(hive-9044) etc, so many optimize feature is