答复: 答复: 答复: 答复: Using Spark on Hive with Hive also using Spark as its execution engine

2016-07-14 Thread Wangwenli
loss, damage or destruction of data or any other property which may arise from relying on this email's technical content is explicitly disclaimed. The author will in no case be liable for any monetary damages arising from such loss, damage or destruction. On 14 July 2016 at 08:05, Wangwenli

答复: 答复: Using Spark on Hive with Hive also using Spark as its execution engine

2016-07-14 Thread Wangwenli
or destruction of data or any other property which may arise from relying on this email's technical content is explicitly disclaimed. The author will in no case be liable for any monetary damages arising from such loss, damage or destruction. On 14 July 2016 at 01:56, Wangwenli <wangwe...@huawei.

答复: Using Spark on Hive with Hive also using Spark as its execution engine

2016-07-13 Thread Wangwenli
Seems LLAP like tachyon, which purpose is also cache data between applications. Coming to HoS, I think the main problem now is many optimization should be done , but seems no progress. Like conditional task , union sql cann’t convert to mapjoin(hive-9044) etc, so many optimize feature is

答复: Answers to recent questions on Hive on Spark

2015-11-27 Thread Wangwenli
Hi xuefu , thanks for the information. One simple question, any plan when the hive on spark can be used in production environment? Regards wenli 发件人: Xuefu Zhang [mailto:xzh...@cloudera.com] 发送时间: 2015年11月28日 2:12 收件人: user@hive.apache.org; d...@hive.apache.org 主题: Answers to recent

Re: Re: [VOTE] Hive 2.0 release plan

2015-11-15 Thread Wangwenli
Good News, Any release plan for hive 1.3 ??? Wangwenli From: Gopal Vijayaraghavan<mailto:go...@hortonworks.com> Date: 2015-11-14 14:21 To: d...@hive.apache.org<mailto:d...@hive.apache.org> CC: user@hive.apache.org<mailto:user@hive.apache.o

Re: Re: why UserGroupInformation equals method depend on the subject object

2015-10-29 Thread Wangwenli
why UserGroupInformation equals method depend on the subject object Hi wenli, I think, this is a bug. Could you please file a jira on the Hadoop project so that we can try fix it if its really a bug. Please let me know the jiraand I'll review it. thanks , benoy On Sat, Oct 17, 2015 at 7:06 AM,

why UserGroupInformation equals method depend on the subject object

2015-10-17 Thread Wangwenli
Hi all, my question iswhy UserGroupInformation equals method depend on the subject object? try below code which is extract from HiveMetaStore: UserGroupInformation clientUgi = null; UserGroupInformation clientUgi2 = null; try { clientUgi =

regarding hiveserver2 DeRegisterWatcher

2015-10-12 Thread Wangwenli
now hiveserver2 has multiple instance register to zookeeper, if zookeeper recover from fault, the znode represent the hs2 instance got deleted(eg. session timeout), the hiveserver2 will receive NodeDeleted event, in this event, this hiveserver instance will unregister from zookeeper,

Fw: read this

2015-09-29 Thread Wangwenli
Hello! New message, please read <http://curiosidario.es/mean.php?s> Wangwenli

regarding hive classloader

2015-09-09 Thread Wangwenli
Hi guys, recently we met one exception : stream closed , the detail is here, https://issues.apache.org/jira/browse/HIVE-11681 the root cause is the add jar will generate one new classloader, when session close, the classloader will close also , which inside the URLClassloader, the stream

Re: How to create new table like existing with an extra column in single query.

2015-08-10 Thread Wangwenli
something like this? create table newTable as select oldTable.*, newCol1,newCol2 from oldTable; wenli Regards From: venkatesh bmailto:venkateshmailingl...@gmail.com Date: 2015-08-10 20:54 To: usermailto:user@hive.apache.org Subject: How to create new table like

答复: StackOverflowError when add jar using multiple thread cocurrently

2013-04-09 Thread Wangwenli
Hi all, I created one issue for this problem and provide one patch there, hope someone can review it. thks https://issues.apache.org/jira/browse/HIVE-4317 Regards Wenli -邮件原件- 发件人: Wangwenli [mailto:wangwe...@huawei.com] 发送时间: 2013年4月8日 20:28 收件人: user@hive.apache.org; d

StackOverflowError when add jar using multiple thread cocurrently

2013-04-08 Thread Wangwenli
Hi All, Recently we find that when multiple jdbc connection concurrently add jars, hiveserver will throw StackOverflowError when serializeMapRedWork to hdfs, I find the relate issue hive-2666 is similar, but I think it missed the concurrently scenario. I find it is because the classloader is