Can anyone help view the problem about avro schema

2018-08-19 Thread Zhang, Liyun
Hi : I want to ask question about 'avro.schema.url'. I have a partitioned table with huge number of partitions like following CREATE TABLE episodes_partitioned PARTITIONED BY (doctor_pt INT) ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.avro.AvroSerDe' STORED AS INPUTFORMAT 'org.apac

Can anyone knows how to build hive 0.12 version?

2018-08-17 Thread Zhang, Liyun
Hi all: Now I am using hive-0.12 to build package. In this version, we seems not use mvn. Can anyone know how to build a package in hive-0.12 or provide a link ? Best Regards ZhangLiyun/Kelly Zhang

Does anyone know how to deal with special case in DefaultRuleDispatcher?

2017-12-06 Thread Zhang, Liyun
in case proc is null if (proc != null) { // Call the process function return proc.process(nd, ndStack, procCtx, nodeOutputs); } else { return null; } } {code} Appreciate to get some suggestions from you. Best Regards Kelly Zhang/Zhang,Liyun

RE: Does any one know where I can upload spark-2.2.0-bin-hadoop2-without-hive.tgz

2017-12-05 Thread Zhang, Liyun
Hi Sahil: Very thanks, I can download 2.2 pkg in http://d3jw87u4immizc.cloudfront.net/spark-tarball/spark-2.2.0-bin-hadoop2-without-hive.tgz! Best Regards Kelly Zhang/Zhang,Liyun -Original Message- From: Sahil Takiar [mailto:takiar.sa...@gmail.com] Sent: Wednesday, December 6

Does any one know where I can upload spark-2.2.0-bin-hadoop2-without-hive.tgz

2017-12-04 Thread Zhang, Liyun
/log4j2.properties $BASE_DIR/spark/conf/ Best Regards Kelly Zhang/Zhang,Liyun

Anyone knows the problem I found in VectorizedLogicBench.IfExprLongColumnLongColumnBench?

2017-11-16 Thread Zhang, Liyun
e code, do you know why the test data is discrete? If the data is discrete, does this mean the test data is not stable? Appreciate to get some feedback from you! Best Regards Kelly Zhang/Zhang,Liyun

RE: Anyone knows the problem I found in VectorizedLogicBench.IfExprLongColumnLongColumnBench?

2017-11-15 Thread Zhang, Liyun
expression used in VectorizedLogicBench.IfExprLongColumnLongColumnBench: https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/IfExprLongColumnLongColumn.java#L90 Best Regards Kelly Zhang/Zhang,Liyun -Original Message- From

RE: Anyone knows the problem I found in VectorizedLogicBench.IfExprLongColumnLongColumnBench?

2017-11-15 Thread Zhang, Liyun
e code, do you know why the test data is discrete? If the data is discrete, does this mean the test data is not stable? Appreciate to get some feedback from you! Best Regards Kelly Zhang/Zhang,Liyun

Anyone knows the problem I found in VectorizedLogicBench.IfExprLongColumnLongColumnBench?

2017-11-15 Thread Zhang, Liyun
e code, do you know why the test data is discrete? If the data is discrete, does this mean the test data is not stable? Appreciate to get some feedback from you! Best Regards Kelly Zhang/Zhang,Liyun

RE: How to measure the execution time of query on Hive on Tez

2017-10-12 Thread Zhang, Liyun
49 764 2017-10-12T16:29:39,318 INFO [main] SessionState: ------- From: Zhang, Liyun [mailto:liyun.zh...@intel.com] Sent: Thursday, October 12, 2017 4:40 PM To: dev@hive.apache.org Subject: How to measure the ex

RE: How to measure the execution time of query on Hive on Tez

2017-10-12 Thread Zhang, Liyun
: Map 1: 23(+23)/46 Map 10: 23(+23)/46 Map 15: 1/1 Map 16: 1/1 Map 7: 1/1 Map 8: 1/1 Reducer 11: 127/127 Reducer 12: 0/35Reducer 13: Best Regards Kelly Zhang/Zhang,Liyun From: Zhang, Liyun Sent: Thursday, October 12, 2017 4:40 PM To: 'dev@hive.apach

How to measure the execution time of query on Hive on Tez

2017-10-12 Thread Zhang, Liyun
CPU_TIME(ms) should be used? [cid:image001.png@01D34378.B0FDB5B0] Appreciate to get some feedback from you! Best Regards Kelly Zhang/Zhang,Liyun

RE: Anyone knows to use which command to regenerate the q*out files?

2017-09-29 Thread Zhang, Liyun
gards Kelly Zhang/Zhang,Liyun -Original Message- From: Prasanth Jayachandran [mailto:pjayachand...@hortonworks.com] Sent: Saturday, September 30, 2017 11:53 AM To: dev@hive.apache.org; dev@hive.apache.org Subject: Re: Anyone knows to use which command to regenerate the q*out files? H

Anyone knows to use which command to regenerate the q*out files?

2017-09-29 Thread Zhang, Liyun
Hi all: Anyone knows to use which command to regenerate the q*out files ? I have tried "mvn clean test -Dtest=TestCliDriver -Dtest.output.overwrite=true" but seems not work. Appreciate to get some suggestion from you! Best Regards Kelly Zhang/Zhang,Liyun

RE: Welcome Rui Li to Hive PMC

2017-05-25 Thread Zhang, Liyun
Congratulations Rui!! -Original Message- From: Chao Sun [mailto:sunc...@apache.org] Sent: Thursday, May 25, 2017 12:41 PM To: dev@hive.apache.org Cc: u...@hive.apache.org Subject: Re: Welcome Rui Li to Hive PMC Congratulations Rui!! On Wed, May 24, 2017 at 9:19 PM, Xuefu Zhang wrote:

RE: Jimmy Xiang now a Hive PMC member

2017-05-25 Thread Zhang, Liyun
Congratulations Jimmy!! -Original Message- From: Chao Sun [mailto:sunc...@apache.org] Sent: Thursday, May 25, 2017 12:41 PM To: dev@hive.apache.org Cc: u...@hive.apache.org Subject: Re: Jimmy Xiang now a Hive PMC member Congratulations Jimmy!! On Wed, May 24, 2017 at 9:16 PM, Xuefu Zhan

Is there any way to print out the physical plan of hive query?

2017-04-18 Thread Zhang, Liyun
Hi all: I want to ask how to print the physical plan of hive query. I can use "explain" to get the detailed mr,tez, spark plan but I want to print out the physical plan. Appreciate to get some suggestions! Best Regards Kelly Zhang/Zhang,Liyun

Can anyone help to assign the privilege to me to update the wiki of hive on spark

2016-12-28 Thread Zhang, Liyun
Hi: I want to update wiki<https://cwiki.apache.org/confluence/display/Hive/Hive+on+Spark%3A+Getting+Started> of hive on spark because HIVE-8373, my account is kellyzly, can anyone help to assign the privilege to me to update wiki? Best Regards Kelly Zhang/Zhang