Re: [VOTE] Apache Hive 2.3.9 Release Candidate 0

2021-06-04 Thread Xuefu Zhang
+1. Thank Chao for doing this. I performed the following actions: 1. Downloaded the release candidate artifacts and verified the signatures and checksums. 2. Built from the source. 3. Initialized schema using schematool and launched hive metastore service on top of it. 4. Used Hive client to conne

Re: [VOTE] Apache Hive 2.3.8 Release Candidate 3

2021-01-10 Thread Xuefu Zhang
+1. I performed the following: 1. Downloaded bin and src tarball and verified signature and checksum 2. Freshly initiated a mysql based metastore and ran Hive metastore service on top of it. 3. Created a simple table and queried it with Hive CLI. 4. Didn't test beeline, however. Thanks, Xuefu On

[jira] [Created] (HIVE-24280) Fix a potential NPE

2020-10-15 Thread Xuefu Zhang (Jira)
Xuefu Zhang created HIVE-24280: -- Summary: Fix a potential NPE Key: HIVE-24280 URL: https://issues.apache.org/jira/browse/HIVE-24280 Project: Hive Issue Type: Improvement Components

Re: Time to Remove Hive-on-Spark

2020-07-23 Thread Xuefu Zhang
> > > > > We can deprecate in Hive 3.x and remove in Hive 4.x. The plan would be > > to > > > use Tez moving forward. > > > > > > My point about the vendor's move to Tez is that HoS adoption is very > low, > > > it's only going lo

HIVE-19853 and Timestamp in Arrow

2020-07-21 Thread Xuefu Zhang
Hi all, Recently I noticed that HIve serializes timestamp, which has no time zone, in Arrow as microsec in UTC. This seems a little counterintuitive on the surface. Thus, I'd like to understand it a bit more. From the JIRA [1], it seems that the choice was made for Spark because Spark does that. H

Re: Time to Remove Hive-on-Spark

2020-07-21 Thread Xuefu Zhang
t; >>>> > > > > >>>> On Wed, Jun 3, 2020 at 1:23 PM David Mollitor < > dam6...@gmail.com> > > > > >> wrote: > > > > >>>> > > > > >>>>> Hello Gang, > > > > >>>>> > > > > >>>>> I have spent some time working on upgrading Avro (far less than > > > > >> others): > > > > >>>>> > > > > >>>>> https://issues.apache.org/jira/browse/HIVE-21737 > > > > >>>>> > > > > >>>>> This should be a relatively easy thing to do, but is blocked by > > > > >>>>> Hive-on-Spark. HoS has a weird thing where it downloads some > > > > >>>>> cloud-storage-hosted file of Spark-Hadoop as part of its maven > > run. > > > > >>>>> > > > > >>>>> Since HoS is not going to receive updates from the major > vendors, > > > is > > > > >> it > > > > >>>>> time to simply remove it? > > > > >>>>> > > > > >>>>> Tests are currently disabled: > > > > >>>>> https://issues.apache.org/jira/browse/HIVE-23137 > > > > >>>>> > > > > >>>>> Thanks. > > > > >>>>> > > > > >>> > > > > >>> > > > > >> > > > > > > > > > > > > > > > > > > -- > > Xuefu Zhang > > > > "In Honey We Trust!" > > >

Re: [ANNOUNCE] New PMC Member : Vihang Karajgaonkar

2018-07-30 Thread Xuefu Zhang
Congratulations, Vihang! On Mon, Jul 30, 2018 at 10:53 AM, Andrew Sherman < asher...@cloudera.com.invalid> wrote: > Congratulations Vihang! > > > > On Mon, Jul 30, 2018 at 12:44 AM Peter Vary > wrote: > > > Congratulations Vihang! > > > > > On Jul 29, 2018, at 22:32, Vineet Garg wrote: > > > >

Re: [ANNOUNCE] New PMC Member : Sahil Takiar

2018-07-30 Thread Xuefu Zhang
Congrats, Sahil! On Mon, Jul 30, 2018 at 10:53 AM, Andrew Sherman < asher...@cloudera.com.invalid> wrote: > Congratulations Sahil! > > On Mon, Jul 30, 2018 at 7:29 AM Sahil Takiar > wrote: > > > Thanks! > > > > On Mon, Jul 30, 2018 at 2:44 AM, Peter Vary > > wrote: > > > > > Congratulations Sah

Re: [ANNOUNCE] New PMC Member : Peter Vary

2018-07-30 Thread Xuefu Zhang
Congratulations, Peter! On Mon, Jul 30, 2018 at 12:11 PM, Jesus Camacho Rodriguez < jcamachorodrig...@hortonworks.com> wrote: > Congrats Peter! > > On 7/30/18, 10:53 AM, "Andrew Sherman" > wrote: > > Congratulations Peter! > > On Sun, Jul 29, 2018 at 1:32 PM Vineet Garg > wrote: > >

Re: [ANNOUNCE] New committer: Slim Bouguerra

2018-07-30 Thread Xuefu Zhang
congratulations!!! On Mon, Jul 30, 2018 at 12:10 PM, Jesus Camacho Rodriguez < jcamachorodrig...@hortonworks.com> wrote: > Congrats Slim! > > On 7/30/18, 10:53 AM, "Andrew Sherman" > wrote: > > Congratulations Slim! > > On Mon, Jul 30, 2018 at 12:46 AM Peter Vary > > wrote: > >

Re: [ANNOUNCE] New PMC Member : Vineet Garg

2018-07-30 Thread Xuefu Zhang
Congratulations! On Mon, Jul 30, 2018 at 12:10 PM, Jesus Camacho Rodriguez < jcamachorodrig...@hortonworks.com> wrote: > Congrats Vineet! > > On 7/30/18, 10:53 AM, "Andrew Sherman" > wrote: > > Congratulations Vineet! > > On Mon, Jul 30, 2018 at 12:52 AM Deepak Jaiswal < > djais...@hort

Re: Integrating Yetus with Precommit job

2017-11-07 Thread Xuefu Zhang
+1 on the ideas. On Tue, Nov 7, 2017 at 6:17 AM, Adam Szita wrote: > Thanks for all the replies. > > Vihang: Good idea on making everything green before turning this on. For > this purpose I've filed a couple of jiras: > -HIVE-17995 Run > checks

Re: does anyone care about list bucketing stored as directories?

2017-10-08 Thread Xuefu Zhang
Lack a response doesn't necessarily means "don't care". Maybe you can have a good description of the problem and proposed solution. Frankly I cannot make much sense out of the previous email. Thanks, Xuefu On Fri, Oct 6, 2017 at 5:05 PM, Sergey Shelukhin wrote: > Looks like nobody does… I’ll fi

[jira] [Created] (HIVE-17586) Make HS2 BackgroundOperationPool not fixed

2017-09-22 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-17586: -- Summary: Make HS2 BackgroundOperationPool not fixed Key: HIVE-17586 URL: https://issues.apache.org/jira/browse/HIVE-17586 Project: Hive Issue Type: Bug

[jira] [Created] (HIVE-17548) ThriftCliService reports inaccurate the number of current sessions in the log message

2017-09-17 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-17548: -- Summary: ThriftCliService reports inaccurate the number of current sessions in the log message Key: HIVE-17548 URL: https://issues.apache.org/jira/browse/HIVE-17548

[jira] [Created] (HIVE-17507) Support Mesos for Hive on Spark

2017-09-11 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-17507: -- Summary: Support Mesos for Hive on Spark Key: HIVE-17507 URL: https://issues.apache.org/jira/browse/HIVE-17507 Project: Hive Issue Type: Improvement

Re: Review Request 61663: WebUI query plan graphs

2017-08-29 Thread Xuefu Zhang
ews.apache.org/r/61663/#comment260184> Apache license header. - Xuefu Zhang On Aug. 16, 2017, 1:55 p.m., Karen Coppage wrote: > > --- > This is an automatically generated e-mail. To r

[jira] [Created] (HIVE-17401) Hive session idle timeout doesn't function properly

2017-08-28 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-17401: -- Summary: Hive session idle timeout doesn't function properly Key: HIVE-17401 URL: https://issues.apache.org/jira/browse/HIVE-17401 Project: Hive Issue Type

Re: Aug. 2017 Hive User Group Meeting

2017-08-21 Thread Xuefu Zhang
Dear Hive users and developers, As reminder, the next Hive User Group Meeting will occur this Thursday, Aug. 24. The agenda is available on the event page ( https://www.meetup.com/Hive-User-Group-Meeting/events/242210487/). See you all there! Thanks, Xuefu On Tue, Aug 1, 2017 at 7:18 PM, Xuefu

Re: [DISCUSSION] WebUI query plan graphs

2017-08-10 Thread Xuefu Zhang
Hi Karen, Thanks for reaching out. While your message doesn't seem showing any images, I think the feature would be a great addition to Hive. (Hive community always welcomes contributions like this.) Please feel free to create an JIRA for easier discussion and tracking. Thanks again for your int

Aug. 2017 Hive User Group Meeting

2017-08-01 Thread Xuefu Zhang
Hi all, It's an honor to announce that Hive community is launching a Hive user group meeting in the bay area this month. The details can be found at https://www.meetup.com/Hive-User-Group-Meeting/events/242210487/. We are inviting talk proposals from Hive users as well as developers at this time.

Re: [Announce] New committer: Peter Vary

2017-07-07 Thread Xuefu Zhang
Congratulations! On Fri, Jul 7, 2017 at 4:17 AM, Adam Szita wrote: > Congrats all! > > On 7 July 2017 at 10:03, Zoltan Haindrich > wrote: > > > Congratulations Peter, Teddy, Deepesh, Vihang and Sahil! > > It's great to see that the Hive community is growing! > > > > On 6 Jul 2017 02:52, Ashutos

Re: [ANNOUNCE] New PMC Member : Matt McCline

2017-07-07 Thread Xuefu Zhang
Congratulations! On Fri, Jul 7, 2017 at 8:27 AM, Eugene Koifman wrote: > Congratulations! > > On 7/7/17, 1:04 AM, "Zoltan Haindrich" wrote: > > Congrats Matt! > > On 7 Jul 2017 09:46, Peter Vary wrote: > Congratulations Matt! :) > > 2017. júl. 7. 0:34 ezt írta ("Jesus Camacho R

Re: [Announce] New committer: Teddy Choi

2017-07-07 Thread Xuefu Zhang
Congratulations! On Fri, Jul 7, 2017 at 12:09 AM, Matthew McCline wrote: > Congratulations Teddy! > > Get Outlook for iOS > > > > On Wed, Jul 5, 2017 at 5:53 PM -0700, "Ashutosh Chauhan" < > hashut...@apache.org> wrote: > > > The Project Manage

Re: [DISCUSS] Separating out the metastore as its own TLP

2017-07-05 Thread Xuefu Zhang
I think Edward's concern is valid. While I voiced my support for this proposal, which was more from the benefits of the whole Hadoop ecosystem, I don't see the equal benefits for Hive. Instead, it may even create more overhead for Hive. I'd really like to take time to see what are the road blocks f

Re: [DISCUSS] Separating out the metastore as its own TLP

2017-06-30 Thread Xuefu Zhang
+1, sounds like a good idea! On Fri, Jun 30, 2017 at 1:24 PM, Harsha wrote: > Thanks for the proposal Alan. I am +1 on separating the Hive Metastore. > This is a great opportunity for building a Metastore to not only address > schemas for the data at rest but also for the data in motion. We have

[jira] [Created] (HIVE-16962) Better error msg for Hive on Spark in case user cancels query and closes session

2017-06-26 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-16962: -- Summary: Better error msg for Hive on Spark in case user cancels query and closes session Key: HIVE-16962 URL: https://issues.apache.org/jira/browse/HIVE-16962 Project

[jira] [Created] (HIVE-16961) Hive on Spark leaks spark application in case user cancels query and closes session

2017-06-26 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-16961: -- Summary: Hive on Spark leaks spark application in case user cancels query and closes session Key: HIVE-16961 URL: https://issues.apache.org/jira/browse/HIVE-16961

[jira] [Created] (HIVE-16854) SparkClientFactory is locked too aggressively

2017-06-07 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-16854: -- Summary: SparkClientFactory is locked too aggressively Key: HIVE-16854 URL: https://issues.apache.org/jira/browse/HIVE-16854 Project: Hive Issue Type: Bug

[jira] [Created] (HIVE-16799) Control the max number of task for a stage in a spark job

2017-05-31 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-16799: -- Summary: Control the max number of task for a stage in a spark job Key: HIVE-16799 URL: https://issues.apache.org/jira/browse/HIVE-16799 Project: Hive Issue

Re: [Announce] New PMC members

2017-05-26 Thread Xuefu Zhang
Many congratulations to Yongzhi, Daniel, Vaibhav, Sergio, Aihua, Chaoyu! Well-deserved! Thanks, Xuefu On Fri, May 26, 2017 at 7:19 AM, Jimmy Xiang wrote: > Congrats!! > > On Fri, May 26, 2017 at 2:52 AM, Adam Szita wrote: > > Congrats to all, well done! > > > > Adam > > > > On 26 May 2017 at 0

Welcome Rui Li to Hive PMC

2017-05-24 Thread Xuefu Zhang
Hi all, It's an honer to announce that Apache Hive PMC has recently voted to invite Rui Li as a new Hive PMC member. Rui is a long time Hive contributor and committer, and has made significant contribution in Hive especially in Hive on Spark. Please join me in congratulating him and looking forwar

Jimmy Xiang now a Hive PMC member

2017-05-24 Thread Xuefu Zhang
Hi all, It's an honer to announce that Apache Hive PMC has recently voted to invite Jimmy Xiang as a new Hive PMC member. Please join me in congratulating him and looking forward to a bigger role that he will play in Apache Hive project. Thanks, Xuefu

Re: Review Request 50787: Add a timezone-aware timestamp

2017-05-08 Thread Xuefu Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/50787/#review174202 --- Ship it! Ship It! - Xuefu Zhang On May 8, 2017, 3:17 p.m

Re: Review Request 50787: Add a timezone-aware timestamp

2017-05-07 Thread Xuefu Zhang
make a note about the source of the code, like TimeStampTZWritable? - Xuefu Zhang On May 3, 2017, 6:34 a.m., Rui Li wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > http

Welcome new Hive committer, Zhihai Xu

2017-05-05 Thread Xuefu Zhang
Hi all, I'm very please to announce that Hive PMC has recently voted to offer Zhihai a committership which he accepted. Please join me in congratulating on this recognition and thanking him for his contributions to Hive. Regards, Xuefu

Re: Review Request 58865: HIVE-16552: Limit the number of tasks a Spark job may contain

2017-05-03 Thread Xuefu Zhang
PRE-CREATION ql/src/test/results/clientnegative/spark/spark_job_max_tasks.q.out PRE-CREATION Diff: https://reviews.apache.org/r/58865/diff/4/ Changes: https://reviews.apache.org/r/58865/diff/3-4/ Testing --- Test locally Thanks, Xuefu Zhang

Re: Review Request 58865: HIVE-16552: Limit the number of tasks a Spark job may contain

2017-05-02 Thread Xuefu Zhang
into an instable state. What you said was what I tried in first place. - Xuefu --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/58865/#review173689

Re: Review Request 58865: HIVE-16552: Limit the number of tasks a Spark job may contain

2017-05-02 Thread Xuefu Zhang
--- Test locally Thanks, Xuefu Zhang

Re: Review Request 58865: HIVE-16552: Limit the number of tasks a Spark job may contain

2017-05-01 Thread Xuefu Zhang
anges: https://reviews.apache.org/r/58865/diff/1-2/ Testing --- Test locally Thanks, Xuefu Zhang

Review Request 58865: HIVE-16552: Limit the number of tasks a Spark job may contain

2017-04-28 Thread Xuefu Zhang
/status/RemoteSparkJobMonitor.java dd73f3e ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/SparkJobMonitor.java 0b224f2 Diff: https://reviews.apache.org/r/58865/diff/1/ Testing --- Test locally Thanks, Xuefu Zhang

[jira] [Created] (HIVE-16552) Limit the number of tasks a Spark job may contain

2017-04-27 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-16552: -- Summary: Limit the number of tasks a Spark job may contain Key: HIVE-16552 URL: https://issues.apache.org/jira/browse/HIVE-16552 Project: Hive Issue Type

Re: Review Request 57586: HIVE-16183: Fix potential thread safety issues with static variables

2017-03-15 Thread Xuefu Zhang
relies on existing test cases. Thanks, Xuefu Zhang

Re: Review Request 57586: HIVE-16183: Fix potential thread safety issues with static variables

2017-03-15 Thread Xuefu Zhang
relies on existing test cases. Thanks, Xuefu Zhang

Re: [ANNOUNCE] New PMC Member : Eugene Koifman

2017-03-15 Thread Xuefu Zhang
Congratulations, Eugene! On Wed, Mar 15, 2017 at 7:31 AM, Sergio Pena wrote: > Congratulations Eugene !! > > On Wed, Mar 15, 2017 at 5:41 AM, Prasanth Jayachandran < > pjayachand...@hortonworks.com> wrote: > > > Congratulations Eugene! > > > > Thanks > > Prasanth > > > > > > > > > > On Tue, Mar

Re: Review Request 57586: HIVE-16183: Fix potential thread safety issues with static variables

2017-03-14 Thread Xuefu Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/57586/#review168921 ------- On March 14, 2017, 4:32 a.m., Xuefu Zhang wrote: > > --

[jira] [Created] (HIVE-16196) UDFJson having thread-safety issues

2017-03-13 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-16196: -- Summary: UDFJson having thread-safety issues Key: HIVE-16196 URL: https://issues.apache.org/jira/browse/HIVE-16196 Project: Hive Issue Type: Bug

Review Request 57586: HIVE-16183: Fix potential thread safety issues with static variables

2017-03-13 Thread Xuefu Zhang
/apache/hive/testutils/jdbc/HiveBurnInClient.java 41ade5f Diff: https://reviews.apache.org/r/57586/diff/1/ Testing --- This relies on existing test cases. Thanks, Xuefu Zhang

[jira] [Created] (HIVE-16183) Fix potential thread safety issues with static variables

2017-03-12 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-16183: -- Summary: Fix potential thread safety issues with static variables Key: HIVE-16183 URL: https://issues.apache.org/jira/browse/HIVE-16183 Project: Hive Issue Type

[jira] [Created] (HIVE-16179) HoS tasks may fail due to ArrayIndexOutOfBoundException in BinarySortableSerDe

2017-03-10 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-16179: -- Summary: HoS tasks may fail due to ArrayIndexOutOfBoundException in BinarySortableSerDe Key: HIVE-16179 URL: https://issues.apache.org/jira/browse/HIVE-16179 Project

[jira] [Created] (HIVE-16156) FileSinkOperator should delete existing output target when renaming

2017-03-09 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-16156: -- Summary: FileSinkOperator should delete existing output target when renaming Key: HIVE-16156 URL: https://issues.apache.org/jira/browse/HIVE-16156 Project: Hive

[jira] [Created] (HIVE-15893) Followup on HIVE-15671

2017-02-13 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-15893: -- Summary: Followup on HIVE-15671 Key: HIVE-15893 URL: https://issues.apache.org/jira/browse/HIVE-15893 Project: Hive Issue Type: Improvement Components

[jira] [Created] (HIVE-15683) Measure performance impact on group by by HIVE-15580

2017-01-20 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-15683: -- Summary: Measure performance impact on group by by HIVE-15580 Key: HIVE-15683 URL: https://issues.apache.org/jira/browse/HIVE-15683 Project: Hive Issue Type

[jira] [Created] (HIVE-15682) Eliminate the dummy iterator and optimize the per row based reducer-side processing

2017-01-20 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-15682: -- Summary: Eliminate the dummy iterator and optimize the per row based reducer-side processing Key: HIVE-15682 URL: https://issues.apache.org/jira/browse/HIVE-15682

Re: Review Request 55776: Eliminate unbounded memory usage for orderBy and groupBy in Hive on Spark

2017-01-20 Thread Xuefu Zhang
On Jan. 20, 2017, 6:26 p.m., Xuefu Zhang wrote: > > I think we also need to update > > ql/src/test/results/clientpositive/union_top_level.q.out > > Xuefu Zhang wrote: > No. I verified that MR's plan and result don't change at all. This is > because the

Re: Review Request 55776: Eliminate unbounded memory usage for orderBy and groupBy in Hive on Spark

2017-01-20 Thread Xuefu Zhang
On Jan. 20, 2017, 6:26 p.m., Xuefu Zhang wrote: > > I think we also need to update > > ql/src/test/results/clientpositive/union_top_level.q.out > > Xuefu Zhang wrote: > No. I verified that MR's plan and result don't change at all. This is > because the

Re: Review Request 55776: Eliminate unbounded memory usage for orderBy and groupBy in Hive on Spark

2017-01-20 Thread Xuefu Zhang
On Jan. 20, 2017, 6:26 p.m., Xuefu Zhang wrote: > > I think we also need to update > > ql/src/test/results/clientpositive/union_top_level.q.out No. I verified that MR's plan and result don't change at all. This is because the keys are the same for group by a

Re: Review Request 55776: Eliminate unbounded memory usage for orderBy and groupBy in Hive on Spark

2017-01-20 Thread Xuefu Zhang
an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/55776/#review162449 --- On Jan. 20, 2017, 6:07 p.m., Xuefu Zhang wrote: > >

Review Request 55776: Eliminate unbounded memory usage for orderBy and groupBy in Hive on Spark

2017-01-20 Thread Xuefu Zhang
/spark/union_top_level.q.out c9cb5d3 ql/src/test/results/clientpositive/spark/vector_outer_join5.q.out 9e1742f Diff: https://reviews.apache.org/r/55776/diff/ Testing --- All test passed Thanks, Xuefu Zhang

[jira] [Created] (HIVE-15671) RPCServer.registerClient() erroneously uses server/client handshake timeout for connection timeout

2017-01-19 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-15671: -- Summary: RPCServer.registerClient() erroneously uses server/client handshake timeout for connection timeout Key: HIVE-15671 URL: https://issues.apache.org/jira/browse/HIVE-15671

[jira] [Created] (HIVE-15580) Replace Spark's groupByKey operator with something with bounded memory

2017-01-10 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-15580: -- Summary: Replace Spark's groupByKey operator with something with bounded memory Key: HIVE-15580 URL: https://issues.apache.org/jira/browse/HIVE-15580 Project:

[jira] [Created] (HIVE-15543) Don't try to get memory/cores to decide parallelism when Spark dynamic allocation is enabled

2017-01-04 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-15543: -- Summary: Don't try to get memory/cores to decide parallelism when Spark dynamic allocation is enabled Key: HIVE-15543 URL: https://issues.apache.org/jira/browse/HIVE-

[jira] [Created] (HIVE-15527) Memory usage is unbound in SortByShuffler for Spark

2016-12-30 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-15527: -- Summary: Memory usage is unbound in SortByShuffler for Spark Key: HIVE-15527 URL: https://issues.apache.org/jira/browse/HIVE-15527 Project: Hive Issue Type

Naveen Gangam has become a Hive Committer

2016-12-16 Thread Xuefu Zhang
Bcc: dev/user Hi all, It's my honor to announce that Apache Hive PMC has voted on and approved Naveen's committership. Please join me in congratulate him on his contributions and achievements. Regards, Xuefu

Re: [ANNOUNCE] New Hive Committer - Rajesh Balamohan

2016-12-13 Thread Xuefu Zhang
Congratulations! On Tue, Dec 13, 2016 at 6:51 PM, Prasanth Jayachandran wrote: > The Apache Hive PMC has voted to make Rajesh Balamohan a committer on the > Apache Hive Project. Please join me in congratulating Rajesh. > > Congratulations Rajesh! > > Thanks > Prasanth

[jira] [Created] (HIVE-15237) Propagate Spark job failure to Hive

2016-11-17 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-15237: -- Summary: Propagate Spark job failure to Hive Key: HIVE-15237 URL: https://issues.apache.org/jira/browse/HIVE-15237 Project: Hive Issue Type: Bug

Re: Review Request 53166: HIVE-14910: Flaky test: TestSparkClient.testJobSubmission

2016-10-28 Thread Xuefu Zhang
/JobHandleImpl.java (line 165) <https://reviews.apache.org/r/53166/#comment223637> Nit: could we avoid using single letter variable name for things other than integer iterators? Same below. - Xuefu Zhang On Oct. 26, 2016, 1:48 p.m., Barna Zsombor Klara

Re: behavior or insert overwrite with dynamic partitions

2016-10-17 Thread Xuefu Zhang
It seems right to me that an existing partition should be overwritten if that partition gets any data while older, untouched partition should stay. After all, we are overwriting certain partitions, not the whole table. --Xuefu On Mon, Oct 17, 2016 at 6:10 PM, Sergey Shelukhin wrote: > What do y

[jira] [Created] (HIVE-14885) Support PPD for nested columns

2016-10-04 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-14885: -- Summary: Support PPD for nested columns Key: HIVE-14885 URL: https://issues.apache.org/jira/browse/HIVE-14885 Project: Hive Issue Type: Improvement

Re: Review Request 50787: Add a timezone-aware timestamp

2016-09-21 Thread Xuefu Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/50787/#review149942 --- Ship it! Ship It! - Xuefu Zhang On Sept. 22, 2016, 4:05 a.m

Re: Review Request 50787: Add a timezone-aware timestamp

2016-09-21 Thread Xuefu Zhang
che.org/r/50787/#comment217725> License header please. - Xuefu Zhang On Sept. 22, 2016, 1:08 a.m., Rui Li wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://re

[jira] [Created] (HIVE-14617) NPE in UDF MapValues() if input is null

2016-08-24 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-14617: -- Summary: NPE in UDF MapValues() if input is null Key: HIVE-14617 URL: https://issues.apache.org/jira/browse/HIVE-14617 Project: Hive Issue Type: Bug

Re: Question about Hive on Spark

2016-08-22 Thread Xuefu Zhang
That happens per session or if certain configs are changed in the session. On Mon, Aug 22, 2016 at 5:53 PM, Tao Li wrote: > Hi, > > Looks like the Spark client (SparkClientImpl class) submits Sparks jobs to > the YARN cluster by forking a process and kicking off spark-submit script. > Are we pro

Re: [ANNOUNCE] New PMC Member : Pengcheng

2016-07-17 Thread Xuefu Zhang
Congrats, PengCheng! On Sun, Jul 17, 2016 at 2:28 PM, Sushanth Sowmyan wrote: > Welcome aboard Pengcheng! :) > > On Jul 17, 2016 12:01, "Lefty Leverenz" wrote: > > > Congratulations Pengcheng! > > > > -- Lefty > > > > On Sun, Jul 17, 2016 at 1:03 PM, Ashutosh Chauhan > > wrote: > > > >> > > >>

Re: [Announce] New Hive Committer - Mohit Sabharwal

2016-07-04 Thread Xuefu Zhang
Congrats, Mohit! --Xuefu On Mon, Jul 4, 2016 at 10:09 AM, Sahil Takiar wrote: > Congrats Mohit! > > On Sun, Jul 3, 2016 at 10:11 PM, Lefty Leverenz > wrote: > > > Congratulations Mohit! > > > > -- Lefty > > > > On Sun, Jul 3, 2016 at 11:50 PM, Alpesh Patel > > wrote: > > > > > Congrats > > >

[jira] [Created] (HIVE-13873) Column pruning for nested fields

2016-05-26 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-13873: -- Summary: Column pruning for nested fields Key: HIVE-13873 URL: https://issues.apache.org/jira/browse/HIVE-13873 Project: Hive Issue Type: New Feature

Re: Error in Hive on Spark

2016-03-23 Thread Xuefu Zhang
nks a lot, > Stana > > > 2016-03-22 1:16 GMT+08:00 Xuefu Zhang : > > > Stana, > > > > I'm not sure if I fully understand the problem. spark-submit is launched > in > > the same host as your application, which should be able to access > > hive-exec.jar.

Re: Error in Hive on Spark

2016-03-21 Thread Xuefu Zhang
application executed spark-submit with local path of > > hive-exec-2.0.0.jar to yarn cluster, there 's no hive-exec-2.0.0.jar in > > yarn cluster. Then application threw the exception: "hive-exec-2.0.0.jar > > does not exist ...". > > > > Can it be set pro

[jira] [Created] (HIVE-13276) Hive on Spark doesn't work when spark.master=local

2016-03-13 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-13276: -- Summary: Hive on Spark doesn't work when spark.master=local Key: HIVE-13276 URL: https://issues.apache.org/jira/browse/HIVE-13276 Project: Hive Issue Type

Re: Error in Hive on Spark

2016-03-10 Thread Xuefu Zhang
You can probably avoid the problem by set environment variable SPARK_HOME or JVM property spark.home that points to your spark installation. --Xuefu On Thu, Mar 10, 2016 at 3:11 AM, Stana wrote: > I am trying out Hive on Spark with hive 2.0.0 and spark 1.4.1, and > executing org.apache.hadoop.

Re: [ANNOUNCE] New Hive Committer - Wei Zheng

2016-03-09 Thread Xuefu Zhang
Congratulations, Wei! On Wed, Mar 9, 2016 at 6:48 PM, Chao Sun wrote: > Congratulations! > > On Wed, Mar 9, 2016 at 6:44 PM, Prasanth Jayachandran < > pjayachand...@hortonworks.com> wrote: > > > Congratulations Wei! > > > > On Mar 9, 2016, at 8:43 PM, Sergey Shelukhin >

Re: Spark and HBase metastore jiras in 2.0 release

2016-02-17 Thread Xuefu Zhang
I don't think 2.0 branch has every patch from spark-branch. However, master does. I will take care of spark branch JIrA resolution versions. Thanks, Xuefu On Tue, Feb 16, 2016 at 9:48 PM, Thejas Nair wrote: > The hbase-metastore branch jiras are all part of Hive 2.0.0 release, > as no work was

Re: [ANNOUNCE] Apache Hive 2.0.0 Released

2016-02-16 Thread Xuefu Zhang
Congratulation, guys!!! --Xuefu On Tue, Feb 16, 2016 at 11:54 AM, Prasanth Jayachandran < pjayachand...@hortonworks.com> wrote: > Great news! Thanks Sergey for the effort. > > Thanks > Prasanth > > > On Feb 16, 2016, at 1:44 PM, Sergey Shelukhin wrote: > > > > The Apache Hive team is proud to a

Re: Review Request 43176: HIVE-12965: Insert overwrite local directory should perserve the overwritten directory permission

2016-02-11 Thread Xuefu Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/43176/#review118941 --- Ship it! Ship It! - Xuefu Zhang On Feb. 11, 2016, 9:54 p.m

Re: Review Request 43176: HIVE-12965: Insert overwrite local directory should perserve the overwritten directory permission

2016-02-11 Thread Xuefu Zhang
tps://reviews.apache.org/r/43176/#comment180247> qq: So closing the file systems gave the issues seen in the test failures? - Xuefu Zhang On Feb. 11, 2016, 9:54 p.m., Chaoyu Tang wrote: > > --- > This is an automatically g

Re: Review Request 43176: HIVE-12965: Insert overwrite local directory should perserve the overwritten directory permission

2016-02-09 Thread Xuefu Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/43176/#review118462 --- Ship it! Ship It! - Xuefu Zhang On Feb. 9, 2016, 8:55 p.m

Re: Review Request 43176: HIVE-12965: Insert overwrite local directory should perserve the overwritten directory permission

2016-02-09 Thread Xuefu Zhang
his instead of relying on exception handling? See below exmaple when checking the sourcePath. - Xuefu Zhang On Feb. 9, 2016, 6:54 p.m., Chaoyu Tang wrote: > > --- > This is an automatically generated e-mail. To reply, visit: >

Re: [VOTE] Apache Hive 2.0.0 Release Candidate 2

2016-02-09 Thread Xuefu Zhang
Some trouble I met: 1. downloaded source and build Hive with -Pdist. 2. try to run Hive CLI and get the following error: Exception in thread "main" java.lang.RuntimeException: Hive metastore database is not initialized. Please use schematool (e.g. ./schematool -initSchema -dbType ...) to create t

Re: Review Request 43176: HIVE-12965: Insert overwrite local directory should perserve the overwritten directory permission

2016-02-09 Thread Xuefu Zhang
hadoop/hive/ql/exec/MoveTask.java (line 160) <https://reviews.apache.org/r/43176/#comment179627> it seems fs didn't get closed in all paths. However, I understand that the problem was there before. - Xuefu Zhang On Feb. 4, 2016, 4:07 a

Re: Review Request 43176: HIVE-12965: Insert overwrite local directory should perserve the overwritten directory permission

2016-02-04 Thread Xuefu Zhang
one is slower. Could we instead remember the original permission and set it to the new directory that we are going to replace? - Xuefu Zhang On Feb. 4, 2016, 4:07 a.m., Chaoyu Tang wrote: > > --- > This is an automatically g

[jira] [Created] (HIVE-12951) Reduce Spark executor prewarm timeout to 5s

2016-01-27 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-12951: -- Summary: Reduce Spark executor prewarm timeout to 5s Key: HIVE-12951 URL: https://issues.apache.org/jira/browse/HIVE-12951 Project: Hive Issue Type: Bug

Re: January Hive User Group Meeting

2016-01-21 Thread Xuefu Zhang
For those who cannot attend in person, here is the webex info: https://cloudera.webex.com/meet/xzhang 1-650-479-3208 Call-in toll number (US/Canada) 623 810 662 (access code) Thanks, Xuefu On Wed, Jan 20, 2016 at 9:45 AM, Xuefu Zhang wrote: > Hi all, > > As a reminder, the meetin

Re: January Hive User Group Meeting

2016-01-20 Thread Xuefu Zhang
Hi all, As a reminder, the meeting will be held tomorrow as scheduled. Please refer to the meetup page[1] for details. Looking forward to meeting you all! Thanks, Xuefu [1] http://www.meetup.com/Hive-User-Group-Meeting/events/227463783/ On Wed, Dec 16, 2015 at 3:38 PM, Xuefu Zhang wrote

[jira] [Created] (HIVE-12828) Update Spark version to 1.6

2016-01-09 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-12828: -- Summary: Update Spark version to 1.6 Key: HIVE-12828 URL: https://issues.apache.org/jira/browse/HIVE-12828 Project: Hive Issue Type: Task Components

[jira] [Created] (HIVE-12811) Name yarn application name more meaning than just "Hive on Spark"

2016-01-08 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-12811: -- Summary: Name yarn application name more meaning than just "Hive on Spark" Key: HIVE-12811 URL: https://issues.apache.org/jira/browse/HIVE-12811 Pro

Re: Review Request 41582: HIVE-12713: Miscellaneous improvements in driver compile and execute logging

2015-12-21 Thread Xuefu Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/41582/#review111501 --- Ship it! Ship It! - Xuefu Zhang On Dec. 21, 2015, 3:46 p.m

Re: Review Request 41582: HIVE-12713: Miscellaneous improvements in driver compile and execute logging

2015-12-21 Thread Xuefu Zhang
be better if we check if debug log is enabled. Same below - Xuefu Zhang On Dec. 20, 2015, 1:05 a.m., Chaoyu Tang wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://re

[jira] [Created] (HIVE-12708) Hive on Spark doesn't work with Kerboresed HBase [Spark Branch]

2015-12-18 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-12708: -- Summary: Hive on Spark doesn't work with Kerboresed HBase [Spark Branch] Key: HIVE-12708 URL: https://issues.apache.org/jira/browse/HIVE-12708 Project:

Re: January Hive User Group Meeting

2015-12-16 Thread Xuefu Zhang
ndorsed by Peridale Technology > Ltd, its subsidiaries or their employees, unless expressly so stated. It is > the responsibility of the recipient to ensure that this email is virus > free, therefore neither Peridale Ltd, its subsidiaries nor their employees > accept any responsibili

January Hive User Group Meeting

2015-12-16 Thread Xuefu Zhang
Dear Hive users and developers, Hive community is considering a user group meeting[1] January 21, 2016 at Cloudera facility in Palo Alto, CA. This will be a great opportunity for vast users and developers to find out what's happening in the community and share each other's experience with Hive. Th

  1   2   3   4   5   6   7   8   9   10   >