Re: [VOTE] Apache Hive 2.3.9 Release Candidate 0

+1. Thank Chao for doing this. I performed the following actions: 1. Downloaded the release candidate artifacts and verified the signatures and checksums. 2. Built from the source. 3. Initialized schema using schematool and launched hive metastore service on top of it. 4. Used Hive client to

Re: [VOTE] Apache Hive 2.3.8 Release Candidate 3

+1. I performed the following: 1. Downloaded bin and src tarball and verified signature and checksum 2. Freshly initiated a mysql based metastore and ran Hive metastore service on top of it. 3. Created a simple table and queried it with Hive CLI. 4. Didn't test beeline, however. Thanks, Xuefu

[jira] [Created] (HIVE-24280) Fix a potential NPE

Xuefu Zhang created HIVE-24280: -- Summary: Fix a potential NPE Key: HIVE-24280 URL: https://issues.apache.org/jira/browse/HIVE-24280 Project: Hive Issue Type: Improvement Components

Re: Time to Remove Hive-on-Spark

e in Hive 3.x and remove in Hive 4.x. The plan would be > > to > > > use Tez moving forward. > > > > > > My point about the vendor's move to Tez is that HoS adoption is very > low, > > > it's only going lower, and while I don't know the specifics of i

HIVE-19853 and Timestamp in Arrow

Hi all, Recently I noticed that HIve serializes timestamp, which has no time zone, in Arrow as microsec in UTC. This seems a little counterintuitive on the surface. Thus, I'd like to understand it a bit more. From the JIRA [1], it seems that the choice was made for Spark because Spark does that.

Re: Time to Remove Hive-on-Spark

t; > >>>> On Wed, Jun 3, 2020 at 1:23 PM David Mollitor < > dam6...@gmail.com> > > > > >> wrote: > > > > >>>> > > > > >>>>> Hello Gang, > > > > >>>>> > > > > >>>>> I have spent some time working on upgrading Avro (far less than > > > > >> others): > > > > >>>>> > > > > >>>>> https://issues.apache.org/jira/browse/HIVE-21737 > > > > >>>>> > > > > >>>>> This should be a relatively easy thing to do, but is blocked by > > > > >>>>> Hive-on-Spark. HoS has a weird thing where it downloads some > > > > >>>>> cloud-storage-hosted file of Spark-Hadoop as part of its maven > > run. > > > > >>>>> > > > > >>>>> Since HoS is not going to receive updates from the major > vendors, > > > is > > > > >> it > > > > >>>>> time to simply remove it? > > > > >>>>> > > > > >>>>> Tests are currently disabled: > > > > >>>>> https://issues.apache.org/jira/browse/HIVE-23137 > > > > >>>>> > > > > >>>>> Thanks. > > > > >>>>> > > > > >>> > > > > >>> > > > > >> > > > > > > > > > > > > > > > > > > -- > > Xuefu Zhang > > > > "In Honey We Trust!" > > >

Re: [ANNOUNCE] New PMC Member : Vihang Karajgaonkar

Congratulations, Vihang! On Mon, Jul 30, 2018 at 10:53 AM, Andrew Sherman < asher...@cloudera.com.invalid> wrote: > Congratulations Vihang! > > > > On Mon, Jul 30, 2018 at 12:44 AM Peter Vary > wrote: > > > Congratulations Vihang! > > > > > On Jul 29, 2018, at 22:32, Vineet Garg wrote: > > > >

Re: [ANNOUNCE] New PMC Member : Sahil Takiar

Congrats, Sahil! On Mon, Jul 30, 2018 at 10:53 AM, Andrew Sherman < asher...@cloudera.com.invalid> wrote: > Congratulations Sahil! > > On Mon, Jul 30, 2018 at 7:29 AM Sahil Takiar > wrote: > > > Thanks! > > > > On Mon, Jul 30, 2018 at 2:44 AM, Peter Vary > > wrote: > > > > > Congratulations

Re: [ANNOUNCE] New PMC Member : Peter Vary

Congratulations, Peter! On Mon, Jul 30, 2018 at 12:11 PM, Jesus Camacho Rodriguez < jcamachorodrig...@hortonworks.com> wrote: > Congrats Peter! > > On 7/30/18, 10:53 AM, "Andrew Sherman" > wrote: > > Congratulations Peter! > > On Sun, Jul 29, 2018 at 1:32 PM Vineet Garg > wrote: > >

Re: [ANNOUNCE] New committer: Slim Bouguerra

congratulations!!! On Mon, Jul 30, 2018 at 12:10 PM, Jesus Camacho Rodriguez < jcamachorodrig...@hortonworks.com> wrote: > Congrats Slim! > > On 7/30/18, 10:53 AM, "Andrew Sherman" > wrote: > > Congratulations Slim! > > On Mon, Jul 30, 2018 at 12:46 AM Peter Vary > > wrote: > >

Re: [ANNOUNCE] New PMC Member : Vineet Garg

Congratulations! On Mon, Jul 30, 2018 at 12:10 PM, Jesus Camacho Rodriguez < jcamachorodrig...@hortonworks.com> wrote: > Congrats Vineet! > > On 7/30/18, 10:53 AM, "Andrew Sherman" > wrote: > > Congratulations Vineet! > > On Mon, Jul 30, 2018 at 12:52 AM Deepak Jaiswal < >

Re: Integrating Yetus with Precommit job

+1 on the ideas. On Tue, Nov 7, 2017 at 6:17 AM, Adam Szita wrote: > Thanks for all the replies. > > Vihang: Good idea on making everything green before turning this on. For > this purpose I've filed a couple of jiras: > -HIVE-17995

Re: does anyone care about list bucketing stored as directories?

Lack a response doesn't necessarily means "don't care". Maybe you can have a good description of the problem and proposed solution. Frankly I cannot make much sense out of the previous email. Thanks, Xuefu On Fri, Oct 6, 2017 at 5:05 PM, Sergey Shelukhin wrote: > Looks

[jira] [Created] (HIVE-17586) Make HS2 BackgroundOperationPool not fixed

Xuefu Zhang created HIVE-17586: -- Summary: Make HS2 BackgroundOperationPool not fixed Key: HIVE-17586 URL: https://issues.apache.org/jira/browse/HIVE-17586 Project: Hive Issue Type: Bug

[jira] [Created] (HIVE-17548) ThriftCliService reports inaccurate the number of current sessions in the log message

Xuefu Zhang created HIVE-17548: -- Summary: ThriftCliService reports inaccurate the number of current sessions in the log message Key: HIVE-17548 URL: https://issues.apache.org/jira/browse/HIVE-17548

[jira] [Created] (HIVE-17507) Support Mesos for Hive on Spark

Xuefu Zhang created HIVE-17507: -- Summary: Support Mesos for Hive on Spark Key: HIVE-17507 URL: https://issues.apache.org/jira/browse/HIVE-17507 Project: Hive Issue Type: Improvement

Re: Review Request 61663: WebUI query plan graphs

.org/r/61663/#comment260184> Apache license header. - Xuefu Zhang On Aug. 16, 2017, 1:55 p.m., Karen Coppage wrote: > > --- > This is an automatically generated e-mail. To reply, visi

[jira] [Created] (HIVE-17401) Hive session idle timeout doesn't function properly

Xuefu Zhang created HIVE-17401: -- Summary: Hive session idle timeout doesn't function properly Key: HIVE-17401 URL: https://issues.apache.org/jira/browse/HIVE-17401 Project: Hive Issue Type: Bug

Re: Aug. 2017 Hive User Group Meeting

Dear Hive users and developers, As reminder, the next Hive User Group Meeting will occur this Thursday, Aug. 24. The agenda is available on the event page ( https://www.meetup.com/Hive-User-Group-Meeting/events/242210487/). See you all there! Thanks, Xuefu On Tue, Aug 1, 2017 at 7:18 PM, Xuefu

Re: [DISCUSSION] WebUI query plan graphs

Hi Karen, Thanks for reaching out. While your message doesn't seem showing any images, I think the feature would be a great addition to Hive. (Hive community always welcomes contributions like this.) Please feel free to create an JIRA for easier discussion and tracking. Thanks again for your

Aug. 2017 Hive User Group Meeting

Hi all, It's an honor to announce that Hive community is launching a Hive user group meeting in the bay area this month. The details can be found at https://www.meetup.com/Hive-User-Group-Meeting/events/242210487/. We are inviting talk proposals from Hive users as well as developers at this

Re: [Announce] New committer: Peter Vary

Congratulations! On Fri, Jul 7, 2017 at 4:17 AM, Adam Szita wrote: > Congrats all! > > On 7 July 2017 at 10:03, Zoltan Haindrich > wrote: > > > Congratulations Peter, Teddy, Deepesh, Vihang and Sahil! > > It's great to see that the Hive community

Re: [ANNOUNCE] New PMC Member : Matt McCline

Congratulations! On Fri, Jul 7, 2017 at 8:27 AM, Eugene Koifman wrote: > Congratulations! > > On 7/7/17, 1:04 AM, "Zoltan Haindrich" wrote: > > Congrats Matt! > > On 7 Jul 2017 09:46, Peter Vary wrote: >

Re: [Announce] New committer: Teddy Choi

Congratulations! On Fri, Jul 7, 2017 at 12:09 AM, Matthew McCline wrote: > Congratulations Teddy! > > Get Outlook for iOS > > > > On Wed, Jul 5, 2017 at 5:53 PM -0700, "Ashutosh Chauhan" < > hashut...@apache.org>

Re: [DISCUSS] Separating out the metastore as its own TLP

I think Edward's concern is valid. While I voiced my support for this proposal, which was more from the benefits of the whole Hadoop ecosystem, I don't see the equal benefits for Hive. Instead, it may even create more overhead for Hive. I'd really like to take time to see what are the road blocks

Re: [DISCUSS] Separating out the metastore as its own TLP

+1, sounds like a good idea! On Fri, Jun 30, 2017 at 1:24 PM, Harsha wrote: > Thanks for the proposal Alan. I am +1 on separating the Hive Metastore. > This is a great opportunity for building a Metastore to not only address > schemas for the data at rest but also for the data

[jira] [Created] (HIVE-16962) Better error msg for Hive on Spark in case user cancels query and closes session

Xuefu Zhang created HIVE-16962: -- Summary: Better error msg for Hive on Spark in case user cancels query and closes session Key: HIVE-16962 URL: https://issues.apache.org/jira/browse/HIVE-16962 Project

[jira] [Created] (HIVE-16961) Hive on Spark leaks spark application in case user cancels query and closes session

Xuefu Zhang created HIVE-16961: -- Summary: Hive on Spark leaks spark application in case user cancels query and closes session Key: HIVE-16961 URL: https://issues.apache.org/jira/browse/HIVE-16961

[jira] [Created] (HIVE-16854) SparkClientFactory is locked too aggressively

Xuefu Zhang created HIVE-16854: -- Summary: SparkClientFactory is locked too aggressively Key: HIVE-16854 URL: https://issues.apache.org/jira/browse/HIVE-16854 Project: Hive Issue Type: Bug

[jira] [Created] (HIVE-16799) Control the max number of task for a stage in a spark job

Xuefu Zhang created HIVE-16799: -- Summary: Control the max number of task for a stage in a spark job Key: HIVE-16799 URL: https://issues.apache.org/jira/browse/HIVE-16799 Project: Hive Issue

Re: [Announce] New PMC members

Many congratulations to Yongzhi, Daniel, Vaibhav, Sergio, Aihua, Chaoyu! Well-deserved! Thanks, Xuefu On Fri, May 26, 2017 at 7:19 AM, Jimmy Xiang wrote: > Congrats!! > > On Fri, May 26, 2017 at 2:52 AM, Adam Szita wrote: > > Congrats to all, well done! >

Welcome Rui Li to Hive PMC

Hi all, It's an honer to announce that Apache Hive PMC has recently voted to invite Rui Li as a new Hive PMC member. Rui is a long time Hive contributor and committer, and has made significant contribution in Hive especially in Hive on Spark. Please join me in congratulating him and looking

Jimmy Xiang now a Hive PMC member

Hi all, It's an honer to announce that Apache Hive PMC has recently voted to invite Jimmy Xiang as a new Hive PMC member. Please join me in congratulating him and looking forward to a bigger role that he will play in Apache Hive project. Thanks, Xuefu

Re: Review Request 50787: Add a timezone-aware timestamp

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/50787/#review174202 --- Ship it! Ship It! - Xuefu Zhang On May 8, 2017, 3:17 p.m

Re: Review Request 50787: Add a timezone-aware timestamp

make a note about the source of the code, like TimeStampTZWritable? - Xuefu Zhang On May 3, 2017, 6:34 a.m., Rui Li wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > http

Welcome new Hive committer, Zhihai Xu

Hi all, I'm very please to announce that Hive PMC has recently voted to offer Zhihai a committership which he accepted. Please join me in congratulating on this recognition and thanking him for his contributions to Hive. Regards, Xuefu

Re: Review Request 58865: HIVE-16552: Limit the number of tasks a Spark job may contain

PRE-CREATION ql/src/test/results/clientnegative/spark/spark_job_max_tasks.q.out PRE-CREATION Diff: https://reviews.apache.org/r/58865/diff/4/ Changes: https://reviews.apache.org/r/58865/diff/3-4/ Testing --- Test locally Thanks, Xuefu Zhang

Re: Review Request 58865: HIVE-16552: Limit the number of tasks a Spark job may contain

g rc=4. In fact, if we lose the transition, Hive actually goes into an instable state. What you said was what I tried in first place. - Xuefu --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/58865/#review173689 --

Re: Review Request 58865: HIVE-16552: Limit the number of tasks a Spark job may contain

--- Test locally Thanks, Xuefu Zhang

Re: Review Request 58865: HIVE-16552: Limit the number of tasks a Spark job may contain

: https://reviews.apache.org/r/58865/diff/1-2/ Testing --- Test locally Thanks, Xuefu Zhang

Review Request 58865: HIVE-16552: Limit the number of tasks a Spark job may contain

/status/RemoteSparkJobMonitor.java dd73f3e ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/SparkJobMonitor.java 0b224f2 Diff: https://reviews.apache.org/r/58865/diff/1/ Testing --- Test locally Thanks, Xuefu Zhang

[jira] [Created] (HIVE-16552) Limit the number of tasks a Spark job may contain

Xuefu Zhang created HIVE-16552: -- Summary: Limit the number of tasks a Spark job may contain Key: HIVE-16552 URL: https://issues.apache.org/jira/browse/HIVE-16552 Project: Hive Issue Type

Re: Review Request 57586: HIVE-16183: Fix potential thread safety issues with static variables

--- This relies on existing test cases. Thanks, Xuefu Zhang

Re: Review Request 57586: HIVE-16183: Fix potential thread safety issues with static variables

--- This relies on existing test cases. Thanks, Xuefu Zhang

Re: [ANNOUNCE] New PMC Member : Eugene Koifman

Congratulations, Eugene! On Wed, Mar 15, 2017 at 7:31 AM, Sergio Pena wrote: > Congratulations Eugene !! > > On Wed, Mar 15, 2017 at 5:41 AM, Prasanth Jayachandran < > pjayachand...@hortonworks.com> wrote: > > > Congratulations Eugene! > > > > Thanks > > Prasanth > > >

Re: Review Request 57586: HIVE-16183: Fix potential thread safety issues with static variables

, this method needs to be instance method as well. - Xuefu --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/57586/#review168921 ------- On March 14, 2017, 4:32 a.m., Xuefu Zhang wrote: > > ---

[jira] [Created] (HIVE-16196) UDFJson having thread-safety issues

Xuefu Zhang created HIVE-16196: -- Summary: UDFJson having thread-safety issues Key: HIVE-16196 URL: https://issues.apache.org/jira/browse/HIVE-16196 Project: Hive Issue Type: Bug

Review Request 57586: HIVE-16183: Fix potential thread safety issues with static variables

/apache/hive/testutils/jdbc/HiveBurnInClient.java 41ade5f Diff: https://reviews.apache.org/r/57586/diff/1/ Testing --- This relies on existing test cases. Thanks, Xuefu Zhang

[jira] [Created] (HIVE-16183) Fix potential thread safety issues with static variables

Xuefu Zhang created HIVE-16183: -- Summary: Fix potential thread safety issues with static variables Key: HIVE-16183 URL: https://issues.apache.org/jira/browse/HIVE-16183 Project: Hive Issue Type

[jira] [Created] (HIVE-16179) HoS tasks may fail due to ArrayIndexOutOfBoundException in BinarySortableSerDe

Xuefu Zhang created HIVE-16179: -- Summary: HoS tasks may fail due to ArrayIndexOutOfBoundException in BinarySortableSerDe Key: HIVE-16179 URL: https://issues.apache.org/jira/browse/HIVE-16179 Project

[jira] [Created] (HIVE-16156) FileSinkOperator should delete existing output target when renaming

Xuefu Zhang created HIVE-16156: -- Summary: FileSinkOperator should delete existing output target when renaming Key: HIVE-16156 URL: https://issues.apache.org/jira/browse/HIVE-16156 Project: Hive

[jira] [Created] (HIVE-15893) Followup on HIVE-15671

Xuefu Zhang created HIVE-15893: -- Summary: Followup on HIVE-15671 Key: HIVE-15893 URL: https://issues.apache.org/jira/browse/HIVE-15893 Project: Hive Issue Type: Improvement Components

[jira] [Created] (HIVE-15683) Measure performance impact on group by by HIVE-15580

Xuefu Zhang created HIVE-15683: -- Summary: Measure performance impact on group by by HIVE-15580 Key: HIVE-15683 URL: https://issues.apache.org/jira/browse/HIVE-15683 Project: Hive Issue Type

[jira] [Created] (HIVE-15682) Eliminate the dummy iterator and optimize the per row based reducer-side processing

Xuefu Zhang created HIVE-15682: -- Summary: Eliminate the dummy iterator and optimize the per row based reducer-side processing Key: HIVE-15682 URL: https://issues.apache.org/jira/browse/HIVE-15682

Re: Review Request 55776: Eliminate unbounded memory usage for orderBy and groupBy in Hive on Spark

On Jan. 20, 2017, 6:26 p.m., Xuefu Zhang wrote: > > I think we also need to update > > ql/src/test/results/clientpositive/union_top_level.q.out > > Xuefu Zhang wrote: > No. I verified that MR's plan and result don't change at all. This is > because the key

Re: Review Request 55776: Eliminate unbounded memory usage for orderBy and groupBy in Hive on Spark

On Jan. 20, 2017, 6:26 p.m., Xuefu Zhang wrote: > > I think we also need to update > > ql/src/test/results/clientpositive/union_top_level.q.out > > Xuefu Zhang wrote: > No. I verified that MR's plan and result don't change at all. This is > because the key

Re: Review Request 55776: Eliminate unbounded memory usage for orderBy and groupBy in Hive on Spark

On Jan. 20, 2017, 6:26 p.m., Xuefu Zhang wrote: > > I think we also need to update > > ql/src/test/results/clientpositive/union_top_level.q.out No. I verified that MR's plan and result don't change at all. This is because the keys are the same for group by and order b

Re: Review Request 55776: Eliminate unbounded memory usage for orderBy and groupBy in Hive on Spark

ically generated e-mail. To reply, visit: https://reviews.apache.org/r/55776/#review162449 ------- On Jan. 20, 2017, 6:07 p.m., Xuefu Zhang wrote: > > --- &g

Review Request 55776: Eliminate unbounded memory usage for orderBy and groupBy in Hive on Spark

/spark/union_top_level.q.out c9cb5d3 ql/src/test/results/clientpositive/spark/vector_outer_join5.q.out 9e1742f Diff: https://reviews.apache.org/r/55776/diff/ Testing --- All test passed Thanks, Xuefu Zhang

[jira] [Created] (HIVE-15671) RPCServer.registerClient() erroneously uses server/client handshake timeout for connection timeout

Xuefu Zhang created HIVE-15671: -- Summary: RPCServer.registerClient() erroneously uses server/client handshake timeout for connection timeout Key: HIVE-15671 URL: https://issues.apache.org/jira/browse/HIVE-15671

[jira] [Created] (HIVE-15580) Replace Spark's groupByKey operator with something with bounded memory

Xuefu Zhang created HIVE-15580: -- Summary: Replace Spark's groupByKey operator with something with bounded memory Key: HIVE-15580 URL: https://issues.apache.org/jira/browse/HIVE-15580 Project: Hive

[jira] [Created] (HIVE-15543) Don't try to get memory/cores to decide parallelism when Spark dynamic allocation is enabled

Xuefu Zhang created HIVE-15543: -- Summary: Don't try to get memory/cores to decide parallelism when Spark dynamic allocation is enabled Key: HIVE-15543 URL: https://issues.apache.org/jira/browse/HIVE-15543

[jira] [Created] (HIVE-15527) Memory usage is unbound in SortByShuffler for Spark

Xuefu Zhang created HIVE-15527: -- Summary: Memory usage is unbound in SortByShuffler for Spark Key: HIVE-15527 URL: https://issues.apache.org/jira/browse/HIVE-15527 Project: Hive Issue Type

Naveen Gangam has become a Hive Committer

Bcc: dev/user Hi all, It's my honor to announce that Apache Hive PMC has voted on and approved Naveen's committership. Please join me in congratulate him on his contributions and achievements. Regards, Xuefu

Re: [ANNOUNCE] New Hive Committer - Rajesh Balamohan

Congratulations! On Tue, Dec 13, 2016 at 6:51 PM, Prasanth Jayachandran wrote: > The Apache Hive PMC has voted to make Rajesh Balamohan a committer on the > Apache Hive Project. Please join me in congratulating Rajesh. > > Congratulations Rajesh! > > Thanks > Prasanth

[jira] [Created] (HIVE-15237) Propagate Spark job failure to Hive

Xuefu Zhang created HIVE-15237: -- Summary: Propagate Spark job failure to Hive Key: HIVE-15237 URL: https://issues.apache.org/jira/browse/HIVE-15237 Project: Hive Issue Type: Bug

Re: Review Request 53166: HIVE-14910: Flaky test: TestSparkClient.testJobSubmission

/JobHandleImpl.java (line 165) <https://reviews.apache.org/r/53166/#comment223637> Nit: could we avoid using single letter variable name for things other than integer iterators? Same below. - Xuefu Zhang On Oct. 26, 2016, 1:48 p.m., Barna Zsombor Klara

Re: behavior or insert overwrite with dynamic partitions

It seems right to me that an existing partition should be overwritten if that partition gets any data while older, untouched partition should stay. After all, we are overwriting certain partitions, not the whole table. --Xuefu On Mon, Oct 17, 2016 at 6:10 PM, Sergey Shelukhin

[jira] [Created] (HIVE-14885) Support PPD for nested columns

Xuefu Zhang created HIVE-14885: -- Summary: Support PPD for nested columns Key: HIVE-14885 URL: https://issues.apache.org/jira/browse/HIVE-14885 Project: Hive Issue Type: Improvement

Re: Review Request 50787: Add a timezone-aware timestamp

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/50787/#review149942 --- Ship it! Ship It! - Xuefu Zhang On Sept. 22, 2016, 4:05 a.m

Re: Review Request 50787: Add a timezone-aware timestamp

che.org/r/50787/#comment217725> License header please. - Xuefu Zhang On Sept. 22, 2016, 1:08 a.m., Rui Li wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://re

[jira] [Created] (HIVE-14617) NPE in UDF MapValues() if input is null

Xuefu Zhang created HIVE-14617: -- Summary: NPE in UDF MapValues() if input is null Key: HIVE-14617 URL: https://issues.apache.org/jira/browse/HIVE-14617 Project: Hive Issue Type: Bug

Re: Question about Hive on Spark

That happens per session or if certain configs are changed in the session. On Mon, Aug 22, 2016 at 5:53 PM, Tao Li wrote: > Hi, > > Looks like the Spark client (SparkClientImpl class) submits Sparks jobs to > the YARN cluster by forking a process and kicking off

Re: [ANNOUNCE] New PMC Member : Pengcheng

Congrats, PengCheng! On Sun, Jul 17, 2016 at 2:28 PM, Sushanth Sowmyan wrote: > Welcome aboard Pengcheng! :) > > On Jul 17, 2016 12:01, "Lefty Leverenz" wrote: > > > Congratulations Pengcheng! > > > > -- Lefty > > > > On Sun, Jul 17, 2016 at 1:03

Re: [Announce] New Hive Committer - Mohit Sabharwal

Congrats, Mohit! --Xuefu On Mon, Jul 4, 2016 at 10:09 AM, Sahil Takiar wrote: > Congrats Mohit! > > On Sun, Jul 3, 2016 at 10:11 PM, Lefty Leverenz > wrote: > > > Congratulations Mohit! > > > > -- Lefty > > > > On Sun, Jul 3, 2016 at 11:50 PM,

[jira] [Created] (HIVE-13873) Column pruning for nested fields

Xuefu Zhang created HIVE-13873: -- Summary: Column pruning for nested fields Key: HIVE-13873 URL: https://issues.apache.org/jira/browse/HIVE-13873 Project: Hive Issue Type: New Feature

Re: Error in Hive on Spark

e CLI ? > > Thanks a lot, > Stana > > > 2016-03-22 1:16 GMT+08:00 Xuefu Zhang <xu...@uber.com>: > > > Stana, > > > > I'm not sure if I fully understand the problem. spark-submit is launched > in > > the same host as your application, which sho

Re: Error in Hive on Spark

t; > When application executed spark-submit with local path of > > hive-exec-2.0.0.jar to yarn cluster, there 's no hive-exec-2.0.0.jar in > > yarn cluster. Then application threw the exception: "hive-exec-2.0.0.jar > > does not exist ...". > > > > Can it

[jira] [Created] (HIVE-13276) Hive on Spark doesn't work when spark.master=local

Xuefu Zhang created HIVE-13276: -- Summary: Hive on Spark doesn't work when spark.master=local Key: HIVE-13276 URL: https://issues.apache.org/jira/browse/HIVE-13276 Project: Hive Issue Type: Bug

Re: Error in Hive on Spark

You can probably avoid the problem by set environment variable SPARK_HOME or JVM property spark.home that points to your spark installation. --Xuefu On Thu, Mar 10, 2016 at 3:11 AM, Stana wrote: > I am trying out Hive on Spark with hive 2.0.0 and spark 1.4.1, and >

Re: [ANNOUNCE] New Hive Committer - Wei Zheng

Congratulations, Wei! On Wed, Mar 9, 2016 at 6:48 PM, Chao Sun wrote: > Congratulations! > > On Wed, Mar 9, 2016 at 6:44 PM, Prasanth Jayachandran < > pjayachand...@hortonworks.com> wrote: > > > Congratulations Wei! > > > > On Mar 9, 2016, at 8:43 PM, Sergey Shelukhin

Re: Spark and HBase metastore jiras in 2.0 release

I don't think 2.0 branch has every patch from spark-branch. However, master does. I will take care of spark branch JIrA resolution versions. Thanks, Xuefu On Tue, Feb 16, 2016 at 9:48 PM, Thejas Nair wrote: > The hbase-metastore branch jiras are all part of Hive 2.0.0

Re: [ANNOUNCE] Apache Hive 2.0.0 Released

Congratulation, guys!!! --Xuefu On Tue, Feb 16, 2016 at 11:54 AM, Prasanth Jayachandran < pjayachand...@hortonworks.com> wrote: > Great news! Thanks Sergey for the effort. > > Thanks > Prasanth > > > On Feb 16, 2016, at 1:44 PM, Sergey Shelukhin wrote: > > > > The Apache

Re: Review Request 43176: HIVE-12965: Insert overwrite local directory should perserve the overwritten directory permission

tps://reviews.apache.org/r/43176/#comment180247> qq: So closing the file systems gave the issues seen in the test failures? - Xuefu Zhang On Feb. 11, 2016, 9:54 p.m., Chaoyu Tang wrote: > > --- > This is an automatically g

Re: Review Request 43176: HIVE-12965: Insert overwrite local directory should perserve the overwritten directory permission

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/43176/#review118941 --- Ship it! Ship It! - Xuefu Zhang On Feb. 11, 2016, 9:54 p.m

Re: Review Request 43176: HIVE-12965: Insert overwrite local directory should perserve the overwritten directory permission

p/hive/ql/exec/MoveTask.java (line 160) <https://reviews.apache.org/r/43176/#comment179627> it seems fs didn't get closed in all paths. However, I understand that the problem was there before. - Xuefu Zhang On Feb. 4, 2016, 4:07 a.m., Chaoy

Re: Review Request 43176: HIVE-12965: Insert overwrite local directory should perserve the overwritten directory permission

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/43176/#review118462 --- Ship it! Ship It! - Xuefu Zhang On Feb. 9, 2016, 8:55 p.m

Re: Review Request 43176: HIVE-12965: Insert overwrite local directory should perserve the overwritten directory permission

d of relying on exception handling? See below exmaple when checking the sourcePath. - Xuefu Zhang On Feb. 9, 2016, 6:54 p.m., Chaoyu Tang wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://re

Re: [VOTE] Apache Hive 2.0.0 Release Candidate 2

Some trouble I met: 1. downloaded source and build Hive with -Pdist. 2. try to run Hive CLI and get the following error: Exception in thread "main" java.lang.RuntimeException: Hive metastore database is not initialized. Please use schematool (e.g. ./schematool -initSchema -dbType ...) to create

Re: Review Request 43176: HIVE-12965: Insert overwrite local directory should perserve the overwritten directory permission

s slower. Could we instead remember the original permission and set it to the new directory that we are going to replace? - Xuefu Zhang On Feb. 4, 2016, 4:07 a.m., Chaoyu Tang wrote: > > --- > This is an automatically genera

[jira] [Created] (HIVE-12951) Reduce Spark executor prewarm timeout to 5s

Xuefu Zhang created HIVE-12951: -- Summary: Reduce Spark executor prewarm timeout to 5s Key: HIVE-12951 URL: https://issues.apache.org/jira/browse/HIVE-12951 Project: Hive Issue Type: Bug

Re: January Hive User Group Meeting

For those who cannot attend in person, here is the webex info: https://cloudera.webex.com/meet/xzhang 1-650-479-3208 Call-in toll number (US/Canada) 623 810 662 (access code) Thanks, Xuefu On Wed, Jan 20, 2016 at 9:45 AM, Xuefu Zhang <xzh...@cloudera.com> wrote: > Hi all, > >

Re: January Hive User Group Meeting

Hi all, As a reminder, the meeting will be held tomorrow as scheduled. Please refer to the meetup page[1] for details. Looking forward to meeting you all! Thanks, Xuefu [1] http://www.meetup.com/Hive-User-Group-Meeting/events/227463783/ On Wed, Dec 16, 2015 at 3:38 PM, Xuefu Zhang <

[jira] [Created] (HIVE-12828) Update Spark version to 1.6

Xuefu Zhang created HIVE-12828: -- Summary: Update Spark version to 1.6 Key: HIVE-12828 URL: https://issues.apache.org/jira/browse/HIVE-12828 Project: Hive Issue Type: Task Components

[jira] [Created] (HIVE-12811) Name yarn application name more meaning than just "Hive on Spark"

Xuefu Zhang created HIVE-12811: -- Summary: Name yarn application name more meaning than just "Hive on Spark" Key: HIVE-12811 URL: https://issues.apache.org/jira/browse/HIVE-12811 Pro

Re: Review Request 41582: HIVE-12713: Miscellaneous improvements in driver compile and execute logging

ht be better if we check if debug log is enabled. Same below - Xuefu Zhang On Dec. 20, 2015, 1:05 a.m., Chaoyu Tang wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://re

Re: Review Request 41582: HIVE-12713: Miscellaneous improvements in driver compile and execute logging

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/41582/#review111501 --- Ship it! Ship It! - Xuefu Zhang On Dec. 21, 2015, 3:46 p.m

[jira] [Created] (HIVE-12708) Hive on Spark doesn't work with Kerboresed HBase [Spark Branch]

Xuefu Zhang created HIVE-12708: -- Summary: Hive on Spark doesn't work with Kerboresed HBase [Spark Branch] Key: HIVE-12708 URL: https://issues.apache.org/jira/browse/HIVE-12708 Project: Hive

January Hive User Group Meeting

Dear Hive users and developers, Hive community is considering a user group meeting[1] January 21, 2016 at Cloudera facility in Palo Alto, CA. This will be a great opportunity for vast users and developers to find out what's happening in the community and share each other's experience with Hive.

Re: January Hive User Group Meeting

be understood as given or endorsed by Peridale Technology > Ltd, its subsidiaries or their employees, unless expressly so stated. It is > the responsibility of the recipient to ensure that this email is virus > free, therefore neither Peridale Ltd, its subsidiaries nor their employees &

  1   2   3   4   5   6   7   8   9   10   >