[jira] [Commented] (HIVE-15302) Relax the requirement that HoS needs Spark built w/o Hive

2016-11-29 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15705364#comment-15705364 ] Xuefu Zhang commented on HIVE-15302: This sounds good to me. If we know the minimum se

[jira] [Commented] (HIVE-15272) "LEFT OUTER JOIN" Is not populating correct records with Hive On Spark

2016-11-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703275#comment-15703275 ] Xuefu Zhang commented on HIVE-15272: [~VPareek] would you mind providing a repro case

[jira] [Commented] (HIVE-15168) Flaky test: TestSparkClient.testJobSubmission (still flaky)

2016-11-23 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15691816#comment-15691816 ] Xuefu Zhang commented on HIVE-15168: Agree with Rui that we should just fix the test c

[jira] [Comment Edited] (HIVE-15239) hive on spark combine equivalentwork get wrong result because of tablescan operation compare

2016-11-23 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15691764#comment-15691764 ] Xuefu Zhang edited comment on HIVE-15239 at 11/24/16 12:25 AM: -

[jira] [Commented] (HIVE-15239) hive on spark combine equivalentwork get wrong result because of tablescan operation compare

2016-11-23 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15691764#comment-15691764 ] Xuefu Zhang commented on HIVE-15239: Patch looks good. Two minor comments: 1. The fol

[jira] [Commented] (HIVE-15272) "LEFT OUTER JOIN" Is not populating different records with Hive On Spark

2016-11-23 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15691127#comment-15691127 ] Xuefu Zhang commented on HIVE-15272: Just curious: what's the difference? Is that just

[jira] [Updated] (HIVE-15272) "LEFT OUTER JOIN" Is not populating different records with Hive On Spark

2016-11-23 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-15272: --- Description: Following query is populating different result every time I ran with Hive on Spark: {cod

[jira] [Commented] (HIVE-15237) Propagate Spark job failure to Hive

2016-11-22 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15688835#comment-15688835 ] Xuefu Zhang commented on HIVE-15237: Hi [~lirui], thanks for the patch. It looks good.

[jira] [Commented] (HIVE-15168) Flaky test: TestSparkClient.testJobSubmission (still flaky)

2016-11-21 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15685732#comment-15685732 ] Xuefu Zhang commented on HIVE-15168: There seems to be test failures. > Flaky test: T

[jira] [Commented] (HIVE-15168) Flaky test: TestSparkClient.testJobSubmission (still flaky)

2016-11-21 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15683685#comment-15683685 ] Xuefu Zhang commented on HIVE-15168: Sorry for the delay. I will take a look today. Th

[jira] [Commented] (HIVE-15239) hive on spark combine equivalentwork get wrong result because of tablescan operation compare

2016-11-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15675878#comment-15675878 ] Xuefu Zhang commented on HIVE-15239: cc: [~lirui]. I got a different problem with cdh

[jira] [Commented] (HIVE-15233) UDF UUID() should be non-deterministic

2016-11-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15675871#comment-15675871 ] Xuefu Zhang commented on HIVE-15233: +1 pending on test > UDF UUID() should be non-de

[jira] [Updated] (HIVE-15239) hive on spark combine equivalentwork get wrong result because of tablescan operation compare

2016-11-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-15239: --- Description: env: hive on spark engine reproduce step: {code} create table a1(KEHHAO string, START_DT

[jira] [Commented] (HIVE-15231) query on view with CTE and alias fails with table not found error

2016-11-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15675515#comment-15675515 ] Xuefu Zhang commented on HIVE-15231: +1 from me as well. > query on view with CTE and

[jira] [Commented] (HIVE-15233) UDF UUID() should be non-deterministic

2016-11-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15675425#comment-15675425 ] Xuefu Zhang commented on HIVE-15233: Thanks, Chao!. I wonder if a .q test would help,

[jira] [Updated] (HIVE-15237) Propagate Spark job failure to Hive

2016-11-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-15237: --- Attachment: HIVE-15237.patch Thanks, Rui. For your reference, I attached a POC patch that was based on

[jira] [Commented] (HIVE-15237) Propagate Spark job failure to Hive

2016-11-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15675223#comment-15675223 ] Xuefu Zhang commented on HIVE-15237: fyi: [~lirui] > Propagate Spark job failure to H

[jira] [Commented] (HIVE-15233) UDF UUID() should be non-deterministic

2016-11-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15675003#comment-15675003 ] Xuefu Zhang commented on HIVE-15233: +1. The patch looks simple enough. It would be gr

[jira] [Commented] (HIVE-15208) Query string should be HTML encoded for Web UI

2016-11-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15667957#comment-15667957 ] Xuefu Zhang commented on HIVE-15208: +1 > Query string should be HTML encoded for Web

[jira] [Commented] (HIVE-15209) Set hive.strict.checks.cartesian.product to false by default

2016-11-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15667837#comment-15667837 ] Xuefu Zhang commented on HIVE-15209: I don't think erring out and saying that "Cartesi

[jira] [Commented] (HIVE-15209) Set hive.strict.checks.cartesian.product to false by default

2016-11-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15667776#comment-15667776 ] Xuefu Zhang commented on HIVE-15209: I'm not sure how setting the default value to tru

[jira] [Commented] (HIVE-14162) Allow disabling of long running job on Hive On Spark On YARN

2016-11-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15667609#comment-15667609 ] Xuefu Zhang commented on HIVE-14162: If they are switching engines, I think spark reso

[jira] [Commented] (HIVE-14162) Allow disabling of long running job on Hive On Spark On YARN

2016-11-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15667464#comment-15667464 ] Xuefu Zhang commented on HIVE-14162: Hi [~aihuaxu], I'm not 100% sure if this request

[jira] [Commented] (HIVE-15173) Allow dec as an alias for decimal

2016-11-10 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15654786#comment-15654786 ] Xuefu Zhang commented on HIVE-15173: Patch looks good. The only concern is b/c. I gues

[jira] [Comment Edited] (HIVE-15168) Flaky test: TestSparkClient.testJobSubmission (still flaky)

2016-11-09 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15652357#comment-15652357 ] Xuefu Zhang edited comment on HIVE-15168 at 11/9/16 11:22 PM: --

[jira] [Commented] (HIVE-15168) Flaky test: TestSparkClient.testJobSubmission (still flaky)

2016-11-09 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15652357#comment-15652357 ] Xuefu Zhang commented on HIVE-15168: Could we have a few words describing the problem

[jira] [Commented] (HIVE-15139) HoS local mode fails with NumberFormatException

2016-11-08 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15648078#comment-15648078 ] Xuefu Zhang commented on HIVE-15139: +1. Thanks for fixing this. > HoS local mode fai

[jira] [Commented] (HIVE-15139) HoS local mode fails with NumberFormatException

2016-11-07 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15646367#comment-15646367 ] Xuefu Zhang commented on HIVE-15139: Hi [~lirui], thanks for working on this. The patc

[jira] [Commented] (HIVE-13947) HoS print wrong number for hash table size in map join scenario

2016-11-04 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15637454#comment-15637454 ] Xuefu Zhang commented on HIVE-13947: +1 > HoS print wrong number for hash table size

[jira] [Commented] (HIVE-15104) Hive on Spark generate more shuffle data than hive on mr

2016-11-03 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15634112#comment-15634112 ] Xuefu Zhang commented on HIVE-15104: I checked the source code and it seems that both

[jira] [Commented] (HIVE-15104) Hive on Spark generate more shuffle data than hive on mr

2016-11-03 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15633820#comment-15633820 ] Xuefu Zhang commented on HIVE-15104: [~lirui], thanks for sharing your findings. Can y

[jira] [Commented] (HIVE-15104) Hive on Spark generate more shuffle data than hive on mr

2016-11-02 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15631376#comment-15631376 ] Xuefu Zhang commented on HIVE-15104: This is rather interesting. I know I originally r

[jira] [Assigned] (HIVE-1555) JDBC Storage Handler

2016-11-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-1555: - Assignee: Dmitry Zagorulkin (was: Teddy Choi) Assign to Dmitry who has shown interest in working

[jira] [Commented] (HIVE-14910) Flaky test: TestSparkClient.testJobSubmission

2016-10-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15615727#comment-15615727 ] Xuefu Zhang commented on HIVE-14910: Minor comment on RB. Changes look good to me, but

[jira] [Commented] (HIVE-15039) A better job monitor console output for HoS

2016-10-26 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15609745#comment-15609745 ] Xuefu Zhang commented on HIVE-15039: +1. Thanks for working on this, Rui! > A better

[jira] [Commented] (HIVE-12951) Reduce Spark executor prewarm timeout to 5s

2016-10-26 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15608847#comment-15608847 ] Xuefu Zhang commented on HIVE-12951: Prawarming containers tends to help queries that

[jira] [Commented] (HIVE-12951) Reduce Spark executor prewarm timeout to 5s

2016-10-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15605750#comment-15605750 ] Xuefu Zhang commented on HIVE-12951: Besides more containers that are already active,

[jira] [Commented] (HIVE-15054) Hive insertion query execution fails on Hive on Spark

2016-10-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15605709#comment-15605709 ] Xuefu Zhang commented on HIVE-15054: [~aihuaxu] thanks for looking at this. [~lirui]/

[jira] [Commented] (HIVE-15026) Option to not merge the views

2016-10-20 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15592677#comment-15592677 ] Xuefu Zhang commented on HIVE-15026: In general, Hive "expands" view/cte in the logica

[jira] [Commented] (HIVE-14797) reducer number estimating may lead to data skew

2016-10-20 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15592184#comment-15592184 ] Xuefu Zhang commented on HIVE-14797: That sounds good enough to me. > reducer number

[jira] [Commented] (HIVE-14797) reducer number estimating may lead to data skew

2016-10-19 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15590047#comment-15590047 ] Xuefu Zhang commented on HIVE-14797: I guess my point is that the chance for a user to

[jira] [Commented] (HIVE-14999) SparkClientUtilities does not support viewFS

2016-10-19 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15590021#comment-15590021 ] Xuefu Zhang commented on HIVE-14999: +1 > SparkClientUtilities does not support viewF

[jira] [Commented] (HIVE-13423) Handle the overflow case for decimal datatype for sum()

2016-10-19 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15589285#comment-15589285 ] Xuefu Zhang commented on HIVE-13423: +1 > Handle the overflow case for decimal dataty

[jira] [Commented] (HIVE-13423) Handle the overflow case for decimal datatype for sum()

2016-10-19 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15589243#comment-15589243 ] Xuefu Zhang commented on HIVE-13423: This sounds good to me. I'd +1 on this unless [~c

[jira] [Commented] (HIVE-13423) Handle the overflow case for decimal datatype for sum()

2016-10-19 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15589241#comment-15589241 ] Xuefu Zhang commented on HIVE-13423: This sounds good to me. I'd +1 on this unless [~c

[jira] [Commented] (HIVE-14797) reducer number estimating may lead to data skew

2016-10-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15587229#comment-15587229 ] Xuefu Zhang commented on HIVE-14797: [~lirui] Choosing a different seed for determinin

[jira] [Commented] (HIVE-14029) Update Spark version to 2.0.0

2016-10-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15583487#comment-15583487 ] Xuefu Zhang commented on HIVE-14029: Spark claims API compatibility within a major rel

[jira] [Commented] (HIVE-14029) Update Spark version to 2.0.0

2016-10-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15583356#comment-15583356 ] Xuefu Zhang commented on HIVE-14029: [~spena], Keeping b/c is a good thing in general.

[jira] [Commented] (HIVE-13423) Handle the overflow case for decimal datatype for sum()

2016-10-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15583055#comment-15583055 ] Xuefu Zhang commented on HIVE-13423: [~ctang.ma]/[~aihuaxu], as to sacrificing scale f

[jira] [Commented] (HIVE-13423) Handle the overflow case for decimal datatype for sum()

2016-10-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15582931#comment-15582931 ] Xuefu Zhang commented on HIVE-13423: [~aihuaxu], thanks for looking into this. Do we k

[jira] [Commented] (HIVE-12551) Fix several kryo exceptions in branch-1

2016-10-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15566603#comment-15566603 ] Xuefu Zhang commented on HIVE-12551: Hi [~prasanth_j], thanks for your information. Ye

[jira] [Commented] (HIVE-14928) Analyze table no scan mess up schema

2016-10-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15566116#comment-15566116 ] Xuefu Zhang commented on HIVE-14928: cc: [~sershe], [~prasanth_j], Wondering if there

[jira] [Commented] (HIVE-12551) Fix several kryo exceptions in branch-1

2016-10-10 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15564254#comment-15564254 ] Xuefu Zhang commented on HIVE-12551: It seems that this patch also breaks Hive on Spar

[jira] [Commented] (HIVE-14797) reducer number estimating may lead to data skew

2016-10-09 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15561154#comment-15561154 ] Xuefu Zhang commented on HIVE-14797: +1 > reducer number estimating may lead to data

[jira] [Commented] (HIVE-14888) SparkClientImpl checks for "kerberos" string in hiveconf only when determining whether to use keytab file.

2016-10-04 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15546613#comment-15546613 ] Xuefu Zhang commented on HIVE-14888: Is this the same as HIVE-14359, which is resolved

[jira] [Commented] (HIVE-14885) Support PPD for nested columns

2016-10-04 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15545992#comment-15545992 ] Xuefu Zhang commented on HIVE-14885: cc: [~zshao], [~Ferd], [~spena] > Support PPD fo

[jira] [Commented] (HIVE-14858) Analyze command should support custom input formats

2016-09-29 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15533929#comment-15533929 ] Xuefu Zhang commented on HIVE-14858: +1 > Analyze command should support custom input

[jira] [Commented] (HIVE-14847) HiveServer2: Implement some admission control mechanism for graceful degradation when resources are exhausted

2016-09-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15530125#comment-15530125 ] Xuefu Zhang commented on HIVE-14847: With HIVE-9423, I'm not sure what else we need to

[jira] [Commented] (HIVE-12222) Define port range in property for RPCServer

2016-09-27 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15526582#comment-15526582 ] Xuefu Zhang commented on HIVE-1: +1 > Define port range in property for RPCServer

[jira] [Commented] (HIVE-14029) Update Spark version to 2.0.0

2016-09-23 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15516900#comment-15516900 ] Xuefu Zhang commented on HIVE-14029: Hi [~lirui], Thanks for the investigation. I'm wo

[jira] [Commented] (HIVE-12222) Define port range in property for RPCServer

2016-09-22 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514485#comment-15514485 ] Xuefu Zhang commented on HIVE-1: HI [~aihuaxu], thanks for working on this. The pa

[jira] [Commented] (HIVE-14029) Update Spark version to 2.0.0

2016-09-22 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15513528#comment-15513528 ] Xuefu Zhang commented on HIVE-14029: +1 on identifying the minimum set. > Update Spar

[jira] [Commented] (HIVE-9423) HiveServer2: Implement some admission control mechanism for graceful degradation when resources are exhausted

2016-09-22 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15513552#comment-15513552 ] Xuefu Zhang commented on HIVE-9423: --- Could we update the JIRA title to reflect what the p

[jira] [Commented] (HIVE-14412) Add a timezone-aware timestamp

2016-09-21 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15512148#comment-15512148 ] Xuefu Zhang commented on HIVE-14412: +1 > Add a timezone-aware timestamp > --

[jira] [Commented] (HIVE-14412) Add a timezone-aware timestamp

2016-09-21 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15511974#comment-15511974 ] Xuefu Zhang commented on HIVE-14412: [~lirui], I have a couple of minor comment on RB.

[jira] [Commented] (HIVE-14029) Update Spark version to 2.0.0

2016-09-21 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15511577#comment-15511577 ] Xuefu Zhang commented on HIVE-14029: I made a build of spark 2.0 and indeed spark-asse

[jira] [Commented] (HIVE-14029) Update Spark version to 2.0.0

2016-09-21 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15511533#comment-15511533 ] Xuefu Zhang commented on HIVE-14029: Hi guys, thanks for working/reviewing this. The p

[jira] [Commented] (HIVE-14797) reducer number estimating may lead to data skew

2016-09-21 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15510378#comment-15510378 ] Xuefu Zhang commented on HIVE-14797: The new change seems good. Minor nit: can we chan

[jira] [Commented] (HIVE-14797) reducer number estimating may lead to data skew

2016-09-20 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15506967#comment-15506967 ] Xuefu Zhang commented on HIVE-14797: This seems making sense, but can we not hard code

[jira] [Commented] (HIVE-14714) Finishing Hive on Spark causes "java.io.IOException: Stream closed"

2016-09-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15493696#comment-15493696 ] Xuefu Zhang commented on HIVE-14714: I'm not sure if this is obvious from the code cha

[jira] [Commented] (HIVE-13873) Column pruning for nested fields

2016-09-14 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15490828#comment-15490828 ] Xuefu Zhang commented on HIVE-13873: Hi [~Ferd], would you like to move this forward?

[jira] [Comment Edited] (HIVE-14412) Add a timezone-aware timestamp

2016-09-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15488427#comment-15488427 ] Xuefu Zhang edited comment on HIVE-14412 at 9/13/16 9:29 PM: -

[jira] [Commented] (HIVE-14412) Add a timezone-aware timestamp

2016-09-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15488427#comment-15488427 ] Xuefu Zhang commented on HIVE-14412: I think the standard type name is TIMESTAMP WITH

[jira] [Commented] (HIVE-14412) Add a timezone-aware timestamp

2016-09-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485772#comment-15485772 ] Xuefu Zhang commented on HIVE-14412: Hi [~lirui], thanks for working on this. It may t

[jira] [Commented] (HIVE-14738) Not implicit cast from float to double in round function.

2016-09-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485314#comment-15485314 ] Xuefu Zhang commented on HIVE-14738: [~dscarlat], could you provide example on how rou

[jira] [Commented] (HIVE-14718) spark download is not ignored to a sufficient degree

2016-09-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485126#comment-15485126 ] Xuefu Zhang commented on HIVE-14718: Can we get some clarification on the problem? I u

[jira] [Commented] (HIVE-14568) Hive Decimal Returns NULL

2016-08-31 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15453811#comment-15453811 ] Xuefu Zhang commented on HIVE-14568: I think this is mostly by design. You have two co

[jira] [Commented] (HIVE-14661) Hive should extract deterministic conditions from where clause and use them for partition pruning

2016-08-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15444741#comment-15444741 ] Xuefu Zhang commented on HIVE-14661: cc: [~csun] > Hive should extract deterministic

[jira] [Resolved] (HIVE-14617) NPE in UDF MapValues() if input is null

2016-08-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-14617. Resolution: Fixed Fix Version/s: 2.2.0 Committed latest patch to master. Thanks to Chao for t

[jira] [Comment Edited] (HIVE-14617) NPE in UDF MapValues() if input is null

2016-08-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15436864#comment-15436864 ] Xuefu Zhang edited comment on HIVE-14617 at 8/25/16 1:34 PM: -

[jira] [Updated] (HIVE-14617) NPE in UDF MapValues() if input is null

2016-08-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-14617: --- Status: Open (was: Patch Available) > NPE in UDF MapValues() if input is null > -

[jira] [Updated] (HIVE-14617) NPE in UDF MapValues() if input is null

2016-08-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-14617: --- Attachment: HIVE-14617.1.patch Patch #1 fixes code style only. I'm not submitting this patch to avoid

[jira] [Commented] (HIVE-14398) import database.tablename from path error

2016-08-24 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15436127#comment-15436127 ] Xuefu Zhang commented on HIVE-14398: I closed this as "not reproducible". > import da

[jira] [Updated] (HIVE-14398) import database.tablename from path error

2016-08-24 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-14398: --- Resolution: Cannot Reproduce Status: Resolved (was: Patch Available) > import database.tablen

[jira] [Commented] (HIVE-14617) NPE in UDF MapValues() if input is null

2016-08-24 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15436117#comment-15436117 ] Xuefu Zhang commented on HIVE-14617: Thanks for the review, Chao. I will take care of

[jira] [Updated] (HIVE-14617) NPE in UDF MapValues() if input is null

2016-08-24 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-14617: --- Status: Patch Available (was: Open) > NPE in UDF MapValues() if input is null > -

[jira] [Updated] (HIVE-14617) NPE in UDF MapValues() if input is null

2016-08-24 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-14617: --- Attachment: HIVE-14617.patch > NPE in UDF MapValues() if input is null > -

[jira] [Updated] (HIVE-14617) NPE in UDF MapValues() if input is null

2016-08-24 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-14617: --- Description: For query {code} select exploded_traits from hdrone.vehiclestore_udr_vehicle lateral vie

[jira] [Commented] (HIVE-14398) import database.tablename from path error

2016-08-22 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15430749#comment-15430749 ] Xuefu Zhang commented on HIVE-14398: [~chenyechao], Thanks for reporting and fix the p

[jira] [Commented] (HIVE-14595) TimestampWritable::setTimestamp gives wrong result when 2nd VInt exists

2016-08-22 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15430743#comment-15430743 ] Xuefu Zhang commented on HIVE-14595: +1 for v2 also. Thanks for the fix. To clarify,

[jira] [Commented] (HIVE-14595) TimestampWritable::setTimestamp gives wrong result when 2nd VInt exists

2016-08-21 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15430071#comment-15430071 ] Xuefu Zhang commented on HIVE-14595: +1 > TimestampWritable::setTimestamp gives wrong

[jira] [Commented] (HIVE-14580) Introduce || operator

2016-08-21 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15429908#comment-15429908 ] Xuefu Zhang commented on HIVE-14580: I thought Hive uses || as OR, and if so, wouldn't

[jira] [Commented] (HIVE-14412) Add a timezone-aware timestamp

2016-08-16 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15423172#comment-15423172 ] Xuefu Zhang commented on HIVE-14412: Adding a new field might be okay, as long as the

[jira] [Commented] (HIVE-14412) Add a timezone-aware timestamp

2016-08-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15421358#comment-15421358 ] Xuefu Zhang commented on HIVE-14412: [~lirui], your proposal looks good to me, especia

[jira] [Updated] (HIVE-14340) Add a new hook triggers before query compilation and after query execution

2016-08-02 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-14340: --- Labels: TODOC2.2 (was: ) > Add a new hook triggers before query compilation and after query execution

[jira] [Commented] (HIVE-14340) Add a new hook triggers before query compilation and after query execution

2016-08-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15402804#comment-15402804 ] Xuefu Zhang commented on HIVE-14340: Patch looks good to me. +1 > Add a new hook trig

[jira] [Commented] (HIVE-14343) HiveDriverRunHookContext's command is null in HS2 mode

2016-08-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15402728#comment-15402728 ] Xuefu Zhang commented on HIVE-14343: +1 > HiveDriverRunHookContext's command is null

[jira] [Commented] (HIVE-14383) SparkClientImpl should pass principal and keytab to spark-submit instead of calling kinit explicitely

2016-07-29 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15399826#comment-15399826 ] Xuefu Zhang commented on HIVE-14383: I think the old version of Spark doesn't do kinit

[jira] [Commented] (HIVE-14303) CommonJoinOperator.checkAndGenObject should return directly at CLOSE state to avoid NPE if ExecReducer.close is called twice.

2016-07-27 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15396871#comment-15396871 ] Xuefu Zhang commented on HIVE-14303: Ok. Thanks for the explanation. +1 > CommonJoinO

[jira] [Commented] (HIVE-14359) Hive on Spark might fail in HS2 with LDAP authentication in a kerberized cluster

2016-07-27 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15395903#comment-15395903 ] Xuefu Zhang commented on HIVE-14359: +1 > Hive on Spark might fail in HS2 with LDAP a

<    1   2   3   4   5   6   7   8   9   10   >