[jira] [Updated] (HIVE-12205) Spark: unify spark statististics aggregation between local and remote spark client

2016-02-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-12205: --- Fix Version/s: 2.1.0 > Spark: unify spark statististics aggregation between local and remote spark >

[jira] [Commented] (HIVE-12205) Spark: unify spark statististics aggregation between local and remote spark client

2016-02-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15150575#comment-15150575 ] Xuefu Zhang commented on HIVE-12205: Also cherry-picked to master. Thanks, guys! > Sp

[jira] [Updated] (HIVE-12205) Spark: unify spark statististics aggregation between local and remote spark client

2016-02-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-12205: --- Fix Version/s: spark-branch > Spark: unify spark statististics aggregation between local and remote sp

[jira] [Commented] (HIVE-12965) Insert overwrite local directory should perserve the overwritten directory permission

2016-02-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143619#comment-15143619 ] Xuefu Zhang commented on HIVE-12965: +1. Thanks for fixing the tests. > Insert overwr

[jira] [Commented] (HIVE-11866) Add framework to enable testing using LDAPServer using LDAP protocol

2016-02-10 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15141921#comment-15141921 ] Xuefu Zhang commented on HIVE-11866: +1 latest patch looks good to me. > Add framewor

[jira] [Commented] (HIVE-12965) Insert overwrite local directory should perserve the overwritten directory permission

2016-02-09 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15139743#comment-15139743 ] Xuefu Zhang commented on HIVE-12965: +1 > Insert overwrite local directory should per

[jira] [Commented] (HIVE-12965) Insert overwrite local directory should perserve the overwritten directory permission

2016-02-09 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15139111#comment-15139111 ] Xuefu Zhang commented on HIVE-12965: Patch looks good. Some minor comments on RB. If y

[jira] [Comment Edited] (HIVE-10115) HS2 running on a Kerberized cluster should offer Kerberos(GSSAPI) and Delegation token(DIGEST) when alternate authentication is enabled

2016-02-05 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15134866#comment-15134866 ] Xuefu Zhang edited comment on HIVE-10115 at 2/5/16 8:02 PM: It

[jira] [Commented] (HIVE-10115) HS2 running on a Kerberized cluster should offer Kerberos(GSSAPI) and Delegation token(DIGEST) when alternate authentication is enabled

2016-02-05 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15134866#comment-15134866 ] Xuefu Zhang commented on HIVE-10115: It doesn't seem the spark failures are related to

[jira] [Commented] (HIVE-12984) spark tgz-s need to be deleted on mvn clean, as are other binary artifacts in the tree

2016-02-04 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15132423#comment-15132423 ] Xuefu Zhang commented on HIVE-12984: I'm well open to that. However, there isn't such

[jira] [Commented] (HIVE-12650) Increase default value of hive.spark.client.server.connect.timeout to exceeds spark.yarn.am.waitTime

2016-02-02 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15129761#comment-15129761 ] Xuefu Zhang commented on HIVE-12650: I see. I think that's what the [~joyoungzh...@gma

[jira] [Commented] (HIVE-12650) Increase default value of hive.spark.client.server.connect.timeout to exceeds spark.yarn.am.waitTime

2016-02-02 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15129655#comment-15129655 ] Xuefu Zhang commented on HIVE-12650: Hi [~lirui], thanks for the info. It's good that

[jira] [Commented] (HIVE-12650) Increase default value of hive.spark.client.server.connect.timeout to exceeds spark.yarn.am.waitTime

2016-02-02 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15129392#comment-15129392 ] Xuefu Zhang commented on HIVE-12650: Thanks, [~vanzin]. If there is no timeout in spa

[jira] [Commented] (HIVE-12984) spark tgz-s need to be deleted on mvn clean, as are other binary artifacts in the tree

2016-02-02 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15129012#comment-15129012 ] Xuefu Zhang commented on HIVE-12984: [~sershe], that would be indeed a pain for develo

[jira] [Commented] (HIVE-12650) Increase default value of hive.spark.client.server.connect.timeout to exceeds spark.yarn.am.waitTime

2016-02-02 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128949#comment-15128949 ] Xuefu Zhang commented on HIVE-12650: Thanks, [~vanzin]. I guess the question is the di

[jira] [Commented] (HIVE-12650) Increase default value of hive.spark.client.server.connect.timeout to exceeds spark.yarn.am.waitTime

2016-02-02 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128361#comment-15128361 ] Xuefu Zhang commented on HIVE-12650: [~lirui], thanks for your analysis. Yeah, I saw t

[jira] [Updated] (HIVE-12951) Reduce Spark executor prewarm timeout to 5s

2016-02-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-12951: --- Attachment: HIVE-12951.patch > Reduce Spark executor prewarm timeout to 5s > -

[jira] [Commented] (HIVE-12650) Increase default value of hive.spark.client.server.connect.timeout to exceeds spark.yarn.am.waitTime

2016-02-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127564#comment-15127564 ] Xuefu Zhang commented on HIVE-12650: I'm specially interested in case where Hive calls

[jira] [Commented] (HIVE-12650) Increase default value of hive.spark.client.server.connect.timeout to exceeds spark.yarn.am.waitTime

2016-02-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127507#comment-15127507 ] Xuefu Zhang commented on HIVE-12650: Here is the log that provided the the JIRA creato

[jira] [Commented] (HIVE-12650) Increase default value of hive.spark.client.server.connect.timeout to exceeds spark.yarn.am.waitTime

2016-02-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15126866#comment-15126866 ] Xuefu Zhang commented on HIVE-12650: Thanks for the clarification, [~vanzin]. I agree

[jira] [Commented] (HIVE-12650) Increase default value of hive.spark.client.server.connect.timeout to exceeds spark.yarn.am.waitTime

2016-02-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15126293#comment-15126293 ] Xuefu Zhang commented on HIVE-12650: Hi [~lirui], since application master in the cont

[jira] [Commented] (HIVE-12880) spark-assembly causes Hive class version problems

2016-01-29 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124529#comment-15124529 ] Xuefu Zhang commented on HIVE-12880: +1. Let's see if it has any impact on tests. > s

[jira] [Commented] (HIVE-12940) Cherry pick spark branch to master

2016-01-27 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120839#comment-15120839 ] Xuefu Zhang commented on HIVE-12940: Yes, let's cherry-pick the commits one by one. Th

[jira] [Commented] (HIVE-12951) Reduce Spark executor prewarm timeout to 5s

2016-01-27 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120769#comment-15120769 ] Xuefu Zhang commented on HIVE-12951: Hi [~lirui], that's an interesting idea. I can se

[jira] [Commented] (HIVE-12951) Reduce Spark executor prewarm timeout to 5s

2016-01-27 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120609#comment-15120609 ] Xuefu Zhang commented on HIVE-12951: Hi [~lirui], thanks for the information. Yes, the

[jira] [Commented] (HIVE-12880) spark-assembly causes Hive class version problems

2016-01-27 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120594#comment-15120594 ] Xuefu Zhang commented on HIVE-12880: Hi [~sershe], maybe I wasn't clear enough, but I

[jira] [Updated] (HIVE-12951) Reduce Spark executor prewarm timeout to 5s

2016-01-27 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-12951: --- Attachment: HIVE-12951.patch cc: [~lirui] > Reduce Spark executor prewarm timeout to 5s > ---

[jira] [Commented] (HIVE-12727) refactor Hive strict checks to be more granular, allow order by no limit and no partition filter by default for now

2016-01-27 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120252#comment-15120252 ] Xuefu Zhang commented on HIVE-12727: Yeah. looks good to me. > refactor Hive strict c

[jira] [Commented] (HIVE-12777) Add capability to restore session in CLIService and SessionManager

2016-01-27 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15119335#comment-15119335 ] Xuefu Zhang commented on HIVE-12777: This is fine if all you want is to create a sessi

[jira] [Commented] (HIVE-12940) Cherry pick spark branch to master

2016-01-27 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15119304#comment-15119304 ] Xuefu Zhang commented on HIVE-12940: +1 pending on tests. Thanks for working on this,

[jira] [Commented] (HIVE-12727) refactor Hive strict checks to be more granular, allow order by no limit and no partition filter by default for now

2016-01-26 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15117755#comment-15117755 ] Xuefu Zhang commented on HIVE-12727: That sounds more reasonable. Quick observation: t

[jira] [Commented] (HIVE-12727) refactor Hive strict checks to be more granular, allow order by no limit and no partition filter by default for now

2016-01-24 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15114354#comment-15114354 ] Xuefu Zhang commented on HIVE-12727: Other than granular control over checks, is "hive

[jira] [Commented] (HIVE-12777) Add capability to restore session in CLIService and SessionManager

2016-01-24 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15114338#comment-15114338 ] Xuefu Zhang commented on HIVE-12777: Thanks for the explanation. Hive session has a la

[jira] [Comment Edited] (HIVE-12880) spark-assembly causes Hive class version problems

2016-01-22 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15113455#comment-15113455 ] Xuefu Zhang edited comment on HIVE-12880 at 1/23/16 4:14 AM: -

[jira] [Commented] (HIVE-12880) spark-assembly causes Hive class version problems

2016-01-22 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15113455#comment-15113455 ] Xuefu Zhang commented on HIVE-12880: [~sershe], thanks for working on this. Since the

[jira] [Issue Comment Deleted] (HIVE-12880) spark-assembly causes Hive class version problems

2016-01-22 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-12880: --- Comment: was deleted (was: [~sershe], thanks for working on this. I think the logic of copying spark-

[jira] [Commented] (HIVE-12880) spark-assembly causes Hive class version problems

2016-01-22 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15113445#comment-15113445 ] Xuefu Zhang commented on HIVE-12880: [~sershe], thanks for working on this. I think th

[jira] [Commented] (HIVE-12777) Add capability to restore session

2016-01-21 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15110981#comment-15110981 ] Xuefu Zhang commented on HIVE-12777: Could we have description of what the feature is

[jira] [Commented] (HIVE-12727) allow full table queries in strict mode

2016-01-20 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15109987#comment-15109987 ] Xuefu Zhang commented on HIVE-12727: I think it makes sense for us to have an agreemen

[jira] [Commented] (HIVE-12888) TestSparkNegativeCliDriver does not run in Spark mode[Spark Branch]

2016-01-20 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15108588#comment-15108588 ] Xuefu Zhang commented on HIVE-12888: +1 > TestSparkNegativeCliDriver does not run in

[jira] [Commented] (HIVE-12736) It seems that result of Hive on Spark be mistaken and result of Hive and Hive on Spark are not the same

2016-01-19 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15108052#comment-15108052 ] Xuefu Zhang commented on HIVE-12736: I also tried memcheck.q, and it passed locally fo

[jira] [Commented] (HIVE-12880) spark-assembly causes Hive class version problems

2016-01-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106155#comment-15106155 ] Xuefu Zhang commented on HIVE-12880: agreed that letting the script find the jar and a

[jira] [Commented] (HIVE-12736) It seems that result of Hive on Spark be mistaken and result of Hive and Hive on Spark are not the same

2016-01-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105449#comment-15105449 ] Xuefu Zhang commented on HIVE-12736: Hi [~chengxiang li], thanks for the explanation.

[jira] [Commented] (HIVE-9774) Print yarn application id to console [Spark Branch]

2016-01-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105421#comment-15105421 ] Xuefu Zhang commented on HIVE-9774: --- +1 > Print yarn application id to console [Spark Br

[jira] [Commented] (HIVE-12777) Add capability to restore session

2016-01-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15104171#comment-15104171 ] Xuefu Zhang commented on HIVE-12777: Sorry but I still don't understand what functiona

[jira] [Commented] (HIVE-12736) It seems that result of Hive on Spark be mistaken and result of Hive and Hive on Spark are not the same

2016-01-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15104138#comment-15104138 ] Xuefu Zhang commented on HIVE-12736: Hi [~chengxiang li], Sorry for being late in revi

[jira] [Updated] (HIVE-12736) It seems that result of Hive on Spark be mistaken and result of Hive and Hive on Spark are not the same

2016-01-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-12736: --- Description: {code} select * from staff; 1 jone22 1 2 lucy21 1 3

[jira] [Commented] (HIVE-12611) Make sure spark.yarn.queue is effective and takes the value from mapreduce.job.queuename if given [Spark Branch]

2016-01-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15102946#comment-15102946 ] Xuefu Zhang commented on HIVE-12611: It also looks like the problem with parquet was f

[jira] [Comment Edited] (HIVE-9774) Print yarn application id to console [Spark Branch]

2016-01-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15102652#comment-15102652 ] Xuefu Zhang edited comment on HIVE-9774 at 1/15/16 11:07 PM: - [

[jira] [Commented] (HIVE-9774) Print yarn application id to console [Spark Branch]

2016-01-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15102652#comment-15102652 ] Xuefu Zhang commented on HIVE-9774: --- [~lirui], could you take a look at this to see if th

[jira] [Commented] (HIVE-12880) spark-assembly causes Hive class version problems

2016-01-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15102500#comment-15102500 ] Xuefu Zhang commented on HIVE-12880: I just checked my spark-assembly.jar, and it does

[jira] [Commented] (HIVE-12611) Make sure spark.yarn.queue is effective and takes the value from mapreduce.job.queuename if given [Spark Branch]

2016-01-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15101852#comment-15101852 ] Xuefu Zhang commented on HIVE-12611: +1 > Make sure spark.yarn.queue is effective and

[jira] [Commented] (HIVE-12828) Update Spark version to 1.6

2016-01-14 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15101220#comment-15101220 ] Xuefu Zhang commented on HIVE-12828: I think we are okay. Please feel free to commit t

[jira] [Commented] (HIVE-12828) Update Spark version to 1.6

2016-01-14 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15101183#comment-15101183 ] Xuefu Zhang commented on HIVE-12828: +1 > Update Spark version to 1.6 > -

[jira] [Commented] (HIVE-12828) Update Spark version to 1.6

2016-01-14 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15101152#comment-15101152 ] Xuefu Zhang commented on HIVE-12828: I'm not sure if the test cleanup /thirdparty dir.

[jira] [Updated] (HIVE-12828) Update Spark version to 1.6

2016-01-14 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-12828: --- Attachment: HIVE-12828.2-spark.patch > Update Spark version to 1.6 > --- > >

[jira] [Updated] (HIVE-12828) Update Spark version to 1.6

2016-01-14 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-12828: --- Attachment: HIVE-12828.2-spark.patch Hi [~lirui], the file is updated and I verified that the test pas

[jira] [Commented] (HIVE-12828) Update Spark version to 1.6

2016-01-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097618#comment-15097618 ] Xuefu Zhang commented on HIVE-12828: Hi [~lirui], it seems that cloudfront still has t

[jira] [Commented] (HIVE-12828) Update Spark version to 1.6

2016-01-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097583#comment-15097583 ] Xuefu Zhang commented on HIVE-12828: [~lirui], I used this command to generate the tar

[jira] [Commented] (HIVE-12777) Add capability to restore session

2016-01-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097569#comment-15097569 ] Xuefu Zhang commented on HIVE-12777: Could we have more description on what we are try

[jira] [Commented] (HIVE-12783) fix the unit test failures in TestSparkClient and TestSparkSessionManagerImpl

2016-01-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097559#comment-15097559 ] Xuefu Zhang commented on HIVE-12783: +1 to patch #3 also. > fix the unit test failure

[jira] [Commented] (HIVE-12828) Update Spark version to 1.6

2016-01-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095181#comment-15095181 ] Xuefu Zhang commented on HIVE-12828: Okay. I forgot about it. The tarball is updated w

[jira] [Commented] (HIVE-12811) Name yarn application name more meaning than just "Hive on Spark"

2016-01-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15094348#comment-15094348 ] Xuefu Zhang commented on HIVE-12811: +1 > Name yarn application name more meaning tha

[jira] [Commented] (HIVE-12828) Update Spark version to 1.6

2016-01-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15093957#comment-15093957 ] Xuefu Zhang commented on HIVE-12828: Yeah, I didn't enable that profile as I had never

[jira] [Commented] (HIVE-12811) Name yarn application name more meaning than just "Hive on Spark"

2016-01-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15093183#comment-15093183 ] Xuefu Zhang commented on HIVE-12811: It might be a valid case, but now let's not do th

[jira] [Updated] (HIVE-12828) Update Spark version to 1.6

2016-01-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-12828: --- Attachment: mem.patch Hi [~lirui], I believe that these failures were caused by the new Spark version

[jira] [Commented] (HIVE-12828) Update Spark version to 1.6

2016-01-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15092560#comment-15092560 ] Xuefu Zhang commented on HIVE-12828: Thanks for working on this, [~lirui]! The spark t

[jira] [Commented] (HIVE-12783) fix the unit test failures in TestSparkClient and TestSparkSessionManagerImpl

2016-01-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15092294#comment-15092294 ] Xuefu Zhang commented on HIVE-12783: +1. Thanks for the explanation and fix. > fix th

[jira] [Commented] (HIVE-11485) Session close should not close async SQL operations

2016-01-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15092011#comment-15092011 ] Xuefu Zhang commented on HIVE-11485: Users may not have any idea of asyc execution, su

[jira] [Commented] (HIVE-12811) Name yarn application name more meaning than just "Hive on Spark"

2016-01-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15091961#comment-15091961 ] Xuefu Zhang commented on HIVE-12811: [~lirui], good point. I guess query string is out

[jira] [Commented] (HIVE-12783) fix the unit test failures in TestSparkClient and TestSparkSessionManagerImpl

2016-01-09 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090659#comment-15090659 ] Xuefu Zhang commented on HIVE-12783: Patch looks good. Just one thing I'm not sure of

[jira] [Commented] (HIVE-12828) Update Spark version to 1.6

2016-01-09 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090652#comment-15090652 ] Xuefu Zhang commented on HIVE-12828: cc: [~lirui] > Update Spark version to 1.6 > ---

[jira] [Commented] (HIVE-12784) Group by SemanticException: Invalid column reference

2016-01-08 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089530#comment-15089530 ] Xuefu Zhang commented on HIVE-12784: +1 > Group by SemanticException: Invalid column

[jira] [Commented] (HIVE-12611) Make sure spark.yarn.queue is effective and takes the value from mapreduce.job.queuename if given [Spark Branch]

2016-01-08 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089295#comment-15089295 ] Xuefu Zhang commented on HIVE-12611: [~lirui], would you like to take a look at this o

[jira] [Commented] (HIVE-12811) Name yarn application name more meaning than just "Hive on Spark"

2016-01-08 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089292#comment-15089292 ] Xuefu Zhang commented on HIVE-12811: [~lirui], would you like to help on this one? Tha

[jira] [Commented] (HIVE-12783) fix the unit test failures in TestSparkClient and TestSparkSessionManagerImpl

2016-01-07 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15088126#comment-15088126 ] Xuefu Zhang commented on HIVE-12783: Awesome. It seems having fixed TestSparkClient fo

[jira] [Commented] (HIVE-12783) fix the unit test failures in TestSparkClient and TestSparkSessionManagerImpl

2016-01-07 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15088117#comment-15088117 ] Xuefu Zhang commented on HIVE-12783: I think the problem is not about project dependen

[jira] [Commented] (HIVE-11890) Create ORC module

2016-01-07 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15087581#comment-15087581 ] Xuefu Zhang commented on HIVE-11890: {quote} The Spark tests and qfile tests were fail

[jira] [Commented] (HIVE-12783) fix the unit test failures in TestSparkClient and TestSparkSessionManagerImpl

2016-01-07 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15087570#comment-15087570 ] Xuefu Zhang commented on HIVE-12783: The failure seems being caused by HIVE-11890. The

[jira] [Commented] (HIVE-12783) fix the unit test failures in TestSparkClient and TestSparkSessionManagerImpl

2016-01-06 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15086444#comment-15086444 ] Xuefu Zhang commented on HIVE-12783: Actually this seems to be real problem and timeou

[jira] [Commented] (HIVE-12569) Excessive console message from SparkClientImpl [Spark Branch]

2016-01-06 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15086099#comment-15086099 ] Xuefu Zhang commented on HIVE-12569: I have just downgraded it. > Excessive console m

[jira] [Updated] (HIVE-12569) Excessive console message from SparkClientImpl [Spark Branch]

2016-01-06 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-12569: --- Priority: Major (was: Blocker) > Excessive console message from SparkClientImpl [Spark Branch] >

[jira] [Commented] (HIVE-11485) Session close should not close async SQL operations

2016-01-06 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15085829#comment-15085829 ] Xuefu Zhang commented on HIVE-11485: It's unclear to me why we would consider asynchro

[jira] [Commented] (HIVE-12772) Beeline/JDBC output of decimal values is not 0-padded, does not match with CLI output

2016-01-05 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083930#comment-15083930 ] Xuefu Zhang commented on HIVE-12772: +1. it looks good. Thanks for the fixing this. >

[jira] [Commented] (HIVE-12772) Beeline/JDBC output of decimal values is not 0-padded, does not match with CLI output

2016-01-05 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083579#comment-15083579 ] Xuefu Zhang commented on HIVE-12772: +1 > Beeline/JDBC output of decimal values is no

[jira] [Commented] (HIVE-12772) Beeline/JDBC output of decimal values is not 0-padded, does not match with CLI output

2016-01-04 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15081922#comment-15081922 ] Xuefu Zhang commented on HIVE-12772: Yeah. The problem of enforcing the scale alignmen

[jira] [Commented] (HIVE-12772) Beeline/JDBC output of decimal values is not 0-padded, does not match with CLI output

2016-01-04 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15081799#comment-15081799 ] Xuefu Zhang commented on HIVE-12772: Hi [~jdere], thanks for reporting and fixing the

[jira] [Commented] (HIVE-12736) It seems that result of Hive on Spark is mistake And result of Hive and Hive on Spark are not the same

2015-12-22 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15069049#comment-15069049 ] Xuefu Zhang commented on HIVE-12736: cc: [~chengxiang li] > It seems that result of H

[jira] [Commented] (HIVE-12733) UX improvements for HIVE-12499

2015-12-22 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15068954#comment-15068954 ] Xuefu Zhang commented on HIVE-12733: +1 > UX improvements for HIVE-12499 > --

[jira] [Commented] (HIVE-12727) allow full table queries in strict mode

2015-12-22 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15068952#comment-15068952 ] Xuefu Zhang commented on HIVE-12727: I concur that it doesn't seem very pleasing to ha

[jira] [Commented] (HIVE-12713) Miscellaneous improvements in driver compile and execute logging

2015-12-21 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15066720#comment-15066720 ] Xuefu Zhang commented on HIVE-12713: +1 > Miscellaneous improvements in driver compil

[jira] [Commented] (HIVE-12713) Miscellaneous improvements in driver compile and execute logging

2015-12-21 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15066545#comment-15066545 ] Xuefu Zhang commented on HIVE-12713: Patch looks good to me. Minor comment/question on

[jira] [Updated] (HIVE-12708) Hive on Spark doesn't work with Kerboresed HBase [Spark Branch]

2015-12-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-12708: --- Attachment: HIVE-12708.1-spark.patch > Hive on Spark doesn't work with Kerboresed HBase [Spark Branch]

[jira] [Commented] (HIVE-12708) Hive on Spark doesn't work with Kerboresed HBase [Spark Branch]

2015-12-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15064881#comment-15064881 ] Xuefu Zhang commented on HIVE-12708: Good catch. Yes. It's hbase configuration. I'll c

[jira] [Commented] (HIVE-12708) Hive on Spark doesn't work with Kerboresed HBase [Spark Branch]

2015-12-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15064798#comment-15064798 ] Xuefu Zhang commented on HIVE-12708: [~jxiang], [~szehon], could you help review the p

[jira] [Updated] (HIVE-12708) Hive on Spark doesn't work with Kerboresed HBase [Spark Branch]

2015-12-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-12708: --- Attachment: HIVE-12708.1-spark.patch > Hive on Spark doesn't work with Kerboresed HBase [Spark Branch]

[jira] [Commented] (HIVE-12678) BETWEEN relational operator sometimes returns incorrect results against PARQUET tables

2015-12-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15063501#comment-15063501 ] Xuefu Zhang commented on HIVE-12678: cc: [~spena] > BETWEEN relational operator somet

[jira] [Commented] (HIVE-12616) NullPointerException when spark session is reused to run a mapjoin

2015-12-14 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15057239#comment-15057239 ] Xuefu Zhang commented on HIVE-12616: +1 [~nemon], could you create a followup JIRA th

[jira] [Commented] (HIVE-12615) Do not start spark session when only explain

2015-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15052999#comment-15052999 ] Xuefu Zhang commented on HIVE-12615: Okay. It can be done, but just takes some extra w

[jira] [Commented] (HIVE-12615) Do not start spark session when only explain

2015-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15052743#comment-15052743 ] Xuefu Zhang commented on HIVE-12615: [~nemon], Thanks for working on this. I noticed:

<    3   4   5   6   7   8   9   10   11   12   >