[jira] [Created] (HIVE-9258) Explain query shouldn't launch a Spark application [Spark Branch]

2015-01-05 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-9258: - Summary: Explain query shouldn't launch a Spark application [Spark Branch] Key: HIVE-9258 URL: https://issues.apache.org/jira/browse/HIVE-9258 Project:

[jira] [Commented] (HIVE-8673) Result differences after merge [Spark Branch]

2015-01-05 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14265506#comment-14265506 ] Xuefu Zhang commented on HIVE-8673: --- [~brocknoland], could we analyze a bit about

[jira] [Commented] (HIVE-9246) Remove tabs from spark code [Spark Branch]

2015-01-05 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14265488#comment-14265488 ] Xuefu Zhang commented on HIVE-9246: --- +1 > Remove tabs from spark code [Spark

[jira] [Updated] (HIVE-9246) Remove tabs from spark code [Spark Branch]

2015-01-05 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9246: -- Status: Patch Available (was: Open) > Remove tabs from spark code [Spark Bra

[jira] [Commented] (HIVE-6173) Beeline doesn't accept --hiveconf option as Hive CLI does

2015-01-05 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14265377#comment-14265377 ] Xuefu Zhang commented on HIVE-6173: --- Re #2: autocommit is still not applicable, eve

[jira] [Commented] (HIVE-8578) Investigate test failures related to HIVE-8545 [Spark Branch]

2015-01-05 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14265369#comment-14265369 ] Xuefu Zhang commented on HIVE-8578: --- The failure seems related to IOCon

[jira] [Resolved] (HIVE-9135) Cache Map and Reduce works in RSC [Spark Branch]

2015-01-05 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-9135. --- Resolution: Won't Fix I'm closing this because of limited benefit. We have cached input pat

[jira] [Commented] (HIVE-8578) Investigate test failures related to HIVE-8545 [Spark Branch]

2015-01-05 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14265287#comment-14265287 ] Xuefu Zhang commented on HIVE-8578: --- Hi [~jxiang], what's the latest statu

[jira] [Commented] (HIVE-9243) Static Map in IOContext is not thread safe

2015-01-05 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14265100#comment-14265100 ] Xuefu Zhang commented on HIVE-9243: --- +1 > Static Map in IOContext is not thre

[jira] [Commented] (HIVE-9154) Cache pathToPartitionInfo in context aware record reader

2015-01-05 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14265092#comment-14265092 ] Xuefu Zhang commented on HIVE-9154: --- +1 to patch #3. > Cache pathToPartition

[jira] [Commented] (HIVE-9007) Hive may generate wrong plan for map join queries due to IdentityProjectRemover [Spark Branch]

2015-01-05 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14265066#comment-14265066 ] Xuefu Zhang commented on HIVE-9007: --- +1 > Hive may generate wrong plan for m

[jira] [Commented] (HIVE-9219) Investigate differences for auto join tests in explain after merge from trunk [Spark Branch]

2015-01-05 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14264879#comment-14264879 ] Xuefu Zhang commented on HIVE-9219: --- It seems HIVE-9037 added join key, which supers

[jira] [Commented] (HIVE-9251) SetSparkReducerParallelism is likely to set too small number of reducers [Spark Branch]

2015-01-04 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14264160#comment-14264160 ] Xuefu Zhang commented on HIVE-9251: --- I see. Thanks for the explanation. It seems tha

[jira] [Commented] (HIVE-9243) Static Map in IOContext is not thread safe

2015-01-04 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14264159#comment-14264159 ] Xuefu Zhang commented on HIVE-9243: --- Sounds good to me. We might come back to

[jira] [Commented] (HIVE-9243) Static Map in IOContext is not thread safe

2015-01-04 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14263907#comment-14263907 ] Xuefu Zhang commented on HIVE-9243: --- [~brocknoland], the changes look fine, harmles

[jira] [Commented] (HIVE-9251) SetSparkReducerParallelism is likely to set too small number of reducers [Spark Branch]

2015-01-04 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14263897#comment-14263897 ] Xuefu Zhang commented on HIVE-9251: --- Could you please create SPARK JIRA(s) to req

[jira] [Commented] (HIVE-9251) SetSparkReducerParallelism is likely to set too small number of reducers [Spark Branch]

2015-01-04 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14263896#comment-14263896 ] Xuefu Zhang commented on HIVE-9251: --- Could you elaborate why you think it's un

[jira] [Updated] (HIVE-9084) Investigate IOContext object initialization problem [Spark Branch]

2014-12-30 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9084: -- Resolution: Done Status: Resolved (was: Patch Available) Investigation is done. Problem is

[jira] [Updated] (HIVE-9230) Followup for HIVE-9125, update ppd_join4.q.out for Spark [Spark Branch]

2014-12-30 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9230: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Updated] (HIVE-9230) Followup for HIVE-9125, update ppd_join4.q.out for Spark [Spark Branch]

2014-12-30 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9230: -- Attachment: HIVE-9230.1-spark.patch > Followup for HIVE-9125, update ppd_join4.q.out for Spark [Sp

[jira] [Updated] (HIVE-9230) Followup for HIVE-9125, update ppd_join4.q.out for Spark [Spark Branch]

2014-12-30 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9230: -- Status: Patch Available (was: Open) > Followup for HIVE-9125, update ppd_join4.q.out for Spark [Sp

[jira] [Assigned] (HIVE-9230) Followup for HIVE-9125, update ppd_join4.q.out for Spark [Spark Branch]

2014-12-30 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-9230: - Assignee: Xuefu Zhang > Followup for HIVE-9125, update ppd_join4.q.out for Spark [Spark Bra

[jira] [Created] (HIVE-9230) Followup for HIVE-9125, update ppd_join4.q.out for Spark [Spark Branch]

2014-12-30 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-9230: - Summary: Followup for HIVE-9125, update ppd_join4.q.out for Spark [Spark Branch] Key: HIVE-9230 URL: https://issues.apache.org/jira/browse/HIVE-9230 Project: Hive

[jira] [Updated] (HIVE-8920) IOContext problem with multiple MapWorks cloned for multi-insert [Spark Branch]

2014-12-30 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8920: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Resolved] (HIVE-9229) How to calculate the Kendall coefficient of correlation?

2014-12-30 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-9229. --- Resolution: Invalid [~mkosinski], JIRA is used for reporting a problem or requesting a feature, but

[jira] [Updated] (HIVE-8920) IOContext problem with multiple MapWorks cloned for multi-insert [Spark Branch]

2014-12-30 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8920: -- Attachment: HIVE-8920.4-spark.patch > IOContext problem with multiple MapWorks cloned for multi-ins

[jira] [Updated] (HIVE-8920) IOContext problem with multiple MapWorks cloned for multi-insert [Spark Branch]

2014-12-29 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8920: -- Attachment: HIVE-8920.3-spark.patch We have to disable caching for MapInput because of IOContext

[jira] [Updated] (HIVE-9215) Some mapjoin queries broken with IdentityProjectRemover with PPD

2014-12-29 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9215: -- Affects Version/s: spark-branch > Some mapjoin queries broken with IdentityProjectRemover with

[jira] [Commented] (HIVE-9215) Some mapjoin queries broken with IdentityProjectRemover with PPD

2014-12-29 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14260695#comment-14260695 ] Xuefu Zhang commented on HIVE-9215: --- Merged to Spark branch as well. Thanks, N

[jira] [Resolved] (HIVE-9145) authorization_admin_almighty1.q fails with result diff [Spark Branch]

2014-12-29 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-9145. --- Resolution: Duplicate Test disabled via HIVE-9218 > authorization_admin_almighty1.q fails with res

[jira] [Commented] (HIVE-9112) Query may generate different results depending on the number of reducers

2014-12-29 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14260450#comment-14260450 ] Xuefu Zhang commented on HIVE-9112: --- [~ashutoshc], any further idea on this? Th

[jira] [Updated] (HIVE-9153) Perf enhancement on CombineHiveInputFormat and HiveInputFormat

2014-12-29 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9153: -- Resolution: Fixed Fix Version/s: 0.15.0 spark-branch Status

[jira] [Updated] (HIVE-9153) Perf enhancement on CombineHiveInputFormat and HiveInputFormat

2014-12-29 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9153: -- Summary: Perf enhancement on CombineHiveInputFormat and HiveInputFormat (was: Evaluate

[jira] [Commented] (HIVE-9220) HIVE-9109 missed updating result of list_bucket_dml_10

2014-12-29 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14260151#comment-14260151 ] Xuefu Zhang commented on HIVE-9220: --- +1 > HIVE-9109 missed updating re

[jira] [Updated] (HIVE-9218) Remove authorization_admin_almighty1 from spark tests [Spark Branch]

2014-12-29 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9218: -- Status: Patch Available (was: Open) > Remove authorization_admin_almighty1 from spark tests [Sp

[jira] [Assigned] (HIVE-9218) Remove authorization_admin_almighty1 from spark tests [Spark Branch]

2014-12-29 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-9218: - Assignee: Xuefu Zhang > Remove authorization_admin_almighty1 from spark tests [Spark Bra

[jira] [Updated] (HIVE-9218) Remove authorization_admin_almighty1 from spark tests [Spark Branch]

2014-12-29 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9218: -- Attachment: HIVE-9218.1-spark.patch > Remove authorization_admin_almighty1 from spark tests [Sp

[jira] [Commented] (HIVE-9215) Some mapjoin queries broken with IdentityProjectRemover with PPD

2014-12-29 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14260143#comment-14260143 ] Xuefu Zhang commented on HIVE-9215: --- +1 > Some mapjoin queries brok

[jira] [Updated] (HIVE-9216) Avoid redundant clone of JobConf [Spark Branch]

2014-12-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9216: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Commented] (HIVE-9153) Evaluate CombineHiveInputFormat versus HiveInputFormat

2014-12-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14259849#comment-14259849 ] Xuefu Zhang commented on HIVE-9153: --- +1 > Evaluate CombineHiveInputFormat

[jira] [Commented] (HIVE-9153) Evaluate CombineHiveInputFormat versus HiveInputFormat

2014-12-26 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14259106#comment-14259106 ] Xuefu Zhang commented on HIVE-9153: --- [~lirui], is the test failure (dml) related to

[jira] [Commented] (HIVE-9216) Avoid redundant clone of JobConf [Spark Branch]

2014-12-26 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14259099#comment-14259099 ] Xuefu Zhang commented on HIVE-9216: --- +1 > Avoid redundant clone of JobConf

[jira] [Updated] (HIVE-9153) Evaluate CombineHiveInputFormat versus HiveInputFormat

2014-12-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9153: -- Affects Version/s: (was: spark-branch) > Evaluate CombineHiveInputFormat versus HiveInputFor

[jira] [Updated] (HIVE-9153) Evaluate CombineHiveInputFormat versus HiveInputFormat

2014-12-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9153: -- Summary: Evaluate CombineHiveInputFormat versus HiveInputFormat (was: Evaluate CombineHiveInputFormat

[jira] [Commented] (HIVE-9153) Evaluate CombineHiveInputFormat versus HiveInputFormat [Spark Branch]

2014-12-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14258841#comment-14258841 ] Xuefu Zhang commented on HIVE-9153: --- Re: Utilities.getBaseWork() changes, I suppose

[jira] [Commented] (HIVE-9007) Hive may generate wrong plan for map join queries due to IdentityProjectRemover [Spark Branch]

2014-12-24 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14258591#comment-14258591 ] Xuefu Zhang commented on HIVE-9007: --- That's the last resort. It would be great

[jira] [Updated] (HIVE-9199) Excessive exclusive lock used in some DDLs with DummyTxnManager

2014-12-24 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9199: -- Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch Available

[jira] [Commented] (HIVE-9212) Several plugin version in modules is not consistent with others.

2014-12-24 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14258312#comment-14258312 ] Xuefu Zhang commented on HIVE-9212: --- +1 > Several plugin version in modules

[jira] [Updated] (HIVE-9209) Spark branch compile failed on hadoop-1[Spark Branch]

2014-12-23 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9209: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Commented] (HIVE-9209) Spark branch compile failed on hadoop-1[Spark Branch]

2014-12-23 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14257973#comment-14257973 ] Xuefu Zhang commented on HIVE-9209: --- +1 > Spark branch compile failed on hadoop-

[jira] [Updated] (HIVE-9207) Add more log information for debug RSC[Spark Branch]

2014-12-23 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9207: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Commented] (HIVE-9207) Add more log information for debug RSC[Spark Branch]

2014-12-23 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14257965#comment-14257965 ] Xuefu Zhang commented on HIVE-9207: --- +1 > Add more log information for debug RS

[jira] [Commented] (HIVE-9199) Excessive exclusive lock used in some DDLs with DummyTxnManager

2014-12-23 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14257696#comment-14257696 ] Xuefu Zhang commented on HIVE-9199: --- With my limited understanding, the patch looks

[jira] [Commented] (HIVE-9094) TimeoutException when trying get executor count from RSC [Spark Branch]

2014-12-23 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14257681#comment-14257681 ] Xuefu Zhang commented on HIVE-9094: --- This problem again reappeared in ptest: h

[jira] [Commented] (HIVE-9202) Choose Kryo as the serializer for pTest [Spark Branch]

2014-12-23 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14257674#comment-14257674 ] Xuefu Zhang commented on HIVE-9202: --- BTW, groupby_multi_insert_common_distinct.q fa

[jira] [Comment Edited] (HIVE-9202) Choose Kryo as the serializer for pTest [Spark Branch]

2014-12-23 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14257674#comment-14257674 ] Xuefu Zhang edited comment on HIVE-9202 at 12/23/14 11:1

[jira] [Updated] (HIVE-9202) Choose Kryo as the serializer for pTest [Spark Branch]

2014-12-23 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9202: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Resolved] (HIVE-9204) Test windowing.q is failing [Spark Branch]

2014-12-23 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-9204. --- Resolution: Duplicate Dupe of HIVE-9104. > Test windowing.q is failing [Spark Bra

[jira] [Created] (HIVE-9204) Test windowing.q is failing [Spark Branch]

2014-12-23 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-9204: - Summary: Test windowing.q is failing [Spark Branch] Key: HIVE-9204 URL: https://issues.apache.org/jira/browse/HIVE-9204 Project: Hive Issue Type: Sub-task

Could anyone add Pierre Yin as a contributor?

2014-12-23 Thread Xuefu Zhang
I tried but the webui gave me errors and I'm wondering if anyone has other means. Thanks, Xuefu

[jira] [Updated] (HIVE-9202) Choose Kryo as the serializer for pTest [Spark Branch]

2014-12-23 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9202: -- Attachment: HIVE-9202.1-spark.patch > Choose Kryo as the serializer for pTest [Spark Bra

[jira] [Updated] (HIVE-9202) Choose Kryo as the serializer for pTest [Spark Branch]

2014-12-23 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9202: -- Status: Patch Available (was: Open) > Choose Kryo as the serializer for pTest [Spark Bra

[jira] [Created] (HIVE-9202) Choose Kryo as the serializer for pTest [Spark Branch]

2014-12-23 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-9202: - Summary: Choose Kryo as the serializer for pTest [Spark Branch] Key: HIVE-9202 URL: https://issues.apache.org/jira/browse/HIVE-9202 Project: Hive Issue Type: Sub

[jira] [Commented] (HIVE-9191) TimeOutException when using RSC with beeline [Spark Branch]

2014-12-23 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14257072#comment-14257072 ] Xuefu Zhang commented on HIVE-9191: --- I think this might be the same problem that I

[jira] [Updated] (HIVE-9198) Hive reported exception because that hive's derby version conflict with spark's derby version

2014-12-23 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9198: -- Attachment: HIVE-9198.1-spark.patch Upload the same patch with correct name to trigger test run. > H

[jira] [Updated] (HIVE-9164) Profile query compiler #2 [Spark Branch]

2014-12-22 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9164: -- Issue Type: Sub-task (was: Improvement) Parent: HIVE-9134 > Profile query compiler #2 [Sp

[jira] [Commented] (HIVE-9191) TimeOutException when using RSC with beeline [Spark Branch]

2014-12-22 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14256231#comment-14256231 ] Xuefu Zhang commented on HIVE-9191: --- [~csun], it seems that there is a problem star

[jira] [Commented] (HIVE-9153) Evaluate CombineHiveInputFormat versus HiveInputFormat [Spark Branch]

2014-12-22 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14256082#comment-14256082 ] Xuefu Zhang commented on HIVE-9153: --- Thanks, [~lirui]. It seems that the smaller nu

[jira] [Commented] (HIVE-8640) Support hints of SMBJoin [Spark Branch]

2014-12-22 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14256063#comment-14256063 ] Xuefu Zhang commented on HIVE-8640: --- Agreed. I guess it doesn't hurt to have

[jira] [Reopened] (HIVE-9154) Cache pathToPartitionInfo in context aware record reader

2014-12-22 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reopened HIVE-9154: --- Patch reverted in trunk. > Cache pathToPartitionInfo in context aware record rea

[jira] [Commented] (HIVE-9154) Cache pathToPartitionInfo in context aware record reader

2014-12-22 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14255839#comment-14255839 ] Xuefu Zhang commented on HIVE-9154: --- [~navis], Sorry that I missed that. I will re

[jira] [Updated] (HIVE-8640) Support hints of SMBJoin [Spark Branch]

2014-12-22 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8640: -- Labels: TODOC-SPARK (was: ) > Support hints of SMBJoin [Spark Bra

[jira] [Updated] (HIVE-8640) Support hints of SMBJoin [Spark Branch]

2014-12-20 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8640: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Updated] (HIVE-9177) Fix child operator references after NonBlockingOpDeDupProc (II)

2014-12-20 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9177: -- Resolution: Fixed Fix Version/s: 0.15.0 spark-branch Status

[jira] [Commented] (HIVE-8640) Support hints of SMBJoin [Spark Branch]

2014-12-20 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254776#comment-14254776 ] Xuefu Zhang commented on HIVE-8640: --- +1 > Support hints of SMBJoin [Spark

Re: Review Request 29281: HIVE-8640 : Support hints of SMBJoin [Spark Branch]

2014-12-19 Thread Xuefu Zhang
> On Dec. 20, 2014, 1:36 a.m., Xuefu Zhang wrote: > > Patch looks good and clean. However, I have two high-level questions: > > 1. what's a SMB hint? For map-join, hint is /*+ MAPJOIN(X)*/. It doesn't > > seem even close for SMB hint. > > 2. from the code,

Re: Review Request 29281: HIVE-8640 : Support hints of SMBJoin [Spark Branch]

2014-12-19 Thread Xuefu Zhang
<https://reviews.apache.org/r/29281/#comment108924> Just curious. The previous rule might change JoinOperator to MapJoinOperator during the walking. is this rule able to process these converted MapJoinOperators in the same wa

[jira] [Updated] (HIVE-9178) Create a separate API for remote Spark Context RPC other than job submission [Spark Branch]

2014-12-19 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9178: -- Summary: Create a separate API for remote Spark Context RPC other than job submission [Spark Branch

[jira] [Commented] (HIVE-9178) Create a separate API for remote Spark Context RPC other than job submission [Spark Branch]

2014-12-19 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254286#comment-14254286 ] Xuefu Zhang commented on HIVE-9178: --- cc: [~vanzin] > Create a separate API for

[jira] [Commented] (HIVE-9179) Add listeners on JobHandle so job status change can be notified to the client [Spark Branch]

2014-12-19 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254287#comment-14254287 ] Xuefu Zhang commented on HIVE-9179: --- cc: [~vanzin] > Add listeners on JobHandle

[jira] [Created] (HIVE-9179) Add listeners on JobHandle so job status change can be notified to the client [Spark Branch]

2014-12-19 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-9179: - Summary: Add listeners on JobHandle so job status change can be notified to the client [Spark Branch] Key: HIVE-9179 URL: https://issues.apache.org/jira/browse/HIVE-9179

[jira] [Created] (HIVE-9178) Create a separate API for remote Spark Context RPC other than job submission

2014-12-19 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-9178: - Summary: Create a separate API for remote Spark Context RPC other than job submission Key: HIVE-9178 URL: https://issues.apache.org/jira/browse/HIVE-9178 Project: Hive

[jira] [Commented] (HIVE-9177) Fix child operator references after NonBlockingOpDeDupProc (II)

2014-12-19 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254252#comment-14254252 ] Xuefu Zhang commented on HIVE-9177: --- +1. > Fix child operator reference

[jira] [Updated] (HIVE-9164) Profile query compiler #2 [Spark Branch]

2014-12-19 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9164: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Commented] (HIVE-9164) Profile query compiler #2 [Spark Branch]

2014-12-19 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254061#comment-14254061 ] Xuefu Zhang commented on HIVE-9164: --- +1 > Profile query compiler #2 [Spark

[jira] [Updated] (HIVE-9088) Spark counter serialization error in spark.log [Spark Branch]

2014-12-19 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9088: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Updated] (HIVE-9154) Cache pathToPartitionInfo in context aware record reader

2014-12-19 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9154: -- Resolution: Fixed Fix Version/s: 0.15.0 spark-branch Status

[jira] [Commented] (HIVE-9094) TimeoutException when trying get executor count from RSC [Spark Branch]

2014-12-19 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14253538#comment-14253538 ] Xuefu Zhang commented on HIVE-9094: --- Thank you for capturing this, [~left

[jira] [Commented] (HIVE-9088) Spark counter serialization error in spark.log [Spark Branch]

2014-12-19 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14253534#comment-14253534 ] Xuefu Zhang commented on HIVE-9088: --- +1 > Spark counter serialization e

[jira] [Updated] (HIVE-9154) Cache pathToPartitionInfo in context aware record reader

2014-12-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9154: -- Attachment: HIVE-9154.1-spark.patch > Cache pathToPartitionInfo in context aware record rea

[jira] [Commented] (HIVE-7954) Investigate query failures (3)

2014-12-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14252889#comment-14252889 ] Xuefu Zhang commented on HIVE-7954: --- Thank you very much for taking care of

[jira] [Updated] (HIVE-8639) Convert SMBJoin to MapJoin [Spark Branch]

2014-12-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8639: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Commented] (HIVE-8639) Convert SMBJoin to MapJoin [Spark Branch]

2014-12-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14252142#comment-14252142 ] Xuefu Zhang commented on HIVE-8639: --- +1 > Convert SMBJoin to MapJoin [Spark

Re: Review Request 28930: HIVE-8639 : Convert SMBJoin to MapJoin [Spark Branch]

2014-12-18 Thread Xuefu Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28930/#review65528 --- Ship it! Ship It! - Xuefu Zhang On Dec. 18, 2014, 2:07 a.m

[jira] [Commented] (HIVE-8639) Convert SMBJoin to MapJoin [Spark Branch]

2014-12-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14252086#comment-14252086 ] Xuefu Zhang commented on HIVE-8639: --- [~szehon], I'm reviewing at the momen

[jira] [Updated] (HIVE-9127) Improve CombineHiveInputFormat.getSplit performance

2014-12-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9127: -- Fix Version/s: spark-branch > Improve CombineHiveInputFormat.getSplit performa

[jira] [Commented] (HIVE-9127) Improve CombineHiveInputFormat.getSplit performance

2014-12-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14252059#comment-14252059 ] Xuefu Zhang commented on HIVE-9127: --- Spark patch is also committed to Spark br

[jira] [Updated] (HIVE-9094) TimeoutException when trying get executor count from RSC [Spark Branch]

2014-12-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9094: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Updated] (HIVE-9127) Improve CombineHiveInputFormat.getSplit performance

2014-12-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9127: -- Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch Available

[jira] [Updated] (HIVE-9136) Profile query compiler [Spark Branch]

2014-12-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9136: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

<    3   4   5   6   7   8   9   10   11   12   >