[jira] [Commented] (HIVE-9085) Spark Client RPC should have larger default max message size [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14244131#comment-14244131 ] Xuefu Zhang commented on HIVE-9085: --- +1 pending on tests, which didn't seem getting

[jira] [Commented] (HIVE-8911) Enable mapjoin hints [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14244136#comment-14244136 ] Xuefu Zhang commented on HIVE-8911: --- The above test ran for 4h40m. I aborted it manually

[jira] [Created] (HIVE-9088) Spark counter serialization error in Spark.log [Spark Branch]

Xuefu Zhang created HIVE-9088: - Summary: Spark counter serialization error in Spark.log [Spark Branch] Key: HIVE-9088 URL: https://issues.apache.org/jira/browse/HIVE-9088 Project: Hive Issue

[jira] [Commented] (HIVE-9088) Spark counter serialization error in Spark.log [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1429#comment-1429 ] Xuefu Zhang commented on HIVE-9088: --- cc: [~chengxiang li] Spark counter serialization

[jira] [Updated] (HIVE-9088) Spark counter serialization error in Spark.log [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9088: -- Description: It seems that the counter didn't get registered. Increasing it in executor caused

[jira] [Created] (HIVE-9089) Error when cleaning up in spark.log [Spark Branch]

Xuefu Zhang created HIVE-9089: - Summary: Error when cleaning up in spark.log [Spark Branch] Key: HIVE-9089 URL: https://issues.apache.org/jira/browse/HIVE-9089 Project: Hive Issue Type: Sub-task

[jira] [Updated] (HIVE-9084) Investigate IOContext object initialization problem [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9084: -- Attachment: HIVE-9084.2-spark.patch Investigate IOContext object initialization problem [Spark Branch

[jira] [Updated] (HIVE-9078) Hive should not submit second SparkTask while previous one has failed.[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9078: -- Attachment: HIVE-9078.2-spark.patch Hive should not submit second SparkTask while previous one has

Re: Review Request 28889: HIVE-8911 - Enable mapjoin hints [Spark Branch]

the static methods non-static, which would further simplify the code. ql/src/java/org/apache/hadoop/hive/ql/optimizer/SparkMapJoinProcessor.java https://reviews.apache.org/r/28889/#comment107797 nit: grandParentOps.get(0) is repeated in the next line. nice to have a var for it. - Xuefu Zhang

[jira] [Updated] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7816: -- Attachment: HIVE-7816.1-spark.patch Enable map-join tests which Tez executes [Spark Branch

[jira] [Commented] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14244704#comment-14244704 ] Xuefu Zhang commented on HIVE-7816: --- Patch looks good. One question though, do we need

[jira] [Commented] (HIVE-9085) Spark Client RPC should have larger default max message size [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14244727#comment-14244727 ] Xuefu Zhang commented on HIVE-9085: --- I cannot associate the plan changes with the patch

[jira] [Issue Comment Deleted] (HIVE-9085) Spark Client RPC should have larger default max message size [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9085: -- Comment: was deleted (was: I cannot associate the plan changes with the patch. However, the diff can

[jira] [Commented] (HIVE-9085) Spark Client RPC should have larger default max message size [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14244754#comment-14244754 ] Xuefu Zhang commented on HIVE-9085: --- The plan diff seems being caused by HIVE-9025, which

[jira] [Updated] (HIVE-9085) Spark Client RPC should have larger default max message size [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9085: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Commented] (HIVE-9079) Hive hangs while failed to get executorCount[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14244764#comment-14244764 ] Xuefu Zhang commented on HIVE-9079: --- The following test failures seem to be the random

[jira] [Updated] (HIVE-9079) Hive hangs while failed to get executorCount[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9079: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Updated] (HIVE-9059) Remove wrappers for SparkJobInfo and SparkStageInfo

[ https://issues.apache.org/jira/browse/HIVE-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9059: -- Status: Patch Available (was: Open) Remove wrappers for SparkJobInfo and SparkStageInfo

[jira] [Updated] (HIVE-9059) Remove wrappers for SparkJobInfo and SparkStageInfo

[ https://issues.apache.org/jira/browse/HIVE-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9059: -- Description: SPARK-4567 is resolved. We can remove the wrappers we added to solve the serailization

[jira] [Commented] (HIVE-9081) Bucket mapjoin should use the new alias in posToAliasMap [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14244899#comment-14244899 ] Xuefu Zhang commented on HIVE-9081: --- FYI: They are already updated. Bucket mapjoin

[jira] [Commented] (HIVE-9081) Bucket mapjoin should use the new alias in posToAliasMap [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14244907#comment-14244907 ] Xuefu Zhang commented on HIVE-9081: --- Is the patch ready or waiting for another test run

[jira] [Commented] (HIVE-9081) Bucket mapjoin should use the new alias in posToAliasMap [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14244933#comment-14244933 ] Xuefu Zhang commented on HIVE-9081: --- +1 Bucket mapjoin should use the new alias

[jira] [Updated] (HIVE-9081) Bucket mapjoin should use the new alias in posToAliasMap [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9081: -- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to Spark branch. Thanks

Re: Review Request 28930: HIVE-8639 : Convert SMBJoin to MapJoin [Spark Branch]

and the reason to switch? - Xuefu Zhang On Dec. 11, 2014, 4:39 a.m., Szehon Ho wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28930

[jira] [Commented] (HIVE-9017) Clean up temp files of RSC [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14244987#comment-14244987 ] Xuefu Zhang commented on HIVE-9017: --- It seem the right way is to ask Spark to do

[jira] [Updated] (HIVE-9088) Spark counter serialization error in spark.log [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9088: -- Summary: Spark counter serialization error in spark.log [Spark Branch] (was: Spark counter

[jira] [Resolved] (HIVE-8431) Enable smb_mapjoin_11.q and smb_mapjoin_12.q [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-8431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-8431. --- Resolution: Fixed Fix Version/s: spark-branch From testconfiguration.properties, these two

[jira] [Commented] (HIVE-9017) Clean up temp files of RSC [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14245020#comment-14245020 ] Xuefu Zhang commented on HIVE-9017: --- To clarify, when Spark lunched multiple executors

[jira] [Commented] (HIVE-9017) Clean up temp files of RSC [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14245042#comment-14245042 ] Xuefu Zhang commented on HIVE-9017: --- Okay, I think we have difference in the term

[jira] [Commented] (HIVE-8098) The spark golden file for union_remove_25 is different from MR version [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-8098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14245056#comment-14245056 ] Xuefu Zhang commented on HIVE-8098: --- As of now, the difference is 6814 for spark vs 6812

[jira] [Commented] (HIVE-8982) IndexOutOfBounds exception in mapjoin [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-8982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14245173#comment-14245173 ] Xuefu Zhang commented on HIVE-8982: --- join25.q failed because: {code} 2014-12-12 19:14

[jira] [Commented] (HIVE-8982) IndexOutOfBounds exception in mapjoin [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-8982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14245177#comment-14245177 ] Xuefu Zhang commented on HIVE-8982: --- Actually Chengxiang's patch (HIVE-9079

[jira] [Created] (HIVE-9094) join25.q fails because of timeout when trying get executor count from RSC [Spark Branch]

Xuefu Zhang created HIVE-9094: - Summary: join25.q fails because of timeout when trying get executor count from RSC [Spark Branch] Key: HIVE-9094 URL: https://issues.apache.org/jira/browse/HIVE-9094

[jira] [Commented] (HIVE-8982) IndexOutOfBounds exception in mapjoin [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-8982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14245191#comment-14245191 ] Xuefu Zhang commented on HIVE-8982: --- That's good. +1 IndexOutOfBounds exception

[jira] [Commented] (HIVE-8982) IndexOutOfBounds exception in mapjoin [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-8982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14245216#comment-14245216 ] Xuefu Zhang commented on HIVE-8982: --- [~csun], for some reason, I wasn't able to generate

[jira] [Updated] (HIVE-9084) Investigate IOContext object initialization problem [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9084: -- Attachment: HIVE-9084.2-spark.patch Investigate IOContext object initialization problem [Spark Branch

[jira] [Updated] (HIVE-9084) Investigate IOContext object initialization problem [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9084: -- Attachment: (was: HIVE-9084.2-spark.patch) Investigate IOContext object initialization problem

[jira] [Updated] (HIVE-9084) Investigate IOContext object initialization problem [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9084: -- Attachment: (was: HIVE-9084.1-spark.patch) Investigate IOContext object initialization problem

[jira] [Updated] (HIVE-9084) Investigate IOContext object initialization problem [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9084: -- Attachment: (was: HIVE-9084.2-spark.patch) Investigate IOContext object initialization problem

Re: Review Request 28934: HIVE-9078 Hive should not submit second SparkTask while previous one has failed.[Spark Branch]

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28934/#review64717 --- Ship it! Ship It! - Xuefu Zhang On Dec. 11, 2014, 6:51 a.m

[jira] [Updated] (HIVE-9046) Skip child tasks if parent task failed [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9046: -- Issue Type: Sub-task (was: Bug) Parent: HIVE-7292 Skip child tasks if parent task failed

[jira] [Resolved] (HIVE-9046) Skip child tasks if parent task failed [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-9046. --- Resolution: Duplicate Dupe of HIVE-9078. Skip child tasks if parent task failed [Spark Branch

[jira] [Commented] (HIVE-9078) Hive should not submit second SparkTask while previous one has failed.[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242447#comment-14242447 ] Xuefu Zhang commented on HIVE-9078: --- +1 pending on tests. Hive should not submit second

[jira] [Commented] (HIVE-8508) UT: fix bucketsort_insert tests - related to SMBMapJoinOperator

[ https://issues.apache.org/jira/browse/HIVE-8508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242455#comment-14242455 ] Xuefu Zhang commented on HIVE-8508: --- +1 pending on tests. UT: fix bucketsort_insert

[jira] [Commented] (HIVE-9079) Hive hangs while failed to get executorCount[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242456#comment-14242456 ] Xuefu Zhang commented on HIVE-9079: --- Hi [~chengxiang li], are you sure that you uploaded

[jira] [Updated] (HIVE-8508) UT: fix bucketsort_insert tests - related to SMBMapJoinOperator

[ https://issues.apache.org/jira/browse/HIVE-8508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8508: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Commented] (HIVE-8508) UT: fix bucketsort_insert tests - related to SMBMapJoinOperator

[ https://issues.apache.org/jira/browse/HIVE-8508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242646#comment-14242646 ] Xuefu Zhang commented on HIVE-8508: --- Committed to Spark branch. Thanks, Chinna. UT: fix

[jira] [Commented] (HIVE-8578) Investigate test failures related to HIVE-8545 [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242649#comment-14242649 ] Xuefu Zhang commented on HIVE-8578: --- Another occurrence of the problem: http://ec2-174

[jira] [Updated] (HIVE-9078) Hive should not submit second SparkTask while previous one has failed.[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9078: -- Attachment: HIVE-9078.1-spark.patch Reload the same patch to trigger test run. Hive should not submit

[jira] [Resolved] (HIVE-8751) Null Pointer Exception when counter is used for stats during inserting overwrite partitioned tables [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-8751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-8751. --- Resolution: Cannot Reproduce Cannot reproduce the problem in the latest branch. It must have been

[jira] [Resolved] (HIVE-8405) Research Bucket Map Join [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-8405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-8405. --- Resolution: Fixed Fix Version/s: spark-branch Research is done with the attached doc

[jira] [Resolved] (HIVE-7382) Create a MiniSparkCluster and set up a testing framework [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-7382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-7382. --- Resolution: Fixed Fix Version/s: spark-branch Fixed via HIVE-8836. Create a MiniSparkCluster

[jira] [Comment Edited] (HIVE-7382) Create a MiniSparkCluster and set up a testing framework [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-7382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242715#comment-14242715 ] Xuefu Zhang edited comment on HIVE-7382 at 12/11/14 3:53 PM

[jira] [Commented] (HIVE-7593) Instantiate SparkClient per user session [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-7593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242726#comment-14242726 ] Xuefu Zhang commented on HIVE-7593: --- [~chengxiang li], With RSC, this shouldn't

[jira] [Resolved] (HIVE-7516) Add capacity control over queries running on Spark cluster [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-7516. --- Resolution: Won't Fix This and HIVE-7768 seem to be duplicates. Close this one and let work start

[jira] [Assigned] (HIVE-7768) Integrate with Spark executor scaling [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-7768: - Assignee: Chengxiang Li (was: Szehon Ho) Since Szehon is busy with SMB-MJ conversion

[jira] [Commented] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242744#comment-14242744 ] Xuefu Zhang commented on HIVE-7816: --- It seems that not all test in the list are added

[jira] [Resolved] (HIVE-7613) Research optimization of auto convert join to map join [Spark branch]

[ https://issues.apache.org/jira/browse/HIVE-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-7613. --- Resolution: Fixed Fix Version/s: spark-branch Since MJ is already in place (via HIVE-8699

[jira] [Updated] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7816: -- Assignee: Rui Li Enable map-join tests which Tez executes [Spark Branch

[jira] [Assigned] (HIVE-7874) Support multiple concurrent users

[ https://issues.apache.org/jira/browse/HIVE-7874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-7874: - Assignee: Chengxiang Li With RSC, this shouldn't be a problem any more. [~chengxiang li], could

[jira] [Commented] (HIVE-9078) Hive should not submit second SparkTask while previous one has failed.[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242834#comment-14242834 ] Xuefu Zhang commented on HIVE-9078: --- I'm wondering if, by removing the trying logic, we

[jira] [Assigned] (HIVE-8849) Hive/Spark/Yarn integration [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-8849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-8849: - Assignee: Chengxiang Li Assign to Chengxiang as he is taking care of all integration related

[jira] [Updated] (HIVE-9043) HiveException: Conflict on row inspector for {table}

[ https://issues.apache.org/jira/browse/HIVE-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9043: -- Attachment: HIVE-9043.1.patch Attache the same patch to trigger test run. HiveException: Conflict

[jira] [Updated] (HIVE-9081) Bucket mapjoin should use the new alias in posToAliasMap [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9081: -- Issue Type: Sub-task (was: Bug) Parent: HIVE-7292 Bucket mapjoin should use the new alias

[jira] [Commented] (HIVE-9025) join38.q (without map join) produces incorrect result when testing with multiple reducers

[ https://issues.apache.org/jira/browse/HIVE-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242956#comment-14242956 ] Xuefu Zhang commented on HIVE-9025: --- Also merged to Spark branch. join38.q (without map

[jira] [Commented] (HIVE-9026) Re-enable remaining tests after HIVE-8970 [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242957#comment-14242957 ] Xuefu Zhang commented on HIVE-9026: --- [~csun] HIVE-9025 is fixed and merged to Spark

[jira] [Updated] (HIVE-9043) HiveException: Conflict on row inspector for {table}

[ https://issues.apache.org/jira/browse/HIVE-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9043: -- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk and merged

[jira] [Comment Edited] (HIVE-9043) HiveException: Conflict on row inspector for {table}

[ https://issues.apache.org/jira/browse/HIVE-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243125#comment-14243125 ] Xuefu Zhang edited comment on HIVE-9043 at 12/11/14 10:19 PM

[jira] [Updated] (HIVE-9060) Fix child operator references after NonBlockingOpDeDupProc

[ https://issues.apache.org/jira/browse/HIVE-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9060: -- Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch Available

[jira] [Created] (HIVE-9084) Investigate IOContext object initialization problem [Spark Branch]

Xuefu Zhang created HIVE-9084: - Summary: Investigate IOContext object initialization problem [Spark Branch] Key: HIVE-9084 URL: https://issues.apache.org/jira/browse/HIVE-9084 Project: Hive

[jira] [Updated] (HIVE-9084) Investigate IOContext object initialization problem [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9084: -- Issue Type: Sub-task (was: Bug) Parent: HIVE-7292 Investigate IOContext object initialization

[jira] [Updated] (HIVE-9084) Investigate IOContext object initialization problem [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9084: -- Description: In recent ptest run (Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com

[jira] [Updated] (HIVE-9084) Investigate IOContext object initialization problem [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9084: -- Attachment: HIVE-9084.1-spark.patch Patch #1 is for experimental only. It changed the the HashMap

[jira] [Updated] (HIVE-9084) Investigate IOContext object initialization problem [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9084: -- Status: Patch Available (was: Open) Investigate IOContext object initialization problem [Spark Branch

[jira] [Commented] (HIVE-8913) Make SparkMapJoinResolver handle runtime skew join [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-8913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243414#comment-14243414 ] Xuefu Zhang commented on HIVE-8913: --- I have moved the discussion to emails. I created

[jira] [Commented] (HIVE-9081) Bucket mapjoin should use the new alias in posToAliasMap [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243426#comment-14243426 ] Xuefu Zhang commented on HIVE-9081: --- Since this patch is applying to trunk, is there way

[jira] [Issue Comment Deleted] (HIVE-9081) Bucket mapjoin should use the new alias in posToAliasMap [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9081: -- Comment: was deleted (was: Since this patch is applying to trunk, is there way to add a test case

Re: Review Request 28972: HIVE-9081 Bucket mapjoin should use the new alias in posToAliasMap [Spark Branch]

://reviews.apache.org/r/28972/#comment107612 This changes seems not required for Spark, right? - Xuefu Zhang On Dec. 11, 2014, 11:07 p.m., Jimmy Xiang wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org

[jira] [Commented] (HIVE-9081) Bucket mapjoin should use the new alias in posToAliasMap [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243484#comment-14243484 ] Xuefu Zhang commented on HIVE-9081: --- Patch looks good. Minor comments/questions on review

[jira] [Commented] (HIVE-9085) Spark Client RPC should have larger default max message size [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243532#comment-14243532 ] Xuefu Zhang commented on HIVE-9085: --- qq: what issue is the added close() call to fix

[jira] [Updated] (HIVE-9083) New metastore API to support to purge partition-data directly in dropPartitions().

[ https://issues.apache.org/jira/browse/HIVE-9083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9083: -- Summary: New metastore API to support to purge partition-data directly in dropPartitions

[jira] [Commented] (HIVE-9041) Generate better plan for queries containing both union and multi-insert [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243562#comment-14243562 ] Xuefu Zhang commented on HIVE-9041: --- So the problem is a single (static) instance

[jira] [Commented] (HIVE-9078) Hive should not submit second SparkTask while previous one has failed.[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243619#comment-14243619 ] Xuefu Zhang commented on HIVE-9078: --- I guess I wasn't clear and there was a typo. I meant

[jira] [Updated] (HIVE-9084) Investigate IOContext object initialization problem [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9084: -- Attachment: HIVE-9084.1-spark.patch Not sure why ptest didn't kick in. Reattach the same patch to retry

[jira] [Commented] (HIVE-8913) Make SparkMapJoinResolver handle runtime skew join [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-8913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243717#comment-14243717 ] Xuefu Zhang commented on HIVE-8913: --- +1 Make SparkMapJoinResolver handle runtime skew

[jira] [Commented] (HIVE-9060) Fix child operator references after NonBlockingOpDeDupProc

[ https://issues.apache.org/jira/browse/HIVE-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241662#comment-14241662 ] Xuefu Zhang commented on HIVE-9060: --- Patch looks good. One minor comment, it seems

[jira] [Commented] (HIVE-9063) NPE in RemoteSparkJobStatus.getSparkStatistics [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241685#comment-14241685 ] Xuefu Zhang commented on HIVE-9063: --- Patch looks good. Rearranging the imports seems

[jira] [Updated] (HIVE-9063) NPE in RemoteSparkJobStatus.getSparkStatistics [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9063: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Commented] (HIVE-8507) UT: fix rcfile_bigdata test

[ https://issues.apache.org/jira/browse/HIVE-8507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241721#comment-14241721 ] Xuefu Zhang commented on HIVE-8507: --- +1 UT: fix rcfile_bigdata test

[jira] [Updated] (HIVE-8507) UT: fix rcfile_bigdata test [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-8507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8507: -- Summary: UT: fix rcfile_bigdata test [Spark Branch] (was: UT: fix rcfile_bigdata test) UT: fix

[jira] [Updated] (HIVE-8507) UT: fix rcfile_bigdata test [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-8507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8507: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Commented] (HIVE-9043) HiveException: Conflict on row inspector for {table}

[ https://issues.apache.org/jira/browse/HIVE-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241764#comment-14241764 ] Xuefu Zhang commented on HIVE-9043: --- Hi [~jxiang], Thanks for working on this. The patch

[jira] [Commented] (HIVE-9043) HiveException: Conflict on row inspector for {table}

[ https://issues.apache.org/jira/browse/HIVE-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241847#comment-14241847 ] Xuefu Zhang commented on HIVE-9043: --- Sounds good. +1 pending on tests. HiveException

[jira] [Commented] (HIVE-8993) Make sure Spark + HS2 work [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-8993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241863#comment-14241863 ] Xuefu Zhang commented on HIVE-8993: --- Patch looks good to me. [~brocknoland], could you

[jira] [Commented] (HIVE-8913) Make SparkMapJoinResolver handle runtime skew join [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-8913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242100#comment-14242100 ] Xuefu Zhang commented on HIVE-8913: --- Yes, it's possible, but we already have

[jira] [Commented] (HIVE-8913) Make SparkMapJoinResolver handle runtime skew join [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-8913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242104#comment-14242104 ] Xuefu Zhang commented on HIVE-8913: --- {quote} Just quick thought, maybe

[jira] [Commented] (HIVE-8993) Make sure Spark + HS2 work [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-8993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242117#comment-14242117 ] Xuefu Zhang commented on HIVE-8993: --- The test failures are concerning, but I don't think

[jira] [Updated] (HIVE-8993) Make sure Spark + HS2 work [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-8993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8993: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Commented] (HIVE-9060) Fix child operator references after NonBlockingOpDeDupProc

[ https://issues.apache.org/jira/browse/HIVE-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242124#comment-14242124 ] Xuefu Zhang commented on HIVE-9060: --- It seems there is still a duplication of {code

[jira] [Assigned] (HIVE-8639) Convert SMBJoin to MapJoin [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-8639: - Assignee: Szehon Ho (was: Chinna Rao Lalam) Convert SMBJoin to MapJoin [Spark Branch

<    5   6   7   8   9   10   11   12   13   14   >