[jira] [Commented] (HIVE-8701) Combine nested map joins into the parent map join if possible [Spark Branch]

2014-11-19 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14218875#comment-14218875 ] Suhas Satish commented on HIVE-8701: [~szehon] - Can you illustrate how you plan to opt

[jira] [Commented] (HIVE-8548) Integrate with remote Spark context after HIVE-8528 [Spark Branch]

2014-11-12 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208778#comment-14208778 ] Suhas Satish commented on HIVE-8548: Thanks for clarifying [~xuefuz] and [~vanzin]. I h

[jira] [Commented] (HIVE-8548) Integrate with remote Spark context after HIVE-8528 [Spark Branch]

2014-11-12 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208562#comment-14208562 ] Suhas Satish commented on HIVE-8548: HI [~xuefuz] - Regarding unit testing remote-spark

[jira] [Commented] (HIVE-8622) Split map-join plan into 2 SparkTasks in 3 stages [Spark Branch]

2014-11-07 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14202496#comment-14202496 ] Suhas Satish commented on HIVE-8622: [~csun] - We already have a mapr of BaseWork cont

[jira] [Commented] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-06 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201604#comment-14201604 ] Suhas Satish commented on HIVE-8700: ah yes. thanks [~csun] Regarding the test failure

[jira] [Commented] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-06 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201486#comment-14201486 ] Suhas Satish commented on HIVE-8700: Hi [~csun] I thought the dummyStoreOperators were

[jira] [Commented] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-06 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201354#comment-14201354 ] Suhas Satish commented on HIVE-8700: removed in HIVE-8700.3-spark.patch > Replace Redu

[jira] [Updated] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-06 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8700: --- Attachment: HIVE-8700.3-spark.patch > Replace ReduceSink to HashTableSink (or equi.) for small tables [

[jira] [Commented] (HIVE-8621) Dump small table join data for map-join [Spark Branch]

2014-11-06 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201344#comment-14201344 ] Suhas Satish commented on HIVE-8621: [~jxiang] - Are you sure you are getting any tags

[jira] [Commented] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-06 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201319#comment-14201319 ] Suhas Satish commented on HIVE-8700: It was an optimization suggested by eclipse to cat

[jira] [Updated] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-06 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8700: --- Attachment: HIVE-8700.2-spark.patch > Replace ReduceSink to HashTableSink (or equi.) for small tables [

[jira] [Commented] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-06 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201199#comment-14201199 ] Suhas Satish commented on HIVE-8700: {code} explain select table1.key, table2.value, ta

[jira] [Commented] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-06 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201198#comment-14201198 ] Suhas Satish commented on HIVE-8700: Have a patch which now generates the HashTableSink

[jira] [Commented] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-05 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14199011#comment-14199011 ] Suhas Satish commented on HIVE-8700: https://reviews.apache.org/r/27640/ > Replace Red

[jira] [Commented] (HIVE-8622) Split map-join plan into 2 SparkTasks in 3 stages [Spark Branch]

2014-11-05 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14199002#comment-14199002 ] Suhas Satish commented on HIVE-8622: Thanks Chao, I have leveraged some of your work in

[jira] [Updated] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-05 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8700: --- Status: Patch Available (was: Open) > Replace ReduceSink to HashTableSink (or equi.) for small tables

[jira] [Commented] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-05 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14199000#comment-14199000 ] Suhas Satish commented on HIVE-8700: Attaching a patch that leverages changes from Chao

[jira] [Updated] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-05 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8700: --- Attachment: HIVE-8700-spark.patch > Replace ReduceSink to HashTableSink (or equi.) for small tables [Sp

[jira] [Commented] (HIVE-8622) Split map-join plan into 2 SparkTasks in 3 stages [Spark Branch]

2014-11-05 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14198723#comment-14198723 ] Suhas Satish commented on HIVE-8622: I saw this condition in your patch -

[jira] [Commented] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-04 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14197096#comment-14197096 ] Suhas Satish commented on HIVE-8700: Hi Szehon, The patch still needs some work. This i

[jira] [Updated] (HIVE-8621) Dump small table join data for map-join [Spark Branch]

2014-11-04 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8621: --- Assignee: (was: Suhas Satish) > Dump small table join data for map-join [Spark Branch] > --

[jira] [Commented] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-03 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195403#comment-14195403 ] Suhas Satish commented on HIVE-8700: Sure [~szehon]. Attaching my changeset as a patch.

[jira] [Updated] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-03 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8700: --- Attachment: HIVE-8700.patch > Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Br

[jira] [Commented] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-03 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14194854#comment-14194854 ] Suhas Satish commented on HIVE-8700: Thank you [~szehon] > Replace ReduceSink to HashT

[jira] [Assigned] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-03 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish reassigned HIVE-8700: -- Assignee: Suhas Satish (was: Szehon Ho) > Replace ReduceSink to HashTableSink (or equi.) for sm

[jira] [Commented] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-02 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14193895#comment-14193895 ] Suhas Satish commented on HIVE-8700: Hi Xuefu, I was working on this as apart of HIVE-

[jira] [Updated] (HIVE-8621) Dump small table join data for map-join [Spark Branch]

2014-10-31 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8621: --- Description: This jira aims to re-use a slightly modified approach of map-reduce distributed cache in

[jira] [Updated] (HIVE-8621) Dump small table join data for map-join [Spark Branch]

2014-10-31 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8621: --- Summary: Dump small table join data for map-join [Spark Branch] (was: Dump small table join data into

[jira] [Work started] (HIVE-8621) Dump small table join data into appropriate number of broadcast variables [Spark Branch]

2014-10-29 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-8621 started by Suhas Satish. -- > Dump small table join data into appropriate number of broadcast variables > [Spark

[jira] [Commented] (HIVE-8616) convert joinOp to MapJoinOp and generate MapWorks only [Spark Branch]

2014-10-29 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14189548#comment-14189548 ] Suhas Satish commented on HIVE-8616: Even with this merged into spark branch, the follo

[jira] [Commented] (HIVE-8621) Dump small table join data into appropriate number of broadcast variables [Spark Branch]

2014-10-29 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14189531#comment-14189531 ] Suhas Satish commented on HIVE-8621: Currently so far in the spark implementation, we a

[jira] [Updated] (HIVE-8616) convert joinOp to MapJoinOp and generate MapWorks only [Spark Branch]

2014-10-29 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8616: --- Attachment: HIVE-8616.3-spark.patch > convert joinOp to MapJoinOp and generate MapWorks only [Spark Bra

[jira] [Commented] (HIVE-8616) convert joinOp to MapJoinOp and generate MapWorks only [Spark Branch]

2014-10-29 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14189370#comment-14189370 ] Suhas Satish commented on HIVE-8616: Hi Xuefu, Yes most of these failing tests set hiv

[jira] [Commented] (HIVE-8616) convert joinOp to MapJoinOp and generate MapWorks only [Spark Branch]

2014-10-28 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14188061#comment-14188061 ] Suhas Satish commented on HIVE-8616: Addressed review board comments and uploaded updat

[jira] [Updated] (HIVE-8616) convert joinOp to MapJoinOp and generate MapWorks only [Spark Branch]

2014-10-28 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8616: --- Attachment: HIVE-8616.2-spark.patch > convert joinOp to MapJoinOp and generate MapWorks only [Spark Bra

[jira] [Updated] (HIVE-8621) Dump small table join data into appropriate number of broadcast variables [Spark Branch]

2014-10-27 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8621: --- Summary: Dump small table join data into appropriate number of broadcast variables [Spark Branch] (was

[jira] [Commented] (HIVE-8621) Dump small table join data into appropriate number of broadcast variables [Spark Branch]

2014-10-27 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186003#comment-14186003 ] Suhas Satish commented on HIVE-8621: Agreed, there was no confusion. Have updated the t

[jira] [Updated] (HIVE-8621) Aggregate all small table join data into m x n broadcast variables [Spark Branch]

2014-10-27 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8621: --- Description: The number of broadcast variables that must be created is m x n where 'm' is the number o

[jira] [Updated] (HIVE-8621) Aggregate all small table join data into m x n broadcast variables [Spark Branch]

2014-10-27 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8621: --- Summary: Aggregate all small table join data into m x n broadcast variables [Spark Branch] (was: Aggre

[jira] [Updated] (HIVE-8621) Aggregate all small table join data into mxn broadcast variables [Spark Branch]

2014-10-27 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8621: --- Description: In the title of the jira, 'm' is the number of small tables in the (m+1)- way join and n

[jira] [Updated] (HIVE-8621) Aggregate all small table join data into mxn broadcast variables [Spark Branch]

2014-10-27 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8621: --- Summary: Aggregate all small table join data into mxn broadcast variables [Spark Branch] (was: Aggrega

[jira] [Updated] (HIVE-8621) Aggregate all small table join data into broadcast variables

2014-10-27 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8621: --- Summary: Aggregate all small table join data into broadcast variables (was: Aggregate all small table

[jira] [Commented] (HIVE-8621) Aggregate all small table join data into 1 broadcast variable

2014-10-27 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14185960#comment-14185960 ] Suhas Satish commented on HIVE-8621: Hi Szehon, Yes what you say makes sense. I had not

[jira] [Updated] (HIVE-8621) Aggregate all small table join data into 1 broadcast variable

2014-10-27 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8621: --- Issue Type: Sub-task (was: Bug) Parent: HIVE-7292 > Aggregate all small table join data into 1

[jira] [Updated] (HIVE-8623) Implement SparkHashTableLoader for map-join broadcast variable read

2014-10-27 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8623: --- Issue Type: Sub-task (was: Task) Parent: HIVE-7292 > Implement SparkHashTableLoader for map-jo

[jira] [Created] (HIVE-8623) Implement SparkHashTableLoader for map-join broadcast variable read

2014-10-27 Thread Suhas Satish (JIRA)
Suhas Satish created HIVE-8623: -- Summary: Implement SparkHashTableLoader for map-join broadcast variable read Key: HIVE-8623 URL: https://issues.apache.org/jira/browse/HIVE-8623 Project: Hive I

[jira] [Updated] (HIVE-8622) Split map-join plan into 2 SparkTasks in 3 stages.

2014-10-27 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8622: --- Issue Type: Sub-task (was: Bug) Parent: HIVE-7292 > Split map-join plan into 2 SparkTasks in 3

[jira] [Created] (HIVE-8622) Split map-join plan into 2 SparkTasks in 3 stages.

2014-10-27 Thread Suhas Satish (JIRA)
Suhas Satish created HIVE-8622: -- Summary: Split map-join plan into 2 SparkTasks in 3 stages. Key: HIVE-8622 URL: https://issues.apache.org/jira/browse/HIVE-8622 Project: Hive Issue Type: Bug

[jira] [Created] (HIVE-8621) Aggregate all small table join data into 1 broadcast variable

2014-10-27 Thread Suhas Satish (JIRA)
Suhas Satish created HIVE-8621: -- Summary: Aggregate all small table join data into 1 broadcast variable Key: HIVE-8621 URL: https://issues.apache.org/jira/browse/HIVE-8621 Project: Hive Issue T

[jira] [Commented] (HIVE-8616) convert joinOp to MapJoinOp and generate MapWorks only

2014-10-27 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14185886#comment-14185886 ] Suhas Satish commented on HIVE-8616: Review board: https://reviews.apache.org/r/27247/

[jira] [Commented] (HIVE-7613) Research optimization of auto convert join to map join [Spark branch]

2014-10-27 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14185878#comment-14185878 ] Suhas Satish commented on HIVE-7613: Submitted patch for HIVE-8616. This can be used as

[jira] [Updated] (HIVE-8616) convert joinOp to MapJoinOp and generate MapWorks only

2014-10-27 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8616: --- Status: Patch Available (was: Open) Attached a patch which addresses this sub-task. With this patch ap

[jira] [Updated] (HIVE-8616) convert joinOp to MapJoinOp and generate MapWorks only

2014-10-27 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8616: --- Attachment: HIVE-8616-spark.patch > convert joinOp to MapJoinOp and generate MapWorks only > --

[jira] [Created] (HIVE-8616) convert joinOp to MapJoinOp and generate MapWorks only

2014-10-27 Thread Suhas Satish (JIRA)
Suhas Satish created HIVE-8616: -- Summary: convert joinOp to MapJoinOp and generate MapWorks only Key: HIVE-8616 URL: https://issues.apache.org/jira/browse/HIVE-8616 Project: Hive Issue Type: Sub

[jira] [Commented] (HIVE-7916) Snappy-java error when running hive query on spark [Spark Branch]

2014-10-24 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14183290#comment-14183290 ] Suhas Satish commented on HIVE-7916: Not sure what solved it for you, but setting this

[jira] [Commented] (HIVE-7916) Snappy-java error when running hive query on spark [Spark Branch]

2014-10-17 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14175771#comment-14175771 ] Suhas Satish commented on HIVE-7916: Hitting the same problem with snappy 1.1.1.3 as we

[jira] [Commented] (HIVE-7916) Snappy-java error when running hive query on spark [Spark Branch]

2014-10-17 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14175712#comment-14175712 ] Suhas Satish commented on HIVE-7916: I also hit the following snappy lib exceptions - I

[jira] [Commented] (HIVE-7551) expand spark accumulator to support hive counter [Spark Branch]

2014-10-10 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14167997#comment-14167997 ] Suhas Satish commented on HIVE-7551: Xuefu is right, feel free to work on this ~Chengxi

[jira] [Commented] (HIVE-8243) clone SparkWork for join optimization

2014-09-23 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14145705#comment-14145705 ] Suhas Satish commented on HIVE-8243: cloning via kryo.copy() as suggested for MapredWor

[jira] [Updated] (HIVE-8243) clone SparkWork for join optimization

2014-09-23 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8243: --- Issue Type: Sub-task (was: Bug) Parent: HIVE-7292 > clone SparkWork for join optimization > --

[jira] [Created] (HIVE-8243) clone SparkWork for join optimization

2014-09-23 Thread Suhas Satish (JIRA)
Suhas Satish created HIVE-8243: -- Summary: clone SparkWork for join optimization Key: HIVE-8243 URL: https://issues.apache.org/jira/browse/HIVE-8243 Project: Hive Issue Type: Bug Compon

[jira] [Updated] (HIVE-8183) make ConvertJoinMapJoin optimization pluggable for different execution frameworks

2014-09-18 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8183: --- Description: Originally introduced for Tez, ConvertJoinMapJoin heavily uses OptimizeTezProcContext . A

[jira] [Updated] (HIVE-8183) make ConvertJoinMapJoin optimization pluggable for different execution frameworks

2014-09-18 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8183: --- Description: Originally introduced for Tez, ConvertJoinMapJoin heavily uses OptimizeTezProcContext . A

[jira] [Created] (HIVE-8183) make ConvertJoinMapJoin optimization pluggable for different execution frameworks

2014-09-18 Thread Suhas Satish (JIRA)
Suhas Satish created HIVE-8183: -- Summary: make ConvertJoinMapJoin optimization pluggable for different execution frameworks Key: HIVE-8183 URL: https://issues.apache.org/jira/browse/HIVE-8183 Project: Hi

[jira] [Commented] (HIVE-7613) Research optimization of auto convert join to map join [Spark branch]

2014-09-18 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14139611#comment-14139611 ] Suhas Satish commented on HIVE-7613: {{ConvertJoinMapJoin}} heavily uses {{OptimizeTezP

[jira] [Commented] (HIVE-7613) Research optimization of auto convert join to map join [Spark branch]

2014-09-17 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14138567#comment-14138567 ] Suhas Satish commented on HIVE-7613: Hi Xuefu, thats a good idea. I was thinking on th

[jira] [Commented] (HIVE-7952) Investigate query failures (1)

2014-09-03 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14120706#comment-14120706 ] Suhas Satish commented on HIVE-7952: auto_sortmerge_join_1 and auto_sortmerge_join13 ar

[jira] [Commented] (HIVE-7613) Research optimization of auto convert join to map join [Spark branch]

2014-09-03 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14120697#comment-14120697 ] Suhas Satish commented on HIVE-7613: as a part of this work, we should also enable auto

[jira] [Assigned] (HIVE-7952) Investigate query failures (1)

2014-09-02 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish reassigned HIVE-7952: -- Assignee: Suhas Satish > Investigate query failures (1) > -- > >

[jira] [Commented] (HIVE-7869) Build long running HS2 test framework

2014-09-02 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118721#comment-14118721 ] Suhas Satish commented on HIVE-7869: thanks Brock. I will continue to add queries to th

[jira] [Commented] (HIVE-7869) Long running tests (1) [Spark Branch]

2014-08-29 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14115909#comment-14115909 ] Suhas Satish commented on HIVE-7869: addressed review board comments > Long running te

[jira] [Updated] (HIVE-7869) Long running tests (1) [Spark Branch]

2014-08-29 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-7869: --- Attachment: HIVE-7869.2-spark.patch > Long running tests (1) [Spark Branch] >

[jira] [Commented] (HIVE-7775) enable sample8.q.[Spark Branch]

2014-08-29 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14115380#comment-14115380 ] Suhas Satish commented on HIVE-7775: what kind of join did Szehon enable? Does hive on

[jira] [Commented] (HIVE-7551) expand spark accumulator to support hive counter [Spark Branch]

2014-08-29 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14115369#comment-14115369 ] Suhas Satish commented on HIVE-7551: Assigning to myself after talking to Na. Is this f

[jira] [Assigned] (HIVE-7551) expand spark accumulator to support hive counter [Spark Branch]

2014-08-29 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish reassigned HIVE-7551: -- Assignee: Suhas Satish (was: Na Yang) > expand spark accumulator to support hive counter [Spar

[jira] [Commented] (HIVE-7869) Long running tests (1) [Spark Branch]

2014-08-28 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14114696#comment-14114696 ] Suhas Satish commented on HIVE-7869: est failures are not related to the patch. > Lon

[jira] [Commented] (HIVE-7869) Long running tests (1) [Spark Branch]

2014-08-28 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14114665#comment-14114665 ] Suhas Satish commented on HIVE-7869: https://reviews.apache.org/r/25177/ > Long runnin

[jira] [Updated] (HIVE-7869) Long running tests (1) [Spark Branch]

2014-08-28 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-7869: --- Attachment: HIVE-7869-spark.patch > Long running tests (1) [Spark Branch] > --

[jira] [Updated] (HIVE-7869) Long running tests (1) [Spark Branch]

2014-08-28 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-7869: --- Status: Patch Available (was: Open) > Long running tests (1) [Spark Branch] > ---

[jira] [Assigned] (HIVE-7869) Long running tests (1) [Spark Branch]

2014-08-25 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish reassigned HIVE-7869: -- Assignee: Suhas Satish > Long running tests (1) [Spark Branch] > ---

[jira] [Commented] (HIVE-7821) StarterProject: enable groupby4.q

2014-08-22 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14107795#comment-14107795 ] Suhas Satish commented on HIVE-7821: 4 of the 5 tests are unrelated to SparkCliDriver.

[jira] [Updated] (HIVE-7821) StarterProject: enable groupby4.q

2014-08-22 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-7821: --- Attachment: HIVE-7821.4-spark.patch > StarterProject: enable groupby4.q >

[jira] [Commented] (HIVE-7821) StarterProject: enable groupby4.q

2014-08-22 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14107639#comment-14107639 ] Suhas Satish commented on HIVE-7821: rebasing patch > StarterProject: enable groupby4.

[jira] [Updated] (HIVE-7821) StarterProject: enable groupby4.q

2014-08-22 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-7821: --- Attachment: (was: HIVE-7821.2-spark.patch) > StarterProject: enable groupby4.q > -

[jira] [Updated] (HIVE-7821) StarterProject: enable groupby4.q

2014-08-22 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-7821: --- Attachment: HIVE-7821.3-spark.patch > StarterProject: enable groupby4.q >

[jira] [Updated] (HIVE-7821) StarterProject: enable groupby4.q

2014-08-22 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-7821: --- Attachment: HIVE-7821.2-spark.patch > StarterProject: enable groupby4.q >

[jira] [Updated] (HIVE-7821) StarterProject: enable groupby4.q

2014-08-22 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-7821: --- Attachment: (was: HIVE-7821-spark.2.patch) > StarterProject: enable groupby4.q > -

[jira] [Commented] (HIVE-7821) StarterProject: enable groupby4.q

2014-08-22 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14107376#comment-14107376 ] Suhas Satish commented on HIVE-7821: Attached updated patch generated with git diff --n

[jira] [Updated] (HIVE-7821) StarterProject: enable groupby4.q

2014-08-22 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-7821: --- Attachment: HIVE-7821-spark.2.patch > StarterProject: enable groupby4.q >

[jira] [Commented] (HIVE-7821) StarterProject: enable groupby4.q

2014-08-22 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14107319#comment-14107319 ] Suhas Satish commented on HIVE-7821: grouby4 has a deterministic order, so the output o

[jira] [Updated] (HIVE-7821) StarterProject: enable groupby4.q

2014-08-22 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-7821: --- Attachment: HIVE-7821.patch > StarterProject: enable groupby4.q > - >

[jira] [Updated] (HIVE-7821) StarterProject: enable groupby4.q

2014-08-22 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-7821: --- Status: Patch Available (was: Open) > StarterProject: enable groupby4.q > ---

[jira] [Assigned] (HIVE-7821) StarterProject: enable groupby4.q

2014-08-21 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish reassigned HIVE-7821: -- Assignee: Suhas Satish (was: Chinna Rao Lalam) > StarterProject: enable groupby4.q > --

[jira] [Commented] (HIVE-5351) Secure-Socket-Layer (SSL) support for HiveServer2

2014-07-02 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14050663#comment-14050663 ] Suhas Satish commented on HIVE-5351: I have used the 3 properties above and started my

[jira] [Commented] (HIVE-4629) HS2 should support an API to retrieve query logs

2014-03-10 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13926260#comment-13926260 ] Suhas Satish commented on HIVE-4629: It would be great to have this jira accepted into