[jira] [Assigned] (HIVE-8128) Improve Parquet Vectorization

2014-11-12 Thread Dong Chen (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Chen reassigned HIVE-8128: --- Assignee: Dong Chen > Improve Parquet Vectorization > - > >

[jira] [Commented] (HIVE-8812) TestMinimrCliDriver failure if run in the same command as TestHBaseNegativeCliDriver

2014-11-12 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209408#comment-14209408 ] Hive QA commented on HIVE-8812: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Updated] (HIVE-8192) Check DDL's writetype in DummyTxnManager

2014-11-12 Thread cw (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cw updated HIVE-8192: - Attachment: HIVE-8192.2.patch > Check DDL's writetype in DummyTxnManager > > >

[jira] [Updated] (HIVE-8192) Check DDL's writetype in DummyTxnManager

2014-11-12 Thread cw (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cw updated HIVE-8192: - Attachment: (was: HIVE-8192.patch.txt) > Check DDL's writetype in DummyTxnManager > ---

[jira] [Updated] (HIVE-8192) Check DDL's writetype in DummyTxnManager

2014-11-12 Thread cw (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cw updated HIVE-8192: - Status: Patch Available (was: Open) > Check DDL's writetype in DummyTxnManager >

[jira] [Commented] (HIVE-8284) Equality comparison is done between two floating point variables in HiveRelMdUniqueKeys#getUniqueKeys()

2014-11-12 Thread JongWon Park (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209379#comment-14209379 ] JongWon Park commented on HIVE-8284: Thanks, Ashutosh! > Equality comparison is done b

[jira] [Updated] (HIVE-5150) UnsatisfiedLinkError when running hive unit tests on Windows

2014-11-12 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-5150: --- Resolution: Won't Fix Status: Resolved (was: Patch Available) After move to maven base

[jira] [Commented] (HIVE-7333) Create RDD translator, translating Hive Tables into Spark RDDs [Spark Branch]

2014-11-12 Thread Kiran Lonikar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209358#comment-14209358 ] Kiran Lonikar commented on HIVE-7333: - Thanks. Considering what Reynold said, I looked

[jira] [Commented] (HIVE-8842) auto_join2.q produces incorrect tree [Spark Branch]

2014-11-12 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209353#comment-14209353 ] Hive QA commented on HIVE-8842: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Updated] (HIVE-8284) Equality comparison is done between two floating point variables in HiveRelMdUniqueKeys#getUniqueKeys()

2014-11-12 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-8284: --- Component/s: CBO > Equality comparison is done between two floating point variables in > HiveR

[jira] [Updated] (HIVE-8284) Equality comparison is done between two floating point variables in HiveRelMdUniqueKeys#getUniqueKeys()

2014-11-12 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-8284: --- Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch Availabl

[jira] [Commented] (HIVE-7333) Create RDD translator, translating Hive Tables into Spark RDDs [Spark Branch]

2014-11-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209339#comment-14209339 ] Xuefu Zhang commented on HIVE-7333: --- I created HIVE-8853 for work related to vectorizatio

[jira] [Created] (HIVE-8853) Make vectorization work with Spark [Spark Branch]

2014-11-12 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-8853: - Summary: Make vectorization work with Spark [Spark Branch] Key: HIVE-8853 URL: https://issues.apache.org/jira/browse/HIVE-8853 Project: Hive Issue Type: Sub-task

[jira] [Commented] (HIVE-7333) Create RDD translator, translating Hive Tables into Spark RDDs [Spark Branch]

2014-11-12 Thread Kiran Lonikar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209302#comment-14209302 ] Kiran Lonikar commented on HIVE-7333: - Hi Rui, Thanks for your quick reply. I did not

[jira] [Commented] (HIVE-7333) Create RDD translator, translating Hive Tables into Spark RDDs [Spark Branch]

2014-11-12 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209330#comment-14209330 ] Rui Li commented on HIVE-7333: -- Hi Xuefu & Reynold, Thanks a lot for the explanations! Hi Ki

[jira] [Commented] (HIVE-7333) Create RDD translator, translating Hive Tables into Spark RDDs [Spark Branch]

2014-11-12 Thread Kiran Lonikar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209329#comment-14209329 ] Kiran Lonikar commented on HIVE-7333: - i think this is what shark did, It had each RDD

[jira] [Commented] (HIVE-7333) Create RDD translator, translating Hive Tables into Spark RDDs [Spark Branch]

2014-11-12 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209327#comment-14209327 ] Reynold Xin commented on HIVE-7333: --- Don't think any changes are necessary in Spark. At t

[jira] [Commented] (HIVE-8295) Add batch retrieve partition objects for metastore direct sql

2014-11-12 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209328#comment-14209328 ] Hive QA commented on HIVE-8295: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Updated] (HIVE-8823) Add additional serde properties for parquet

2014-11-12 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu updated HIVE-8823: --- Attachment: HIVE-8823.2.patch Thank Brock for your review. Since these two properties are not needed fo

[jira] [Commented] (HIVE-7333) Create RDD translator, translating Hive Tables into Spark RDDs [Spark Branch]

2014-11-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209321#comment-14209321 ] Xuefu Zhang commented on HIVE-7333: --- Hi [~rxin], thanks for your input. This is rather in

[jira] [Commented] (HIVE-7333) Create RDD translator, translating Hive Tables into Spark RDDs [Spark Branch]

2014-11-12 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209315#comment-14209315 ] Reynold Xin commented on HIVE-7333: --- This is pretty trivial to solve. Each "row" in a RDD

[jira] [Assigned] (HIVE-8852) Update new spark progress API for local submitted job monitoring[Spark Branch]

2014-11-12 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li reassigned HIVE-8852: Assignee: Rui Li > Update new spark progress API for local submitted job monitoring[Spark Branch] >

[jira] [Commented] (HIVE-7333) Create RDD translator, translating Hive Tables into Spark RDDs [Spark Branch]

2014-11-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209309#comment-14209309 ] Xuefu Zhang commented on HIVE-7333: --- That's correct. Rui. RDD is a dataset of rows. How t

[jira] [Commented] (HIVE-7292) Hive on Spark

2014-11-12 Thread Kiran Lonikar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209307#comment-14209307 ] Kiran Lonikar commented on HIVE-7292: - Sorry, I have not looked at the code, but want t

[jira] [Created] (HIVE-8852) Update new spark progress API for local submitted job monitoring[Spark Branch]

2014-11-12 Thread Chengxiang Li (JIRA)
Chengxiang Li created HIVE-8852: --- Summary: Update new spark progress API for local submitted job monitoring[Spark Branch] Key: HIVE-8852 URL: https://issues.apache.org/jira/browse/HIVE-8852 Project: Hiv

[jira] [Updated] (HIVE-8830) hcatalog process don't exit because of non daemon thread

2014-11-12 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated HIVE-8830: Resolution: Fixed Status: Resolved (was: Patch Available) Patch committed to trunk. Thanks f

[jira] [Commented] (HIVE-7333) Create RDD translator, translating Hive Tables into Spark RDDs [Spark Branch]

2014-11-12 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209297#comment-14209297 ] Rui Li commented on HIVE-7333: -- Hi [~klonikar], Thanks for your interest. When I did the test

[jira] [Commented] (HIVE-7333) Create RDD translator, translating Hive Tables into Spark RDDs [Spark Branch]

2014-11-12 Thread Kiran Lonikar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209281#comment-14209281 ] Kiran Lonikar commented on HIVE-7333: - Sorry, I have not looked at the code, but want t

Re: Review Request 27933: HIVE-8810 Make HashTableSinkOperator works for Spark Branch [Spark Branch]

2014-11-12 Thread Jimmy Xiang
> On Nov. 13, 2014, 12:34 a.m., Chao Sun wrote: > > ql/src/java/org/apache/hadoop/hive/ql/exec/SparkHashTableSinkOperator.java, > > line 326 > > > > > > Can we use "SPARKHASHTABLESINK", or something similar? > > Jimm

[jira] [Created] (HIVE-8851) Broadcast files for small tables via SparkContext.addFile() and SparkFiles.get() [Spark Branch]

2014-11-12 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-8851: - Summary: Broadcast files for small tables via SparkContext.addFile() and SparkFiles.get() [Spark Branch] Key: HIVE-8851 URL: https://issues.apache.org/jira/browse/HIVE-8851

[jira] [Updated] (HIVE-8842) auto_join2.q produces incorrect tree [Spark Branch]

2014-11-12 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao updated HIVE-8842: --- Attachment: HIVE-8842.3-spark.patch Addressing RB comments. > auto_join2.q produces incorrect tree [Spark Branch] > --

[jira] [Commented] (HIVE-7664) VectorizedBatchUtil.addRowToBatchFrom is not optimized for Vectorized execution and takes 25% CPU

2014-11-12 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209256#comment-14209256 ] Hive QA commented on HIVE-7664: --- {color:red}Overall{color}: -1 no tests executed Here are

[jira] [Commented] (HIVE-8739) handle Derby errors with joins and filters in Direct SQL in a Derby-specific path

2014-11-12 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209252#comment-14209252 ] Hive QA commented on HIVE-8739: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Updated] (HIVE-8810) Make HashTableSinkOperator works for Spark Branch [Spark Branch]

2014-11-12 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Xiang updated HIVE-8810: -- Status: Open (was: Patch Available) > Make HashTableSinkOperator works for Spark Branch [Spark Branch] >

Re: Review Request 27955: HIVE-8842 - auto_join2.q produces incorrect tree [Spark Branch]

2014-11-12 Thread Chao Sun
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27955/ --- (Updated Nov. 13, 2014, 4:38 a.m.) Review request for hive, Szehon Ho and Xuefu

Re: Review Request 27955: HIVE-8842 - auto_join2.q produces incorrect tree [Spark Branch]

2014-11-12 Thread Chao Sun
> On Nov. 13, 2014, 3:56 a.m., Xuefu Zhang wrote: > > ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/SparkMapJoinResolver.java, > > line 136 > > > > > > It seems that originalWork is the work enclosed in ori

[jira] [Commented] (HIVE-5150) UnsatisfiedLinkError when running hive unit tests on Windows

2014-11-12 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209254#comment-14209254 ] Hive QA commented on HIVE-5150: --- {color:red}Overall{color}: -1 no tests executed Here are

[jira] [Commented] (HIVE-8842) auto_join2.q produces incorrect tree [Spark Branch]

2014-11-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209224#comment-14209224 ] Xuefu Zhang commented on HIVE-8842: --- Thanks for working on this, [~csun]. Minor comment/q

Re: Review Request 27955: HIVE-8842 - auto_join2.q produces incorrect tree [Spark Branch]

2014-11-12 Thread Xuefu Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27955/#review61198 --- ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/SparkMapJo

[jira] [Commented] (HIVE-8842) auto_join2.q produces incorrect tree [Spark Branch]

2014-11-12 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209220#comment-14209220 ] Hive QA commented on HIVE-8842: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Assigned] (HIVE-8841) Make RDD caching work for multi-insert after HIVE-8793 when map join is involved [Spark Branch]

2014-11-12 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li reassigned HIVE-8841: Assignee: Rui Li > Make RDD caching work for multi-insert after HIVE-8793 when map join is > involved [Spar

[jira] [Updated] (HIVE-8780) insert1.q and ppd_join4.q hangs with hadoop-1 [Spark Branch]

2014-11-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8780: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available)

[jira] [Commented] (HIVE-8780) insert1.q and ppd_join4.q hangs with hadoop-1 [Spark Branch]

2014-11-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209210#comment-14209210 ] Xuefu Zhang commented on HIVE-8780: --- Thanks, [~chengxiang li]. This is very good to know.

Re: Review Request 27566: HIVE-8609: move beeline to jline2

2014-11-12 Thread cheng xu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27566/ --- (Updated Nov. 13, 2014, 3:44 a.m.) Review request for hive. Repository: hive-

[jira] [Updated] (HIVE-8609) Move beeline to jline2

2014-11-12 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu updated HIVE-8609: --- Attachment: HIVE-8609.5.patch > Move beeline to jline2 > -- > > Key

[jira] [Updated] (HIVE-8609) Move beeline to jline2

2014-11-12 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu updated HIVE-8609: --- Attachment: (was: HIVE-8609.5.patch) > Move beeline to jline2 > -- > >

[jira] [Updated] (HIVE-8609) Move beeline to jline2

2014-11-12 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu updated HIVE-8609: --- Attachment: (was: HIVE-8609.5.patch) > Move beeline to jline2 > -- > >

[jira] [Updated] (HIVE-8609) Move beeline to jline2

2014-11-12 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu updated HIVE-8609: --- Attachment: HIVE-8609.5.patch A quick update for the patch with Mohit's comments and drop the previous

[jira] [Commented] (HIVE-8839) Support "alter table .. add/replace columns cascade"

2014-11-12 Thread Chaoyu Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209199#comment-14209199 ] Chaoyu Tang commented on HIVE-8839: --- Most failures were from temp table tests, will look

[jira] [Updated] (HIVE-8340) Windows: HiveServer2 service doesn't stop backend jvm process, which prevents follow-up service start.

2014-11-12 Thread Vaibhav Gumashta (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vaibhav Gumashta updated HIVE-8340: --- Summary: Windows: HiveServer2 service doesn't stop backend jvm process, which prevents follow-u

Re: Review Request 27566: HIVE-8609: move beeline to jline2

2014-11-12 Thread cheng xu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27566/ --- (Updated Nov. 13, 2014, 3:35 a.m.) Review request for hive. Changes ---

[jira] [Commented] (HIVE-8845) Switch to Tez 0.5.2

2014-11-12 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209173#comment-14209173 ] Hive QA commented on HIVE-8845: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-8780) insert1.q and ppd_join4.q hangs with hadoop-1 [Spark Branch]

2014-11-12 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209200#comment-14209200 ] Chengxiang Li commented on HIVE-8780: - Well, Spark wrapped hdfs file with HadoopRDD, du

Re: Review Request 27566: HIVE-8609: move beeline to jline2

2014-11-12 Thread cheng xu
> On Nov. 13, 2014, 2:06 a.m., Mohit Sabharwal wrote: > > beeline/src/java/org/apache/hive/beeline/BeeLineCommandCompleter.java, line > > 35 > > > > > > nit: add @Override The override keyword is not applicable here s

Re: Review Request 27933: HIVE-8810 Make HashTableSinkOperator works for Spark Branch [Spark Branch]

2014-11-12 Thread Xuefu Zhang
> On Nov. 12, 2014, 11:47 p.m., Xuefu Zhang wrote: > > ql/src/java/org/apache/hadoop/hive/ql/exec/SparkHashTableSinkOperator.java, > > line 57 > > > > > > Could we extend from HashTableSinkOperator instead? > > Jimmy

[jira] [Updated] (HIVE-8609) Move beeline to jline2

2014-11-12 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu updated HIVE-8609: --- Attachment: HIVE-8609.5.patch Hi [~brocknoland] and [~mohitsabharwal], I found one of the reasons for t

[jira] [Commented] (HIVE-8840) Print prettier Spark work graph after HIVE-8793 [Spark Branch]

2014-11-12 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209061#comment-14209061 ] Rui Li commented on HIVE-8840: -- I think two things need to be done to achieve this purpose: 1.

[jira] [Updated] (HIVE-8842) auto_join2.q produces incorrect tree [Spark Branch]

2014-11-12 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao updated HIVE-8842: --- Attachment: HIVE-8842.2-spark.patch Also fixed an issue about dependency - the original SparkTask may have children, a

[jira] [Updated] (HIVE-7685) Parquet memory manager

2014-11-12 Thread Dong Chen (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Chen updated HIVE-7685: Attachment: HIVE-7685.1.patch.ready Update the config definition name in HiveConf. It is defined in Parquet.

Review Request 27955: HIVE-8842 - auto_join2.q produces incorrect tree [Spark Branch]

2014-11-12 Thread Chao Sun
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27955/ --- Review request for hive, Szehon Ho and Xuefu Zhang. Bugs: HIVE-8842 https:/

Re: Review Request 27933: HIVE-8810 Make HashTableSinkOperator works for Spark Branch [Spark Branch]

2014-11-12 Thread Jimmy Xiang
> On Nov. 13, 2014, 12:34 a.m., Chao Sun wrote: > > ql/src/java/org/apache/hadoop/hive/ql/exec/SparkHashTableSinkOperator.java, > > line 326 > > > > > > Can we use "SPARKHASHTABLESINK", or something similar? > > Jimm

[jira] [Commented] (HIVE-8284) Equality comparison is done between two floating point variables in HiveRelMdUniqueKeys#getUniqueKeys()

2014-11-12 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209025#comment-14209025 ] Ashutosh Chauhan commented on HIVE-8284: +1 > Equality comparison is done between

[jira] [Updated] (HIVE-8850) ObjectStore:: rollbackTransaction() should set the transaction status to TXN_STATUS.ROLLBACK irrespective of whether it is active or not

2014-11-12 Thread Hari Sankar Sivarama Subramaniyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Sankar Sivarama Subramaniyan updated HIVE-8850: Component/s: Metastore > ObjectStore:: rollbackTransaction()

[jira] [Commented] (HIVE-8827) Remove SSLv2Hello from list of disabled protocols

2014-11-12 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209081#comment-14209081 ] Hive QA commented on HIVE-8827: --- {color:red}Overall{color}: -1 at least one tests failed H

[ANNOUNCE] Apache Hive 0.14.0 Released

2014-11-12 Thread Gunther Hagleitner
The Apache Hive team is proud to announce the the release of Apache Hive version 0.14.0. The Apache Hive (TM) data warehouse software facilitates querying and managing large datasets residing in distributed storage. Built on top of Apache Hadoop (TM), it provides: * Tools to enable easy data extr

[jira] [Updated] (HIVE-8850) ObjectStore:: rollbackTransaction() should set the transaction status to TXN_STATUS.ROLLBACK irrespective of whether it is active or not

2014-11-12 Thread Hari Sankar Sivarama Subramaniyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Sankar Sivarama Subramaniyan updated HIVE-8850: Attachment: HIVE-8850.1.patch cc-ing [~sushanth] for review.

[jira] [Updated] (HIVE-8850) ObjectStore:: rollbackTransaction() should set the transaction status to TXN_STATUS.ROLLBACK irrespective of whether it is active or not

2014-11-12 Thread Hari Sankar Sivarama Subramaniyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Sankar Sivarama Subramaniyan updated HIVE-8850: Description: We can run into issues as described below: Hive

[jira] [Commented] (HIVE-8810) Make HashTableSinkOperator works for Spark Branch [Spark Branch]

2014-11-12 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209067#comment-14209067 ] Hive QA commented on HIVE-8810: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-8536) Enable runtime skew join optimization for spark [Spark Branch]

2014-11-12 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209083#comment-14209083 ] Rui Li commented on HIVE-8536: -- Runtime skew join should be processed by two resolvers: {{Skew

[jira] [Commented] (HIVE-8793) Refactor to make splitting SparkWork a physical resolver [Spark Branch]

2014-11-12 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209056#comment-14209056 ] Rui Li commented on HIVE-8793: -- Thank you [~xuefuz] for the review! > Refactor to make splitt

[jira] [Updated] (HIVE-8824) Exception happened in case set hive.metastore.try.direct.sql to true when running 'show table stats xxx' on impala with hive metastore db is mysql

2014-11-12 Thread lixuebin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lixuebin updated HIVE-8824: --- Description: Hive Metstore Database is MySQL. First: set hive-site.xml hive.metastore.try.direct.sql true seco

[jira] [Created] (HIVE-8850) ObjectStore:: rollbackTransaction() should set the transaction status to TXN_STATUS.ROLLBACK irrespective of whether it is active or not

2014-11-12 Thread Hari Sankar Sivarama Subramaniyan (JIRA)
Hari Sankar Sivarama Subramaniyan created HIVE-8850: --- Summary: ObjectStore:: rollbackTransaction() should set the transaction status to TXN_STATUS.ROLLBACK irrespective of whether it is active or not Key: HIVE-8

Re: Review Request 27933: HIVE-8810 Make HashTableSinkOperator works for Spark Branch [Spark Branch]

2014-11-12 Thread Jimmy Xiang
> On Nov. 12, 2014, 11:47 p.m., Xuefu Zhang wrote: > > ql/src/java/org/apache/hadoop/hive/ql/exec/SparkHashTableSinkOperator.java, > > line 57 > > > > > > Could we extend from HashTableSinkOperator instead? > > Jimmy

[jira] [Updated] (HIVE-8850) ObjectStore:: rollbackTransaction() should set the transaction status to TXN_STATUS.ROLLBACK irrespective of whether it is active or not

2014-11-12 Thread Hari Sankar Sivarama Subramaniyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Sankar Sivarama Subramaniyan updated HIVE-8850: Status: Patch Available (was: Open) > ObjectStore:: rollback

[jira] [Commented] (HIVE-8850) ObjectStore:: rollbackTransaction() should set the transaction status to TXN_STATUS.ROLLBACK irrespective of whether it is active or not

2014-11-12 Thread Hari Sankar Sivarama Subramaniyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209069#comment-14209069 ] Hari Sankar Sivarama Subramaniyan commented on HIVE-8850: - Stack Tr

[jira] [Commented] (HIVE-8836) Enable automatic tests with remote spark client.[Spark Branch]

2014-11-12 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209035#comment-14209035 ] Chengxiang Li commented on HIVE-8836: - Yes, [~xuefuz], this would be enabled with HIVE-

Re: Review Request 27933: HIVE-8810 Make HashTableSinkOperator works for Spark Branch [Spark Branch]

2014-11-12 Thread Suhas Satish
> On Nov. 13, 2014, 12:34 a.m., Chao Sun wrote: > > ql/src/java/org/apache/hadoop/hive/ql/exec/SparkHashTableSinkOperator.java, > > line 326 > > > > > > Can we use "SPARKHASHTABLESINK", or something similar? > > Jimm

Re: Review Request 27566: HIVE-8609: move beeline to jline2

2014-11-12 Thread Mohit Sabharwal
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27566/#review60811 --- Few requests to improve docs, otherwise LGTM! beeline/src/java/org

Re: Review Request 27933: HIVE-8810 Make HashTableSinkOperator works for Spark Branch [Spark Branch]

2014-11-12 Thread Chao Sun
> On Nov. 13, 2014, 12:34 a.m., Chao Sun wrote: > > ql/src/java/org/apache/hadoop/hive/ql/exec/SparkHashTableSinkOperator.java, > > line 326 > > > > > > Can we use "SPARKHASHTABLESINK", or something similar? > > Jimm

[jira] [Commented] (HIVE-8845) Switch to Tez 0.5.2

2014-11-12 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208997#comment-14208997 ] Gopal V commented on HIVE-8845: --- LGTM, tests pending - +1 > Switch to Tez 0.5.2 > --

Re: Review Request 27933: HIVE-8810 Make HashTableSinkOperator works for Spark Branch [Spark Branch]

2014-11-12 Thread Jimmy Xiang
> On Nov. 13, 2014, 12:34 a.m., Chao Sun wrote: > > ql/src/java/org/apache/hadoop/hive/ql/exec/SparkHashTableSinkOperator.java, > > line 274 > > > > > > Don't need this check anymore. That's right. No need for this c

[jira] [Commented] (HIVE-8839) Support "alter table .. add/replace columns cascade"

2014-11-12 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208991#comment-14208991 ] Hive QA commented on HIVE-8839: --- {color:red}Overall{color}: -1 at least one tests failed H

Re: Review Request 27933: HIVE-8810 Make HashTableSinkOperator works for Spark Branch [Spark Branch]

2014-11-12 Thread Chao Sun
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27933/#review61150 --- ql/src/java/org/apache/hadoop/hive/ql/exec/SparkHashTableSinkOperat

[jira] [Assigned] (HIVE-8840) Print prettier Spark work graph after HIVE-8793 [Spark Branch]

2014-11-12 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Xiang reassigned HIVE-8840: - Assignee: Jimmy Xiang > Print prettier Spark work graph after HIVE-8793 [Spark Branch] > -

[jira] [Commented] (HIVE-8810) Make HashTableSinkOperator works for Spark Branch [Spark Branch]

2014-11-12 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208987#comment-14208987 ] Hive QA commented on HIVE-8810: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Updated] (HIVE-5664) Drop cascade database fails when the db has any tables with indexes

2014-11-12 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-5664: --- Affects Version/s: 0.14.0 0.13.0 Status: Open (was: Patch

[jira] [Commented] (HIVE-8826) Remove jdbm from top level license file

2014-11-12 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208969#comment-14208969 ] Ferdinand Xu commented on HIVE-8826: Thank Brock for helping me commit it. > Remove jd

[jira] [Commented] (HIVE-8842) auto_join2.q produces incorrect tree [Spark Branch]

2014-11-12 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208961#comment-14208961 ] Chao commented on HIVE-8842: Probably I need a rebase. Also, running {{auto_join2.q}} throws ex

[jira] [Updated] (HIVE-8810) Make HashTableSinkOperator works for Spark Branch [Spark Branch]

2014-11-12 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Xiang updated HIVE-8810: -- Attachment: HIVE-8810.2-spark.patch > Make HashTableSinkOperator works for Spark Branch [Spark Branch] >

Re: Review Request 27933: HIVE-8810 Make HashTableSinkOperator works for Spark Branch [Spark Branch]

2014-11-12 Thread Jimmy Xiang
> On Nov. 12, 2014, 11:47 p.m., Xuefu Zhang wrote: > > ql/src/java/org/apache/hadoop/hive/ql/plan/SparkHashTableSinkDesc.java, > > line 34 > > > > > > This class seems to be identiccal to HashTableSinkDesc. Could we ex

[jira] [Commented] (HIVE-8295) Add batch retrieve partition objects for metastore direct sql

2014-11-12 Thread Gunther Hagleitner (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208953#comment-14208953 ] Gunther Hagleitner commented on HIVE-8295: -- yes +1 for that. > Add batch retrieve

Re: Review Request 27933: HIVE-8810 Make HashTableSinkOperator works for Spark Branch [Spark Branch]

2014-11-12 Thread Jimmy Xiang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27933/ --- (Updated Nov. 12, 2014, 11:58 p.m.) Review request for hive, Chao Sun, Szehon H

[jira] [Updated] (HIVE-2137) JDBC driver doesn't encode string properly.

2014-11-12 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-2137: --- Resolution: Won't Fix Status: Resolved (was: Patch Available) HIVE-6977 removed HS1 an

[jira] [Assigned] (HIVE-8842) auto_join2.q produces incorrect tree [Spark Branch]

2014-11-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-8842: - Assignee: Chao > auto_join2.q produces incorrect tree [Spark Branch] > ---

[jira] [Commented] (HIVE-2974) Add online docs for from_utc_timestamp() and to_utc_timestamp()

2014-11-12 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208932#comment-14208932 ] Lefty Leverenz commented on HIVE-2974: -- Doc note: The wiki already documents from_utc

Re: Review Request 27933: HIVE-8810 Make HashTableSinkOperator works for Spark Branch [Spark Branch]

2014-11-12 Thread Xuefu Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27933/#review61102 --- ql/src/java/org/apache/hadoop/hive/ql/exec/SparkHashTableSinkOperat

[jira] [Comment Edited] (HIVE-8512) queries with star and aggregate should fail

2014-11-12 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208882#comment-14208882 ] Sergey Shelukhin edited comment on HIVE-8512 at 11/12/14 11:28 PM: --

[jira] [Commented] (HIVE-8512) queries with star and aggregate should fail

2014-11-12 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208882#comment-14208882 ] Sergey Shelukhin commented on HIVE-8512: The problem is that validation for this is

[jira] [Updated] (HIVE-7532) allow disabling direct sql per query with external metastore

2014-11-12 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lefty Leverenz updated HIVE-7532: - Labels: (was: TODOC14) > allow disabling direct sql per query with external metastore > -

[jira] [Commented] (HIVE-7532) allow disabling direct sql per query with external metastore

2014-11-12 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208875#comment-14208875 ] Lefty Leverenz commented on HIVE-7532: -- Good to know. Thanks [~sershe]. > allow disa

  1   2   3   4   >