[jira] [Updated] (HIVE-8716) Partition filters are not pushed down with lateral view

2014-11-05 Thread Prasanth J (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth J updated HIVE-8716: - Attachment: HIVE-8716.2.patch Partition filters are not pushed down with lateral view

[jira] [Commented] (HIVE-8732) ORC string statistics are not merged correctly

2014-11-05 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14197848#comment-14197848 ] Hive QA commented on HIVE-8732: --- {color:green}Overall{color}: +1 all checks pass Here are

[jira] [Commented] (HIVE-8735) statistics update can fail due to long paths

2014-11-05 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14197979#comment-14197979 ] Hive QA commented on HIVE-8735: --- {color:red}Overall{color}: -1 at least one tests failed

[jira] [Commented] (HIVE-8739) better logging for direct SQL errors and handle more special cases

2014-11-05 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198111#comment-14198111 ] Hive QA commented on HIVE-8739: --- {color:red}Overall{color}: -1 at least one tests failed

[jira] [Commented] (HIVE-7858) Parquet compression should be configurable via table property

2014-11-05 Thread Alex McLintock (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198231#comment-14198231 ] Alex McLintock commented on HIVE-7858: -- (I'm trying to understand the scope of this

[jira] [Commented] (HIVE-8724) Right outer join produces incorrect result on Tez

2014-11-05 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198246#comment-14198246 ] Hive QA commented on HIVE-8724: --- {color:red}Overall{color}: -1 at least one tests failed

[jira] [Commented] (HIVE-8740) Sorted dynamic partition does not work correctly with constant folding

2014-11-05 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198322#comment-14198322 ] Hive QA commented on HIVE-8740: --- {color:red}Overall{color}: -1 at least one tests failed

Parsing Hive queries to get table names and column names

2014-11-05 Thread Ritesh Gautam
Hello, I am trying to parse hive queries so that I can get the table names on which the query is dependent on. I have tried the following : 1) downloaded the grammer and used ANTLR to generate the lexer and parser, but there are some errors as such when I try to build it: .. symbol:

[jira] [Commented] (HIVE-8716) Partition filters are not pushed down with lateral view

2014-11-05 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198359#comment-14198359 ] Hive QA commented on HIVE-8716: --- {color:red}Overall{color}: -1 at least one tests failed

[jira] [Created] (HIVE-8742) ODBC driver for HiveServer2

2014-11-05 Thread Guo Ruijing (JIRA)
Guo Ruijing created HIVE-8742: - Summary: ODBC driver for HiveServer2 Key: HIVE-8742 URL: https://issues.apache.org/jira/browse/HIVE-8742 Project: Hive Issue Type: Improvement

[jira] [Updated] (HIVE-8728) Fix ptf.q determinism

2014-11-05 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8728: -- Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch Available)

Can we submit Hive on Spark queries to Spark-Hadoop1

2014-11-05 Thread Prabu Soundar Rajan -X (prabsoun - MINDTREE LIMITED at Cisco)
Hi Team, We observe when we submit queries through hive on Spark to a Spark cluster build with hadoop1, it is looking for some hadoop-2 class constructs and the tasks are failing. Could you please explain us can we submit queries to Spark cluster build with hadoop1. Thanks Regards, Prabu

[jira] [Commented] (HIVE-8718) Refactoring: move mapLocalWork field from MapWork to BaseWork

2014-11-05 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198477#comment-14198477 ] Xuefu Zhang commented on HIVE-8718: --- committed to trunk. Thanks to Szehon for the review.

[jira] [Updated] (HIVE-8718) Refactoring: move mapLocalWork field from MapWork to BaseWork

2014-11-05 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8718: -- Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch Available)

Re: Hive 0.14 update

2014-11-05 Thread jay vyas
Hi hive ! A while back i created https://issues.apache.org/jira/browse/HIVE-8553 but no feedback on it yet. As part of the 0.14 release, maybe some thoughts on how to best curate hive smoke tests for apache bigtop in that JIRA would be superhelpful to us in the bigtop community. And as always,

[jira] [Commented] (HIVE-8739) better logging for direct SQL errors and handle more special cases

2014-11-05 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198519#comment-14198519 ] Ashutosh Chauhan commented on HIVE-8739: {code} tableValue = (case when

[jira] [Commented] (HIVE-8329) Enable postgres for storing stats

2014-11-05 Thread Damien Carol (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198531#comment-14198531 ] Damien Carol commented on HIVE-8329: Doesn't compile on the trunk :/ don't know why

[jira] [Commented] (HIVE-8728) Fix ptf.q determinism

2014-11-05 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198555#comment-14198555 ] Xuefu Zhang commented on HIVE-8728: --- Also merged to Spark branch. Fix ptf.q determinism

[jira] [Commented] (HIVE-8718) Refactoring: move mapLocalWork field from MapWork to BaseWork

2014-11-05 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198561#comment-14198561 ] Xuefu Zhang commented on HIVE-8718: --- Also merged to Spark branch. Refactoring: move

[jira] [Commented] (HIVE-7858) Parquet compression should be configurable via table property

2014-11-05 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198635#comment-14198635 ] Brock Noland commented on HIVE-7858: Hi, This change doesn't really have anything to

[jira] [Updated] (HIVE-8736) add ordering to cbo_correctness to make result consistent

2014-11-05 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-8736: --- Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch

[jira] [Commented] (HIVE-8484) HCatalog throws an exception if Pig job is of type 'fetch'

2014-11-05 Thread Lorand Bendig (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198641#comment-14198641 ] Lorand Bendig commented on HIVE-8484: - I suspect that these failing tests are not

Re: Can we submit Hive on Spark queries to Spark-Hadoop1

2014-11-05 Thread Xuefu Zhang
Did you build Hive with -Phadoop-1? --Xuefu On Wed, Nov 5, 2014 at 6:53 AM, Prabu Soundar Rajan -X (prabsoun - MINDTREE LIMITED at Cisco) prabs...@cisco.com wrote: Hi Team, We observe when we submit queries through hive on Spark to a Spark cluster build with hadoop1, it is looking for some

[jira] [Commented] (HIVE-8711) DB deadlocks not handled in TxnHandler for Postgres, Oracle, and SQLServer

2014-11-05 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198675#comment-14198675 ] Alan Gates commented on HIVE-8711: -- bq. 1. TxnHandler.detectDeadlock() - I think it makes

[jira] [Updated] (HIVE-8711) DB deadlocks not handled in TxnHandler for Postgres, Oracle, and SQLServer

2014-11-05 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-8711: - Status: Open (was: Patch Available) DB deadlocks not handled in TxnHandler for Postgres, Oracle, and

[jira] [Updated] (HIVE-8661) JDBC/HCat MinimizeJAR should be configurable in pom.xml

2014-11-05 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-8661: --- Status: Open (was: Patch Available) Seems like patch needs to be rebased. Its a real

[jira] [Updated] (HIVE-8733) HiveServer2 dynamic service discovery not picking correct IP address when hive.server2.thrift.bind.host is not set

2014-11-05 Thread Vaibhav Gumashta (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vaibhav Gumashta updated HIVE-8733: --- Resolution: Fixed Status: Resolved (was: Patch Available) Patch committed to trunk

[jira] [Commented] (HIVE-8622) Split map-join plan into 2 SparkTasks in 3 stages [Spark Branch]

2014-11-05 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198723#comment-14198723 ] Suhas Satish commented on HIVE-8622: I saw this condition in your patch -

Review Request 27627: Split map-join plan into 2 SparkTasks in 3 stages [Spark Branch]

2014-11-05 Thread Chao Sun
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27627/ --- Review request for hive. Bugs: HIVE-8622

[jira] [Updated] (HIVE-8727) Dag summary has incorrect row counts and duration per vertex

2014-11-05 Thread Prasanth J (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth J updated HIVE-8727: - Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (HIVE-8743) Disable MapJoin [Spark Branch]

2014-11-05 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Xiang updated HIVE-8743: -- Fix Version/s: spark-branch Status: Patch Available (was: Open) Disable MapJoin [Spark

[jira] [Commented] (HIVE-8743) Disable MapJoin [Spark Branch]

2014-11-05 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198777#comment-14198777 ] Xuefu Zhang commented on HIVE-8743: --- +1 Disable MapJoin [Spark Branch]

[jira] [Updated] (HIVE-7729) Enable q-tests for ANALYZE TABLE feature [Spark Branch]

2014-11-05 Thread Na Yang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Na Yang updated HIVE-7729: -- Status: Patch Available (was: Open) Enable q-tests for ANALYZE TABLE feature [Spark Branch]

[jira] [Updated] (HIVE-8743) Disable MapJoin [Spark Branch]

2014-11-05 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8743: -- Resolution: Fixed Status: Resolved (was: Patch Available) committed to Spark branch. Disable

[jira] [Commented] (HIVE-7729) Enable q-tests for ANALYZE TABLE feature [Spark Branch]

2014-11-05 Thread Na Yang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198780#comment-14198780 ] Na Yang commented on HIVE-7729: --- Enabled some .q tests for stats. Hive-on-Spark does not

Review Request 27632: Enable q-tests for ANALYZE TABLE feature [Spark Branch]

2014-11-05 Thread Na Yang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27632/ --- Review request for hive, Brock Noland, Szehon Ho, and Xuefu Zhang. Bugs:

Re: Review Request 27632: Enable q-tests for ANALYZE TABLE feature [Spark Branch]

2014-11-05 Thread Na Yang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27632/ --- (Updated Nov. 5, 2014, 6:27 p.m.) Review request for hive, Brock Noland,

[jira] [Commented] (HIVE-8743) Disable MapJoin [Spark Branch]

2014-11-05 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198805#comment-14198805 ] Hive QA commented on HIVE-8743: --- {color:red}Overall{color}: -1 no tests executed Here are

[jira] [Updated] (HIVE-8099) IN operator for partition column fails when the partition column type is DATE

2014-11-05 Thread Venki Korukanti (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venki Korukanti updated HIVE-8099: -- Attachment: HIVE-8099.1.patch bq. We need to change partition pruning code to consider the

[jira] [Updated] (HIVE-8099) IN operator for partition column fails when the partition column type is DATE

2014-11-05 Thread Venki Korukanti (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venki Korukanti updated HIVE-8099: -- Status: Patch Available (was: Open) IN operator for partition column fails when the partition

[jira] [Commented] (HIVE-8550) Hive cannot load data into partitioned table with Unicode key

2014-11-05 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198880#comment-14198880 ] Xiaobing Zhou commented on HIVE-8550: - Non-Windows installations already supported

Re: Review Request 27627: Split map-join plan into 2 SparkTasks in 3 stages [Spark Branch]

2014-11-05 Thread Xuefu Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27627/#review59987 ---

Re: Review Request 27632: Enable q-tests for ANALYZE TABLE feature [Spark Branch]

2014-11-05 Thread Szehon Ho
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27632/#review60001 --- Let's hold off and see why its picking counter when spark

[jira] [Updated] (HIVE-7795) Enable ptf.q and ptf_streaming.q.[Spark Branch]

2014-11-05 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Xiang updated HIVE-7795: -- Fix Version/s: spark-branch Status: Patch Available (was: Open) Enable ptf.q and

[jira] [Updated] (HIVE-7795) Enable ptf.q and ptf_streaming.q.[Spark Branch]

2014-11-05 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Xiang updated HIVE-7795: -- Attachment: HIVE-7795.1-spark.patch Enable ptf.q and ptf_streaming.q.[Spark Branch]

[jira] [Commented] (HIVE-8740) Sorted dynamic partition does not work correctly with constant folding

2014-11-05 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198913#comment-14198913 ] Alan Gates commented on HIVE-8740: -- Is this the set of queries you're referring to? {code}

[jira] [Updated] (HIVE-8737) setEnv is not portable, which fails TestCliDriverMethods#testprocessInitFiles on Windows

2014-11-05 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HIVE-8737: Description: repro: {noformat} mvn test -Phadoop-2 -Dtest=TestCliDriverMethods#testprocessInitFiles

[jira] [Commented] (HIVE-7729) Enable q-tests for ANALYZE TABLE feature [Spark Branch]

2014-11-05 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198935#comment-14198935 ] Hive QA commented on HIVE-7729: --- {color:red}Overall{color}: -1 at least one tests failed

[jira] [Commented] (HIVE-8724) Right outer join produces incorrect result on Tez

2014-11-05 Thread Harish Butani (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198966#comment-14198966 ] Harish Butani commented on HIVE-8724: - Oh '(this.fetchDone[t] == false)' was

[jira] [Commented] (HIVE-8724) Right outer join produces incorrect result on Tez

2014-11-05 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198968#comment-14198968 ] Ashutosh Chauhan commented on HIVE-8724: +1 vector_decimal_3 failure needs to be

[jira] [Commented] (HIVE-8740) Sorted dynamic partition does not work correctly with constant folding

2014-11-05 Thread Prasanth J (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198987#comment-14198987 ] Prasanth J commented on HIVE-8740: -- Ah ok!. With hive convention of INSERT INTO I was

[jira] [Updated] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-05 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8700: --- Attachment: HIVE-8700-spark.patch Replace ReduceSink to HashTableSink (or equi.) for small tables

[jira] [Updated] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-05 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8700: --- Status: Patch Available (was: Open) Replace ReduceSink to HashTableSink (or equi.) for small tables

[jira] [Commented] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-05 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199000#comment-14199000 ] Suhas Satish commented on HIVE-8700: Attaching a patch that leverages changes from

[jira] [Commented] (HIVE-8622) Split map-join plan into 2 SparkTasks in 3 stages [Spark Branch]

2014-11-05 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199002#comment-14199002 ] Suhas Satish commented on HIVE-8622: Thanks Chao, I have leveraged some of your work in

[jira] [Created] (HIVE-8744) hbase_stats3.q test fails when paths stored at JDBCStatsUtils.getIdColumnName() are too large

2014-11-05 Thread JIRA
Sergio Peña created HIVE-8744: - Summary: hbase_stats3.q test fails when paths stored at JDBCStatsUtils.getIdColumnName() are too large Key: HIVE-8744 URL: https://issues.apache.org/jira/browse/HIVE-8744

Review Request 27640: Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-05 Thread Suhas Satish
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27640/ --- Review request for hive, Chao Sun, Jimmy Xiang, Szehon Ho, and Xuefu Zhang.

Re: Review Request 27640: HIVE-8700 Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-05 Thread Suhas Satish
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27640/ --- (Updated Nov. 5, 2014, 8:29 p.m.) Review request for hive, Chao Sun, Jimmy

[jira] [Commented] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-05 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199011#comment-14199011 ] Suhas Satish commented on HIVE-8700: https://reviews.apache.org/r/27640/ Replace

[jira] [Updated] (HIVE-8744) hbase_stats3.q test fails when paths stored at JDBCStatsUtils.getIdColumnName() are too large

2014-11-05 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-8744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergio Peña updated HIVE-8744: -- Attachment: CDH-23009.1.java hbase_stats3.q test fails when paths stored at

[jira] [Updated] (HIVE-8744) hbase_stats3.q test fails when paths stored at JDBCStatsUtils.getIdColumnName() are too large

2014-11-05 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-8744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergio Peña updated HIVE-8744: -- Status: Patch Available (was: Open) hbase_stats3.q test fails when paths stored at

[jira] [Commented] (HIVE-7795) Enable ptf.q and ptf_streaming.q.[Spark Branch]

2014-11-05 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199059#comment-14199059 ] Hive QA commented on HIVE-7795: --- {color:red}Overall{color}: -1 at least one tests failed

[jira] [Commented] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-05 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199065#comment-14199065 ] Hive QA commented on HIVE-8700: --- {color:red}Overall{color}: -1 no tests executed Here are

[jira] [Updated] (HIVE-8724) Right outer join produces incorrect result on Tez

2014-11-05 Thread Gunther Hagleitner (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gunther Hagleitner updated HIVE-8724: - Status: Patch Available (was: Open) Right outer join produces incorrect result on Tez

[jira] [Updated] (HIVE-8724) Right outer join produces incorrect result on Tez

2014-11-05 Thread Gunther Hagleitner (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gunther Hagleitner updated HIVE-8724: - Attachment: HIVE-8724.3.patch .3 fixes test failures, by updating the golden file. Problem

[jira] [Updated] (HIVE-8724) Right outer join produces incorrect result on Tez

2014-11-05 Thread Gunther Hagleitner (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gunther Hagleitner updated HIVE-8724: - Status: Open (was: Patch Available) Right outer join produces incorrect result on Tez

[jira] [Updated] (HIVE-8745) Joins on decimal keys return different results whether they are run as reduce join or map join

2014-11-05 Thread Gunther Hagleitner (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gunther Hagleitner updated HIVE-8745: - Attachment: join_test.q Joins on decimal keys return different results whether they are

[jira] [Commented] (HIVE-8745) Joins on decimal keys return different results whether they are run as reduce join or map join

2014-11-05 Thread Gunther Hagleitner (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199083#comment-14199083 ] Gunther Hagleitner commented on HIVE-8745: -- Test file has same join twice, once

[jira] [Created] (HIVE-8745) Joins on decimal keys return different results whether they are run as reduce join or map join

2014-11-05 Thread Gunther Hagleitner (JIRA)
Gunther Hagleitner created HIVE-8745: Summary: Joins on decimal keys return different results whether they are run as reduce join or map join Key: HIVE-8745 URL:

Re: Review Request 27599: HIVE-8735 : statistics update can fail due to long paths

2014-11-05 Thread j . prasanth . j
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27599/#review60033 ---

[jira] [Commented] (HIVE-8735) statistics update can fail due to long paths

2014-11-05 Thread Prasanth J (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199107#comment-14199107 ] Prasanth J commented on HIVE-8735: -- Some comments in RB statistics update can fail due

Re: Review Request 27640: HIVE-8700 Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-05 Thread Szehon Ho
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27640/#review60031 --- Hi, I know this is a combination of patches from Suhas and Chao,

Re: Review Request 27627: Split map-join plan into 2 SparkTasks in 3 stages [Spark Branch]

2014-11-05 Thread Szehon Ho
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27627/#review60034 --- Hi Chao, I left a review for a form of this patch at

Re: Review Request 27627: Split map-join plan into 2 SparkTasks in 3 stages [Spark Branch]

2014-11-05 Thread Chao Sun
On Nov. 5, 2014, 9:24 p.m., Szehon Ho wrote: Hi Chao, I left a review for a form of this patch at https://reviews.apache.org/r/27640/, as Suhas put it up for a separate review in combination with his patch. Thanks, I'll take a look there. - Chao

Re: Review Request 27627: Split map-join plan into 2 SparkTasks in 3 stages [Spark Branch]

2014-11-05 Thread Chao Sun
On Nov. 5, 2014, 7:16 p.m., Xuefu Zhang wrote: ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/SparkMapJoinResolver.java, line 128 https://reviews.apache.org/r/27627/diff/1/?file=750389#file750389line128 Do you mean parentTasks != null? That was a silly mistake. On

[jira] [Commented] (HIVE-8099) IN operator for partition column fails when the partition column type is DATE

2014-11-05 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199136#comment-14199136 ] Hive QA commented on HIVE-8099: --- {color:red}Overall{color}: -1 at least one tests failed

Re: Review Request 27640: HIVE-8700 Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-05 Thread Chao Sun
On Nov. 5, 2014, 9:23 p.m., Szehon Ho wrote: ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/SparkMapJoinResolver.java, line 188 https://reviews.apache.org/r/27640/diff/1/?file=750693#file750693line188 Can you elaborate why we need this assumption? This may not be true

[jira] [Updated] (HIVE-8740) Sorted dynamic partition does not work correctly with constant folding

2014-11-05 Thread Prasanth J (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth J updated HIVE-8740: - Attachment: HIVE-8740.2.patch Thanks for the clarification [~alangates]. That was my mistake.. I should

[jira] [Commented] (HIVE-8698) default log4j.properties not included in jar files anymore

2014-11-05 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199179#comment-14199179 ] Thejas M Nair commented on HIVE-8698: - [~brocknoland] Will you be able to review this ?

[jira] [Created] (HIVE-8746) ORC timestamp columns are sensitive to daylight savings time

2014-11-05 Thread Owen O'Malley (JIRA)
Owen O'Malley created HIVE-8746: --- Summary: ORC timestamp columns are sensitive to daylight savings time Key: HIVE-8746 URL: https://issues.apache.org/jira/browse/HIVE-8746 Project: Hive Issue

[jira] [Commented] (HIVE-8698) default log4j.properties not included in jar files anymore

2014-11-05 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199194#comment-14199194 ] Brock Noland commented on HIVE-8698: I think this makes sense. Basically the block

[jira] [Commented] (HIVE-8732) ORC string statistics are not merged correctly

2014-11-05 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199199#comment-14199199 ] Owen O'Malley commented on HIVE-8732: - I've created the timestamp bug as HIVE-8746. The

Re: Review Request 27640: HIVE-8700 Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-05 Thread Suhas Satish
On Nov. 5, 2014, 9:23 p.m., Szehon Ho wrote: ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/SparkMapJoinResolver.java, line 201 https://reviews.apache.org/r/27640/diff/1/?file=750693#file750693line201 We need to handle the case of where parent is the mapwork of

[jira] [Commented] (HIVE-8736) add ordering to cbo_correctness to make result consistent

2014-11-05 Thread Gunther Hagleitner (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199213#comment-14199213 ] Gunther Hagleitner commented on HIVE-8736: -- Yes - +1 for hive .14 add ordering

[jira] [Updated] (HIVE-8698) default log4j.properties not included in jar files anymore

2014-11-05 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated HIVE-8698: Fix Version/s: 0.14.0 default log4j.properties not included in jar files anymore

[jira] [Commented] (HIVE-8698) default log4j.properties not included in jar files anymore

2014-11-05 Thread Gunther Hagleitner (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199230#comment-14199230 ] Gunther Hagleitner commented on HIVE-8698: -- +1 for .14 default log4j.properties

[jira] [Commented] (HIVE-8698) default log4j.properties not included in jar files anymore

2014-11-05 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199225#comment-14199225 ] Thejas M Nair commented on HIVE-8698: - Thanks for the quick review Brock! [~hagleitn] I

[jira] [Updated] (HIVE-8736) add ordering to cbo_correctness to make result consistent

2014-11-05 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-8736: --- Fix Version/s: (was: 0.15.0) 0.14.0 add ordering to cbo_correctness to

[jira] [Updated] (HIVE-8740) Sorted dynamic partition does not work correctly with constant folding

2014-11-05 Thread Prasanth J (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth J updated HIVE-8740: - Description: Sorted dynamic partition optimization looks for partition columns from the operator above

[jira] [Commented] (HIVE-8740) Sorted dynamic partition does not work correctly with constant folding

2014-11-05 Thread Gunther Hagleitner (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199237#comment-14199237 ] Gunther Hagleitner commented on HIVE-8740: -- LGTM +1 (also for .14. fixes major

[jira] [Updated] (HIVE-8698) default log4j.properties not included in jar files anymore

2014-11-05 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated HIVE-8698: Priority: Critical (was: Major) default log4j.properties not included in jar files anymore

[jira] [Commented] (HIVE-8716) Partition filters are not pushed down with lateral view

2014-11-05 Thread Gunther Hagleitner (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199240#comment-14199240 ] Gunther Hagleitner commented on HIVE-8716: -- +1 for .14 (and trunk). Partition

[jira] [Commented] (HIVE-8395) CBO: enable by default

2014-11-05 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199242#comment-14199242 ] Sergey Shelukhin commented on HIVE-8395: Ok, we have a clean pass, I will cease

[jira] [Updated] (HIVE-8708) Add query id to explain log option

2014-11-05 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-8708: --- Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HIVE-8724) Right outer join produces incorrect result on Tez

2014-11-05 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199257#comment-14199257 ] Hive QA commented on HIVE-8724: --- {color:green}Overall{color}: +1 all checks pass Here are

[jira] [Updated] (HIVE-7729) Enable q-tests for ANALYZE TABLE feature [Spark Branch]

2014-11-05 Thread Na Yang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Na Yang updated HIVE-7729: -- Attachment: HIVE-7729.2-spark.patch Enable q-tests for ANALYZE TABLE feature [Spark Branch]

Re: Review Request 27640: HIVE-8700 Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-05 Thread Szehon Ho
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27640/#review60052 ---

[jira] [Updated] (HIVE-8740) Sorted dynamic partition does not work correctly with constant folding

2014-11-05 Thread Prasanth J (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth J updated HIVE-8740: - Attachment: HIVE-8740.3.patch Added more tests to cover cases where sorted dynamic partition is enabled

Re: Review Request 27632: Enable q-tests for ANALYZE TABLE feature [Spark Branch]

2014-11-05 Thread Na Yang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27632/ --- (Updated Nov. 5, 2014, 10:41 p.m.) Review request for hive, Brock Noland,

Re: Review Request 27632: Enable q-tests for ANALYZE TABLE feature [Spark Branch]

2014-11-05 Thread Na Yang
On Nov. 5, 2014, 7:19 p.m., Szehon Ho wrote: Let's hold off and see why its picking counter when spark test-driver is setup to use fs, I dont think we can change the qtest to all use fs, as different test drivers might want to test with different configurations. Hope that makes

  1   2   3   >