[jira] [Created] (HIVE-11978) LLAP: NPE in Expr toString

2015-09-28 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-11978: --- Summary: LLAP: NPE in Expr toString Key: HIVE-11978 URL: https://issues.apache.org/jira/browse/HIVE-11978 Project: Hive Issue Type: Bug

Re: Derby version used by Hive

2015-09-28 Thread Richard Hillegas
Thanks! Some responses inline... "kulkarni.swar...@gmail.com" wrote on 09/28/2015 10:08:08 AM: > From: "kulkarni.swar...@gmail.com" > To: "dev@hive.apache.org" > Date: 09/28/2015 10:08 AM > Subject: Re: Derby version

Re: Derby version used by Hive

2015-09-28 Thread kulkarni.swar...@gmail.com
Richard, A quick eye-balling of the code doesn't show anything that could potentially be a blocker for this upgrade. Also +1 on staying on the latest and greatest. Please feel free to open up a JIRA and submit the patch. Also just out of curiosity, what are you really using a derby backed store

[jira] [Created] (HIVE-11975) mssql scripts contains invalid 'GO' statement

2015-09-28 Thread Huan Huang (JIRA)
Huan Huang created HIVE-11975: - Summary: mssql scripts contains invalid 'GO' statement Key: HIVE-11975 URL: https://issues.apache.org/jira/browse/HIVE-11975 Project: Hive Issue Type: Bug

[jira] [Created] (HIVE-11976) Extend CBO rules to being able to apply rules only once on a given operator

2015-09-28 Thread Jesus Camacho Rodriguez (JIRA)
Jesus Camacho Rodriguez created HIVE-11976: -- Summary: Extend CBO rules to being able to apply rules only once on a given operator Key: HIVE-11976 URL: https://issues.apache.org/jira/browse/HIVE-11976

[jira] [Created] (HIVE-11980) Follow up on HIVE-11696, exception is thrown from CTAS from the table with table-level serde is Parquet while partition-level serde is JSON

2015-09-28 Thread Aihua Xu (JIRA)
Aihua Xu created HIVE-11980: --- Summary: Follow up on HIVE-11696, exception is thrown from CTAS from the table with table-level serde is Parquet while partition-level serde is JSON Key: HIVE-11980 URL:

[jira] [Created] (HIVE-11977) Hive should handle an external avro table with zero length files present

2015-09-28 Thread Aaron Dossett (JIRA)
Aaron Dossett created HIVE-11977: Summary: Hive should handle an external avro table with zero length files present Key: HIVE-11977 URL: https://issues.apache.org/jira/browse/HIVE-11977 Project: Hive

[jira] [Created] (HIVE-11983) Hive streaming API's uses incorrect logic to assign buckets to incoming records

2015-09-28 Thread Roshan Naik (JIRA)
Roshan Naik created HIVE-11983: -- Summary: Hive streaming API's uses incorrect logic to assign buckets to incoming records Key: HIVE-11983 URL: https://issues.apache.org/jira/browse/HIVE-11983 Project:

[jira] [Created] (HIVE-11982) Some test case for union all with recent changes

2015-09-28 Thread Yongzhi Chen (JIRA)
Yongzhi Chen created HIVE-11982: --- Summary: Some test case for union all with recent changes Key: HIVE-11982 URL: https://issues.apache.org/jira/browse/HIVE-11982 Project: Hive Issue Type: Bug

[jira] [Created] (HIVE-11974) Table name created using long name does not display full name in show tables command

2015-09-28 Thread Chetan Bhat (JIRA)
Chetan Bhat created HIVE-11974: -- Summary: Table name created using long name does not display full name in show tables command Key: HIVE-11974 URL: https://issues.apache.org/jira/browse/HIVE-11974

re: Derby version used by Hive

2015-09-28 Thread Richard Hillegas
I haven't received a response to the following message, which I posted last week. Maybe my message rambled too much. Here is an attempt to pose my question more succinctly: Q: Does anyone know of any reason why we can't upgrade Hive's Derby version to 10.12.1.1, the new version being vetted by

[jira] [Created] (HIVE-11973) IN operator fails when the column type is DATE

2015-09-28 Thread sanjiv singh (JIRA)
sanjiv singh created HIVE-11973: --- Summary: IN operator fails when the column type is DATE Key: HIVE-11973 URL: https://issues.apache.org/jira/browse/HIVE-11973 Project: Hive Issue Type: Bug

Re: Review Request 38211: HIVE-11684

2015-09-28 Thread Jesús Camacho Rodríguez
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/38211/ --- (Updated Sept. 28, 2015, 11:40 a.m.) Review request for hive and John

Re: Review Request 38211: HIVE-11684

2015-09-28 Thread Jesús Camacho Rodríguez
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/38211/ --- (Updated Sept. 28, 2015, 9:27 a.m.) Review request for hive and John

Re: Review Request 38211: HIVE-11684

2015-09-28 Thread Jesús Camacho Rodríguez
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/38211/ --- (Updated Sept. 28, 2015, 9:04 a.m.) Review request for hive and John

Build failed in Jenkins: HIVE-TRUNK-JAVA8 #117

2015-09-28 Thread hiveqa
See Changes: [Xuefu Zhang] HIVE-10624: Update the initial script to make beeline bucked cli as default and allow user choose old hive cli by env (Ferdinand via Xuefu) [Xuefu Zhang] HIVE-10623:

Splitting tests in PTest2

2015-09-28 Thread Prasanth Jayachandran
Hello everyone Regarding HIVE-11642, the tests for MiniLlapCliDriver are not split across multiple nodes. I can see from the logs that MiniTezCliDriver are broken down into many tests and ran on different machines.

[jira] [Created] (HIVE-11984) Add HS2 open operation metrics

2015-09-28 Thread Jimmy Xiang (JIRA)
Jimmy Xiang created HIVE-11984: -- Summary: Add HS2 open operation metrics Key: HIVE-11984 URL: https://issues.apache.org/jira/browse/HIVE-11984 Project: Hive Issue Type: Improvement

Re: Splitting tests in PTest2

2015-09-28 Thread Szehon Ho
Yes thanks for looking into it. Can you edit testconfiguration.properties to add a section for LlapCliDriver tests, see HIVE-7254 for details. That way the framework can identify which tests it needs to run and then split it into parallel batches across test nodes. Otherwise it will just run

Re: Splitting tests in PTest2

2015-09-28 Thread Prasanth Jayachandran
Thanks Szehon! I will look at it and update you once done. > On Sep 28, 2015, at 6:37 PM, Szehon Ho wrote: > > Yes thanks for looking into it. Can you edit testconfiguration.properties > to add a section for LlapCliDriver tests, see HIVE-7254 for details. That > way the

[jira] [Created] (HIVE-11979) LLAP: merge master into branch

2015-09-28 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-11979: --- Summary: LLAP: merge master into branch Key: HIVE-11979 URL: https://issues.apache.org/jira/browse/HIVE-11979 Project: Hive Issue Type: Sub-task

[jira] [Created] (HIVE-11981) ORC Schema Evolution Issues (Vectorized, ACID, and Non-Vectorized)

2015-09-28 Thread Matt McCline (JIRA)
Matt McCline created HIVE-11981: --- Summary: ORC Schema Evolution Issues (Vectorized, ACID, and Non-Vectorized) Key: HIVE-11981 URL: https://issues.apache.org/jira/browse/HIVE-11981 Project: Hive

[jira] [Created] (HIVE-11987) CompactionTxnHandler.createValidCompactTxnList() can use much less memory

2015-09-28 Thread Eugene Koifman (JIRA)
Eugene Koifman created HIVE-11987: - Summary: CompactionTxnHandler.createValidCompactTxnList() can use much less memory Key: HIVE-11987 URL: https://issues.apache.org/jira/browse/HIVE-11987 Project:

Review Request 38838: HIVE-11913 : Verify existence of tests for new changes in HiveQA

2015-09-28 Thread Szehon Ho
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/38838/ --- Review request for hive, Brock Noland and Sergio Pena. Bugs: HIVE-11913

Re: Splitting tests in PTest2

2015-09-28 Thread Prasanth Jayachandran
@Szehon.. MiniLlapCliDriver uses the same set of files from minitez. Can that be reused as such without duplicating? > On Sep 28, 2015, at 6:49 PM, Prasanth Jayachandran > wrote: > > Thanks Szehon! I will look at it and update you once done. > >> On Sep 28,

Re: Splitting tests in PTest2

2015-09-28 Thread Szehon Ho
OK it may be possible, I will take a look! Thanks Szehon On Mon, Sep 28, 2015 at 4:56 PM, Prasanth Jayachandran < pjayachand...@hortonworks.com> wrote: > @Szehon.. MiniLlapCliDriver uses the same set of files from minitez. Can > that be reused as such without duplicating? > > > > On Sep 28,

Avro column type in Hive

2015-09-28 Thread Sergey Shelukhin
Hi. I noticed that when I create an Avro table using a very large schema file, mysql metastore silently truncates the TYPE_NAME in COLUMNS_V2 table to the size of varchar (4000); however, when I do describe on the table, it still displays the whole type name (around 100Kb long) that I presume it

[jira] [Created] (HIVE-11985) handle long typenames from Avro schema in metastore

2015-09-28 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-11985: --- Summary: handle long typenames from Avro schema in metastore Key: HIVE-11985 URL: https://issues.apache.org/jira/browse/HIVE-11985 Project: Hive Issue

Re: Splitting tests in PTest2

2015-09-28 Thread Szehon Ho
OK so there is a bit of a chicken-egg problem, I cannot change it until 11642 is in, otherwise it will break the other builds. Once its in I can update the properties file to reference the new LlapCliDriver. Maybe you can check it in and I will try enabling it tonight. On Mon, Sep 28, 2015 at

Re: Avro column type in Hive

2015-09-28 Thread Chaoyu Tang
Yes, when you described the avro table, what you get back was actually from your avro schema instead of database table. The avro table is NOT considered as a metastore backed SerDe. But that it has its columns populated to DB (e.g. HIVE-6308 ) is

Re: Splitting tests in PTest2

2015-09-28 Thread Prasanth Jayachandran
Szehon, I committed a different patch now to llap branch, HIVE-11923. This will let llap and tez test to run much faster hopefully before the 2h timeout. Once all tests passes, committed then we can split up the tests to run in parallel. Even after HIVE-11923 if the patch didn’t complete

[jira] [Created] (HIVE-11986) describe extended command is missing tableType, while describe formatted outputs it

2015-09-28 Thread Aviv (JIRA)
Aviv created HIVE-11986: --- Summary: describe extended command is missing tableType, while describe formatted outputs it Key: HIVE-11986 URL: https://issues.apache.org/jira/browse/HIVE-11986 Project: Hive

Re: Avro column type in Hive

2015-09-28 Thread kulkarni.swar...@gmail.com
Sergey, Is your table a partitioned or a non-partitioned one? I have usually seen this problem manifest itself for partitioned tables and that is mostly where the pruning bites. So if you now try to add a partition to this table, you might see an exception like: java.sql.BatchUpdateException: