[jira] [Created] (HIVE-11692) Fix UT regressions on hbase-metastore branch

[Daniel Dai (JIRA)]

Daniel Dai created HIVE-11692:
-

 Summary: Fix UT regressions on hbase-metastore branch
 Key: HIVE-11692
 URL: https://issues.apache.org/jira/browse/HIVE-11692
 Project: Hive
  Issue Type: Sub-task
  Components: HBase Metastore
Reporter: Daniel Dai
Assignee: Daniel Dai
 Fix For: hbase-metastore-branch


There are several unit test regressions on hbase-metastore:
TestWebHCatE2e (asm-5.0.jar conflict with jersey)
TestHBaseImport (leave some objects behind causing other tests fail)
TestMiniHBaseMetastoreCliDriver (the test itself shall not exist)
TestCliDriver(dynpart_sort_opt_vectorization.q,dynpart_sort_optimization.q)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-11707) Implement "dump metastore"

[Navis (JIRA)]

Navis created HIVE-11707:


 Summary: Implement "dump metastore"
 Key: HIVE-11707
 URL: https://issues.apache.org/jira/browse/HIVE-11707
 Project: Hive
  Issue Type: New Feature
  Components: Metastore
Reporter: Navis
Assignee: Navis
Priority: Minor


In projects, we've frequently met the need of copying existing metastore to 
other database (for other version of hive or other engines like impala, tajo, 
spark, etc.). RDBs support dumping data of metastore into series of SQLs but 
it's needed to be translated before apply if we uses different RDB which is 
time counsuming, error-prone work.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-11706) Implement "show create database"

[Navis (JIRA)]

Navis created HIVE-11706:


 Summary: Implement "show create database"
 Key: HIVE-11706
 URL: https://issues.apache.org/jira/browse/HIVE-11706
 Project: Hive
  Issue Type: New Feature
  Components: Metastore
Reporter: Navis
Assignee: Navis
Priority: Trivial


HIVE-967 introduced "show create table". How about "show create database"?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-11696) Exception when table-level serde is Parquet while partition-level serde is JSON

[Aihua Xu (JIRA)]

Aihua Xu created HIVE-11696:
---

 Summary: Exception when table-level serde is Parquet while 
partition-level serde is JSON
 Key: HIVE-11696
 URL: https://issues.apache.org/jira/browse/HIVE-11696
 Project: Hive
  Issue Type: Bug
  Components: Serializers/Deserializers
Reporter: Aihua Xu


Create a table with partitions and set the SerDe to be Json. The query "select 
* from tbl1" works fine.

Now set table level SerDe to be Parquet serde. Based on HIVE-6785, table level 
and partition level can have different serdes. 

{noformat}
java.io.IOException: org.apache.hadoop.hive.ql.metadata.HiveException: 
java.lang.UnsupportedOperationException: Cannot inspect java.util.ArrayList
at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:154)
at org.apache.hadoop.hive.ql.Driver.getResults(Driver.java:1764)
at 
org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:233)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376)
at 
org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: 
java.lang.UnsupportedOperationException: Cannot inspect java.util.ArrayList
at 
org.apache.hadoop.hive.ql.exec.ListSinkOperator.process(ListSinkOperator.java:93)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:812)
at 
org.apache.hadoop.hive.ql.exec.LimitOperator.process(LimitOperator.java:54)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:812)
at 
org.apache.hadoop.hive.ql.exec.SelectOperator.process(SelectOperator.java:88)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:812)
at 
org.apache.hadoop.hive.ql.exec.TableScanOperator.process(TableScanOperator.java:97)
at 
org.apache.hadoop.hive.ql.exec.FetchOperator.pushRow(FetchOperator.java:425)
at 
org.apache.hadoop.hive.ql.exec.FetchOperator.pushRow(FetchOperator.java:417)
at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:140)
... 13 more
Caused by: java.lang.UnsupportedOperationException: Cannot inspect 
java.util.ArrayList
at 
org.apache.hadoop.hive.ql.io.parquet.serde.ParquetHiveArrayInspector.getList(ParquetHiveArrayInspector.java:112)
at 
org.apache.hadoop.hive.serde2.SerDeUtils.buildJSONString(SerDeUtils.java:310)
at 
org.apache.hadoop.hive.serde2.SerDeUtils.getJSONString(SerDeUtils.java:202)
at 
org.apache.hadoop.hive.serde2.DelimitedJSONSerDe.serializeField(DelimitedJSONSerDe.java:61)
at 
org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe.doSerialize(LazySimpleSerDe.java:246)
at 
org.apache.hadoop.hive.serde2.AbstractEncodingAwareSerDe.serialize(AbstractEncodingAwareSerDe.java:55)
at 
org.apache.hadoop.hive.ql.exec.DefaultFetchFormatter.convert(DefaultFetchFormatter.java:71)
at 
org.apache.hadoop.hive.ql.exec.DefaultFetchFormatter.convert(DefaultFetchFormatter.java:40)
at 
org.apache.hadoop.hive.ql.exec.ListSinkOperator.process(ListSinkOperator.java:90)
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Please double-check JIRA number on commit

[Alan Gates]

+1 to putting it in source.  We could start an "errata" file or 
something that lists these.


Alan.


Lefty Leverenz 
August 29, 2015 at 22:45
One more for the list of commits that don't have the right JIRA issue
number -- but in this case, it doesn't have any issue number:

- dcf21cd6fa98fb5db01ef661bb3b9f94d9ca2d15 HIVE-10021


Do we want to put the list into the source tree?

-- Lefty


On Sun, Jun 7, 2015 at 10:32 PM, Lefty Leverenz 

Lefty Leverenz 
June 7, 2015 at 19:32
Here are the ones I know about:

- 5a576b6fbf1680ab4dd8f275cad484a2614ef2c1 HIVE-10391

- 582f4e1bc39b9605d11f762480b29561a44688ae HIVE-10217

- 8981f365bf0cf921bc0ac2ff8914df44ca2f7de7 HIVE-10500

- 09100831adff7589ee48e735a4beac6ebb25cb3e
& f3ab5fda6af57afff31c29ad048d906fd095d5fb HIVE-10885


Those have JIRA comments listing the commit IDs. Should we list commit IDs
on all issues?

-- Lefty

On Sun, Jun 7, 2015 at 2:16 PM, Lefty Leverenz 

Lefty Leverenz 
June 7, 2015 at 14:16
Good idea! I'll compile a list.

-- Lefty


Owen O'Malley 
June 6, 2015 at 9:00
Editing commits creates a lot of problems. May I suggest that we start a
file that lists the exceptions that you've noticed and check that into our
source tree? That will give everyone access to fix things when they
recognize it. It would look like:

75b679c54c9088434678da2a4d89122620903d72 hive-1234
e8520424879d07e50ea07c28a671251e95c382f6 hive-1235

Of course there may be multiple commits for the same jira, especially on
different branches.

.. Owen

.. Owen

On Sat, Jun 6, 2015 at 2:30 AM, Lefty Leverenz 

Lefty Leverenz 
June 6, 2015 at 2:30

... we should put the commit log in the corresponding
JIRA comment as a cross-reference.



I've only noticed one more slip-up since the end of April, but still think
this is a good idea.

Any more suggestions?


-- Lefty

On Thu, Apr 30, 2015 at 4:53 PM, Xuefu Zhang  wrote:


Yes, for that, I think we should put the commit log in the corresponding
JIRA comment as a cross-reference. I have to admit that I had to fix commit
message for a few of my svn commits in the past.

On Thu, Apr 30, 2015 at 3:53 PM, Lefty Leverenz
wrote:


Found a negative answer to #2 in some ASF instructions
  for security issues
(*underline
added*):

15.  The log for the svn commit that applied the fix is updated to

include

the CVE number. Projects that use git as their primary source code

control

system should not do this as *editing a pushed commit causes all sorts

of

problems*.

All the more reason to be careful about the JIRA number when you commit a
patch.


-- Lefty

On Thu, Apr 30, 2015 at 2:57 AM, Lefty Leverenz

Failing TestHCatClient.testTableSchemaPropagation test?

[Sudheesh Katkam]

Hey y’all,

I am excited to make a contribution 
 to Hive. Hive QA reported 
that TestHCatClient.testTableSchemaPropagation is falling with the patch I 
submitted. I am fairly confident that my changes should not affect that test, 
so is this failure expected? I see from previous test reports that the failure 
happens frequently (?)

Also, can someone please review  my patch? 
After I clicked on “Submit Patch”, the automatic assignee is “Unassigned"; is 
there someone I should assign the JIRA to?

Thank you,
Sudheesh

[jira] [Created] (HIVE-11697) Add Unit Test to test serializability/deserializability of HCatSplits

[Sushanth Sowmyan (JIRA)]

Sushanth Sowmyan created HIVE-11697:
---

 Summary: Add Unit Test to test serializability/deserializability 
of HCatSplits
 Key: HIVE-11697
 URL: https://issues.apache.org/jira/browse/HIVE-11697
 Project: Hive
  Issue Type: Test
Reporter: Sushanth Sowmyan


As HIVE-11344 found, we should have unit tests for this scenario, and we need 
to add one in.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-11698) Add additional test for PointLookupOptimizer

[Jesus Camacho Rodriguez (JIRA)]

Jesus Camacho Rodriguez created HIVE-11698:
--

 Summary: Add additional test for PointLookupOptimizer
 Key: HIVE-11698
 URL: https://issues.apache.org/jira/browse/HIVE-11698
 Project: Hive
  Issue Type: Bug
Affects Versions: 2.0.0
Reporter: Jesus Camacho Rodriguez
Assignee: Jesus Camacho Rodriguez






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Review Request 37930: HIVE-11609 Fix filter logic for hbase scans via composite keys

[Sergey Shelukhin]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/37930/#review97100
---



hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHBaseInputFormatUtil.java
 (line 235)


typo



hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHBaseInputFormatUtil.java
 (line 244)


that seems brittle, can you use actual class objects?


- Sergey Shelukhin


On Aug. 31, 2015, 5:51 a.m., Swarnim Kulkarni wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/37930/
> ---
> 
> (Updated Aug. 31, 2015, 5:51 a.m.)
> 
> 
> Review request for hive, Ashutosh Chauhan, Gopal V, Navis Ryu, and Sergey 
> Shelukhin.
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> HIVE-11609 Fix filter logic for hbase scans via composite keys
> 
> 
> Diffs
> -
> 
>   hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseScanRange.java 
> 8b6432161281bb87e536a164d056b0d1599d7428 
>   
> hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHBaseInputFormatUtil.java
>  c0020706477df48d60937c64db2af908665c 
>   
> hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHBaseTableInputFormat.java
>  8e72759acd939e8650e4763e55240f49de578770 
>   
> hbase-handler/src/test/org/apache/hadoop/hive/hbase/SampleHBaseKeyFactory3.java
>  712725f208f4b2c9cc166750509c25859518ec3e 
>   hbase-handler/src/test/results/positive/hbase_custom_key3.q.out 
> 25032cc36557245b0ae21c80ba66c9866b9d143d 
>   ql/src/java/org/apache/hadoop/hive/ql/plan/TableScanDesc.java 
> 98bce9649b1cddd44be7cd0f9c529985e42874b8 
> 
> Diff: https://reviews.apache.org/r/37930/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Swarnim Kulkarni
> 
>

[jira] [Created] (HIVE-11699) Support special characters in table names

[Pengcheng Xiong (JIRA)]

Pengcheng Xiong created HIVE-11699:
--

 Summary: Support special characters in table names
 Key: HIVE-11699
 URL: https://issues.apache.org/jira/browse/HIVE-11699
 Project: Hive
  Issue Type: New Feature
Reporter: Pengcheng Xiong
Assignee: Pengcheng Xiong


Right now table names can only be "[a-zA-z_0-9]+". This patch tries to 
investigate how much change there should be if we would like to support special 
characters, e.g., "\" in table names.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-11700) exception in logs in Tez test with new logger

[Sergey Shelukhin (JIRA)]

Sergey Shelukhin created HIVE-11700:
---

 Summary: exception in logs in Tez test with new logger
 Key: HIVE-11700
 URL: https://issues.apache.org/jira/browse/HIVE-11700
 Project: Hive
  Issue Type: Bug
Reporter: Sergey Shelukhin
Assignee: Prasanth Jayachandran


{noformat}
2015-08-31 11:27:47,400 WARN Error while converting string 
[${sys:hive.ql.log.PerfLogger.level}] to type [class 
org.apache.logging.log4j.Level]. Using default value [null]. 
java.lang.IllegalArgumentException: Unknown level constant 
[${SYS:HIVE.QL.LOG.PERFLOGGER.LEVEL}].
   at org.apache.logging.log4j.Level.valueOf(Level.java:286)
   at 
org.apache.logging.log4j.core.config.plugins.convert.TypeConverters$LevelConverter.convert(TypeConverters.java:230)
   at 
org.apache.logging.log4j.core.config.plugins.convert.TypeConverters$LevelConverter.convert(TypeConverters.java:226)
   at 
org.apache.logging.log4j.core.config.plugins.convert.TypeConverters.convert(TypeConverters.java:336)
   at 
org.apache.logging.log4j.core.config.plugins.visitors.AbstractPluginVisitor.convert(AbstractPluginVisitor.java:130)
   at 
org.apache.logging.log4j.core.config.plugins.visitors.PluginAttributeVisitor.visit(PluginAttributeVisitor.java:45)
   at 
org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.generateParameters(PluginBuilder.java:247)
   at 
org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.build(PluginBuilder.java:136)
   at 
org.apache.logging.log4j.core.config.AbstractConfiguration.createPluginObject(AbstractConfiguration.java:766)
   at 
org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:706)
   at 
org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:698)
   at 
org.apache.logging.log4j.core.config.AbstractConfiguration.doConfigure(AbstractConfiguration.java:358)
   at 
org.apache.logging.log4j.core.config.AbstractConfiguration.start(AbstractConfiguration.java:161)
   at 
org.apache.logging.log4j.core.LoggerContext.setConfiguration(LoggerContext.java:361)
   at 
org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:426)
   at 
org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:442)
   at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:138)
   at 
org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:147)
   at 
org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:41)
   at org.apache.logging.log4j.LogManager.getContext(LogManager.java:175)
   at 
org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:102)
   at org.apache.logging.log4j.jcl.LogAdapter.getContext(LogAdapter.java:39)
   at 
org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:42)
   at 
org.apache.logging.log4j.jcl.LogFactoryImpl.getInstance(LogFactoryImpl.java:40)
   at org.apache.commons.logging.LogFactory.getLog(LogFactory.java:671)
   at org.apache.hadoop.hive.ql.QTestUtil.(QTestUtil.java:122)
   at 
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.(TestMiniTezCliDriver.java:33)
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Review Request 37620: Hive Parser to Support multi col in clause (x, y..) in ((..), ..., ())

[John Pullokkaran]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/37620/#review97121
---



ql/src/java/org/apache/hadoop/hive/ql/parse/IdentifiersParser.g (line 434)


Nit pick


- John Pullokkaran


On Aug. 21, 2015, 10:07 p.m., pengcheng xiong wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/37620/
> ---
> 
> (Updated Aug. 21, 2015, 10:07 p.m.)
> 
> 
> Review request for hive and John Pullokkaran.
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> Current hive only support single column in clause, e.g., 
> {code}select * from src where  col0 in (v1,v2,v3);{code}
> We want it to support 
> {code}select * from src where (col0,col1+3) in 
> ((col0+v1,v2),(v3,v4-col1));{code}
> 
> 
> Diffs
> -
> 
>   ql/src/java/org/apache/hadoop/hive/ql/parse/IdentifiersParser.g 64af7d1 
>   
> ql/src/test/org/apache/hadoop/hive/ql/parse/TestSQL11ReservedKeyWordsNegative.java
>  61b5892 
>   
> ql/src/test/org/apache/hadoop/hive/ql/parse/TestSQL11ReservedKeyWordsPositive.java
>  4c84e91 
>   ql/src/test/queries/clientpositive/char_udf1.q 8848609 
>   ql/src/test/queries/clientpositive/multi_column_in.q PRE-CREATION 
>   ql/src/test/queries/clientpositive/varchar_udf1.q 395fb12 
>   ql/src/test/results/clientpositive/char_udf1.q.java1.7.out ced0132 
>   ql/src/test/results/clientpositive/multi_column_in.q.out PRE-CREATION 
>   ql/src/test/results/clientpositive/varchar_udf1.q.java1.7.out 96ba06e 
> 
> Diff: https://reviews.apache.org/r/37620/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> pengcheng xiong
> 
>

Re: Review Request 37620: Hive Parser to Support multi col in clause (x, y..) in ((..), ..., ())

[John Pullokkaran]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/37620/#review97123
---



ql/src/java/org/apache/hadoop/hive/ql/parse/IdentifiersParser.g (line 481)


We need to be backwards compatible.



ql/src/test/queries/clientpositive/multi_column_in.q (line 28)


Add a test that has expressions on two columns


- John Pullokkaran


On Aug. 21, 2015, 10:07 p.m., pengcheng xiong wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/37620/
> ---
> 
> (Updated Aug. 21, 2015, 10:07 p.m.)
> 
> 
> Review request for hive and John Pullokkaran.
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> Current hive only support single column in clause, e.g., 
> {code}select * from src where  col0 in (v1,v2,v3);{code}
> We want it to support 
> {code}select * from src where (col0,col1+3) in 
> ((col0+v1,v2),(v3,v4-col1));{code}
> 
> 
> Diffs
> -
> 
>   ql/src/java/org/apache/hadoop/hive/ql/parse/IdentifiersParser.g 64af7d1 
>   
> ql/src/test/org/apache/hadoop/hive/ql/parse/TestSQL11ReservedKeyWordsNegative.java
>  61b5892 
>   
> ql/src/test/org/apache/hadoop/hive/ql/parse/TestSQL11ReservedKeyWordsPositive.java
>  4c84e91 
>   ql/src/test/queries/clientpositive/char_udf1.q 8848609 
>   ql/src/test/queries/clientpositive/multi_column_in.q PRE-CREATION 
>   ql/src/test/queries/clientpositive/varchar_udf1.q 395fb12 
>   ql/src/test/results/clientpositive/char_udf1.q.java1.7.out ced0132 
>   ql/src/test/results/clientpositive/multi_column_in.q.out PRE-CREATION 
>   ql/src/test/results/clientpositive/varchar_udf1.q.java1.7.out 96ba06e 
> 
> Diff: https://reviews.apache.org/r/37620/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> pengcheng xiong
> 
>

Review Request 37963: HIVE-11617 Explain plan for multiple lateral views is very slow

[Aihua Xu]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/37963/
---

Review request for hive.


Repository: hive-git


Description
---

This is to fix the performance issues of graph walking during compilation. The 
PreOrderWalker walks the tree in DFS manner and for the cases of Lateral View 
in which one node could have multiple parents or children, it will repeat 
walking the child nodes which already visited. If there are multiple lateral 
views, the performance for a simple explain command is very bad. Implement a 
new LevelOrderWalker which only visit one node once. It can take necessary 
#levels of ancester nodes in the stack and only walk specified types of nodes 
to speed up performance.


Diffs
-

  ql/src/java/org/apache/hadoop/hive/ql/lib/DefaultGraphWalker.java 
07d2734650f7a82f98dd2ddc03dcab6b5f01cac8 
  ql/src/java/org/apache/hadoop/hive/ql/lib/ForwardWalker.java 
67b47004c06da82368cb6fdaa3f3e1210646f57c 
  ql/src/java/org/apache/hadoop/hive/ql/lib/LevelOrderWalker.java PRE-CREATION 
  ql/src/java/org/apache/hadoop/hive/ql/lib/PreOrderWalker.java 
f22694b6d8f6fb0e4d29694813a4c3b19db04cc3 
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/ColumnPruner.java 
735b448a97ce3b83c018dbf3285851242734aeb9 
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/ConstantPropagate.java 
b6f1f272712f3998c27709f2b132be28e401846c 
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/lineage/Generator.java 
9a5cf55609708d04f36d81bdcee952c623e4108c 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/metainfo/annotation/AnnotateWithOpTraits.java
 c304e97aebfb3a9a4b456f6a8f591a7a3bee60ae 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/stats/annotation/AnnotateWithStatistics.java
 4aeeff20d6c13531f55f60e5252fd8f57ae0efdd 
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/unionproc/UnionProcessor.java 
9937343184d6d0b6f3ec9b992ced212fa43dafd7 
  ql/src/java/org/apache/hadoop/hive/ql/parse/GenMapRedWalker.java 
9583a1b82cdf01da456b5948ab4f42627d72a15b 
  ql/src/java/org/apache/hadoop/hive/ql/parse/GenTezWorkWalker.java 
2d8c8b20c3393f41a235d9f091d15f3313cb4e06 
  ql/src/java/org/apache/hadoop/hive/ql/parse/TezWalker.java 
2f63c1aabc3422b8f3c472634291b5da49b7e239 
  ql/src/java/org/apache/hadoop/hive/ql/parse/spark/GenSparkWorkWalker.java 
e31c025a7e6d4f4db53f1936e70f2c49f82e7020 
  ql/src/java/org/apache/hadoop/hive/ql/ppd/PredicateTransitivePropagate.java 
ea1f7136292b8a965ffc640e3d78827f4e1e4c59 
  ql/src/test/results/clientpositive/correlationoptimizer5.q.out 
63741fc6eb18d10fe635e4b7b978ce602d34c855 
  ql/src/test/results/clientpositive/join32.q.out 
579566907ea03d4fc61c90bfc711c9cccd04c534 
  ql/src/test/results/clientpositive/join32_lessSize.q.out 
c027dbaf5c222d128d55a366f61356a43bef9837 
  ql/src/test/results/clientpositive/join33.q.out 
579566907ea03d4fc61c90bfc711c9cccd04c534 
  ql/src/test/results/clientpositive/lineage2.q.out 
9b227c649df085714ad6c33fbdddcb9d02be61c0 
  ql/src/test/results/clientpositive/lineage3.q.out 
b6b4e0bc46d1819cebf356e8074a35103369b61c 
  ql/src/test/results/clientpositive/spark/join32.q.out 
4ae9dc6e3d5673f92908457cecb25bf0cc153ea6 
  ql/src/test/results/clientpositive/spark/join32_lessSize.q.out 
78bb6554d609a0b5949524b7d240f155ac86c02e 
  ql/src/test/results/clientpositive/spark/join33.q.out 
4ae9dc6e3d5673f92908457cecb25bf0cc153ea6 
  ql/src/test/results/clientpositive/spark/subquery_multiinsert.q.java1.7.out 
1bfdba20995aa48dc2981cefe553170a93431d67 
  ql/src/test/results/clientpositive/subquery_multiinsert.q.java1.7.out 
3a2473fd37ed9e919a63eb281148215d9203e9b8 
  ql/src/test/results/clientpositive/tez/explainuser_2.q.out 
71d8f417be2dc4dafe75b2bc2283637b84493cf3 

Diff: https://reviews.apache.org/r/37963/diff/


Testing
---


Thanks,

Aihua Xu

Re: Review Request 37917: HIVE-11689 minor flow changes to ORC split generation

[Sergey Shelukhin]

> On Aug. 30, 2015, 6:24 a.m., Swarnim Kulkarni wrote:
> > ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java, line 1428
> > 
> >
> > Worth logging a JIRA for this? :)

this is an old comment that may be affected due to code move or something


- Sergey


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/37917/#review97011
---


On Aug. 29, 2015, 1:47 a.m., Sergey Shelukhin wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/37917/
> ---
> 
> (Updated Aug. 29, 2015, 1:47 a.m.)
> 
> 
> Review request for hive, Gopal V and Prasanth_J.
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> see JIRA
> 
> 
> Diffs
> -
> 
>   ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java 8c138b9 
>   ql/src/test/org/apache/hadoop/hive/ql/io/orc/TestInputOutputFormat.java 
> ce86cd8 
> 
> Diff: https://reviews.apache.org/r/37917/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Sergey Shelukhin
> 
>

[jira] [Created] (HIVE-11701) Make tez AM logs work with new log4j2 changes

[Sergey Shelukhin (JIRA)]

Sergey Shelukhin created HIVE-11701:
---

 Summary: Make tez AM logs work with new log4j2 changes
 Key: HIVE-11701
 URL: https://issues.apache.org/jira/browse/HIVE-11701
 Project: Hive
  Issue Type: Sub-task
  Components: Logging, Tests
Reporter: Prasanth Jayachandran
Assignee: Prasanth Jayachandran
 Fix For: 2.0.0


MiniTezCliDriver should log container logs to syslog file. With new log4j2 
changes this file is not created anymore. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-11702) GetSchemas thrift call is slow on scale of 1000+ databases

[Jenny Kim (JIRA)]

Jenny Kim created HIVE-11702:


 Summary: GetSchemas thrift call is slow on scale of 1000+ databases
 Key: HIVE-11702
 URL: https://issues.apache.org/jira/browse/HIVE-11702
 Project: Hive
  Issue Type: Bug
  Components: HiveServer2
Affects Versions: 1.1.1
Reporter: Jenny Kim


Similar to https://issues.apache.org/jira/browse/HIVE-7575 GetSchemas also 
starts to degrade in latency starting at the order of 1000+ databases, which 
returned in about 30 seconds.

However, SHOW DATABASES on the same Hive instance returns within a few seconds.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Hive User Group Meeting Singapore

[Xuefu Zhang]

Dear Hive users,

Hive community is considering a user group meeting during Hadoop World that
will be held in Singarpore [1] Dec 1-3, 2015. As I understand, this will be
the first time that this meeting ever happens in Asia Pacific even though
there is a large user base in that region. As another good news, the
conference organiser is able to provide the venue for this meeting.

However, before I set up a meetup event here [2] to formally announce this,
I'd like to check if there is enough interest from the user community. At
the same time, I will also need to solicit talks from users as well as
developers. Thus, please also let me know if you like to give a short talk.

Your comments and suggestions are greatly appreciated.

Sincerely,
Xuefu

[1] http://strataconf.com/big-data-conference-sg-2015
[2] http://www.meetup.com/Hive-User-Group-Meeting/

[jira] [Created] (HIVE-11703) Make RegExp and RLike reserved keywords

[Pengcheng Xiong (JIRA)]

Pengcheng Xiong created HIVE-11703:
--

 Summary: Make RegExp and RLike reserved keywords
 Key: HIVE-11703
 URL: https://issues.apache.org/jira/browse/HIVE-11703
 Project: Hive
  Issue Type: Sub-task
Reporter: Pengcheng Xiong
Assignee: Pengcheng Xiong


RegExp and RLike are treated as "precedenceEqualNegatableOperator" in Hive. 
They actually come from MySQL. Both of them are not keywords in SQL2011. But 
they are reserved keywords in MySQL. Making them reserved ones can eliminate 
the current 14 ambiguities that we have in current Hive. If users still would 
like to use them as identifiers/function names, users can "set 
hive.support.sql11.reserved.keywords=false;"



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Review Request 37917: HIVE-11689 minor flow changes to ORC split generation

[Sergey Shelukhin]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/37917/
---

(Updated Aug. 31, 2015, 10:49 p.m.)


Review request for hive, Gopal V and Prasanth_J.


Repository: hive-git


Description
---

see JIRA


Diffs (updated)
-

  data/conf/tez/hive-site.xml 2f9415a 
  ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java 8c138b9 
  ql/src/test/org/apache/hadoop/hive/ql/io/orc/TestInputOutputFormat.java 
ce86cd8 

Diff: https://reviews.apache.org/r/37917/diff/


Testing
---


Thanks,

Sergey Shelukhin

[jira] [Created] (HIVE-11704) Create errata.txt file

[Owen O'Malley (JIRA)]

Owen O'Malley created HIVE-11704:


 Summary: Create errata.txt file
 Key: HIVE-11704
 URL: https://issues.apache.org/jira/browse/HIVE-11704
 Project: Hive
  Issue Type: Bug
  Components: Documentation
Reporter: Owen O'Malley
Assignee: Owen O'Malley


As discussed on the email list, we should have a file documenting known 
problems in the commit messages.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Please double-check JIRA number on commit

[Owen O'Malley]

Ok, I've created a patch with Lefty's items. Please take a look:

https://issues.apache.org/jira/browse/HIVE-11704

Re: Review Request 37620: Hive Parser to Support multi col in clause (x, y..) in ((..), ..., ())

[pengcheng xiong]

> On Aug. 25, 2015, 1:17 a.m., John Pullokkaran wrote:
> > ql/src/java/org/apache/hadoop/hive/ql/parse/IdentifiersParser.g, line 475
> > 
> >
> > How about (x,y) in (select a,b from t)

We are going to support this in the next phase.


- pengcheng


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/37620/#review96264
---


On Aug. 21, 2015, 10:07 p.m., pengcheng xiong wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/37620/
> ---
> 
> (Updated Aug. 21, 2015, 10:07 p.m.)
> 
> 
> Review request for hive and John Pullokkaran.
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> Current hive only support single column in clause, e.g., 
> {code}select * from src where  col0 in (v1,v2,v3);{code}
> We want it to support 
> {code}select * from src where (col0,col1+3) in 
> ((col0+v1,v2),(v3,v4-col1));{code}
> 
> 
> Diffs
> -
> 
>   ql/src/java/org/apache/hadoop/hive/ql/parse/IdentifiersParser.g 64af7d1 
>   
> ql/src/test/org/apache/hadoop/hive/ql/parse/TestSQL11ReservedKeyWordsNegative.java
>  61b5892 
>   
> ql/src/test/org/apache/hadoop/hive/ql/parse/TestSQL11ReservedKeyWordsPositive.java
>  4c84e91 
>   ql/src/test/queries/clientpositive/char_udf1.q 8848609 
>   ql/src/test/queries/clientpositive/multi_column_in.q PRE-CREATION 
>   ql/src/test/queries/clientpositive/varchar_udf1.q 395fb12 
>   ql/src/test/results/clientpositive/char_udf1.q.java1.7.out ced0132 
>   ql/src/test/results/clientpositive/multi_column_in.q.out PRE-CREATION 
>   ql/src/test/results/clientpositive/varchar_udf1.q.java1.7.out 96ba06e 
> 
> Diff: https://reviews.apache.org/r/37620/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> pengcheng xiong
> 
>

Re: Review Request 37620: Hive Parser to Support multi col in clause (x, y..) in ((..), ..., ())

[Sergey Shelukhin]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/37620/#review97207
---



ql/src/java/org/apache/hadoop/hive/ql/parse/IdentifiersParser.g (line 475)


phase 4? :)


- Sergey Shelukhin


On Aug. 21, 2015, 10:07 p.m., pengcheng xiong wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/37620/
> ---
> 
> (Updated Aug. 21, 2015, 10:07 p.m.)
> 
> 
> Review request for hive and John Pullokkaran.
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> Current hive only support single column in clause, e.g., 
> {code}select * from src where  col0 in (v1,v2,v3);{code}
> We want it to support 
> {code}select * from src where (col0,col1+3) in 
> ((col0+v1,v2),(v3,v4-col1));{code}
> 
> 
> Diffs
> -
> 
>   ql/src/java/org/apache/hadoop/hive/ql/parse/IdentifiersParser.g 64af7d1 
>   
> ql/src/test/org/apache/hadoop/hive/ql/parse/TestSQL11ReservedKeyWordsNegative.java
>  61b5892 
>   
> ql/src/test/org/apache/hadoop/hive/ql/parse/TestSQL11ReservedKeyWordsPositive.java
>  4c84e91 
>   ql/src/test/queries/clientpositive/char_udf1.q 8848609 
>   ql/src/test/queries/clientpositive/multi_column_in.q PRE-CREATION 
>   ql/src/test/queries/clientpositive/varchar_udf1.q 395fb12 
>   ql/src/test/results/clientpositive/char_udf1.q.java1.7.out ced0132 
>   ql/src/test/results/clientpositive/multi_column_in.q.out PRE-CREATION 
>   ql/src/test/results/clientpositive/varchar_udf1.q.java1.7.out 96ba06e 
> 
> Diff: https://reviews.apache.org/r/37620/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> pengcheng xiong
> 
>

Re: Review Request 37620: Hive Parser to Support multi col in clause (x, y..) in ((..), ..., ())

[pengcheng xiong]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/37620/
---

(Updated Sept. 1, 2015, midnight)


Review request for hive and John Pullokkaran.


Changes
---

Address all of John's comments.


Repository: hive-git


Description
---

Current hive only support single column in clause, e.g., 
{code}select * from src where  col0 in (v1,v2,v3);{code}
We want it to support 
{code}select * from src where (col0,col1+3) in 
((col0+v1,v2),(v3,v4-col1));{code}


Diffs (updated)
-

  ql/src/java/org/apache/hadoop/hive/ql/parse/IdentifiersParser.g 64af7d1 
  
ql/src/test/org/apache/hadoop/hive/ql/parse/TestSQL11ReservedKeyWordsNegative.java
 61b5892 
  
ql/src/test/org/apache/hadoop/hive/ql/parse/TestSQL11ReservedKeyWordsPositive.java
 4c84e91 
  ql/src/test/queries/clientpositive/char_udf1.q 8848609 
  ql/src/test/queries/clientpositive/keyword_2.q PRE-CREATION 
  ql/src/test/queries/clientpositive/multi_column_in.q PRE-CREATION 
  ql/src/test/queries/clientpositive/varchar_udf1.q 395fb12 
  ql/src/test/results/clientpositive/char_udf1.q.java1.7.out ced0132 
  ql/src/test/results/clientpositive/keyword_2.q.out PRE-CREATION 
  ql/src/test/results/clientpositive/multi_column_in.q.out PRE-CREATION 
  ql/src/test/results/clientpositive/varchar_udf1.q.java1.7.out 96ba06e 

Diff: https://reviews.apache.org/r/37620/diff/


Testing
---


Thanks,

pengcheng xiong

Re: Review Request 37620: Hive Parser to Support multi col in clause (x, y..) in ((..), ..., ())

[pengcheng xiong]

> On Aug. 31, 2015, 11:56 p.m., Sergey Shelukhin wrote:
> > ql/src/java/org/apache/hadoop/hive/ql/parse/IdentifiersParser.g, line 475
> > 
> >
> > phase 4? :)

Well, seriously :) , in this phase, we only support clause (x,y..) in 
((..),..., ()) and in the next phase, we will support clause (x,y..) in (select 
x,y from ...). Any comments/suggestions are welcome. :)


- pengcheng


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/37620/#review97207
---


On Sept. 1, 2015, midnight, pengcheng xiong wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/37620/
> ---
> 
> (Updated Sept. 1, 2015, midnight)
> 
> 
> Review request for hive and John Pullokkaran.
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> Current hive only support single column in clause, e.g., 
> {code}select * from src where  col0 in (v1,v2,v3);{code}
> We want it to support 
> {code}select * from src where (col0,col1+3) in 
> ((col0+v1,v2),(v3,v4-col1));{code}
> 
> 
> Diffs
> -
> 
>   ql/src/java/org/apache/hadoop/hive/ql/parse/IdentifiersParser.g 64af7d1 
>   
> ql/src/test/org/apache/hadoop/hive/ql/parse/TestSQL11ReservedKeyWordsNegative.java
>  61b5892 
>   
> ql/src/test/org/apache/hadoop/hive/ql/parse/TestSQL11ReservedKeyWordsPositive.java
>  4c84e91 
>   ql/src/test/queries/clientpositive/char_udf1.q 8848609 
>   ql/src/test/queries/clientpositive/keyword_2.q PRE-CREATION 
>   ql/src/test/queries/clientpositive/multi_column_in.q PRE-CREATION 
>   ql/src/test/queries/clientpositive/varchar_udf1.q 395fb12 
>   ql/src/test/results/clientpositive/char_udf1.q.java1.7.out ced0132 
>   ql/src/test/results/clientpositive/keyword_2.q.out PRE-CREATION 
>   ql/src/test/results/clientpositive/multi_column_in.q.out PRE-CREATION 
>   ql/src/test/results/clientpositive/varchar_udf1.q.java1.7.out 96ba06e 
> 
> Diff: https://reviews.apache.org/r/37620/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> pengcheng xiong
> 
>

Review Request 37980: HIVE-11657 HIVE-2573 introduces some issues during metastore init (and CLI init)

[Sergey Shelukhin]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/37980/
---

Review request for hive, Ashutosh Chauhan and Sushanth Sowmyan.


Repository: hive-git


Description
---

see jira


Diffs
-

  
metastore/src/java/org/apache/hadoop/hive/metastore/RetryingMetaStoreClient.java
 e282981 
  ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionTask.java 6390740 
  ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java 396c070 

Diff: https://reviews.apache.org/r/37980/diff/


Testing
---


Thanks,

Sergey Shelukhin

[jira] [Created] (HIVE-11705) refactor SARG stripe filtering for ORC into a method

[Sergey Shelukhin (JIRA)]

Sergey Shelukhin created HIVE-11705:
---

 Summary: refactor SARG stripe filtering for ORC into a method
 Key: HIVE-11705
 URL: https://issues.apache.org/jira/browse/HIVE-11705
 Project: Hive
  Issue Type: Bug
Reporter: Sergey Shelukhin
Assignee: Sergey Shelukhin


For footer cache PPD to metastore, we'd need a method to do the PPD. Tiny item 
to create it on OrcInputFormat.
For metastore path, these methods will be called from expression proxy similar 
to current objectstore expr filtering; it will change to have serialized sarg 
and column list to come from request instead of conf; includedCols/etc. will 
also come from request instead of assorted java objects. 
The types and stripe stats will need to be extracted from HBase. This is a 
little bit of a problem, since ideally we want to be inside HBase 
filter/coprocessor/ I'd need to take a look to see if this is possible... 
since that filter would need to either deserialize orc, or we would need to 
store types and stats information in some other, non-ORC manner on write. The 
latter is probably a better idea, although it's dangerous because there's no 
sync between this code and ORC itself.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Review Request 37985: HIVE-11705 refactor SARG stripe filtering for ORC into a method

[Sergey Shelukhin]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/37985/
---

Review request for hive and Prasanth_J.


Repository: hive-git


Description
---

see jira


Diffs
-

  ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java 8c138b9 
  ql/src/java/org/apache/hadoop/hive/ql/io/sarg/ConvertAstToSearchArg.java 
e034650 

Diff: https://reviews.apache.org/r/37985/diff/


Testing
---


Thanks,

Sergey Shelukhin

[jira] [Created] (HIVE-11694) Exclude hbase-metastore for hadoop-2

[Daniel Dai (JIRA)]

Daniel Dai created HIVE-11694:
-

 Summary: Exclude hbase-metastore for hadoop-2
 Key: HIVE-11694
 URL: https://issues.apache.org/jira/browse/HIVE-11694
 Project: Hive
  Issue Type: Sub-task
  Components: HBase Metastore
Reporter: Daniel Dai
Assignee: Daniel Dai
 Fix For: hbase-metastore-branch


hbase-metastore doesn't compile for hadoop-1 and we don't have development plan 
to make it work with hadoop-1. Exclude hbase-metastore related file so hadoop-1 
still compiles.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-11693) CommonMergeJoinOperator throws exception with tez

[Rajesh Balamohan (JIRA)]

Rajesh Balamohan created HIVE-11693:
---

 Summary: CommonMergeJoinOperator throws exception with tez
 Key: HIVE-11693
 URL: https://issues.apache.org/jira/browse/HIVE-11693
 Project: Hive
  Issue Type: Bug
Reporter: Rajesh Balamohan


Got this when executing a simple query with latest hive build + tez latest 
version.

{noformat}
Error: Failure while running task: 
attempt_1439860407967_0291_2_03_45_0:java.lang.RuntimeException: 
java.lang.RuntimeException: Hive Runtime Error while closing operators: 
java.lang.RuntimeException: java.io.IOException: Please check if you are 
invoking moveToNext() even after it returned false.
at 
org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:171)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:137)
at 
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:349)
at 
org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
at 
org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:60)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at 
org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:60)
at 
org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:35)
at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Hive Runtime Error while closing 
operators: java.lang.RuntimeException: java.io.IOException: Please check if you 
are invoking moveToNext() even after it returned false.
at 
org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.close(ReduceRecordProcessor.java:316)
at 
org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:162)
... 14 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: 
java.lang.RuntimeException: java.io.IOException: Please check if you are 
invoking moveToNext() even after it returned false.
at 
org.apache.hadoop.hive.ql.exec.CommonMergeJoinOperator.fetchOneRow(CommonMergeJoinOperator.java:412)
at 
org.apache.hadoop.hive.ql.exec.CommonMergeJoinOperator.fetchNextGroup(CommonMergeJoinOperator.java:375)
at 
org.apache.hadoop.hive.ql.exec.CommonMergeJoinOperator.doFirstFetchIfNeeded(CommonMergeJoinOperator.java:482)
at 
org.apache.hadoop.hive.ql.exec.CommonMergeJoinOperator.joinFinalLeftData(CommonMergeJoinOperator.java:434)
at 
org.apache.hadoop.hive.ql.exec.CommonMergeJoinOperator.closeOp(CommonMergeJoinOperator.java:384)
at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:616)
at 
org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.close(ReduceRecordProcessor.java:292)
... 15 more
Caused by: java.lang.RuntimeException: java.io.IOException: Please check if you 
are invoking moveToNext() even after it returned false.
at 
org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:291)
at 
org.apache.hadoop.hive.ql.exec.CommonMergeJoinOperator.fetchOneRow(CommonMergeJoinOperator.java:400)
... 21 more
Caused by: java.io.IOException: Please check if you are invoking moveToNext() 
even after it returned false.
at 
org.apache.tez.runtime.library.common.ValuesIterator.hasCompletedProcessing(ValuesIterator.java:223)
at 
org.apache.tez.runtime.library.common.ValuesIterator.moveToNext(ValuesIterator.java:105)
at 
org.apache.tez.runtime.library.input.OrderedGroupedKVInput$OrderedGroupedKeyValuesReader.next(OrderedGroupedKVInput.java:308)
at 
org.apache.hadoop.hive.ql.exec.tez.KeyValuesFromKeyValues.next(KeyValuesFromKeyValues.java:46)
at 
org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:249)
... 22 more
{noformat}

Not sure if this is related to HIVE-11016. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Build failed in Jenkins: HIVE-TRUNK-JAVA8 #107

[hiveqa]

See 


Changes:

[j.prasanth.j] HIVE-11669: OrcFileDump service should support directories 
(Prasanth Jayachandran reviewed by Sergey Shelukhin)

[ekoifman] HIVE-11357 ACID enable predicate pushdown for insert-only delta file 
2 (Eugene Koifman, reviewed by Alan Gates)

[Sergio Pena] HIVE-11618: Correct the SARG api to reunify the 
PredicateLeaf.Type INTEGER and LONG (Owen O'Malley, reviewed by Sergio Pena)

[sershe] HIVE-11595 : refactor ORC footer reading to make it usable from 
outside (Sergey Shelukhin, reviewed by Prasanth Jayachandran)

[jcamacho] HIVE-11652: Avoid expensive call to removeAll in DefaultGraphWalker 
(Jesus Camacho Rodriguez, reviewed by Ashutosh Chauhan/Hari Sankar Sivarama 
Subramaniyan)

[Chao Sun] "Alter index rebuild" statements submitted through HiveServer2 fail 
when Sentry is enabled (Aihua Xu, reviewed by Chao Sun and Ashutosh Chauhan)

[pxiong] HIVE-11629: CBO: Calcite Operator To Hive Operator (Calcite Return 
Path) : fix the filter expressions for full outer join and right outer join 
(Pengcheng Xiong, reviewed by Jesus Camacho Rodriguez)

--
[...truncated 325 lines...]
Aptest2/src/main/java/org/apache/hive/ptest/execution/conf/Context.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/conf/TestConfiguration.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/conf/TestParser.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/conf/Host.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/conf/ExecutionContextConfiguration.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/conf/TestBatch.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/conf/UnitTestBatch.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/conf/QFileTestBatch.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/JIRAService.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/Drone.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/Constants.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/ssh
A
ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/RemoteCommandResult.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/SSHCommandExecutor.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/RSyncCommandExecutor.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/ssh/SSHCommand.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/ssh/SSHResult.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/ssh/RSyncCommand.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/ssh/RSyncResult.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/NonZeroExitCodeException.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/AbstractSSHCommand.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/AbstractSSHResult.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/SSHExecutionException.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/AbortDroneException.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/LocalCommandFactory.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/ExecutionPhase.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/TestsFailedException.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/PrepPhase.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/LocalCommand.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/ReportingPhase.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/HostExecutor.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/Templates.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/PTest.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/Phase.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/LogDirectoryCleaner.java
Aptest2/src/main/resources
Aptest2/src/main/resources/smart-apply-patch.sh
Aptest2/src/main/resources/batch-exec.vm
Aptest2/src/main/resources/source-prep.vm
Aptest2/src/main/resources/log4j.properties
Aptest2/pom.xml
Aptest2/README.md
Checked out revision 1700224.
+ cd ptest2
+ mvn clean package -DskipTests -Drat.numUnapprovedLicenses=1000 
-Dmaven.repo.local=
[INFO] Scanning for projects...
[INFO] 
[INFO] 
[INFO] Building hive-ptest 1.0
[INFO] 
Downloading: 
http://people.apache.org/~brock/approvals-maven-repository/net/schmizz/sshj/maven-metadata.xml
Downloading: 

[jira] [Created] (HIVE-11695) Hql "write to LOCAL DIRECTORY " can not throws exception when Hive user does not have write-promotion of the DIRECTORY

[WangMeng (JIRA)]

WangMeng created HIVE-11695:
---

 Summary:  Hql "write to LOCAL DIRECTORY " can not throws exception 
when Hive user does not have write-promotion of the DIRECTORY
 Key: HIVE-11695
 URL: https://issues.apache.org/jira/browse/HIVE-11695
 Project: Hive
  Issue Type: Bug
  Components: Query Processor
Affects Versions: 1.2.1, 1.1.0, 1.2.0, 1.0.0, 0.14.0, 0.13.0
Reporter: WangMeng
Assignee: WangMeng


 For Hive user who dose not have write promotion of  LOCAL DIRECTORY such as   
"/data/wangmeng/"  , when the user executes Hql "insert  overwrite LOCAL  
DIRECTORY  "/data/wangmeng/hiveserver2" ,this query can not throw any exception 
 and pretend to have finished successfully.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Review Request 37986: Implement "show create database"

[Navis Ryu]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/37986/
---

Review request for hive.


Bugs: HIVE-11706
https://issues.apache.org/jira/browse/HIVE-11706


Repository: hive-git


Description
---

HIVE-967 introduced "show create table". How about "show create database"?


Diffs
-

  ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java 734742c 
  ql/src/java/org/apache/hadoop/hive/ql/parse/DDLSemanticAnalyzer.java 9f8c756 
  ql/src/java/org/apache/hadoop/hive/ql/parse/HiveParser.g cf7ab3a 
  ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzerFactory.java 
a2fbc11 
  ql/src/java/org/apache/hadoop/hive/ql/plan/DDLWork.java 8dbb3c1 
  ql/src/java/org/apache/hadoop/hive/ql/plan/HiveOperation.java dee2136 
  ql/src/java/org/apache/hadoop/hive/ql/plan/ShowCreateDatabaseDesc.java 
PRE-CREATION 
  ql/src/test/queries/clientpositive/show_create_database.q PRE-CREATION 
  ql/src/test/results/clientpositive/show_create_database.q.out PRE-CREATION 
  ql/src/test/results/clientpositive/tez/show_create_database.q.out 
PRE-CREATION 

Diff: https://reviews.apache.org/r/37986/diff/


Testing
---


Thanks,

Navis Ryu