[jira] [Created] (HIVE-16796) Flaky Test : TestBeeLineDriver.testCliDriver[create_merge_compressed]

2017-05-30 Thread Vihang Karajgaonkar (JIRA) 
Vihang Karajgaonkar created HIVE-16796:
--

 Summary: Flaky Test : 
TestBeeLineDriver.testCliDriver[create_merge_compressed]
 Key: HIVE-16796
 URL: https://issues.apache.org/jira/browse/HIVE-16796
 Project: Hive
  Issue Type: Sub-task
Reporter: Vihang Karajgaonkar


Has been failing in many of the recent builds.

https://builds.apache.org/job/PreCommit-HIVE-Build/5481/
https://builds.apache.org/job/PreCommit-HIVE-Build/5482/



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Review Request 59674: Support position in ORDER BY when using SELECT *

2017-05-30 Thread pengcheng xiong 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/59674/
---

Review request for hive, Ashutosh Chauhan and Sergey Shelukhin.


Repository: hive-git


Description
---

HIVE-16774


Diffs
-

  ql/src/java/org/apache/hadoop/hive/ql/parse/CalcitePlanner.java 721dac8542 
  ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java 7f5051cd5b 
  ql/src/test/queries/clientnegative/orderby_position_unsupported.q a490c2306e 
  ql/src/test/queries/clientpositive/order_by_pos.q PRE-CREATION 
  ql/src/test/queries/clientpositive/perf/query47.q PRE-CREATION 
  ql/src/test/queries/clientpositive/perf/query57.q PRE-CREATION 
  ql/src/test/results/clientnegative/orderby_position_unsupported.q.out 
56d32407f3 
  ql/src/test/results/clientpositive/order_by_pos.q.out PRE-CREATION 
  ql/src/test/results/clientpositive/perf/query47.q.out PRE-CREATION 
  ql/src/test/results/clientpositive/perf/query57.q.out PRE-CREATION 


Diff: https://reviews.apache.org/r/59674/diff/1/


Testing
---


Thanks,

pengcheng xiong

[jira] [Created] (HIVE-16795) Measure Performance for Parquet Vectorization Reader

2017-05-30 Thread Ferdinand Xu (JIRA) 
Ferdinand Xu created HIVE-16795:
---

 Summary: Measure Performance for Parquet Vectorization Reader
 Key: HIVE-16795
 URL: https://issues.apache.org/jira/browse/HIVE-16795
 Project: Hive
  Issue Type: Sub-task
Reporter: Ferdinand Xu


We need to measure the performance of Parquet Vectorization reader feature 
using TPCx-BB or TPC-DS to see how much performance gain we can archive.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Created] (HIVE-16794) Default value for hive.spark.client.connect.timeout of 1000ms is too low

2017-05-30 Thread Eric Lin (JIRA) 
Eric Lin created HIVE-16794:
---

 Summary: Default value for hive.spark.client.connect.timeout of 
1000ms is too low
 Key: HIVE-16794
 URL: https://issues.apache.org/jira/browse/HIVE-16794
 Project: Hive
  Issue Type: Task
  Components: Spark
Affects Versions: 2.1.1
Reporter: Eric Lin


Currently the default timeout value for hive.spark.client.connect.timeout is 
set at 1000ms, which is only 1 second. This is not enough when cluster is busy 
and user will constantly getting the following timeout errors:

{code}
17/05/03 03:20:08 ERROR yarn.ApplicationMaster: User class threw exception: 
java.util.concurrent.ExecutionException: 
io.netty.channel.ConnectTimeoutException: connection timed out: 
/172.19.22.11:35915 
java.util.concurrent.ExecutionException: 
io.netty.channel.ConnectTimeoutException: connection timed out: 
/172.19.22.11:35915 
at io.netty.util.concurrent.AbstractFuture.get(AbstractFuture.java:37) 
at org.apache.hive.spark.client.RemoteDriver.(RemoteDriver.java:156) 
at org.apache.hive.spark.client.RemoteDriver.main(RemoteDriver.java:556) 
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) 
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 
at java.lang.reflect.Method.invoke(Method.java:606) 
at 
org.apache.spark.deploy.yarn.ApplicationMaster$$anon$2.run(ApplicationMaster.scala:542)
 
Caused by: io.netty.channel.ConnectTimeoutException: connection timed out: 
/172.19.22.11:35915 
at 
io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:220)
 
at 
io.netty.util.concurrent.PromiseTask$RunnableAdapter.call(PromiseTask.java:38) 
at 
io.netty.util.concurrent.ScheduledFutureTask.run(ScheduledFutureTask.java:120) 
at 
io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357)
 
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357) 
at 
io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
 
at java.lang.Thread.run(Thread.java:745) 
17/05/03 03:20:08 INFO yarn.ApplicationMaster: Final app status: FAILED, 
exitCode: 15, (reason: User class threw exception: 
java.util.concurrent.ExecutionException: 
io.netty.channel.ConnectTimeoutException: connection timed out: 
/172.19.22.11:35915) 
17/05/03 03:20:16 ERROR yarn.ApplicationMaster: SparkContext did not initialize 
after waiting for 10 ms. Please check earlier log output for errors. 
Failing the application. 
17/05/03 03:20:16 INFO yarn.ApplicationMaster: Unregistering ApplicationMaster 
with FAILED (diag message: User class threw exception: 
java.util.concurrent.ExecutionException: 
io.netty.channel.ConnectTimeoutException: connection timed out: 
/172.19.22.11:35915) 
17/05/03 03:20:16 INFO yarn.ApplicationMaster: Deleting staging directory 
.sparkStaging/application_1492040605432_11445 
17/05/03 03:20:16 INFO util.ShutdownHookManager: Shutdown hook called
{code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] hive pull request #191: HIVE-14309 Shade the contents of hive-orc so that th...

2017-05-30 Thread omalley 
GitHub user omalley opened a pull request:

https://github.com/apache/hive/pull/191

HIVE-14309 Shade the contents of hive-orc so that they don't conflict with 
orc project.



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/omalley/hive hive-14309

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hive/pull/191.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #191


commit aaab5c65161f29e00685ed74eee8ad48271dd692
Author: Owen O'Malley 
Date:   2017-05-26T15:52:26Z

Incorporate fixes from storage-api 2.3.1.

commit 2dd6d489ee6710e5a49c937bfa0fcb04a131bb9e
Author: Thejas Nair 
Date:   2016-07-28T07:47:40Z

HIVE-16787. Fix itests in branch-2.2.

commit 18a55ec80bf1ddda179230ca43e7959f76d7357e
Author: Tao LI 
Date:   2016-08-05T06:38:28Z

BUG-63720: TestOperationLogging fails

commit e694efca226b72cc712fecd3f399284faf3dc596
Author: Vaibhav Gumashta 
Date:   2017-02-14T02:31:49Z

BUG-67801: Disable TestJdbcWithMiniHS2.testAddJarConstructorUnCaching

Change-Id: Ie7810f48979720fffdb6934d169cc88edc2baa61

commit 29dd342bc910577b2d26bb4b9e4a3e9f01d12e80
Author: Sergey Shelukhin 
Date:   2017-01-11T20:43:40Z

BUG-72004 : disable Hive-on-Spark tests (Sergey Shelukhin)

commit a7a0afa3363592707226b9de4b1fa124e97f388a
Author: Owen O'Malley 
Date:   2017-05-30T17:09:02Z

More patchup

commit f3a37c654f4bda8f980ac4e51c62f56f6ebd4405
Author: Ashutosh Chauhan 
Date:   2016-07-29T19:02:04Z

BUG-61003 : Hive UT test failures

commit 3d1c03f478c2c5d6b3b05ddafd81da9176a14a06
Author: Matt McCline 
Date:   2016-07-06T04:25:31Z

BUG-61003: Hive2 UT test failure -- the schema_evol_*.q.out failures 
(adjusted tests for the rollback of HIVE-13380)

commit 3fc6200699a5d635ab41446bfaf8a7555481b281
Author: Prasanth Jayachandran 
Date:   2016-12-19T19:35:59Z

BUG-70968: Move schema evolution and some tez tests to MiniLlap

Change-Id: I82d8ab5fd18f54d780f84548ccf045a9c4f3885d

commit 51658a576f8ec3d3260b1a76062d10ee11d8d955
Author: Pengcheng Xiong 
Date:   2017-01-03T22:36:02Z

BUG-70522: Fenton UT - TestCliDriver[autoColumnStats_4] failure

commit 093e2dec7a329243c4d964d3659d617ad8526f45
Author: Ashutosh Chauhan 
Date:   2017-01-26T19:48:18Z

BUG-70522 : Fenton UT - TestCliDriver[autoColumnStats_4] failure

Change-Id: Ic3dd59398f841b9963306ca52a69d8b00a80ffc8

commit 4d28f69f7e3f4a2abf72a76c4ff82e0c7719ae10
Author: Prasanth Jayachandran 
Date:   2016-12-24T05:12:00Z

BUG-69023: addendum patch

Change-Id: I4f81ac7da124fc51f725e52f09fe2c97647f34e5

commit 77d0cc04c7a1c141acf79af89bcde179cfe7cafe
Author: Ashutosh Chauhan 
Date:   2017-01-24T22:35:02Z

BUG-73211 : Update golden files for fenton hive2

Change-Id: I4d73a505bdd10d195a417490c31df28d4b2a8fc7

commit 1f8a083e24ccb184c7e73d3a1bc75c148a186b9d
Author: Pengcheng Xiong 
Date:   2017-01-03T22:46:04Z

BUG-70684: Fenton UT - TestCliDriver.testCliDriver[udtf_explode]

commit 2274215016c934969d2f60bd3af6a1fcae70bcbb
Author: Ashutosh Chauhan 
Date:   2016-08-05T23:47:15Z

BUG-63023 : 10s of errors related to order of keys in hashmap

commit 1617d272d4d215c139c3e1a94f5f70f13202677e
Author: Ashutosh Chauhan 
Date:   2017-01-24T05:15:51Z

BUG-72915 : Fenton UT - TestMiniTezCliDriver.testCliDriver_mapjoin3 is flaky

Change-Id: Ia070bf7a664492d1889edc52ada0cb0aa0871b81

commit 34507b82683aae7690b00ac5170bb401ece49c0a
Author: Matt McCline 
Date:   2016-08-05T20:00:21Z

BUG-63886: schema evol UT fails

commit d6a266969886c462bfac6b6c0f5d23868d697c0a
Author: Owen O'Malley 
Date:   2017-05-30T17:49:20Z

null optimizer

commit 1729970c77d20af27cf7977a513e339d814d65dc
Author: Ashutosh Chauhan 
Date:   2017-01-23T19:45:09Z

BUG-72965 : Backport HIVE-15544 & HIVE-15481 to fenton hive2
Addendum for HIVE-15481

Change-Id: Iee4acb5831c99f120708786ff62018fe65a21a47

commit aa27c6da16fccf95e5b1c43f7a01f6eaee2a6050
Author: Owen O'Malley 
Date:   2017-05-30T17:53:15Z

more fixes

commit f1fbadd268920843283ec1cad072c9f0bc335788
Author: Ashutosh Chauhan 
Date:   2016-09-13T14:58:50Z

HIVE-874 : Port msck fixes to Erie
Test updatesfor HIVE-14511

commit 184c27c08b2bfb1de4c2b7941b2c8e55755c7a77
Author: Wei Zheng 
Date:   2017-02-02T18:24:18Z

BUG-70516 : Fenton

Re: Review Request 59654: HIVE-16771 : Schematool should use MetastoreSchemaInfo to get the metastore schema version from database

2017-05-30 Thread Vihang Karajgaonkar 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/59654/
---

(Updated May 30, 2017, 11:22 p.m.)


Review request for hive, Naveen Gangam, Sergio Pena, and Sahil Takiar.


Changes
---

Added review suggestions


Bugs: HIVE-16771
https://issues.apache.org/jira/browse/HIVE-16771


Repository: hive-git


Description
---

HIVE-16771 : Schematool should use MetastoreSchemaInfo to get the metastore 
schema version from database


Diffs (updated)
-

  beeline/src/java/org/apache/hive/beeline/HiveSchemaHelper.java 
a4ecc089f8a19bd94af2eae17e534cc6e8d2a9ca 
  beeline/src/java/org/apache/hive/beeline/HiveSchemaTool.java 
f312e46d755fc843369167af6d4da3de7dbe4a61 
  beeline/src/test/org/apache/hive/beeline/TestHiveSchemaTool.java 
716bce7289b6e7c4d4bcea38b06f591a9ad9c098 
  itests/hive-unit/src/test/java/org/apache/hive/beeline/TestSchemaTool.java 
d1658f7bb2e5306b6b5954165759a217d1ba235c 
  metastore/src/java/org/apache/hadoop/hive/metastore/IMetaStoreSchemaInfo.java 
d6627433cb0f3f1c8fe868b3748fd754a7bff821 
  metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreSchemaInfo.java 
6bddb8e864d26a6cb7e2fe9b8b8becf427779944 


Diff: https://reviews.apache.org/r/59654/diff/2/

Changes: https://reviews.apache.org/r/59654/diff/1-2/


Testing
---


Thanks,

Vihang Karajgaonkar

Re: Review Request 59654: HIVE-16771 : Schematool should use MetastoreSchemaInfo to get the metastore schema version from database

2017-05-30 Thread Sergio Pena 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/59654/#review176375
---


Ship it!




The patch looks good. I agree this needs more refactoring to make it better, 
but it is more work to do.
Let's ship this for now.

- Sergio Pena


On May 30, 2017, 9:43 p.m., Vihang Karajgaonkar wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/59654/
> ---
> 
> (Updated May 30, 2017, 9:43 p.m.)
> 
> 
> Review request for hive, Naveen Gangam, Sergio Pena, and Sahil Takiar.
> 
> 
> Bugs: HIVE-16771
> https://issues.apache.org/jira/browse/HIVE-16771
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> HIVE-16771 : Schematool should use MetastoreSchemaInfo to get the metastore 
> schema version from database
> 
> 
> Diffs
> -
> 
>   beeline/src/java/org/apache/hive/beeline/HiveSchemaHelper.java 
> a4ecc089f8a19bd94af2eae17e534cc6e8d2a9ca 
>   beeline/src/java/org/apache/hive/beeline/HiveSchemaTool.java 
> f312e46d755fc843369167af6d4da3de7dbe4a61 
>   beeline/src/test/org/apache/hive/beeline/TestHiveSchemaTool.java 
> 716bce7289b6e7c4d4bcea38b06f591a9ad9c098 
>   itests/hive-unit/src/test/java/org/apache/hive/beeline/TestSchemaTool.java 
> d1658f7bb2e5306b6b5954165759a217d1ba235c 
>   
> metastore/src/java/org/apache/hadoop/hive/metastore/IMetaStoreSchemaInfo.java 
> d6627433cb0f3f1c8fe868b3748fd754a7bff821 
>   
> metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreSchemaInfo.java 
> 6bddb8e864d26a6cb7e2fe9b8b8becf427779944 
> 
> 
> Diff: https://reviews.apache.org/r/59654/diff/1/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Vihang Karajgaonkar
> 
>

[jira] [Created] (HIVE-16793) Scalar sub-query: Scalar safety checks for group-bys

2017-05-30 Thread Gopal V (JIRA) 
Gopal V created HIVE-16793:
--

 Summary: Scalar sub-query: Scalar safety checks for group-bys
 Key: HIVE-16793
 URL: https://issues.apache.org/jira/browse/HIVE-16793
 Project: Hive
  Issue Type: Bug
  Components: SQL
Affects Versions: 3.0.0
Reporter: Gopal V
Assignee: Vineet Garg


This query has an sq_count check, though is useless on a constant key.

{code}
hive> explain select * from part where p_size > (select max(p_size) from part 
where p_type = '1' group by p_type);
Warning: Map Join MAPJOIN[37][bigTable=?] in task 'Map 1' is a cross product
Warning: Map Join MAPJOIN[36][bigTable=?] in task 'Map 1' is a cross product
OK
Plan optimized by CBO.

Vertex dependency in root stage
Map 1 <- Reducer 4 (BROADCAST_EDGE), Reducer 6 (BROADCAST_EDGE)
Reducer 3 <- Map 2 (SIMPLE_EDGE)
Reducer 4 <- Reducer 3 (CUSTOM_SIMPLE_EDGE)
Reducer 6 <- Map 5 (SIMPLE_EDGE)

Stage-0
  Fetch Operator
limit:-1
Stage-1
  Map 1 vectorized, llap
  File Output Operator [FS_64]
Select Operator [SEL_63] (rows= width=621)
  
Output:["_col0","_col1","_col2","_col3","_col4","_col5","_col6","_col7","_col8"]
  Filter Operator [FIL_62] (rows= width=625)
predicate:(_col5 > _col10)
Map Join Operator [MAPJOIN_61] (rows=2 width=625)
  
Conds:(Inner),Output:["_col0","_col1","_col2","_col3","_col4","_col5","_col6","_col7","_col8","_col10"]
<-Reducer 6 [BROADCAST_EDGE] vectorized, llap
  BROADCAST [RS_58]
Select Operator [SEL_57] (rows=1 width=4)
  Output:["_col0"]
  Group By Operator [GBY_56] (rows=1 width=89)

Output:["_col0","_col1"],aggregations:["max(VALUE._col0)"],keys:KEY._col0
  <-Map 5 [SIMPLE_EDGE] vectorized, llap
SHUFFLE [RS_55]
  PartitionCols:_col0
  Group By Operator [GBY_54] (rows=86 width=89)

Output:["_col0","_col1"],aggregations:["max(_col1)"],keys:'1'
Select Operator [SEL_53] (rows=1212121 width=109)
  Output:["_col1"]
  Filter Operator [FIL_52] (rows=1212121 width=109)
predicate:(p_type = '1')
TableScan [TS_17] (rows=2 width=109)
  
tpch_flat_orc_1000@part,part,Tbl:COMPLETE,Col:COMPLETE,Output:["p_type","p_size"]
<-Map Join Operator [MAPJOIN_60] (rows=2 width=621)

Conds:(Inner),Output:["_col0","_col1","_col2","_col3","_col4","_col5","_col6","_col7","_col8"]
  <-Reducer 4 [BROADCAST_EDGE] vectorized, llap
BROADCAST [RS_51]
  Select Operator [SEL_50] (rows=1 width=8)
Filter Operator [FIL_49] (rows=1 width=8)
  predicate:(sq_count_check(_col0) <= 1)
  Group By Operator [GBY_48] (rows=1 width=8)
Output:["_col0"],aggregations:["count(VALUE._col0)"]
  <-Reducer 3 [CUSTOM_SIMPLE_EDGE] vectorized, llap
PARTITION_ONLY_SHUFFLE [RS_47]
  Group By Operator [GBY_46] (rows=1 width=8)
Output:["_col0"],aggregations:["count()"]
Select Operator [SEL_45] (rows=1 width=85)
  Group By Operator [GBY_44] (rows=1 width=85)
Output:["_col0"],keys:KEY._col0
  <-Map 2 [SIMPLE_EDGE] vectorized, llap
SHUFFLE [RS_43]
  PartitionCols:_col0
  Group By Operator [GBY_42] (rows=83 width=85)
Output:["_col0"],keys:'1'
Select Operator [SEL_41] (rows=1212121 
width=105)
  Filter Operator [FIL_40] (rows=1212121 
width=105)
predicate:(p_type = '1')
TableScan [TS_2] (rows=2 
width=105)
  
tpch_flat_orc_1000@part,part,Tbl:COMPLETE,Col:COMPLETE,Output:["p_type"]
  <-Select Operator [SEL_59] (rows=2 width=621)
  
Output:["_col0","_col1","_col2","_col3","_col4","_col5","_col6","_col7","_col8"]
  TableScan [TS_0] (rows=2 width=621)

tpch_flat_orc_1000@part,part,Tbl:COMPLETE,Col:COMPLETE,Output:["p_partkey","p_name","p_mfgr","p_brand","p_type","p_size","p_container","p_retailprice","p_comment"]
{code}

The other version without the filter is missing the check, though the compiler 
cannot assume the nDV of p_type.

{code}
hive>

Re: Review Request 59624: HIVE-16757 remove use of deperecated RelNode.getRows()

2017-05-30 Thread Remus Rusanu 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/59624/
---

(Updated May 30, 2017, 10:15 p.m.)


Review request for hive, Ashutosh Chauhan and Jesús Camacho Rodríguez.


Repository: hive-git


Description
---

HIVE-16757 remove use of deperecated RelNode.getRows(), use 
estimateRowCount(mq) instead


Diffs (updated)
-

  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/cost/HiveAlgorithmsUtil.java
 4ba10e2 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/cost/HiveCostModel.java 
4af1f8d 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/cost/HiveDefaultCostModel.java
 40f2cef 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/cost/HiveOnTezCostModel.java
 af5fc5e 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/cost/HiveRelMdCost.java 
cbea307 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/stats/FilterSelectivityEstimator.java
 a25b58b 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/stats/HiveRelMdDistinctRowCount.java
 77f7aa8 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/stats/HiveRelMdRowCount.java
 7bba80b 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/stats/HiveRelMdSelectivity.java
 7192684 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/stats/HiveRelMdUniqueKeys.java
 9a5a2ba 


Diff: https://reviews.apache.org/r/59624/diff/3/

Changes: https://reviews.apache.org/r/59624/diff/2-3/


Testing
---


Thanks,

Remus Rusanu

Re: Review Request 59654: HIVE-16771 : Schematool should use MetastoreSchemaInfo to get the metastore schema version from database

2017-05-30 Thread Sahil Takiar 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/59654/#review176369
---


Fix it, then Ship it!




Overall, LGTM.


beeline/src/java/org/apache/hive/beeline/HiveSchemaTool.java
Line 784 (original), 759-760 (patched)


Previously, `baseDir.getParent()` was used in when constructing 
`schemaFile`, but it seems that it is no longer the case.

Probably safer to use the `File(String, String)` constructor instead of 
building up the file name using `File.separatorChar` since we don't know what 
metaStoreSchemaInfo.getMetaStoreScriptDir() and 
metaStoreSchemaInfo.generateInitFileName(version) return.


- Sahil Takiar


On May 30, 2017, 9:43 p.m., Vihang Karajgaonkar wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/59654/
> ---
> 
> (Updated May 30, 2017, 9:43 p.m.)
> 
> 
> Review request for hive, Naveen Gangam, Sergio Pena, and Sahil Takiar.
> 
> 
> Bugs: HIVE-16771
> https://issues.apache.org/jira/browse/HIVE-16771
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> HIVE-16771 : Schematool should use MetastoreSchemaInfo to get the metastore 
> schema version from database
> 
> 
> Diffs
> -
> 
>   beeline/src/java/org/apache/hive/beeline/HiveSchemaHelper.java 
> a4ecc089f8a19bd94af2eae17e534cc6e8d2a9ca 
>   beeline/src/java/org/apache/hive/beeline/HiveSchemaTool.java 
> f312e46d755fc843369167af6d4da3de7dbe4a61 
>   beeline/src/test/org/apache/hive/beeline/TestHiveSchemaTool.java 
> 716bce7289b6e7c4d4bcea38b06f591a9ad9c098 
>   itests/hive-unit/src/test/java/org/apache/hive/beeline/TestSchemaTool.java 
> d1658f7bb2e5306b6b5954165759a217d1ba235c 
>   
> metastore/src/java/org/apache/hadoop/hive/metastore/IMetaStoreSchemaInfo.java 
> d6627433cb0f3f1c8fe868b3748fd754a7bff821 
>   
> metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreSchemaInfo.java 
> 6bddb8e864d26a6cb7e2fe9b8b8becf427779944 
> 
> 
> Diff: https://reviews.apache.org/r/59654/diff/1/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Vihang Karajgaonkar
> 
>

Re: Review Request 59654: HIVE-16771 : Schematool should use MetastoreSchemaInfo to get the metastore schema version from database

2017-05-30 Thread Vihang Karajgaonkar 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/59654/
---

(Updated May 30, 2017, 9:43 p.m.)


Review request for hive, Naveen Gangam, Sergio Pena, and Sahil Takiar.


Changes
---

added the link to JIRA


Bugs: HIVE-16771
https://issues.apache.org/jira/browse/HIVE-16771


Repository: hive-git


Description
---

HIVE-16771 : Schematool should use MetastoreSchemaInfo to get the metastore 
schema version from database


Diffs
-

  beeline/src/java/org/apache/hive/beeline/HiveSchemaHelper.java 
a4ecc089f8a19bd94af2eae17e534cc6e8d2a9ca 
  beeline/src/java/org/apache/hive/beeline/HiveSchemaTool.java 
f312e46d755fc843369167af6d4da3de7dbe4a61 
  beeline/src/test/org/apache/hive/beeline/TestHiveSchemaTool.java 
716bce7289b6e7c4d4bcea38b06f591a9ad9c098 
  itests/hive-unit/src/test/java/org/apache/hive/beeline/TestSchemaTool.java 
d1658f7bb2e5306b6b5954165759a217d1ba235c 
  metastore/src/java/org/apache/hadoop/hive/metastore/IMetaStoreSchemaInfo.java 
d6627433cb0f3f1c8fe868b3748fd754a7bff821 
  metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreSchemaInfo.java 
6bddb8e864d26a6cb7e2fe9b8b8becf427779944 


Diff: https://reviews.apache.org/r/59654/diff/1/


Testing
---


Thanks,

Vihang Karajgaonkar

Review Request 59654: HIVE-16771 : Schematool should use MetastoreSchemaInfo to get the metastore schema version from database

2017-05-30 Thread Vihang Karajgaonkar 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/59654/
---

Review request for hive, Naveen Gangam, Sergio Pena, and Sahil Takiar.


Repository: hive-git


Description
---

HIVE-16771 : Schematool should use MetastoreSchemaInfo to get the metastore 
schema version from database


Diffs
-

  beeline/src/java/org/apache/hive/beeline/HiveSchemaHelper.java 
a4ecc089f8a19bd94af2eae17e534cc6e8d2a9ca 
  beeline/src/java/org/apache/hive/beeline/HiveSchemaTool.java 
f312e46d755fc843369167af6d4da3de7dbe4a61 
  beeline/src/test/org/apache/hive/beeline/TestHiveSchemaTool.java 
716bce7289b6e7c4d4bcea38b06f591a9ad9c098 
  itests/hive-unit/src/test/java/org/apache/hive/beeline/TestSchemaTool.java 
d1658f7bb2e5306b6b5954165759a217d1ba235c 
  metastore/src/java/org/apache/hadoop/hive/metastore/IMetaStoreSchemaInfo.java 
d6627433cb0f3f1c8fe868b3748fd754a7bff821 
  metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreSchemaInfo.java 
6bddb8e864d26a6cb7e2fe9b8b8becf427779944 


Diff: https://reviews.apache.org/r/59654/diff/1/


Testing
---


Thanks,

Vihang Karajgaonkar

[jira] [Created] (HIVE-16792) Estimate Rows When Joining BIGINT to INT Column

2017-05-30 Thread BELUGA BEHR (JIRA) 
BELUGA BEHR created HIVE-16792:
--

 Summary: Estimate Rows When Joining BIGINT to INT Column
 Key: HIVE-16792
 URL: https://issues.apache.org/jira/browse/HIVE-16792
 Project: Hive
  Issue Type: Improvement
Affects Versions: 2.1.1
Reporter: BELUGA BEHR
Priority: Minor


{code:sql}
create table test1
(a int);

create table test2
(z bigint);

INSERT INTO test1 VALUES (1);
INSERT INTO test2 VALUES (2147483648);

analyze table test1 compute statistics for columns;
analyze table test2 compute statistics for columns;

EXPLAIN SELECT * FROM test1 t1 INNER JOIN test2 t2 ON t1.a=t2.z;
{code}

{code}
Explain
STAGE DEPENDENCIES:
  Stage-4 is a root stage
  Stage-3 depends on stages: Stage-4
  Stage-0 depends on stages: Stage-3
""
STAGE PLANS:
  Stage: Stage-4
Map Reduce Local Work
  Alias -> Map Local Tables:
t2 
  Fetch Operator
limit: -1
  Alias -> Map Local Operator Tree:
t2 
  TableScan
alias: t2
filterExpr: z is not null (type: boolean)
Statistics: Num rows: 1 Data size: 0 Basic stats: PARTIAL Column 
stats: COMPLETE
Filter Operator
  predicate: z is not null (type: boolean)
  Statistics: Num rows: 1 Data size: 0 Basic stats: PARTIAL Column 
stats: COMPLETE
  HashTable Sink Operator
keys:
  0 UDFToLong(a) (type: bigint)
  1 z (type: bigint)

  Stage: Stage-3
Map Reduce
  Map Operator Tree:
  TableScan
alias: t1
filterExpr: UDFToLong(a) is not null (type: boolean)
Statistics: Num rows: 1 Data size: 1 Basic stats: COMPLETE Column 
stats: NONE
Filter Operator
  predicate: UDFToLong(a) is not null (type: boolean)
  Statistics: Num rows: 1 Data size: 1 Basic stats: COMPLETE Column 
stats: NONE
  Map Join Operator
condition map:
 Inner Join 0 to 1
keys:
  0 UDFToLong(a) (type: bigint)
  1 z (type: bigint)
outputColumnNames: _col0, _col4"
Statistics: Num rows: 1 Data size: 1 Basic stats: COMPLETE 
Column stats: NONE
Select Operator
  expressions: _col0 (type: int), _col4 (type: bigint)"
  outputColumnNames: _col0, _col1"
  Statistics: Num rows: 1 Data size: 1 Basic stats: COMPLETE 
Column stats: NONE
  File Output Operator
compressed: false
Statistics: Num rows: 1 Data size: 1 Basic stats: COMPLETE 
Column stats: NONE
table:
input format: org.apache.hadoop.mapred.TextInputFormat
output format: 
org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
serde: 
org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
  Local Work:
Map Reduce Local Work

  Stage: Stage-0
Fetch Operator
  limit: -1
  Processor Tree:
ListSink
{code}

I would expect that perhaps Hive would be smart enough to know that this join 
is not going to produce any rows because the MIN VALUE of table test2 is more 
than INTEGER.MAX_VALUE.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Re: Review Request 59310: HIVE-15051 Test framework integration with findbugs, rat checks etc.

2017-05-30 Thread Peter Vary 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/59310/
---

(Updated May 30, 2017, 9:38 p.m.)


Review request for hive, Akira Ajisaka, Marta Kuczora, Siddharth Seth, Thejas 
Nair, Vihang Karajgaonkar, and Barna Zsombor Klara.


Changes
---

Addressed review comments.
Running full build on clean branch before starting the tests.


Repository: hive-git


Description
---

Integrated Apache Yetus (https://yetus.apache.org/)
- Created hive personality to contain the hive specific configurations
- Created yetus-wrapper.sh to download yetus and patch the not yet released 
changes:
-- checkstyle_YETUS-484.sh
-- findbugs_YETUS-471.sh
-- maven_YETUS-506.sh
- Created test-patch.sh, and smart-apply-patch.sh to simplify testing/applying 
patch
- Added patchprocess directory to gitignore
- Two small modification in pom.xml
-- Adding findbugs configuration to build
-- Disabling failure on javadoc errors


Diffs (updated)
-

  .gitignore 47c59da 
  dev-support/checkstyle_YETUS-484.sh PRE-CREATION 
  dev-support/findbugs_YETUS-471.sh PRE-CREATION 
  dev-support/hive-personality.sh PRE-CREATION 
  dev-support/maven_YETUS-506.sh PRE-CREATION 
  dev-support/smart-apply-patch.sh PRE-CREATION 
  dev-support/test-patch.sh PRE-CREATION 
  dev-support/yetus-wrapper.sh PRE-CREATION 
  pom.xml 30fa50b 


Diff: https://reviews.apache.org/r/59310/diff/3/

Changes: https://reviews.apache.org/r/59310/diff/2-3/


Testing
---

To test a patch set the FINDBUGS_HOME, and go to the hive source root directory 
and run the test_patch.sh command like this:
./[petervary:~/dev/upstream/hive] $ export 
FINDBUGS_HOME=~/dev/upstream/findbugs-3.0.1/
./[petervary:~/dev/upstream/hive] $ ./dev-support/test-patch.sh 
~/Downloads/HIVE-16345.2.patch


Thanks,

Peter Vary

Re: Review Request 59610: Support numeric as same as decimal

2017-05-30 Thread Ashutosh Chauhan 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/59610/#review176358
---




ql/src/java/org/apache/hadoop/hive/ql/parse/HiveLexer.g
Line 137 (original), 137 (patched)


This will make Numeric reserved keyword, which is ok, but we need to note 
that in Release Notes field of jira and mark incompatible change flag in jira.


- Ashutosh Chauhan


On May 26, 2017, 5:43 p.m., pengcheng xiong wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/59610/
> ---
> 
> (Updated May 26, 2017, 5:43 p.m.)
> 
> 
> Review request for hive and Ashutosh Chauhan.
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> HIVE-16764
> 
> 
> Diffs
> -
> 
>   ql/src/java/org/apache/hadoop/hive/ql/parse/HiveLexer.g 393df65cd9 
>   ql/src/test/queries/clientpositive/perf/query1.q d40f66aa1d 
>   ql/src/test/queries/clientpositive/perf/query10.q PRE-CREATION 
>   ql/src/test/queries/clientpositive/perf/query12.q 7ef6cb89eb 
>   ql/src/test/queries/clientpositive/perf/query13.q 6f43d4738f 
>   ql/src/test/queries/clientpositive/perf/query14.q e075f4f4a8 
>   ql/src/test/queries/clientpositive/perf/query15.q 9f75410fbe 
>   ql/src/test/queries/clientpositive/perf/query16.q 0243bf3fbe 
>   ql/src/test/queries/clientpositive/perf/query17.q bb8a33b8de 
>   ql/src/test/queries/clientpositive/perf/query18.q e6061f5579 
>   ql/src/test/queries/clientpositive/perf/query19.q cfb62185d0 
>   ql/src/test/queries/clientpositive/perf/query2.q PRE-CREATION 
>   ql/src/test/queries/clientpositive/perf/query20.q d4ea10dc18 
>   ql/src/test/queries/clientpositive/perf/query21.q 4c68df9a9e 
>   ql/src/test/queries/clientpositive/perf/query22.q adb509dab0 
>   ql/src/test/queries/clientpositive/perf/query23.q 4939416e73 
>   ql/src/test/queries/clientpositive/perf/query24.q b9b747f4ab 
>   ql/src/test/queries/clientpositive/perf/query25.q 80185ab00c 
>   ql/src/test/queries/clientpositive/perf/query26.q 0e81120214 
>   ql/src/test/queries/clientpositive/perf/query27.q 0cbb3ae5a9 
>   ql/src/test/queries/clientpositive/perf/query28.q 2a5f0922d4 
>   ql/src/test/queries/clientpositive/perf/query29.q 1634b1f6ae 
>   ql/src/test/queries/clientpositive/perf/query3.q 47dfac57c9 
>   ql/src/test/queries/clientpositive/perf/query30.q 25c9e07d11 
>   ql/src/test/queries/clientpositive/perf/query31.q d448dc3894 
>   ql/src/test/queries/clientpositive/perf/query32.q ceb2ddb03c 
>   ql/src/test/queries/clientpositive/perf/query33.q 06628bd1af 
>   ql/src/test/queries/clientpositive/perf/query34.q 5c3efe1719 
>   ql/src/test/queries/clientpositive/perf/query35.q PRE-CREATION 
>   ql/src/test/queries/clientpositive/perf/query36.q 6c3a945a8f 
>   ql/src/test/queries/clientpositive/perf/query37.q c71ec56f8f 
>   ql/src/test/queries/clientpositive/perf/query38.q 2e8517e3b3 
>   ql/src/test/queries/clientpositive/perf/query39.q c9f8f2b96e 
>   ql/src/test/queries/clientpositive/perf/query40.q 155fa084c5 
>   ql/src/test/queries/clientpositive/perf/query42.q c4b115b236 
>   ql/src/test/queries/clientpositive/perf/query43.q f1c22e86d6 
>   ql/src/test/queries/clientpositive/perf/query44.q PRE-CREATION 
>   ql/src/test/queries/clientpositive/perf/query45.q PRE-CREATION 
>   ql/src/test/queries/clientpositive/perf/query46.q 3e8711f9a1 
>   ql/src/test/queries/clientpositive/perf/query48.q a02f6302ed 
>   ql/src/test/queries/clientpositive/perf/query49.q PRE-CREATION 
>   ql/src/test/queries/clientpositive/perf/query5.q a877c4cd88 
>   ql/src/test/queries/clientpositive/perf/query50.q e4bdf0ab6f 
>   ql/src/test/queries/clientpositive/perf/query51.q b7688cfefc 
>   ql/src/test/queries/clientpositive/perf/query52.q 24d0ac3231 
>   ql/src/test/queries/clientpositive/perf/query53.q PRE-CREATION 
>   ql/src/test/queries/clientpositive/perf/query54.q b1a3e832a8 
>   ql/src/test/queries/clientpositive/perf/query55.q 644ba1afd5 
>   ql/src/test/queries/clientpositive/perf/query56.q 63e53ea9fe 
>   ql/src/test/queries/clientpositive/perf/query58.q d392ded7d8 
>   ql/src/test/queries/clientpositive/perf/query59.q PRE-CREATION 
>   ql/src/test/queries/clientpositive/perf/query6.q 8e4a7d375e 
>   ql/src/test/queries/clientpositive/perf/query60.q efa86d1079 
>   ql/src/test/queries/clientpositive/perf/query61.q PRE-CREATION 
>   ql/src/test/queries/clientpositive/perf/query63.q PRE-CREATION 
>   ql/src/test/queries/clientpositive/perf/query64.q 13ebf4ab76 
>   ql/src/test/queries/clientpositive/perf/query65.q bd4475d8ff 
>   ql/src/test/queries/clientpositive/perf/query66.q 9224680411 
>   ql/src/test/queries/clientpositive/perf/query67.q ca2fc61fb0 
>   ql/src/test/queries/clientpositive/perf/query68.q

[jira] [Created] (HIVE-16791) Tez engine giving very inaccurate results on SMB Map joins while map-join and shuffle join gets correct results

2017-05-30 Thread Saumil Mayani (JIRA) 
Saumil Mayani created HIVE-16791:


 Summary: Tez engine giving very inaccurate results on SMB Map 
joins while map-join and shuffle join gets correct results
 Key: HIVE-16791
 URL: https://issues.apache.org/jira/browse/HIVE-16791
 Project: Hive
  Issue Type: Bug
  Components: Hive, HiveServer2
Reporter: Saumil Mayani


SMB Join gives incorrect results.
{code}
SMB-Join
set hive.execution.engine=tez;
set hive.enforce.sortmergebucketmapjoin=false;
set hive.optimize.bucketmapjoin=true;
set hive.optimize.bucketmapjoin.sortedmerge=true;
set hive.auto.convert.sortmerge.join=true;
set hive.auto.convert.join=true;
set hive.auto.convert.join.noconditionaltask.size=50;

OK
20161   11999639
20162   18955110
20172   22217437
Time taken: 92.647 seconds, Fetched: 3 row(s)
{code}
{code}
MAP-JOIN
set hive.execution.engine=tez;
set hive.enforce.sortmergebucketmapjoin=false;
set hive.optimize.bucketmapjoin=true;
set hive.optimize.bucketmapjoin.sortedmerge=true;
set hive.auto.convert.sortmerge.join=true;
set hive.auto.convert.join=true;
set hive.auto.convert.join.noconditionaltask.size=5000;
OK
20161   26586093
20162   17724062
20172   8862031
Time taken: 17.49 seconds, Fetched: 3 row(s)
{code}
{code}
Shuffle Join
set hive.execution.engine=tez;
set hive.enforce.sortmergebucketmapjoin=false;
set hive.optimize.bucketmapjoin=true;
set hive.optimize.bucketmapjoin.sortedmerge=true;
set hive.auto.convert.sortmerge.join=false;
set hive.auto.convert.join=false;
set hive.auto.convert.join.noconditionaltask.size=5000;

OK
20161   26586093
20162   17724062
20172   8862031
Time taken: 38.575 seconds, Fetched: 3 row(s)
{code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Re: CVE-2016-3083: Apache Hive SSL vulnerability bug disclosure

2017-05-30 Thread Sergio Pena 
Hi Vaibhav,

Do you happen to know which JIRA or patches addressed this issue?

- Sergio

On Wed, May 24, 2017 at 5:56 PM, Vaibhav Gumashta  wrote:

> Severity: Important
>
> Vendor: The Apache Software Foundation
>
> Versions Affected:
> Apache Hive 0.13.x
> Apache Hive 0.14.x
> Apache Hive 1.0.0 - 1.0.1
> Apache Hive 1.1.0 - 1.1.1
> Apache Hive 1.2.0 - 1.2.1
> Apache Hive 2.0.0
>
> Description:
>
> Apache Hive (JDBC + HiveServer2) implements SSL for plain TCP and HTTP
> connections (it supports both transport modes). While validating the
> server's certificate during the connection setup, the client doesn't seem
> to be verifying the common name attribute of the certificate. In this way,
> if a JDBC client sends an SSL request to server abc.com, and the server
> responds with a valid certificate (certified by CA) but issued to xyz.com,
> the client will accept that as a valid certificate and the SSL handshake
> will go through.
>
> Mitigation:
>
> Upgrade to Apache Hive 1.2.2 for 1.x release line, or to Apache Hive 2.0.1
> or later for 2.0.x release line, or to Apache Hive 2.1.0 and later for
> 2.1.x release line.
>
> Credit: This issue was discovered by Branden Crawford from Inteco Systems
> Limited (inetco.com).
>

[jira] [Created] (HIVE-16790) HiveCostModel.JoinAlgorithm and derivatives abuse RelMetadataQuery.instance

2017-05-30 Thread Remus Rusanu (JIRA) 
Remus Rusanu created HIVE-16790:
---

 Summary: HiveCostModel.JoinAlgorithm and derivatives abuse 
RelMetadataQuery.instance
 Key: HIVE-16790
 URL: https://issues.apache.org/jira/browse/HIVE-16790
 Project: Hive
  Issue Type: Bug
  Components: Query Planning
Reporter: Remus Rusanu
Assignee: Remus Rusanu


Calling {{RelMetadataQuery.instance()}} has serious performance implication, as 
it invalidates the memoization cache used in Calcite, see HIVE-16757

{{HiveCostModel.JoinAlgorithm}} and the derivate classes abuse this calls, 
sometimes multiple times per function. All methods in JoinAlgortihm that need a 
RelMetadataQuery should accept it as argument, not build one instance.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Re: Review Request 59624: HIVE-16757 remove use of deperecated RelNode.getRows()

2017-05-30 Thread Remus Rusanu 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/59624/
---

(Updated May 30, 2017, 7:31 p.m.)


Review request for hive, Ashutosh Chauhan and Jesús Camacho Rodríguez.


Repository: hive-git


Description
---

HIVE-16757 remove use of deperecated RelNode.getRows(), use 
estimateRowCount(mq) instead


Diffs (updated)
-

  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/cost/HiveAlgorithmsUtil.java
 4ba10e2 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/cost/HiveCostModel.java 
4af1f8d 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/cost/HiveDefaultCostModel.java
 40f2cef 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/cost/HiveOnTezCostModel.java
 af5fc5e 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/cost/HiveRelMdCost.java 
cbea307 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/stats/FilterSelectivityEstimator.java
 a25b58b 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/stats/HiveRelMdDistinctRowCount.java
 77f7aa8 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/stats/HiveRelMdRowCount.java
 7bba80b 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/stats/HiveRelMdSelectivity.java
 7192684 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/stats/HiveRelMdUniqueKeys.java
 9a5a2ba 


Diff: https://reviews.apache.org/r/59624/diff/2/

Changes: https://reviews.apache.org/r/59624/diff/1-2/


Testing
---


Thanks,

Remus Rusanu

Re: Review Request 59624: HIVE-16757 remove use of deperecated RelNode.getRows()

2017-05-30 Thread Ashutosh Chauhan 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/59624/#review176333
---




ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/cost/HiveAlgorithmsUtil.java
Line 64 (original), 64 (patched)


Should this instead be mq.getRowCount(hr); That is waht javadoc of 
RelNode::estimateRowCount() is suggesting?



ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/cost/HiveOnTezCostModel.java
Line 82 (original), 82 (patched)


Should this instead be mq.getRowCount(ts); That is waht javadoc of 
RelNode::estimateRowCount() is suggesting?



ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/stats/FilterSelectivityEstimator.java
Line 94 (original), 96 (patched)


Should this instead be mq.getRowCount(childRel); That is waht javadoc of 
RelNode::estimateRowCount() is suggesting?



ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/stats/HiveRelMdRowCount.java
Line 75 (original), 75 (patched)


Should this instead be mq.getRowCount(join); That is waht javadoc of 
RelNode::estimateRowCount() is suggesting?


- Ashutosh Chauhan


On May 29, 2017, 7:54 a.m., Remus Rusanu wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/59624/
> ---
> 
> (Updated May 29, 2017, 7:54 a.m.)
> 
> 
> Review request for hive, Ashutosh Chauhan and Jesús Camacho Rodríguez.
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> HIVE-16757 remove use of deperecated RelNode.getRows(), use 
> estimateRowCount(mq) instead
> 
> 
> Diffs
> -
> 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/cost/HiveAlgorithmsUtil.java
>  4ba10e2 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/cost/HiveCostModel.java
>  4af1f8d 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/cost/HiveDefaultCostModel.java
>  40f2cef 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/cost/HiveOnTezCostModel.java
>  af5fc5e 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/cost/HiveRelMdCost.java
>  cbea307 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/stats/FilterSelectivityEstimator.java
>  a25b58b 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/stats/HiveRelMdDistinctRowCount.java
>  77f7aa8 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/stats/HiveRelMdRowCount.java
>  7bba80b 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/stats/HiveRelMdSelectivity.java
>  7192684 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/stats/HiveRelMdUniqueKeys.java
>  9a5a2ba 
> 
> 
> Diff: https://reviews.apache.org/r/59624/diff/1/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Remus Rusanu
> 
>

Review Request 59645: HIVE-16788

2017-05-30 Thread Jesús Camacho Rodríguez 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/59645/
---

Review request for hive and Ashutosh Chauhan.


Bugs: HIVE-16788
https://issues.apache.org/jira/browse/HIVE-16788


Repository: hive-git


Description
---

HIVE-16788


Diffs
-

  metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java 
b16218d8a041eb120be25a6079eb641fe228814a 
  metastore/src/test/org/apache/hadoop/hive/metastore/TestObjectStore.java 
69e8826f53c9278a7307817c8bfa4151f36631b9 


Diff: https://reviews.apache.org/r/59645/diff/1/


Testing
---


Thanks,

Jesús Camacho Rodríguez

[jira] [Created] (HIVE-16789) Query with window function fails when where clause returns no records

2017-05-30 Thread Narayana (JIRA) 
Narayana created HIVE-16789:
---

 Summary: Query with window function fails when where clause 
returns no records
 Key: HIVE-16789
 URL: https://issues.apache.org/jira/browse/HIVE-16789
 Project: Hive
  Issue Type: Bug
  Components: Query Processor
Affects Versions: 1.2.1, 1.0.1
 Environment: OS: CentOS release 6.6 (Final)
HDP: 2.7.3
Hive: 1.0.1,1.2.1
Reporter: Narayana


When outer where clause found no matching records, queries like these are 
failing with 

{code}
select 
a,b,c,d,e,
min(case when e='test1' then null else c end) over (partition by a,b order by d 
rows between 1 preceding and current row) prev_c
from
(
select '1234' a ,'abc' b,10 c,2 d,'test1' e
union all 
select '1234' a ,'abc' b,9 c,1 d,'test2' e
union all
select '1234' a ,'abc' b,11 c,3 d,'test2' e
union all  
select '1234' a ,'abcd' b,1 c,5 d,'test2' e
union all 
select '1234' a ,'abcd' b,6 c,9 d,'test1' e
)X
where e='test3'
;
{code}

Error:

Error: java.lang.RuntimeException: Hive Runtime Error while closing operators: 
null
at 
org.apache.hadoop.hive.ql.exec.mr.ExecReducer.close(ExecReducer.java:295)
at 
org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:453)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Unknown Source)
at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
Caused by: java.util.NoSuchElementException
at java.util.ArrayDeque.getFirst(Unknown Source)
at 
org.apache.hadoop.hive.ql.udf.generic.GenericUDAFMax$MaxStreamingFixedWindow.terminate(GenericUDAFMax.java:280)
at 
org.apache.hadoop.hive.ql.udf.ptf.WindowingTableFunction.finishPartition(WindowingTableFunction.java:413)
at 
org.apache.hadoop.hive.ql.exec.PTFOperator$PTFInvocation.finishPartition(PTFOperator.java:337)
at 
org.apache.hadoop.hive.ql.exec.PTFOperator.closeOp(PTFOperator.java:95)
at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:598)
at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:610)
at 
org.apache.hadoop.hive.ql.exec.mr.ExecReducer.close(ExecReducer.java:287)
... 7 more



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Created] (HIVE-16788) ODBC call SQLForeignKeys leads to NPE if you use PK arguments rather than FK arguments

2017-05-30 Thread Jesus Camacho Rodriguez (JIRA) 
Jesus Camacho Rodriguez created HIVE-16788:
--

 Summary: ODBC call SQLForeignKeys leads to NPE if you use PK 
arguments rather than FK arguments
 Key: HIVE-16788
 URL: https://issues.apache.org/jira/browse/HIVE-16788
 Project: Hive
  Issue Type: Bug
  Components: ODBC
Reporter: Carter Shanklin
Assignee: Jesus Camacho Rodriguez


This ODBC call is meant to allow you to determine FK relationships either from 
the PK side or from the FK side.

Hive only allows you to traverse from the FK side, trying it from the PK side 
leads to an NPE.

Example using the table "customer" from TPC-H with FKs defined in Hive:

{code}
=== Foreign Keys ===
Using table as foreign source
(u'HIVE', u'tpch_bin_flat_orc_2', u'nation', u'n_nationkey', u'HIVE', 
u'tpch_bin_flat_orc_2', u'customer', u'c_nationkey', 1, 0, 0, u'custome
r_c2', u'nation_c1', 0)
Not using table as foreign source
Got an error from the server for customer!
{code}

Compare: Postgres
{code}
=== Foreign Keys ===
Using table as foreign source
(u'vagrant', u'public', u'nation', u'n_nationkey', u'vagrant', u'public', 
u'customer', u'c_nationkey', 1, 3, 3, u'customer_c_nationkey_fkey', 
u'nation_pkey', 7)
Not using table as foreign source
(u'vagrant', u'public', u'customer', u'c_custkey', u'vagrant', u'public', 
u'orders', u'o_custkey', 1, 3, 3, u'orders_o_custkey_fkey', u'customer_pkey', 7)
{code}

Note that Postgres allows traversal from either way. The traceback you get in 
the HS2 logs is this:

{code}
2016-12-04T21:08:55,398 ERROR [8998ca98-9940-49f8-8833-7c6ebd8c96a2 
HiveServer2-Handler-Pool: Thread-53] metastore.RetryingHMSHandler: MetaEx
ception(message:java.lang.NullPointerException)
at 
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.newMetaException(HiveMetaStore.java:5785)
at 
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_foreign_keys(HiveMetaStore.java:6474)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:140)
at 
org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:99)
at com.sun.proxy.$Proxy25.get_foreign_keys(Unknown Source)
at 
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getForeignKeys(HiveMetaStoreClient.java:1596)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:154)
at com.sun.proxy.$Proxy26.getForeignKeys(Unknown Source)
at 
org.apache.hive.service.cli.operation.GetCrossReferenceOperation.runInternal(GetCrossReferenceOperation.java:128)
at 
org.apache.hive.service.cli.operation.Operation.run(Operation.java:324)
at 
org.apache.hive.service.cli.session.HiveSessionImpl.getCrossReference(HiveSessionImpl.java:933)
at 
org.apache.hive.service.cli.CLIService.getCrossReference(CLIService.java:411)
at 
org.apache.hive.service.cli.thrift.ThriftCLIService.GetCrossReference(ThriftCLIService.java:738)
at 
org.apache.hive.service.rpc.thrift.TCLIService$Processor$GetCrossReference.getResult(TCLIService.java:1617)
at 
org.apache.hive.service.rpc.thrift.TCLIService$Processor$GetCrossReference.getResult(TCLIService.java:1602)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at 
org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:56)
at 
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NullPointerException
at 
org.apache.hive.common.util.HiveStringUtils.normalizeIdentifier(HiveStringUtils.java:919)
at 
org.apache.hadoop.hive.metastore.ObjectStore$GetHelper.(ObjectStore.java:2722)
at 
org.apache.hadoop.hive.metastore.ObjectStore$GetListHelper.(ObjectStore.java:2863)
at 
org.apache.hadoop.hive.metastore.ObjectStore$11.(ObjectStore.java:8455)
at

Re: [Announce] New PMC members

2017-05-30 Thread Jesus Camacho Rodriguez 
Congrats to all!

- Jesús




On 5/30/17, 5:18 PM, "Siddharth Seth"  wrote:

>Congratulations!
>
>On Tue, May 30, 2017 at 8:55 AM, Sergio Pena 
>wrote:
>
>> Thanks all for your comments, and congratulations to all new PMC members
>> too !!!
>>
>> - Sergio
>>
>> On Sun, May 28, 2017 at 8:43 PM, Rajesh Balamohan 
>> wrote:
>>
>> > Congratulations to new PMC members!
>> >
>> > ~Rajesh.B
>> >
>> > On Sat, May 27, 2017 at 12:14 PM, Zoltan Haindrich <
>> > zhaindr...@hortonworks.com> wrote:
>> >
>> > > Congratulations!
>> > >
>> > > On 27 May 2017 06:26, Lefty Leverenz  wrote:
>> > > Congratulations to the new PMC members, and also to Hive for having
>> such
>> > a
>> > > strong and talented community!
>> > >
>> > > -- Lefty
>> > >
>> > >
>> > > On Fri, May 26, 2017 at 1:12 PM, Eugene Koifman <
>> > ekoif...@hortonworks.com>
>> > > wrote:
>> > >
>> > > > Congratualtions!
>> > > >
>> > > > On 5/26/17, 10:10 AM, "Prasanth Jayachandran" <
>> > > > pjayachand...@hortonworks.com> wrote:
>> > > >
>> > > > Congratulations to all of you!
>> > > >
>> > > > Thanks
>> > > > Prasanth
>> > > > > On May 26, 2017, at 10:09 AM, Pengcheng Xiong <
>> pxi...@apache.org
>> > >
>> > > > wrote:
>> > > > >
>> > > > > Yongzhi, Daniel, Vaibhav, Sergio, Aihua, and Chaoyu!
>> > > > >
>> > > > > Congratulations to all of you!
>> > > > >
>> > > > > Best
>> > > > > Pengcheng
>> > > > >
>> > > > > On Thu, May 25, 2017 at 10:26 PM, Peter Vary <
>> pv...@cloudera.com
>> > >
>> > > > wrote:
>> > > > >
>> > > > >> Wow!
>> > > > >> That's a spring shower of PMCs. :)
>> > > > >> Well deserved Yongzhi, Daniel, Vaibhav, Sergio, Aihua, Chaoyu!
>> > > > >>
>> > > > >> Congratulations to all of you!
>> > > > >>
>> > > > >> Peter
>> > > > >>
>> > > > >> 2017. máj. 26. 6:42 ezt írta ("Ashutosh Chauhan" <
>> > > > hashut...@apache.org>):
>> > > > >>
>> > > > >> The Project Management Committee (PMC) for Apache Hive has
>> > invited
>> > > > Yongzhi
>> > > > >> Chen to become a PMC member and we are pleased to announce
>> that
>> > he
>> > > > has
>> > > > >> accepted.
>> > > > >>
>> > > > >> Please join me in congratulating Yongzhi!
>> > > > >>
>> > > > >> Thanks,
>> > > > >> Ashutosh on behalf of Hive PMC
>> > > > >>
>> > > >
>> > > >
>> > > >
>> > > >
>> > >
>> > >
>> >
>>

[jira] [Created] (HIVE-16787) Fix itests in branch-2.2

2017-05-30 Thread Owen O'Malley (JIRA) 
Owen O'Malley created HIVE-16787:


 Summary: Fix itests in branch-2.2
 Key: HIVE-16787
 URL: https://issues.apache.org/jira/browse/HIVE-16787
 Project: Hive
  Issue Type: Bug
Reporter: Owen O'Malley
Assignee: Owen O'Malley
 Fix For: 2.2.0


The itests are broken in branch 2.2 and need to be fixed before release.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Re: [Announce] New PMC members

2017-05-30 Thread Siddharth Seth 
Congratulations!

On Tue, May 30, 2017 at 8:55 AM, Sergio Pena 
wrote:

> Thanks all for your comments, and congratulations to all new PMC members
> too !!!
>
> - Sergio
>
> On Sun, May 28, 2017 at 8:43 PM, Rajesh Balamohan 
> wrote:
>
> > Congratulations to new PMC members!
> >
> > ~Rajesh.B
> >
> > On Sat, May 27, 2017 at 12:14 PM, Zoltan Haindrich <
> > zhaindr...@hortonworks.com> wrote:
> >
> > > Congratulations!
> > >
> > > On 27 May 2017 06:26, Lefty Leverenz  wrote:
> > > Congratulations to the new PMC members, and also to Hive for having
> such
> > a
> > > strong and talented community!
> > >
> > > -- Lefty
> > >
> > >
> > > On Fri, May 26, 2017 at 1:12 PM, Eugene Koifman <
> > ekoif...@hortonworks.com>
> > > wrote:
> > >
> > > > Congratualtions!
> > > >
> > > > On 5/26/17, 10:10 AM, "Prasanth Jayachandran" <
> > > > pjayachand...@hortonworks.com> wrote:
> > > >
> > > > Congratulations to all of you!
> > > >
> > > > Thanks
> > > > Prasanth
> > > > > On May 26, 2017, at 10:09 AM, Pengcheng Xiong <
> pxi...@apache.org
> > >
> > > > wrote:
> > > > >
> > > > > Yongzhi, Daniel, Vaibhav, Sergio, Aihua, and Chaoyu!
> > > > >
> > > > > Congratulations to all of you!
> > > > >
> > > > > Best
> > > > > Pengcheng
> > > > >
> > > > > On Thu, May 25, 2017 at 10:26 PM, Peter Vary <
> pv...@cloudera.com
> > >
> > > > wrote:
> > > > >
> > > > >> Wow!
> > > > >> That's a spring shower of PMCs. :)
> > > > >> Well deserved Yongzhi, Daniel, Vaibhav, Sergio, Aihua, Chaoyu!
> > > > >>
> > > > >> Congratulations to all of you!
> > > > >>
> > > > >> Peter
> > > > >>
> > > > >> 2017. máj. 26. 6:42 ezt írta ("Ashutosh Chauhan" <
> > > > hashut...@apache.org>):
> > > > >>
> > > > >> The Project Management Committee (PMC) for Apache Hive has
> > invited
> > > > Yongzhi
> > > > >> Chen to become a PMC member and we are pleased to announce
> that
> > he
> > > > has
> > > > >> accepted.
> > > > >>
> > > > >> Please join me in congratulating Yongzhi!
> > > > >>
> > > > >> Thanks,
> > > > >> Ashutosh on behalf of Hive PMC
> > > > >>
> > > >
> > > >
> > > >
> > > >
> > >
> > >
> >
>

Re: [Announce] New PMC members

2017-05-30 Thread Sergio Pena 
Thanks all for your comments, and congratulations to all new PMC members
too !!!

- Sergio

On Sun, May 28, 2017 at 8:43 PM, Rajesh Balamohan 
wrote:

> Congratulations to new PMC members!
>
> ~Rajesh.B
>
> On Sat, May 27, 2017 at 12:14 PM, Zoltan Haindrich <
> zhaindr...@hortonworks.com> wrote:
>
> > Congratulations!
> >
> > On 27 May 2017 06:26, Lefty Leverenz  wrote:
> > Congratulations to the new PMC members, and also to Hive for having such
> a
> > strong and talented community!
> >
> > -- Lefty
> >
> >
> > On Fri, May 26, 2017 at 1:12 PM, Eugene Koifman <
> ekoif...@hortonworks.com>
> > wrote:
> >
> > > Congratualtions!
> > >
> > > On 5/26/17, 10:10 AM, "Prasanth Jayachandran" <
> > > pjayachand...@hortonworks.com> wrote:
> > >
> > > Congratulations to all of you!
> > >
> > > Thanks
> > > Prasanth
> > > > On May 26, 2017, at 10:09 AM, Pengcheng Xiong  >
> > > wrote:
> > > >
> > > > Yongzhi, Daniel, Vaibhav, Sergio, Aihua, and Chaoyu!
> > > >
> > > > Congratulations to all of you!
> > > >
> > > > Best
> > > > Pengcheng
> > > >
> > > > On Thu, May 25, 2017 at 10:26 PM, Peter Vary  >
> > > wrote:
> > > >
> > > >> Wow!
> > > >> That's a spring shower of PMCs. :)
> > > >> Well deserved Yongzhi, Daniel, Vaibhav, Sergio, Aihua, Chaoyu!
> > > >>
> > > >> Congratulations to all of you!
> > > >>
> > > >> Peter
> > > >>
> > > >> 2017. máj. 26. 6:42 ezt írta ("Ashutosh Chauhan" <
> > > hashut...@apache.org>):
> > > >>
> > > >> The Project Management Committee (PMC) for Apache Hive has
> invited
> > > Yongzhi
> > > >> Chen to become a PMC member and we are pleased to announce that
> he
> > > has
> > > >> accepted.
> > > >>
> > > >> Please join me in congratulating Yongzhi!
> > > >>
> > > >> Thanks,
> > > >> Ashutosh on behalf of Hive PMC
> > > >>
> > >
> > >
> > >
> > >
> >
> >
>

Re: [VOTE] Should we release hive-storage-2.3.1rc0?

2017-05-30 Thread Owen O'Malley 
With three +1's the vote passes. Thanks Eugene and Prasanth!

.. Owen

On Fri, May 26, 2017 at 4:36 PM, Prasanth Jayachandran <
pjayachand...@hortonworks.com> wrote:

> +1
> - built from src
> - ran unit tests
> - rat check
> - verified checksum, signature
>
> Thanks
> Prasanth
>
> > On May 26, 2017, at 11:26 AM, Eugene Koifman 
> wrote:
> >
> > Downloaded tarball, built and ran UTs
> > +1
> >
> > On 5/26/17, 9:43 AM, "Owen O'Malley"  wrote:
> >
> >All,
> >   There are a couple of fixes for hive-storage that we need in the
> 2.3
> >branch.
> >
> >Artifacts:
> >tag: https://github.com/apache/hive/releases/tag/storage-
> release-2.3.1rc0
> >tar ball: http://home.apache.org/~omalley/hive-storage-2.3.1/
> >
> >Thanks,
> >   Owen
> >
> >
>
>

[jira] [Created] (HIVE-16786) insert_overwrite_local_directory_1.q writes files and directories outside its target

2017-05-30 Thread Peter Vary (JIRA) 
Peter Vary created HIVE-16786:
-

 Summary: insert_overwrite_local_directory_1.q writes files and 
directories outside its target
 Key: HIVE-16786
 URL: https://issues.apache.org/jira/browse/HIVE-16786
 Project: Hive
  Issue Type: Bug
  Components: Test
Affects Versions: 3.0.0
Reporter: Peter Vary
Assignee: Peter Vary


{{insert_overwrite_local_directory_1.q}} seems like something which writes 
files and directories outside its {{target}} directory...namely; it overwrites 
{{data/files/local_src_table_1}} - and it pollutes the project workspace after 
execution...



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Created] (HIVE-16785) Ensure replication actions are idempotent if any series of events are applied again.

2017-05-30 Thread Sankar Hariappan (JIRA) 
Sankar Hariappan created HIVE-16785:
---

 Summary: Ensure replication actions are idempotent if any series 
of events are applied again.
 Key: HIVE-16785
 URL: https://issues.apache.org/jira/browse/HIVE-16785
 Project: Hive
  Issue Type: Sub-task
  Components: Hive, repl
Affects Versions: 2.1.0
Reporter: Sankar Hariappan
Assignee: Sankar Hariappan


Some of the events(ALTER, RENAME, TRUNCATE) are not idempotent and hence leads 
to failure of REPL LOAD if applied twice or applied on an object which is 
latest than current event. For example, if TRUNCATE is applied on a table which 
is already dropped will fail instead of noop.
Also, need to consider the scenario where the object is missing while applying 
an event. For example, if RENAME_TABLE event is applied on target where the old 
table is missing should validate if table should be recreated or should treat 
the event as noop. This can be done by verifying the DB level last repl ID 
against the current event ID.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)