[jira] [Updated] (HIVE-11792) User explain in tez does not preserve ordering

2015-09-13 Thread Prasanth Jayachandran (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-11792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Prasanth Jayachandran updated HIVE-11792:
-
Attachment: HIVE-11792.2.patch

> User explain in tez does not preserve ordering
> --
>
> Key: HIVE-11792
> URL: https://issues.apache.org/jira/browse/HIVE-11792
> Project: Hive
>  Issue Type: Bug
>  Components: Diagnosability
>Affects Versions: 2.0.0
>Reporter: Prasanth Jayachandran
>Assignee: Prasanth Jayachandran
> Attachments: HIVE-11792.1.patch, HIVE-11792.2.patch
>
>
> HIVE-11037 introduced user level explain. The output of operator attributes 
> are JSONObject which does not preserve ordering. This is causing diffs in 
> test output when run under tez vs llap like below
> {code}
> -partition:{"ts":"2012-01-03+14:46:31","ds":"2012-01-03"}
> -
> table:{"serde:":"org.apache.hadoop.hive.ql.io.orc.OrcSerde","name:":"default.src_orc_merge_test_part","input
>  format:":"org.apache.hadoop.hive.ql.io.orc.OrcInputFormat","output 
> format:":"org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat"}
> +partition:{"ds":"2012-01-03","ts":"2012-01-03+14:46:31"}
> +table:{"name:":"default.src_orc_merge_test_part","input 
> format:":"org.apache.hadoop.hive.ql.io.orc.OrcInputFormat","output 
> format:":"org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat","serde:":"org.apache.hadoop.hive.ql.io.orc.OrcSerde"}
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-11802) Float-point numbers are displayed with different precision in Beeline/JDBC

2015-09-13 Thread Hive QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742374#comment-14742374
 ] 

Hive QA commented on HIVE-11802:




{color:red}Overall{color}: -1 at least one tests failed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12755592/HIVE-11802.2.patch

{color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 9442 tests executed
*Failed tests:*
{noformat}
org.apache.hive.hcatalog.api.TestHCatClient.testTableSchemaPropagation
org.apache.hive.hcatalog.hbase.TestPigHBaseStorageHandler.org.apache.hive.hcatalog.hbase.TestPigHBaseStorageHandler
{noformat}

Test results: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5263/testReport
Console output: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5263/console
Test logs: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-5263/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 2 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12755592 - PreCommit-HIVE-TRUNK-Build

> Float-point numbers are displayed with different precision in Beeline/JDBC
> --
>
> Key: HIVE-11802
> URL: https://issues.apache.org/jira/browse/HIVE-11802
> Project: Hive
>  Issue Type: Bug
>Affects Versions: 1.2.1
>Reporter: Sergio Peña
>Assignee: Sergio Peña
> Attachments: HIVE-11802.2.patch
>
>
> When inserting float-point numbers to a table, the values displayed on 
> beeline or jdbc are with different precision.
> How to reproduce:
> {noformat}
> 0: jdbc:hive2://localhost:1> create table decimals (f float, af 
> array, d double, ad array) stored as parquet;
> No rows affected (0.294 seconds)
> 0: jdbc:hive2://localhost:1> insert into table decimals select 1.10058, 
> array(cast(1.10058 as float)), 2.0133, array(2.0133) from dummy limit 1;
> ...
> No rows affected (20.089 seconds)
> 0: jdbc:hive2://localhost:1> select f, af, af[0], d, ad[0] from decimals;
> +-++-+-+-+--+
> |  f  | af | _c2 |d|   _c4   |
> +-++-+-+-+--+
> | 1.1005799770355225  | [1.10058]  | 1.1005799770355225  | 2.0133  | 2.0133  |
> +-++-+-+-+--+
> {noformat}
> When displaying arrays, the values are displayed correctly, but if I print a 
> specific element, it is then displayed with more decimal positions.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-11482) Add retrying thrift client for HiveServer2

2015-09-13 Thread Akshay Goyal (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742406#comment-14742406
 ] 

Akshay Goyal commented on HIVE-11482:
-

[~leftylev] My confluence username is akshaygoyal.

> Add retrying thrift client for HiveServer2
> --
>
> Key: HIVE-11482
> URL: https://issues.apache.org/jira/browse/HIVE-11482
> Project: Hive
>  Issue Type: Improvement
>  Components: HiveServer2
>Reporter: Amareshwari Sriramadasu
>Assignee: Akshay Goyal
>  Labels: TODOC2.0
> Fix For: 2.0.0
>
> Attachments: HIVE-11482.02.patch
>
>
> Similar to 
> https://github.com/apache/hive/blob/master/metastore/src/java/org/apache/hadoop/hive/metastore/RetryingMetaStoreClient.java,
>  this improvement request is to add a retrying thrift client for HiveServer2 
> to do retries upon thrift exceptions.
> Here are few commits done on a forked branch that can be picked - 
> https://github.com/InMobi/hive/commit/7fb957fb9c2b6000d37c53294e256460010cb6b7
> https://github.com/InMobi/hive/commit/11e4b330f051c3f58927a276d562446761c9cd6d
> https://github.com/InMobi/hive/commit/241386fd870373a9253dca0bcbdd4ea7e665406c



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-11792) User explain in tez does not preserve ordering

2015-09-13 Thread Hive QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742441#comment-14742441
 ] 

Hive QA commented on HIVE-11792:




{color:red}Overall{color}: -1 at least one tests failed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12755597/HIVE-11792.2.patch

{color:red}ERROR:{color} -1 due to 10 failed/errored test(s), 9439 tests 
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_authorization_explain
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_explain_dependency
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_explain_dependency2
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_input4
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join0
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_parallel_join0
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_plan_json
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_explainuser_1
org.apache.hive.hcatalog.api.TestHCatClient.testTableSchemaPropagation
org.apache.hive.hcatalog.streaming.TestStreaming.testTimeOutReaper
{noformat}

Test results: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5264/testReport
Console output: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5264/console
Test logs: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-5264/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 10 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12755597 - PreCommit-HIVE-TRUNK-Build

> User explain in tez does not preserve ordering
> --
>
> Key: HIVE-11792
> URL: https://issues.apache.org/jira/browse/HIVE-11792
> Project: Hive
>  Issue Type: Bug
>  Components: Diagnosability
>Affects Versions: 2.0.0
>Reporter: Prasanth Jayachandran
>Assignee: Prasanth Jayachandran
> Attachments: HIVE-11792.1.patch, HIVE-11792.2.patch
>
>
> HIVE-11037 introduced user level explain. The output of operator attributes 
> are JSONObject which does not preserve ordering. This is causing diffs in 
> test output when run under tez vs llap like below
> {code}
> -partition:{"ts":"2012-01-03+14:46:31","ds":"2012-01-03"}
> -
> table:{"serde:":"org.apache.hadoop.hive.ql.io.orc.OrcSerde","name:":"default.src_orc_merge_test_part","input
>  format:":"org.apache.hadoop.hive.ql.io.orc.OrcInputFormat","output 
> format:":"org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat"}
> +partition:{"ds":"2012-01-03","ts":"2012-01-03+14:46:31"}
> +table:{"name:":"default.src_orc_merge_test_part","input 
> format:":"org.apache.hadoop.hive.ql.io.orc.OrcInputFormat","output 
> format:":"org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat","serde:":"org.apache.hadoop.hive.ql.io.orc.OrcSerde"}
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-10328) Enable new return path for cbo

2015-09-13 Thread Pengcheng Xiong (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-10328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pengcheng Xiong updated HIVE-10328:
---
Attachment: HIVE-10328.11.patch

> Enable new return path for cbo
> --
>
> Key: HIVE-10328
> URL: https://issues.apache.org/jira/browse/HIVE-10328
> Project: Hive
>  Issue Type: Task
>  Components: CBO
>Reporter: Ashutosh Chauhan
>Assignee: Ashutosh Chauhan
> Attachments: HIVE-10328.1.patch, HIVE-10328.10.patch, 
> HIVE-10328.11.patch, HIVE-10328.2.patch, HIVE-10328.3.patch, 
> HIVE-10328.4.patch, HIVE-10328.4.patch, HIVE-10328.5.patch, 
> HIVE-10328.6.patch, HIVE-10328.7.patch, HIVE-10328.8.patch, 
> HIVE-10328.9.patch, HIVE-10328.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-11789) Better support for functions recognition in CBO

2015-09-13 Thread Jesus Camacho Rodriguez (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-11789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jesus Camacho Rodriguez updated HIVE-11789:
---
Summary: Better support for functions recognition in CBO  (was: Support 
multicolumn in CBO)

> Better support for functions recognition in CBO
> ---
>
> Key: HIVE-11789
> URL: https://issues.apache.org/jira/browse/HIVE-11789
> Project: Hive
>  Issue Type: Improvement
>  Components: CBO
>Affects Versions: 2.0.0
>Reporter: Jesus Camacho Rodriguez
>Assignee: Jesus Camacho Rodriguez
>
> Support multicolumn in CBO way in/out i.e. translate STRUCT in/to multicolumn.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-10328) Enable new return path for cbo

2015-09-13 Thread Hive QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-10328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742660#comment-14742660
 ] 

Hive QA commented on HIVE-10328:




{color:red}Overall{color}: -1 at least one tests failed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12755621/HIVE-10328.11.patch

{color:red}ERROR:{color} -1 due to 631 failed/errored test(s), 9439 tests 
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ctas_colname
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_dynpart_sort_opt_vectorization
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_dynpart_sort_optimization
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_groupby2_map_multi_distinct
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_groupby_resolution
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_lineage2
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_lineage3
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_parquet_ppd_boolean
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_parquet_ppd_char
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_parquet_ppd_date
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_parquet_ppd_decimal
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_parquet_ppd_timestamp
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_parquet_ppd_varchar
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_quotedid_basic
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_subquery_in
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_subquery_in_having
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_subquery_notin
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_subquery_unqualcolumnrefs
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_udaf_percentile_approx_23
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_udf_percentile
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union24
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union31
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_unionDistinct_1
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_6_subq
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_windowing_streaming
org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_dboutput
org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_serde_typedbytes2
org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_serde_typedbytes3
org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_serde_typedbytes4
org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_udaf_example_avg
org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_udaf_example_group_concat
org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_udaf_example_max
org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_udaf_example_max_n
org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_udaf_example_min
org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_udaf_example_min_n
org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_udf_example_add
org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_udf_example_format
org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_udf_row_sequence
org.apache.hadoop.hive.cli.TestEncryptedHDFSCliDriver.testCliDriver_encryption_insert_partition_dynamic
org.apache.hadoop.hive.cli.TestEncryptedHDFSCliDriver.testCliDriver_encryption_select_read_only_encrypted_tbl
org.apache.hadoop.hive.cli.TestHBaseCliDriver.testCliDriver_external_table_ppd
org.apache.hadoop.hive.cli.TestHBaseCliDriver.testCliDriver_hbase_ppd_key_range
org.apache.hadoop.hive.cli.TestHBaseCliDriver.testCliDriver_hbase_pushdown
org.apache.hadoop.hive.cli.TestHBaseCliDriver.testCliDriver_hbase_queries
org.apache.hadoop.hive.cli.TestHBaseCliDriver.testCliDriver_hbase_timestamp
org.apache.hadoop.hive.cli.TestHBaseCliDriver.testCliDriver_ppd_key_ranges
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver_bucket4
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver_bucket6
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver_constprog_partitioner
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver_disable_merge_for_bucketing
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver_index_bitmap3
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver_index_bitmap_auto
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver_infer_bucket_sort_map_operators
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver_infer_bucket_sort_merge
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver_infer_bucket_sort_reducers_power_two
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver_list_bucket_dml_10

[jira] [Updated] (HIVE-11789) Better support for functions recognition in CBO

2015-09-13 Thread Jesus Camacho Rodriguez (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-11789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jesus Camacho Rodriguez updated HIVE-11789:
---
Description: Including IN, BETWEEN, and STRUCT (multicolumn). In 
particular, STRUCT is represented as ROW in Calcite.  (was: Support multicolumn 
in CBO way in/out i.e. translate STRUCT in/to multicolumn.)

> Better support for functions recognition in CBO
> ---
>
> Key: HIVE-11789
> URL: https://issues.apache.org/jira/browse/HIVE-11789
> Project: Hive
>  Issue Type: Improvement
>  Components: CBO
>Affects Versions: 2.0.0
>Reporter: Jesus Camacho Rodriguez
>Assignee: Jesus Camacho Rodriguez
>
> Including IN, BETWEEN, and STRUCT (multicolumn). In particular, STRUCT is 
> represented as ROW in Calcite.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-11789) Better support for functions recognition in CBO

2015-09-13 Thread Jesus Camacho Rodriguez (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-11789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jesus Camacho Rodriguez updated HIVE-11789:
---
Attachment: HIVE-11789.patch

> Better support for functions recognition in CBO
> ---
>
> Key: HIVE-11789
> URL: https://issues.apache.org/jira/browse/HIVE-11789
> Project: Hive
>  Issue Type: Improvement
>  Components: CBO
>Affects Versions: 2.0.0
>Reporter: Jesus Camacho Rodriguez
>Assignee: Jesus Camacho Rodriguez
> Attachments: HIVE-11789.patch
>
>
> Including IN, BETWEEN, and STRUCT (multicolumn). In particular, STRUCT is 
> represented as ROW in Calcite.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-11792) User explain in tez does not preserve ordering

2015-09-13 Thread Prasanth Jayachandran (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-11792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Prasanth Jayachandran updated HIVE-11792:
-
Attachment: HIVE-11792.3.patch

> User explain in tez does not preserve ordering
> --
>
> Key: HIVE-11792
> URL: https://issues.apache.org/jira/browse/HIVE-11792
> Project: Hive
>  Issue Type: Bug
>  Components: Diagnosability
>Affects Versions: 2.0.0
>Reporter: Prasanth Jayachandran
>Assignee: Prasanth Jayachandran
> Attachments: HIVE-11792.1.patch, HIVE-11792.2.patch, 
> HIVE-11792.3.patch
>
>
> HIVE-11037 introduced user level explain. The output of operator attributes 
> are JSONObject which does not preserve ordering. This is causing diffs in 
> test output when run under tez vs llap like below
> {code}
> -partition:{"ts":"2012-01-03+14:46:31","ds":"2012-01-03"}
> -
> table:{"serde:":"org.apache.hadoop.hive.ql.io.orc.OrcSerde","name:":"default.src_orc_merge_test_part","input
>  format:":"org.apache.hadoop.hive.ql.io.orc.OrcInputFormat","output 
> format:":"org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat"}
> +partition:{"ds":"2012-01-03","ts":"2012-01-03+14:46:31"}
> +table:{"name:":"default.src_orc_merge_test_part","input 
> format:":"org.apache.hadoop.hive.ql.io.orc.OrcInputFormat","output 
> format:":"org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat","serde:":"org.apache.hadoop.hive.ql.io.orc.OrcSerde"}
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-11792) User explain in tez does not preserve ordering

2015-09-13 Thread Hive QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742744#comment-14742744
 ] 

Hive QA commented on HIVE-11792:




{color:red}Overall{color}: -1 at least one tests failed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12755628/HIVE-11792.3.patch

{color:red}ERROR:{color} -1 due to 7 failed/errored test(s), 9439 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_authorization_explain
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_input4
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join0
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_plan_json
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_explainuser_1
org.apache.hive.hcatalog.api.TestHCatClient.testTableSchemaPropagation
org.apache.hive.hcatalog.streaming.TestStreaming.testTransactionBatchEmptyCommit
{noformat}

Test results: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5267/testReport
Console output: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5267/console
Test logs: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-5267/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 7 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12755628 - PreCommit-HIVE-TRUNK-Build

> User explain in tez does not preserve ordering
> --
>
> Key: HIVE-11792
> URL: https://issues.apache.org/jira/browse/HIVE-11792
> Project: Hive
>  Issue Type: Bug
>  Components: Diagnosability
>Affects Versions: 2.0.0
>Reporter: Prasanth Jayachandran
>Assignee: Prasanth Jayachandran
> Attachments: HIVE-11792.1.patch, HIVE-11792.2.patch, 
> HIVE-11792.3.patch
>
>
> HIVE-11037 introduced user level explain. The output of operator attributes 
> are JSONObject which does not preserve ordering. This is causing diffs in 
> test output when run under tez vs llap like below
> {code}
> -partition:{"ts":"2012-01-03+14:46:31","ds":"2012-01-03"}
> -
> table:{"serde:":"org.apache.hadoop.hive.ql.io.orc.OrcSerde","name:":"default.src_orc_merge_test_part","input
>  format:":"org.apache.hadoop.hive.ql.io.orc.OrcInputFormat","output 
> format:":"org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat"}
> +partition:{"ds":"2012-01-03","ts":"2012-01-03+14:46:31"}
> +table:{"name:":"default.src_orc_merge_test_part","input 
> format:":"org.apache.hadoop.hive.ql.io.orc.OrcInputFormat","output 
> format:":"org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat","serde:":"org.apache.hadoop.hive.ql.io.orc.OrcSerde"}
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-11802) Float-point numbers are displayed with different precision in Beeline/JDBC

2015-09-13 Thread Carl Steinbach (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742769#comment-14742769
 ] 

Carl Steinbach commented on HIVE-11802:
---

Thanks for adding a test. Here's some feedback:
* TestColumn is missing an ASF header.
* TestColumn doesn't prove that beeline returns correct results. What we need 
is an end-to-end test that validates the output of beeline. There's an existing 
test driver (TestBeeLineDriver) that was included in the original HiveServer2 
patch. The goal was to make it easy to write end-to-end Beeline tests in the 
style of the existing qfile tests. There's also a set of sample data files in 
files/types/primitives that cover all primitive types, and an initialization 
file (data/scripts/q_test_init.sql) that creates a 'primitives' table on top of 
it. I think we'd get more complete and easier to maintain test coverage with 
less code by resurrecting TestBeeLineDriver and writing a new beeline qfile 
test that runs a 'SELECT *' query against the primitives table. I suspect the 
original HS2 patch even had a qfile test for this, but I'm too depressed to 
look. It would be awesome if you want to fix this, but all that really stands 
in the way of a +1 is adding the missing ASF header.



> Float-point numbers are displayed with different precision in Beeline/JDBC
> --
>
> Key: HIVE-11802
> URL: https://issues.apache.org/jira/browse/HIVE-11802
> Project: Hive
>  Issue Type: Bug
>Affects Versions: 1.2.1
>Reporter: Sergio Peña
>Assignee: Sergio Peña
> Attachments: HIVE-11802.2.patch
>
>
> When inserting float-point numbers to a table, the values displayed on 
> beeline or jdbc are with different precision.
> How to reproduce:
> {noformat}
> 0: jdbc:hive2://localhost:1> create table decimals (f float, af 
> array, d double, ad array) stored as parquet;
> No rows affected (0.294 seconds)
> 0: jdbc:hive2://localhost:1> insert into table decimals select 1.10058, 
> array(cast(1.10058 as float)), 2.0133, array(2.0133) from dummy limit 1;
> ...
> No rows affected (20.089 seconds)
> 0: jdbc:hive2://localhost:1> select f, af, af[0], d, ad[0] from decimals;
> +-++-+-+-+--+
> |  f  | af | _c2 |d|   _c4   |
> +-++-+-+-+--+
> | 1.1005799770355225  | [1.10058]  | 1.1005799770355225  | 2.0133  | 2.0133  |
> +-++-+-+-+--+
> {noformat}
> When displaying arrays, the values are displayed correctly, but if I print a 
> specific element, it is then displayed with more decimal positions.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-11778) Merge beeline-cli branch to trunk

2015-09-13 Thread Ferdinand Xu (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742771#comment-14742771
 ] 

Ferdinand Xu commented on HIVE-11778:
-

Thanks [~xuefuz], I don't have circle until later this week or next week. I 
will complete the 3rd part and try to investigate the 1st jira.

> Merge beeline-cli branch to trunk
> -
>
> Key: HIVE-11778
> URL: https://issues.apache.org/jira/browse/HIVE-11778
> Project: Hive
>  Issue Type: Sub-task
>  Components: CLI
>Affects Versions: 2.0.0
>Reporter: Ferdinand Xu
>Assignee: Ferdinand Xu
> Attachments: HIVE-11778.patch
>
>
> The team working on the beeline-cli branch would like to merge their work to 
> trunk. This jira will track that effort.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-11778) Merge beeline-cli branch to trunk

2015-09-13 Thread Ferdinand Xu (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742770#comment-14742770
 ] 

Ferdinand Xu commented on HIVE-11778:
-

Thanks [~xuefuz], I don't have circle until later this week or next week. I 
will complete the 3rd part and try to investigate the 1st jira.

> Merge beeline-cli branch to trunk
> -
>
> Key: HIVE-11778
> URL: https://issues.apache.org/jira/browse/HIVE-11778
> Project: Hive
>  Issue Type: Sub-task
>  Components: CLI
>Affects Versions: 2.0.0
>Reporter: Ferdinand Xu
>Assignee: Ferdinand Xu
> Attachments: HIVE-11778.patch
>
>
> The team working on the beeline-cli branch would like to merge their work to 
> trunk. This jira will track that effort.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-11745) Alter table Exchange partition with multiple partition_spec is not working

2015-09-13 Thread Yongzhi Chen (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742807#comment-14742807
 ] 

Yongzhi Chen commented on HIVE-11745:
-

The failures are not related.
org.apache.hive.hcatalog.api.TestHCatClient.testTableSchemaPropagation failed 
more than 100 times.
The 3 spark client tests failed for the same problem: 
java.util.concurrent.TimeoutException: null
The 3 hcatalog.streaming.TestStreaming tests failed because of Table/View 
'TXNS' already exists in Schema 'APP'.
org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge does not relate to alter 
table with partition, and it passed in my local machine.
{noformat}
---
Running org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.783 sec - in 
org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge

Results :

Tests run: 3, Failures: 0, Errors: 0, Skipped: 0
{noformat}

> Alter table Exchange partition with multiple partition_spec is not working
> --
>
> Key: HIVE-11745
> URL: https://issues.apache.org/jira/browse/HIVE-11745
> Project: Hive
>  Issue Type: Bug
>  Components: Metastore
>Affects Versions: 1.2.0, 1.1.0, 2.0.0
>Reporter: Yongzhi Chen
>Assignee: Yongzhi Chen
> Attachments: HIVE-11745.1.patch, HIVE-11745.2.patch
>
>
> Single partition works, but multiple partitions will not work.
> Reproduce steps:
> {noformat}
> DROP TABLE IF EXISTS t1;
> DROP TABLE IF EXISTS t2;
> DROP TABLE IF EXISTS t3;
> DROP TABLE IF EXISTS t4;
> CREATE TABLE t1 (a int) PARTITIONED BY (d1 int);
> CREATE TABLE t2 (a int) PARTITIONED BY (d1 int);
> CREATE TABLE t3 (a int) PARTITIONED BY (d1 int, d2 int);
> CREATE TABLE t4 (a int) PARTITIONED BY (d1 int, d2 int);
> INSERT OVERWRITE TABLE t1 PARTITION (d1 = 1) SELECT salary FROM jsmall LIMIT 
> 10;
> INSERT OVERWRITE TABLE t3 PARTITION (d1 = 1, d2 = 1) SELECT salary FROM 
> jsmall LIMIT 10;
> SELECT * FROM t1;
> SELECT * FROM t3;
> ALTER TABLE t2 EXCHANGE PARTITION (d1 = 1) WITH TABLE t1;
> SELECT * FROM t1;
> SELECT * FROM t2;
> ALTER TABLE t4 EXCHANGE PARTITION (d1 = 1, d2 = 1) WITH TABLE t3;
> SELECT * FROM t3;
> SELECT * FROM t4;
> {noformat}
> The output:
> {noformat}
> 0: jdbc:hive2://10.17.74.148:1/default> SELECT * FROM t3;
> +---+++--+
> | t3.a  | t3.d1  | t3.d2  |
> +---+++--+
> +---+++--+
> No rows selected (0.227 seconds)
> 0: jdbc:hive2://10.17.74.148:1/default> SELECT * FROM t4;
> +---+++--+
> | t4.a  | t4.d1  | t4.d2  |
> +---+++--+
> +---+++--+
> No rows selected (0.266 seconds)
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-11482) Add retrying thrift client for HiveServer2

2015-09-13 Thread Lefty Leverenz (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742761#comment-14742761
 ] 

Lefty Leverenz commented on HIVE-11482:
---

You can edit now, Akshay.  Welcome to the Hive wiki team!

> Add retrying thrift client for HiveServer2
> --
>
> Key: HIVE-11482
> URL: https://issues.apache.org/jira/browse/HIVE-11482
> Project: Hive
>  Issue Type: Improvement
>  Components: HiveServer2
>Reporter: Amareshwari Sriramadasu
>Assignee: Akshay Goyal
>  Labels: TODOC2.0
> Fix For: 2.0.0
>
> Attachments: HIVE-11482.02.patch
>
>
> Similar to 
> https://github.com/apache/hive/blob/master/metastore/src/java/org/apache/hadoop/hive/metastore/RetryingMetaStoreClient.java,
>  this improvement request is to add a retrying thrift client for HiveServer2 
> to do retries upon thrift exceptions.
> Here are few commits done on a forked branch that can be picked - 
> https://github.com/InMobi/hive/commit/7fb957fb9c2b6000d37c53294e256460010cb6b7
> https://github.com/InMobi/hive/commit/11e4b330f051c3f58927a276d562446761c9cd6d
> https://github.com/InMobi/hive/commit/241386fd870373a9253dca0bcbdd4ea7e665406c



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-11789) Better support for functions recognition in CBO

2015-09-13 Thread Hive QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742705#comment-14742705
 ] 

Hive QA commented on HIVE-11789:




{color:red}Overall{color}: -1 at least one tests failed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12755622/HIVE-11789.patch

{color:red}ERROR:{color} -1 due to 32 failed/errored test(s), 9439 tests 
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_filter_numeric
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_orc_create
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_orc_ppd_char
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_orc_ppd_date
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_orc_ppd_decimal
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_orc_ppd_timestamp
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_orc_ppd_varchar
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_orc_predicate_pushdown
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_parquet_ppd_char
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_parquet_ppd_date
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_parquet_ppd_decimal
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_parquet_ppd_timestamp
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_parquet_ppd_varchar
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_parquet_predicate_pushdown
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_partition_date
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_partition_multilevels
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_partition_timestamp
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_udaf_percentile_approx_23
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_udf_between
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_vector_between_in
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_vectorized_timestamp_funcs
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver_auto_sortmerge_join_16
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_auto_sortmerge_join_16
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_tez_dynpart_hashjoin_1
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_tez_vector_dynpart_hashjoin_1
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_vector_between_in
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_vectorized_timestamp_funcs
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_auto_sortmerge_join_16
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_auto_sortmerge_join_16
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_vector_between_in
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_vectorized_timestamp_funcs
org.apache.hive.hcatalog.api.TestHCatClient.testTableSchemaPropagation
{noformat}

Test results: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5266/testReport
Console output: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5266/console
Test logs: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-5266/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 32 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12755622 - PreCommit-HIVE-TRUNK-Build

> Better support for functions recognition in CBO
> ---
>
> Key: HIVE-11789
> URL: https://issues.apache.org/jira/browse/HIVE-11789
> Project: Hive
>  Issue Type: Improvement
>  Components: CBO
>Affects Versions: 2.0.0
>Reporter: Jesus Camacho Rodriguez
>Assignee: Jesus Camacho Rodriguez
> Attachments: HIVE-11789.patch
>
>
> Including IN, BETWEEN, and STRUCT (multicolumn). In particular, STRUCT is 
> represented as ROW in Calcite.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-11796) CLI option is not updated when executing the initial files[beeline-cli]

2015-09-13 Thread Ferdinand Xu (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742777#comment-14742777
 ] 

Ferdinand Xu commented on HIVE-11796:
-

Hi [~xuefuz], do you have time reviewing this jira? Thank you!

> CLI option is not updated when executing the initial files[beeline-cli]
> ---
>
> Key: HIVE-11796
> URL: https://issues.apache.org/jira/browse/HIVE-11796
> Project: Hive
>  Issue Type: Sub-task
>  Components: CLI
>Affects Versions: beeline-cli-branch
>Reporter: Ferdinand Xu
>Assignee: Ferdinand Xu
> Fix For: beeline-cli-branch
>
> Attachments: HIVE-11796.1-beeline-cli.patch
>
>
> "Method not supported" is thrown when executing the initial files. This is 
> caused by CLI option is not updated.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-2655) Ability to define functions in HQL

2015-09-13 Thread Jonathan Chang (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-2655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742955#comment-14742955
 ] 

Jonathan Chang commented on HIVE-2655:
--

Hi,
  I am no longer reachable at this address.  Please contact me at either 
slyco...@gmail.com or (310)425-3759.

Cheers,
Jonathan


> Ability to define functions in HQL
> --
>
> Key: HIVE-2655
> URL: https://issues.apache.org/jira/browse/HIVE-2655
> Project: Hive
>  Issue Type: New Feature
>  Components: SQL
>Reporter: Jonathan Perlow
>Assignee: Brock Noland
>  Labels: TODOC12
> Fix For: 0.12.0
>
> Attachments: ASF.LICENSE.NOT.GRANTED--HIVE-2655.D915.1.patch, 
> ASF.LICENSE.NOT.GRANTED--HIVE-2655.D915.2.patch, 
> ASF.LICENSE.NOT.GRANTED--HIVE-2655.D915.3.patch, 
> ASF.LICENSE.NOT.GRANTED--HIVE-2655.D915.4.patch, HIVE-2655-10.patch, 
> HIVE-2655-10.patch, HIVE-2655-9.patch
>
>
> Ability to create functions in HQL as a substitute for creating them in Java.
> Jonathan Chang requested I create this issue.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-2655) Ability to define functions in HQL

2015-09-13 Thread Lefty Leverenz (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lefty Leverenz updated HIVE-2655:
-
Labels: TODOC12  (was: )

> Ability to define functions in HQL
> --
>
> Key: HIVE-2655
> URL: https://issues.apache.org/jira/browse/HIVE-2655
> Project: Hive
>  Issue Type: New Feature
>  Components: SQL
>Reporter: Jonathan Perlow
>Assignee: Brock Noland
>  Labels: TODOC12
> Fix For: 0.12.0
>
> Attachments: ASF.LICENSE.NOT.GRANTED--HIVE-2655.D915.1.patch, 
> ASF.LICENSE.NOT.GRANTED--HIVE-2655.D915.2.patch, 
> ASF.LICENSE.NOT.GRANTED--HIVE-2655.D915.3.patch, 
> ASF.LICENSE.NOT.GRANTED--HIVE-2655.D915.4.patch, HIVE-2655-10.patch, 
> HIVE-2655-10.patch, HIVE-2655-9.patch
>
>
> Ability to create functions in HQL as a substitute for creating them in Java.
> Jonathan Chang requested I create this issue.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-11809) Insert into table partition failed but partition directory created

2015-09-13 Thread niklaus.xiao (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-11809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

niklaus.xiao updated HIVE-11809:

Description: 
1. userA creates a partition table: create table w1(id int, name string, addr 
string) partitioned by (dt string) row format delimited fields terminated by 
',' stored as textfile;

2. userB tries to insert into userA's table: insert into table w1 
partition(dt='2') select id, name, addr from t1;

3. userB does not have select privilege of table t1 and insert privilege of w1, 
step 2 throws: Error: Error while compiling statement: FAILED: 
HiveAccessControlException Permission denied: Principal [name=hdfs, type=USER] 
does not have following privileges for operation QUERY [[SELECT] on Object 
[type=TABLE_OR_VIEW, name=default.t1]] (state=42000,code=4)

but the partition directory "/user/hive/warehouse/w1/dt=2" created:

hdfs dfs -ls /user/hive/warehouse/w1/
15/09/14 11:16:42 INFO hdfs.PeerCache: SocketCache disabled.
Found 2 items
drwx--   - userA hive  0 2015-09-14 10:05 
/user/hive/warehouse/w1/dt=1
drwx--   - userB  hive  0 2015-09-14 10:23 
/user/hive/warehouse/w1/dt=2


  was:
1. userA creates a partition table: create table w1(id int, name string, addr 
string) partitioned by (dt string) row format delimited fields terminated by 
',' stored as textfile;
2. userB tries to insert into userA's table: insert into table w1 
partition(dt='2') select id, name, addr from t1;
3. userB does not have select privilege of table t1 and insert privilege of w1, 
step 2 throws: Error: Error while compiling statement: FAILED: 
HiveAccessControlException Permission denied: Principal [name=hdfs, type=USER] 
does not have following privileges for operation QUERY [[SELECT] on Object 
[type=TABLE_OR_VIEW, name=default.t1]] (state=42000,code=4)
but the partition directory "/user/hive/warehouse/w1/dt=2" created:
hdfs dfs -ls /user/hive/warehouse/w1/
15/09/14 11:16:42 INFO hdfs.PeerCache: SocketCache disabled.
Found 2 items
drwx--   - userA hive  0 2015-09-14 10:05 
/user/hive/warehouse/w1/dt=1
drwx--   - userB  hive  0 2015-09-14 10:23 
/user/hive/warehouse/w1/dt=2



> Insert into table partition failed but partition directory created
> --
>
> Key: HIVE-11809
> URL: https://issues.apache.org/jira/browse/HIVE-11809
> Project: Hive
>  Issue Type: Bug
>Affects Versions: 1.2.0, 1.1.0, 1.1.1
>Reporter: niklaus.xiao
>
> 1. userA creates a partition table: create table w1(id int, name string, addr 
> string) partitioned by (dt string) row format delimited fields terminated by 
> ',' stored as textfile;
> 2. userB tries to insert into userA's table: insert into table w1 
> partition(dt='2') select id, name, addr from t1;
> 3. userB does not have select privilege of table t1 and insert privilege of 
> w1, 
> step 2 throws: Error: Error while compiling statement: FAILED: 
> HiveAccessControlException Permission denied: Principal [name=hdfs, 
> type=USER] does not have following privileges for operation QUERY [[SELECT] 
> on Object [type=TABLE_OR_VIEW, name=default.t1]] (state=42000,code=4)
> but the partition directory "/user/hive/warehouse/w1/dt=2" created:
> hdfs dfs -ls /user/hive/warehouse/w1/
> 15/09/14 11:16:42 INFO hdfs.PeerCache: SocketCache disabled.
> Found 2 items
> drwx--   - userA hive  0 2015-09-14 10:05 
> /user/hive/warehouse/w1/dt=1
> drwx--   - userB  hive  0 2015-09-14 10:23 
> /user/hive/warehouse/w1/dt=2



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-11792) User explain in tez does not preserve ordering

2015-09-13 Thread Prasanth Jayachandran (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-11792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Prasanth Jayachandran updated HIVE-11792:
-
Attachment: HIVE-11792.4.patch

> User explain in tez does not preserve ordering
> --
>
> Key: HIVE-11792
> URL: https://issues.apache.org/jira/browse/HIVE-11792
> Project: Hive
>  Issue Type: Bug
>  Components: Diagnosability
>Affects Versions: 2.0.0
>Reporter: Prasanth Jayachandran
>Assignee: Prasanth Jayachandran
> Attachments: HIVE-11792.1.patch, HIVE-11792.2.patch, 
> HIVE-11792.3.patch, HIVE-11792.4.patch
>
>
> HIVE-11037 introduced user level explain. The output of operator attributes 
> are JSONObject which does not preserve ordering. This is causing diffs in 
> test output when run under tez vs llap like below
> {code}
> -partition:{"ts":"2012-01-03+14:46:31","ds":"2012-01-03"}
> -
> table:{"serde:":"org.apache.hadoop.hive.ql.io.orc.OrcSerde","name:":"default.src_orc_merge_test_part","input
>  format:":"org.apache.hadoop.hive.ql.io.orc.OrcInputFormat","output 
> format:":"org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat"}
> +partition:{"ds":"2012-01-03","ts":"2012-01-03+14:46:31"}
> +table:{"name:":"default.src_orc_merge_test_part","input 
> format:":"org.apache.hadoop.hive.ql.io.orc.OrcInputFormat","output 
> format:":"org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat","serde:":"org.apache.hadoop.hive.ql.io.orc.OrcSerde"}
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-11482) Add retrying thrift client for HiveServer2

2015-09-13 Thread Akshay Goyal (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742865#comment-14742865
 ] 

Akshay Goyal commented on HIVE-11482:
-

Thanks [~leftylev].

> Add retrying thrift client for HiveServer2
> --
>
> Key: HIVE-11482
> URL: https://issues.apache.org/jira/browse/HIVE-11482
> Project: Hive
>  Issue Type: Improvement
>  Components: HiveServer2
>Reporter: Amareshwari Sriramadasu
>Assignee: Akshay Goyal
>  Labels: TODOC2.0
> Fix For: 2.0.0
>
> Attachments: HIVE-11482.02.patch
>
>
> Similar to 
> https://github.com/apache/hive/blob/master/metastore/src/java/org/apache/hadoop/hive/metastore/RetryingMetaStoreClient.java,
>  this improvement request is to add a retrying thrift client for HiveServer2 
> to do retries upon thrift exceptions.
> Here are few commits done on a forked branch that can be picked - 
> https://github.com/InMobi/hive/commit/7fb957fb9c2b6000d37c53294e256460010cb6b7
> https://github.com/InMobi/hive/commit/11e4b330f051c3f58927a276d562446761c9cd6d
> https://github.com/InMobi/hive/commit/241386fd870373a9253dca0bcbdd4ea7e665406c



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Assigned] (HIVE-11810) LLAP: Exception is ignored if MiniLlap cluster fails to start

2015-09-13 Thread Prasanth Jayachandran (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-11810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Prasanth Jayachandran reassigned HIVE-11810:


Assignee: Prasanth Jayachandran

> LLAP: Exception is ignored if MiniLlap cluster fails to start
> -
>
> Key: HIVE-11810
> URL: https://issues.apache.org/jira/browse/HIVE-11810
> Project: Hive
>  Issue Type: Sub-task
>Reporter: Prasanth Jayachandran
>Assignee: Prasanth Jayachandran
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (HIVE-11810) LLAP: Exception is ignored if MiniLlap cluster fails to start

2015-09-13 Thread Prasanth Jayachandran (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-11810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Prasanth Jayachandran resolved HIVE-11810.
--
   Resolution: Fixed
Fix Version/s: llap

Committed to llap branch.

> LLAP: Exception is ignored if MiniLlap cluster fails to start
> -
>
> Key: HIVE-11810
> URL: https://issues.apache.org/jira/browse/HIVE-11810
> Project: Hive
>  Issue Type: Sub-task
>Reporter: Prasanth Jayachandran
>Assignee: Prasanth Jayachandran
> Fix For: llap
>
> Attachments: HIVE-11810.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-11780) Add "set role none" support

2015-09-13 Thread Dapeng Sun (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Dapeng Sun updated HIVE-11780:
--
Attachment: HIVE-11780.001.patch

same patch for triggering jenkins

> Add "set role none" support
> ---
>
> Key: HIVE-11780
> URL: https://issues.apache.org/jira/browse/HIVE-11780
> Project: Hive
>  Issue Type: Improvement
>  Components: Authorization
>Affects Versions: 1.3.0, 2.0.0, 1.2.2
>Reporter: Dapeng Sun
>Assignee: Dapeng Sun
> Fix For: 1.3.0, 2.0.0, 1.2.2
>
> Attachments: HIVE-11780.001.patch, HIVE-11780.001.patch
>
>
> HIVE should allow user to disable all roles granted for current session by 
> the statement {{SET ROLE NONE;}}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-11810) LLAP: Exception is ignored if MiniLlap cluster fails to start

2015-09-13 Thread Prasanth Jayachandran (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-11810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Prasanth Jayachandran updated HIVE-11810:
-
Attachment: HIVE-11810.patch

> LLAP: Exception is ignored if MiniLlap cluster fails to start
> -
>
> Key: HIVE-11810
> URL: https://issues.apache.org/jira/browse/HIVE-11810
> Project: Hive
>  Issue Type: Sub-task
>Reporter: Prasanth Jayachandran
>Assignee: Prasanth Jayachandran
> Attachments: HIVE-11810.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-2655) Ability to define functions in HQL

2015-09-13 Thread Lefty Leverenz (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-2655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742964#comment-14742964
 ] 

Lefty Leverenz commented on HIVE-2655:
--

Doc note:  This needs to be documented in the DDL wikidoc.

* [Language Manual -- DDL | 
https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL]

Thanks go to Elliot West for requesting this on the Hive user mailing list.

* [user@hive "Hive Macros roadmap" Sept. 11, 2015 | 
http://mail-archives.apache.org/mod_mbox/hive-user/201509.mbox/%3cCAC3gpCaXGL75aBf-Z_yrdCDHT-6iwPESDkMZMGp5vYMF=0x...@mail.gmail.com%3e]

> Ability to define functions in HQL
> --
>
> Key: HIVE-2655
> URL: https://issues.apache.org/jira/browse/HIVE-2655
> Project: Hive
>  Issue Type: New Feature
>  Components: SQL
>Reporter: Jonathan Perlow
>Assignee: Brock Noland
>  Labels: TODOC12
> Fix For: 0.12.0
>
> Attachments: ASF.LICENSE.NOT.GRANTED--HIVE-2655.D915.1.patch, 
> ASF.LICENSE.NOT.GRANTED--HIVE-2655.D915.2.patch, 
> ASF.LICENSE.NOT.GRANTED--HIVE-2655.D915.3.patch, 
> ASF.LICENSE.NOT.GRANTED--HIVE-2655.D915.4.patch, HIVE-2655-10.patch, 
> HIVE-2655-10.patch, HIVE-2655-9.patch
>
>
> Ability to create functions in HQL as a substitute for creating them in Java.
> Jonathan Chang requested I create this issue.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-11780) Add "set role none" support

2015-09-13 Thread Hive QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742974#comment-14742974
 ] 

Hive QA commented on HIVE-11780:




{color:red}Overall{color}: -1 at least one tests failed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12755645/HIVE-11780.001.patch

{color:red}ERROR:{color} -1 due to 3 failed/errored test(s), 9439 tests executed
*Failed tests:*
{noformat}
org.apache.hive.hcatalog.api.TestHCatClient.testTableSchemaPropagation
org.apache.hive.hcatalog.streaming.TestStreaming.testRemainingTransactions
org.apache.hive.hcatalog.streaming.TestStreaming.testTransactionBatchCommit_Delimited
{noformat}

Test results: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5268/testReport
Console output: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5268/console
Test logs: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-5268/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 3 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12755645 - PreCommit-HIVE-TRUNK-Build

> Add "set role none" support
> ---
>
> Key: HIVE-11780
> URL: https://issues.apache.org/jira/browse/HIVE-11780
> Project: Hive
>  Issue Type: Improvement
>  Components: Authorization
>Affects Versions: 1.3.0, 2.0.0, 1.2.2
>Reporter: Dapeng Sun
>Assignee: Dapeng Sun
> Fix For: 1.3.0, 2.0.0, 1.2.2
>
> Attachments: HIVE-11780.001.patch, HIVE-11780.001.patch
>
>
> HIVE should allow user to disable all roles granted for current session by 
> the statement {{SET ROLE NONE;}}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)