[jira] [Commented] (HIVE-11802) Float-point numbers are displayed with different precision in Beeline/JDBC
[ https://issues.apache.org/jira/browse/HIVE-11802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14742374#comment-14742374 ] Hive QA commented on HIVE-11802: {color:red}Overall{color}: -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12755592/HIVE-11802.2.patch {color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 9442 tests executed *Failed tests:* {noformat} org.apache.hive.hcatalog.api.TestHCatClient.testTableSchemaPropagation org.apache.hive.hcatalog.hbase.TestPigHBaseStorageHandler.org.apache.hive.hcatalog.hbase.TestPigHBaseStorageHandler {noformat} Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5263/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5263/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-5263/ Messages: {noformat} Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 2 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12755592 - PreCommit-HIVE-TRUNK-Build > Float-point numbers are displayed with different precision in Beeline/JDBC > -- > > Key: HIVE-11802 > URL: https://issues.apache.org/jira/browse/HIVE-11802 > Project: Hive > Issue Type: Bug >Affects Versions: 1.2.1 >Reporter: Sergio Peña >Assignee: Sergio Peña > Attachments: HIVE-11802.2.patch > > > When inserting float-point numbers to a table, the values displayed on > beeline or jdbc are with different precision. > How to reproduce: > {noformat} > 0: jdbc:hive2://localhost:1> create table decimals (f float, af > array, d double, ad array) stored as parquet; > No rows affected (0.294 seconds) > 0: jdbc:hive2://localhost:1> insert into table decimals select 1.10058, > array(cast(1.10058 as float)), 2.0133, array(2.0133) from dummy limit 1; > ... > No rows affected (20.089 seconds) > 0: jdbc:hive2://localhost:1> select f, af, af[0], d, ad[0] from decimals; > +-++-+-+-+--+ > | f | af | _c2 |d| _c4 | > +-++-+-+-+--+ > | 1.1005799770355225 | [1.10058] | 1.1005799770355225 | 2.0133 | 2.0133 | > +-++-+-+-+--+ > {noformat} > When displaying arrays, the values are displayed correctly, but if I print a > specific element, it is then displayed with more decimal positions. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-11792) User explain in tez does not preserve ordering
[ https://issues.apache.org/jira/browse/HIVE-11792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-11792: - Attachment: HIVE-11792.2.patch > User explain in tez does not preserve ordering > -- > > Key: HIVE-11792 > URL: https://issues.apache.org/jira/browse/HIVE-11792 > Project: Hive > Issue Type: Bug > Components: Diagnosability >Affects Versions: 2.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran > Attachments: HIVE-11792.1.patch, HIVE-11792.2.patch > > > HIVE-11037 introduced user level explain. The output of operator attributes > are JSONObject which does not preserve ordering. This is causing diffs in > test output when run under tez vs llap like below > {code} > -partition:{"ts":"2012-01-03+14:46:31","ds":"2012-01-03"} > - > table:{"serde:":"org.apache.hadoop.hive.ql.io.orc.OrcSerde","name:":"default.src_orc_merge_test_part","input > format:":"org.apache.hadoop.hive.ql.io.orc.OrcInputFormat","output > format:":"org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat"} > +partition:{"ds":"2012-01-03","ts":"2012-01-03+14:46:31"} > +table:{"name:":"default.src_orc_merge_test_part","input > format:":"org.apache.hadoop.hive.ql.io.orc.OrcInputFormat","output > format:":"org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat","serde:":"org.apache.hadoop.hive.ql.io.orc.OrcSerde"} > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-11482) Add retrying thrift client for HiveServer2
[ https://issues.apache.org/jira/browse/HIVE-11482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14742406#comment-14742406 ] Akshay Goyal commented on HIVE-11482: - [~leftylev] My confluence username is akshaygoyal. > Add retrying thrift client for HiveServer2 > -- > > Key: HIVE-11482 > URL: https://issues.apache.org/jira/browse/HIVE-11482 > Project: Hive > Issue Type: Improvement > Components: HiveServer2 >Reporter: Amareshwari Sriramadasu >Assignee: Akshay Goyal > Labels: TODOC2.0 > Fix For: 2.0.0 > > Attachments: HIVE-11482.02.patch > > > Similar to > https://github.com/apache/hive/blob/master/metastore/src/java/org/apache/hadoop/hive/metastore/RetryingMetaStoreClient.java, > this improvement request is to add a retrying thrift client for HiveServer2 > to do retries upon thrift exceptions. > Here are few commits done on a forked branch that can be picked - > https://github.com/InMobi/hive/commit/7fb957fb9c2b6000d37c53294e256460010cb6b7 > https://github.com/InMobi/hive/commit/11e4b330f051c3f58927a276d562446761c9cd6d > https://github.com/InMobi/hive/commit/241386fd870373a9253dca0bcbdd4ea7e665406c -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-11792) User explain in tez does not preserve ordering
[ https://issues.apache.org/jira/browse/HIVE-11792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14742441#comment-14742441 ] Hive QA commented on HIVE-11792: {color:red}Overall{color}: -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12755597/HIVE-11792.2.patch {color:red}ERROR:{color} -1 due to 10 failed/errored test(s), 9439 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_authorization_explain org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_explain_dependency org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_explain_dependency2 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_input4 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join0 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_parallel_join0 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_plan_json org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_explainuser_1 org.apache.hive.hcatalog.api.TestHCatClient.testTableSchemaPropagation org.apache.hive.hcatalog.streaming.TestStreaming.testTimeOutReaper {noformat} Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5264/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5264/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-5264/ Messages: {noformat} Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 10 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12755597 - PreCommit-HIVE-TRUNK-Build > User explain in tez does not preserve ordering > -- > > Key: HIVE-11792 > URL: https://issues.apache.org/jira/browse/HIVE-11792 > Project: Hive > Issue Type: Bug > Components: Diagnosability >Affects Versions: 2.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran > Attachments: HIVE-11792.1.patch, HIVE-11792.2.patch > > > HIVE-11037 introduced user level explain. The output of operator attributes > are JSONObject which does not preserve ordering. This is causing diffs in > test output when run under tez vs llap like below > {code} > -partition:{"ts":"2012-01-03+14:46:31","ds":"2012-01-03"} > - > table:{"serde:":"org.apache.hadoop.hive.ql.io.orc.OrcSerde","name:":"default.src_orc_merge_test_part","input > format:":"org.apache.hadoop.hive.ql.io.orc.OrcInputFormat","output > format:":"org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat"} > +partition:{"ds":"2012-01-03","ts":"2012-01-03+14:46:31"} > +table:{"name:":"default.src_orc_merge_test_part","input > format:":"org.apache.hadoop.hive.ql.io.orc.OrcInputFormat","output > format:":"org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat","serde:":"org.apache.hadoop.hive.ql.io.orc.OrcSerde"} > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-10328) Enable new return path for cbo
[ https://issues.apache.org/jira/browse/HIVE-10328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-10328: --- Attachment: HIVE-10328.11.patch > Enable new return path for cbo > -- > > Key: HIVE-10328 > URL: https://issues.apache.org/jira/browse/HIVE-10328 > Project: Hive > Issue Type: Task > Components: CBO >Reporter: Ashutosh Chauhan >Assignee: Ashutosh Chauhan > Attachments: HIVE-10328.1.patch, HIVE-10328.10.patch, > HIVE-10328.11.patch, HIVE-10328.2.patch, HIVE-10328.3.patch, > HIVE-10328.4.patch, HIVE-10328.4.patch, HIVE-10328.5.patch, > HIVE-10328.6.patch, HIVE-10328.7.patch, HIVE-10328.8.patch, > HIVE-10328.9.patch, HIVE-10328.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-11789) Better support for functions recognition in CBO
[ https://issues.apache.org/jira/browse/HIVE-11789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-11789: --- Summary: Better support for functions recognition in CBO (was: Support multicolumn in CBO) > Better support for functions recognition in CBO > --- > > Key: HIVE-11789 > URL: https://issues.apache.org/jira/browse/HIVE-11789 > Project: Hive > Issue Type: Improvement > Components: CBO >Affects Versions: 2.0.0 >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez > > Support multicolumn in CBO way in/out i.e. translate STRUCT in/to multicolumn. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-11789) Better support for functions recognition in CBO
[ https://issues.apache.org/jira/browse/HIVE-11789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-11789: --- Description: Including IN, BETWEEN, and STRUCT (multicolumn). In particular, STRUCT is represented as ROW in Calcite. (was: Support multicolumn in CBO way in/out i.e. translate STRUCT in/to multicolumn.) > Better support for functions recognition in CBO > --- > > Key: HIVE-11789 > URL: https://issues.apache.org/jira/browse/HIVE-11789 > Project: Hive > Issue Type: Improvement > Components: CBO >Affects Versions: 2.0.0 >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez > > Including IN, BETWEEN, and STRUCT (multicolumn). In particular, STRUCT is > represented as ROW in Calcite. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-11789) Better support for functions recognition in CBO
[ https://issues.apache.org/jira/browse/HIVE-11789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-11789: --- Attachment: HIVE-11789.patch > Better support for functions recognition in CBO > --- > > Key: HIVE-11789 > URL: https://issues.apache.org/jira/browse/HIVE-11789 > Project: Hive > Issue Type: Improvement > Components: CBO >Affects Versions: 2.0.0 >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez > Attachments: HIVE-11789.patch > > > Including IN, BETWEEN, and STRUCT (multicolumn). In particular, STRUCT is > represented as ROW in Calcite. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-11792) User explain in tez does not preserve ordering
[ https://issues.apache.org/jira/browse/HIVE-11792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-11792: - Attachment: HIVE-11792.3.patch > User explain in tez does not preserve ordering > -- > > Key: HIVE-11792 > URL: https://issues.apache.org/jira/browse/HIVE-11792 > Project: Hive > Issue Type: Bug > Components: Diagnosability >Affects Versions: 2.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran > Attachments: HIVE-11792.1.patch, HIVE-11792.2.patch, > HIVE-11792.3.patch > > > HIVE-11037 introduced user level explain. The output of operator attributes > are JSONObject which does not preserve ordering. This is causing diffs in > test output when run under tez vs llap like below > {code} > -partition:{"ts":"2012-01-03+14:46:31","ds":"2012-01-03"} > - > table:{"serde:":"org.apache.hadoop.hive.ql.io.orc.OrcSerde","name:":"default.src_orc_merge_test_part","input > format:":"org.apache.hadoop.hive.ql.io.orc.OrcInputFormat","output > format:":"org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat"} > +partition:{"ds":"2012-01-03","ts":"2012-01-03+14:46:31"} > +table:{"name:":"default.src_orc_merge_test_part","input > format:":"org.apache.hadoop.hive.ql.io.orc.OrcInputFormat","output > format:":"org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat","serde:":"org.apache.hadoop.hive.ql.io.orc.OrcSerde"} > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-10328) Enable new return path for cbo
[ https://issues.apache.org/jira/browse/HIVE-10328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14742660#comment-14742660 ] Hive QA commented on HIVE-10328: {color:red}Overall{color}: -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12755621/HIVE-10328.11.patch {color:red}ERROR:{color} -1 due to 631 failed/errored test(s), 9439 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ctas_colname org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_dynpart_sort_opt_vectorization org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_dynpart_sort_optimization org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_groupby2_map_multi_distinct org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_groupby_resolution org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_lineage2 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_lineage3 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_parquet_ppd_boolean org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_parquet_ppd_char org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_parquet_ppd_date org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_parquet_ppd_decimal org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_parquet_ppd_timestamp org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_parquet_ppd_varchar org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_quotedid_basic org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_subquery_in org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_subquery_in_having org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_subquery_notin org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_subquery_unqualcolumnrefs org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_udaf_percentile_approx_23 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_udf_percentile org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union24 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union31 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_unionDistinct_1 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_6_subq org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_windowing_streaming org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_dboutput org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_serde_typedbytes2 org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_serde_typedbytes3 org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_serde_typedbytes4 org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_udaf_example_avg org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_udaf_example_group_concat org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_udaf_example_max org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_udaf_example_max_n org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_udaf_example_min org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_udaf_example_min_n org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_udf_example_add org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_udf_example_format org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_udf_row_sequence org.apache.hadoop.hive.cli.TestEncryptedHDFSCliDriver.testCliDriver_encryption_insert_partition_dynamic org.apache.hadoop.hive.cli.TestEncryptedHDFSCliDriver.testCliDriver_encryption_select_read_only_encrypted_tbl org.apache.hadoop.hive.cli.TestHBaseCliDriver.testCliDriver_external_table_ppd org.apache.hadoop.hive.cli.TestHBaseCliDriver.testCliDriver_hbase_ppd_key_range org.apache.hadoop.hive.cli.TestHBaseCliDriver.testCliDriver_hbase_pushdown org.apache.hadoop.hive.cli.TestHBaseCliDriver.testCliDriver_hbase_queries org.apache.hadoop.hive.cli.TestHBaseCliDriver.testCliDriver_hbase_timestamp org.apache.hadoop.hive.cli.TestHBaseCliDriver.testCliDriver_ppd_key_ranges org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver_bucket4 org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver_bucket6 org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver_constprog_partitioner org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver_disable_merge_for_bucketing org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver_index_bitmap3 org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver_index_bitmap_auto org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver_infer_bucket_sort_map_operators org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver_infer_bucket_sort_merge org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver_infer_bucket_sort_reducers_power_two org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver_list_bucket_dml_10 org.apac
[jira] [Commented] (HIVE-11789) Better support for functions recognition in CBO
[ https://issues.apache.org/jira/browse/HIVE-11789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14742705#comment-14742705 ] Hive QA commented on HIVE-11789: {color:red}Overall{color}: -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12755622/HIVE-11789.patch {color:red}ERROR:{color} -1 due to 32 failed/errored test(s), 9439 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_filter_numeric org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_orc_create org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_orc_ppd_char org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_orc_ppd_date org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_orc_ppd_decimal org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_orc_ppd_timestamp org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_orc_ppd_varchar org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_orc_predicate_pushdown org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_parquet_ppd_char org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_parquet_ppd_date org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_parquet_ppd_decimal org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_parquet_ppd_timestamp org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_parquet_ppd_varchar org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_parquet_predicate_pushdown org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_partition_date org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_partition_multilevels org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_partition_timestamp org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_udaf_percentile_approx_23 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_udf_between org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_vector_between_in org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_vectorized_timestamp_funcs org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver_auto_sortmerge_join_16 org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_auto_sortmerge_join_16 org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_tez_dynpart_hashjoin_1 org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_tez_vector_dynpart_hashjoin_1 org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_vector_between_in org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_vectorized_timestamp_funcs org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_auto_sortmerge_join_16 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_auto_sortmerge_join_16 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_vector_between_in org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_vectorized_timestamp_funcs org.apache.hive.hcatalog.api.TestHCatClient.testTableSchemaPropagation {noformat} Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5266/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5266/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-5266/ Messages: {noformat} Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 32 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12755622 - PreCommit-HIVE-TRUNK-Build > Better support for functions recognition in CBO > --- > > Key: HIVE-11789 > URL: https://issues.apache.org/jira/browse/HIVE-11789 > Project: Hive > Issue Type: Improvement > Components: CBO >Affects Versions: 2.0.0 >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez > Attachments: HIVE-11789.patch > > > Including IN, BETWEEN, and STRUCT (multicolumn). In particular, STRUCT is > represented as ROW in Calcite. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-11792) User explain in tez does not preserve ordering
[ https://issues.apache.org/jira/browse/HIVE-11792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14742744#comment-14742744 ] Hive QA commented on HIVE-11792: {color:red}Overall{color}: -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12755628/HIVE-11792.3.patch {color:red}ERROR:{color} -1 due to 7 failed/errored test(s), 9439 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_authorization_explain org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_input4 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join0 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_plan_json org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_explainuser_1 org.apache.hive.hcatalog.api.TestHCatClient.testTableSchemaPropagation org.apache.hive.hcatalog.streaming.TestStreaming.testTransactionBatchEmptyCommit {noformat} Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5267/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5267/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-5267/ Messages: {noformat} Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 7 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12755628 - PreCommit-HIVE-TRUNK-Build > User explain in tez does not preserve ordering > -- > > Key: HIVE-11792 > URL: https://issues.apache.org/jira/browse/HIVE-11792 > Project: Hive > Issue Type: Bug > Components: Diagnosability >Affects Versions: 2.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran > Attachments: HIVE-11792.1.patch, HIVE-11792.2.patch, > HIVE-11792.3.patch > > > HIVE-11037 introduced user level explain. The output of operator attributes > are JSONObject which does not preserve ordering. This is causing diffs in > test output when run under tez vs llap like below > {code} > -partition:{"ts":"2012-01-03+14:46:31","ds":"2012-01-03"} > - > table:{"serde:":"org.apache.hadoop.hive.ql.io.orc.OrcSerde","name:":"default.src_orc_merge_test_part","input > format:":"org.apache.hadoop.hive.ql.io.orc.OrcInputFormat","output > format:":"org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat"} > +partition:{"ds":"2012-01-03","ts":"2012-01-03+14:46:31"} > +table:{"name:":"default.src_orc_merge_test_part","input > format:":"org.apache.hadoop.hive.ql.io.orc.OrcInputFormat","output > format:":"org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat","serde:":"org.apache.hadoop.hive.ql.io.orc.OrcSerde"} > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-11482) Add retrying thrift client for HiveServer2
[ https://issues.apache.org/jira/browse/HIVE-11482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14742761#comment-14742761 ] Lefty Leverenz commented on HIVE-11482: --- You can edit now, Akshay. Welcome to the Hive wiki team! > Add retrying thrift client for HiveServer2 > -- > > Key: HIVE-11482 > URL: https://issues.apache.org/jira/browse/HIVE-11482 > Project: Hive > Issue Type: Improvement > Components: HiveServer2 >Reporter: Amareshwari Sriramadasu >Assignee: Akshay Goyal > Labels: TODOC2.0 > Fix For: 2.0.0 > > Attachments: HIVE-11482.02.patch > > > Similar to > https://github.com/apache/hive/blob/master/metastore/src/java/org/apache/hadoop/hive/metastore/RetryingMetaStoreClient.java, > this improvement request is to add a retrying thrift client for HiveServer2 > to do retries upon thrift exceptions. > Here are few commits done on a forked branch that can be picked - > https://github.com/InMobi/hive/commit/7fb957fb9c2b6000d37c53294e256460010cb6b7 > https://github.com/InMobi/hive/commit/11e4b330f051c3f58927a276d562446761c9cd6d > https://github.com/InMobi/hive/commit/241386fd870373a9253dca0bcbdd4ea7e665406c -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-11802) Float-point numbers are displayed with different precision in Beeline/JDBC
[ https://issues.apache.org/jira/browse/HIVE-11802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14742769#comment-14742769 ] Carl Steinbach commented on HIVE-11802: --- Thanks for adding a test. Here's some feedback: * TestColumn is missing an ASF header. * TestColumn doesn't prove that beeline returns correct results. What we need is an end-to-end test that validates the output of beeline. There's an existing test driver (TestBeeLineDriver) that was included in the original HiveServer2 patch. The goal was to make it easy to write end-to-end Beeline tests in the style of the existing qfile tests. There's also a set of sample data files in files/types/primitives that cover all primitive types, and an initialization file (data/scripts/q_test_init.sql) that creates a 'primitives' table on top of it. I think we'd get more complete and easier to maintain test coverage with less code by resurrecting TestBeeLineDriver and writing a new beeline qfile test that runs a 'SELECT *' query against the primitives table. I suspect the original HS2 patch even had a qfile test for this, but I'm too depressed to look. It would be awesome if you want to fix this, but all that really stands in the way of a +1 is adding the missing ASF header. > Float-point numbers are displayed with different precision in Beeline/JDBC > -- > > Key: HIVE-11802 > URL: https://issues.apache.org/jira/browse/HIVE-11802 > Project: Hive > Issue Type: Bug >Affects Versions: 1.2.1 >Reporter: Sergio Peña >Assignee: Sergio Peña > Attachments: HIVE-11802.2.patch > > > When inserting float-point numbers to a table, the values displayed on > beeline or jdbc are with different precision. > How to reproduce: > {noformat} > 0: jdbc:hive2://localhost:1> create table decimals (f float, af > array, d double, ad array) stored as parquet; > No rows affected (0.294 seconds) > 0: jdbc:hive2://localhost:1> insert into table decimals select 1.10058, > array(cast(1.10058 as float)), 2.0133, array(2.0133) from dummy limit 1; > ... > No rows affected (20.089 seconds) > 0: jdbc:hive2://localhost:1> select f, af, af[0], d, ad[0] from decimals; > +-++-+-+-+--+ > | f | af | _c2 |d| _c4 | > +-++-+-+-+--+ > | 1.1005799770355225 | [1.10058] | 1.1005799770355225 | 2.0133 | 2.0133 | > +-++-+-+-+--+ > {noformat} > When displaying arrays, the values are displayed correctly, but if I print a > specific element, it is then displayed with more decimal positions. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-11778) Merge beeline-cli branch to trunk
[ https://issues.apache.org/jira/browse/HIVE-11778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14742770#comment-14742770 ] Ferdinand Xu commented on HIVE-11778: - Thanks [~xuefuz], I don't have circle until later this week or next week. I will complete the 3rd part and try to investigate the 1st jira. > Merge beeline-cli branch to trunk > - > > Key: HIVE-11778 > URL: https://issues.apache.org/jira/browse/HIVE-11778 > Project: Hive > Issue Type: Sub-task > Components: CLI >Affects Versions: 2.0.0 >Reporter: Ferdinand Xu >Assignee: Ferdinand Xu > Attachments: HIVE-11778.patch > > > The team working on the beeline-cli branch would like to merge their work to > trunk. This jira will track that effort. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-11778) Merge beeline-cli branch to trunk
[ https://issues.apache.org/jira/browse/HIVE-11778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14742771#comment-14742771 ] Ferdinand Xu commented on HIVE-11778: - Thanks [~xuefuz], I don't have circle until later this week or next week. I will complete the 3rd part and try to investigate the 1st jira. > Merge beeline-cli branch to trunk > - > > Key: HIVE-11778 > URL: https://issues.apache.org/jira/browse/HIVE-11778 > Project: Hive > Issue Type: Sub-task > Components: CLI >Affects Versions: 2.0.0 >Reporter: Ferdinand Xu >Assignee: Ferdinand Xu > Attachments: HIVE-11778.patch > > > The team working on the beeline-cli branch would like to merge their work to > trunk. This jira will track that effort. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-11796) CLI option is not updated when executing the initial files[beeline-cli]
[ https://issues.apache.org/jira/browse/HIVE-11796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14742777#comment-14742777 ] Ferdinand Xu commented on HIVE-11796: - Hi [~xuefuz], do you have time reviewing this jira? Thank you! > CLI option is not updated when executing the initial files[beeline-cli] > --- > > Key: HIVE-11796 > URL: https://issues.apache.org/jira/browse/HIVE-11796 > Project: Hive > Issue Type: Sub-task > Components: CLI >Affects Versions: beeline-cli-branch >Reporter: Ferdinand Xu >Assignee: Ferdinand Xu > Fix For: beeline-cli-branch > > Attachments: HIVE-11796.1-beeline-cli.patch > > > "Method not supported" is thrown when executing the initial files. This is > caused by CLI option is not updated. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-11745) Alter table Exchange partition with multiple partition_spec is not working
[ https://issues.apache.org/jira/browse/HIVE-11745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14742807#comment-14742807 ] Yongzhi Chen commented on HIVE-11745: - The failures are not related. org.apache.hive.hcatalog.api.TestHCatClient.testTableSchemaPropagation failed more than 100 times. The 3 spark client tests failed for the same problem: java.util.concurrent.TimeoutException: null The 3 hcatalog.streaming.TestStreaming tests failed because of Table/View 'TXNS' already exists in Schema 'APP'. org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge does not relate to alter table with partition, and it passed in my local machine. {noformat} --- Running org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.783 sec - in org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge Results : Tests run: 3, Failures: 0, Errors: 0, Skipped: 0 {noformat} > Alter table Exchange partition with multiple partition_spec is not working > -- > > Key: HIVE-11745 > URL: https://issues.apache.org/jira/browse/HIVE-11745 > Project: Hive > Issue Type: Bug > Components: Metastore >Affects Versions: 1.2.0, 1.1.0, 2.0.0 >Reporter: Yongzhi Chen >Assignee: Yongzhi Chen > Attachments: HIVE-11745.1.patch, HIVE-11745.2.patch > > > Single partition works, but multiple partitions will not work. > Reproduce steps: > {noformat} > DROP TABLE IF EXISTS t1; > DROP TABLE IF EXISTS t2; > DROP TABLE IF EXISTS t3; > DROP TABLE IF EXISTS t4; > CREATE TABLE t1 (a int) PARTITIONED BY (d1 int); > CREATE TABLE t2 (a int) PARTITIONED BY (d1 int); > CREATE TABLE t3 (a int) PARTITIONED BY (d1 int, d2 int); > CREATE TABLE t4 (a int) PARTITIONED BY (d1 int, d2 int); > INSERT OVERWRITE TABLE t1 PARTITION (d1 = 1) SELECT salary FROM jsmall LIMIT > 10; > INSERT OVERWRITE TABLE t3 PARTITION (d1 = 1, d2 = 1) SELECT salary FROM > jsmall LIMIT 10; > SELECT * FROM t1; > SELECT * FROM t3; > ALTER TABLE t2 EXCHANGE PARTITION (d1 = 1) WITH TABLE t1; > SELECT * FROM t1; > SELECT * FROM t2; > ALTER TABLE t4 EXCHANGE PARTITION (d1 = 1, d2 = 1) WITH TABLE t3; > SELECT * FROM t3; > SELECT * FROM t4; > {noformat} > The output: > {noformat} > 0: jdbc:hive2://10.17.74.148:1/default> SELECT * FROM t3; > +---+++--+ > | t3.a | t3.d1 | t3.d2 | > +---+++--+ > +---+++--+ > No rows selected (0.227 seconds) > 0: jdbc:hive2://10.17.74.148:1/default> SELECT * FROM t4; > +---+++--+ > | t4.a | t4.d1 | t4.d2 | > +---+++--+ > +---+++--+ > No rows selected (0.266 seconds) > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-11809) Insert into table partition failed but partition directory created
[ https://issues.apache.org/jira/browse/HIVE-11809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] niklaus.xiao updated HIVE-11809: Description: 1. userA creates a partition table: create table w1(id int, name string, addr string) partitioned by (dt string) row format delimited fields terminated by ',' stored as textfile; 2. userB tries to insert into userA's table: insert into table w1 partition(dt='2') select id, name, addr from t1; 3. userB does not have select privilege of table t1 and insert privilege of w1, step 2 throws: Error: Error while compiling statement: FAILED: HiveAccessControlException Permission denied: Principal [name=hdfs, type=USER] does not have following privileges for operation QUERY [[SELECT] on Object [type=TABLE_OR_VIEW, name=default.t1]] (state=42000,code=4) but the partition directory "/user/hive/warehouse/w1/dt=2" created: hdfs dfs -ls /user/hive/warehouse/w1/ 15/09/14 11:16:42 INFO hdfs.PeerCache: SocketCache disabled. Found 2 items drwx-- - userA hive 0 2015-09-14 10:05 /user/hive/warehouse/w1/dt=1 drwx-- - userB hive 0 2015-09-14 10:23 /user/hive/warehouse/w1/dt=2 was: 1. userA creates a partition table: create table w1(id int, name string, addr string) partitioned by (dt string) row format delimited fields terminated by ',' stored as textfile; 2. userB tries to insert into userA's table: insert into table w1 partition(dt='2') select id, name, addr from t1; 3. userB does not have select privilege of table t1 and insert privilege of w1, step 2 throws: Error: Error while compiling statement: FAILED: HiveAccessControlException Permission denied: Principal [name=hdfs, type=USER] does not have following privileges for operation QUERY [[SELECT] on Object [type=TABLE_OR_VIEW, name=default.t1]] (state=42000,code=4) but the partition directory "/user/hive/warehouse/w1/dt=2" created: hdfs dfs -ls /user/hive/warehouse/w1/ 15/09/14 11:16:42 INFO hdfs.PeerCache: SocketCache disabled. Found 2 items drwx-- - userA hive 0 2015-09-14 10:05 /user/hive/warehouse/w1/dt=1 drwx-- - userB hive 0 2015-09-14 10:23 /user/hive/warehouse/w1/dt=2 > Insert into table partition failed but partition directory created > -- > > Key: HIVE-11809 > URL: https://issues.apache.org/jira/browse/HIVE-11809 > Project: Hive > Issue Type: Bug >Affects Versions: 1.2.0, 1.1.0, 1.1.1 >Reporter: niklaus.xiao > > 1. userA creates a partition table: create table w1(id int, name string, addr > string) partitioned by (dt string) row format delimited fields terminated by > ',' stored as textfile; > 2. userB tries to insert into userA's table: insert into table w1 > partition(dt='2') select id, name, addr from t1; > 3. userB does not have select privilege of table t1 and insert privilege of > w1, > step 2 throws: Error: Error while compiling statement: FAILED: > HiveAccessControlException Permission denied: Principal [name=hdfs, > type=USER] does not have following privileges for operation QUERY [[SELECT] > on Object [type=TABLE_OR_VIEW, name=default.t1]] (state=42000,code=4) > but the partition directory "/user/hive/warehouse/w1/dt=2" created: > hdfs dfs -ls /user/hive/warehouse/w1/ > 15/09/14 11:16:42 INFO hdfs.PeerCache: SocketCache disabled. > Found 2 items > drwx-- - userA hive 0 2015-09-14 10:05 > /user/hive/warehouse/w1/dt=1 > drwx-- - userB hive 0 2015-09-14 10:23 > /user/hive/warehouse/w1/dt=2 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-11780) Add "set role none" support
[ https://issues.apache.org/jira/browse/HIVE-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dapeng Sun updated HIVE-11780: -- Attachment: HIVE-11780.001.patch same patch for triggering jenkins > Add "set role none" support > --- > > Key: HIVE-11780 > URL: https://issues.apache.org/jira/browse/HIVE-11780 > Project: Hive > Issue Type: Improvement > Components: Authorization >Affects Versions: 1.3.0, 2.0.0, 1.2.2 >Reporter: Dapeng Sun >Assignee: Dapeng Sun > Fix For: 1.3.0, 2.0.0, 1.2.2 > > Attachments: HIVE-11780.001.patch, HIVE-11780.001.patch > > > HIVE should allow user to disable all roles granted for current session by > the statement {{SET ROLE NONE;}} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-11792) User explain in tez does not preserve ordering
[ https://issues.apache.org/jira/browse/HIVE-11792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-11792: - Attachment: HIVE-11792.4.patch > User explain in tez does not preserve ordering > -- > > Key: HIVE-11792 > URL: https://issues.apache.org/jira/browse/HIVE-11792 > Project: Hive > Issue Type: Bug > Components: Diagnosability >Affects Versions: 2.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran > Attachments: HIVE-11792.1.patch, HIVE-11792.2.patch, > HIVE-11792.3.patch, HIVE-11792.4.patch > > > HIVE-11037 introduced user level explain. The output of operator attributes > are JSONObject which does not preserve ordering. This is causing diffs in > test output when run under tez vs llap like below > {code} > -partition:{"ts":"2012-01-03+14:46:31","ds":"2012-01-03"} > - > table:{"serde:":"org.apache.hadoop.hive.ql.io.orc.OrcSerde","name:":"default.src_orc_merge_test_part","input > format:":"org.apache.hadoop.hive.ql.io.orc.OrcInputFormat","output > format:":"org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat"} > +partition:{"ds":"2012-01-03","ts":"2012-01-03+14:46:31"} > +table:{"name:":"default.src_orc_merge_test_part","input > format:":"org.apache.hadoop.hive.ql.io.orc.OrcInputFormat","output > format:":"org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat","serde:":"org.apache.hadoop.hive.ql.io.orc.OrcSerde"} > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-11482) Add retrying thrift client for HiveServer2
[ https://issues.apache.org/jira/browse/HIVE-11482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14742865#comment-14742865 ] Akshay Goyal commented on HIVE-11482: - Thanks [~leftylev]. > Add retrying thrift client for HiveServer2 > -- > > Key: HIVE-11482 > URL: https://issues.apache.org/jira/browse/HIVE-11482 > Project: Hive > Issue Type: Improvement > Components: HiveServer2 >Reporter: Amareshwari Sriramadasu >Assignee: Akshay Goyal > Labels: TODOC2.0 > Fix For: 2.0.0 > > Attachments: HIVE-11482.02.patch > > > Similar to > https://github.com/apache/hive/blob/master/metastore/src/java/org/apache/hadoop/hive/metastore/RetryingMetaStoreClient.java, > this improvement request is to add a retrying thrift client for HiveServer2 > to do retries upon thrift exceptions. > Here are few commits done on a forked branch that can be picked - > https://github.com/InMobi/hive/commit/7fb957fb9c2b6000d37c53294e256460010cb6b7 > https://github.com/InMobi/hive/commit/11e4b330f051c3f58927a276d562446761c9cd6d > https://github.com/InMobi/hive/commit/241386fd870373a9253dca0bcbdd4ea7e665406c -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Assigned] (HIVE-11810) LLAP: Exception is ignored if MiniLlap cluster fails to start
[ https://issues.apache.org/jira/browse/HIVE-11810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran reassigned HIVE-11810: Assignee: Prasanth Jayachandran > LLAP: Exception is ignored if MiniLlap cluster fails to start > - > > Key: HIVE-11810 > URL: https://issues.apache.org/jira/browse/HIVE-11810 > Project: Hive > Issue Type: Sub-task >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-11810) LLAP: Exception is ignored if MiniLlap cluster fails to start
[ https://issues.apache.org/jira/browse/HIVE-11810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-11810: - Attachment: HIVE-11810.patch > LLAP: Exception is ignored if MiniLlap cluster fails to start > - > > Key: HIVE-11810 > URL: https://issues.apache.org/jira/browse/HIVE-11810 > Project: Hive > Issue Type: Sub-task >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran > Attachments: HIVE-11810.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-2655) Ability to define functions in HQL
[ https://issues.apache.org/jira/browse/HIVE-2655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lefty Leverenz updated HIVE-2655: - Labels: TODOC12 (was: ) > Ability to define functions in HQL > -- > > Key: HIVE-2655 > URL: https://issues.apache.org/jira/browse/HIVE-2655 > Project: Hive > Issue Type: New Feature > Components: SQL >Reporter: Jonathan Perlow >Assignee: Brock Noland > Labels: TODOC12 > Fix For: 0.12.0 > > Attachments: ASF.LICENSE.NOT.GRANTED--HIVE-2655.D915.1.patch, > ASF.LICENSE.NOT.GRANTED--HIVE-2655.D915.2.patch, > ASF.LICENSE.NOT.GRANTED--HIVE-2655.D915.3.patch, > ASF.LICENSE.NOT.GRANTED--HIVE-2655.D915.4.patch, HIVE-2655-10.patch, > HIVE-2655-10.patch, HIVE-2655-9.patch > > > Ability to create functions in HQL as a substitute for creating them in Java. > Jonathan Chang requested I create this issue. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-2655) Ability to define functions in HQL
[ https://issues.apache.org/jira/browse/HIVE-2655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14742955#comment-14742955 ] Jonathan Chang commented on HIVE-2655: -- Hi, I am no longer reachable at this address. Please contact me at either slyco...@gmail.com or (310)425-3759. Cheers, Jonathan > Ability to define functions in HQL > -- > > Key: HIVE-2655 > URL: https://issues.apache.org/jira/browse/HIVE-2655 > Project: Hive > Issue Type: New Feature > Components: SQL >Reporter: Jonathan Perlow >Assignee: Brock Noland > Labels: TODOC12 > Fix For: 0.12.0 > > Attachments: ASF.LICENSE.NOT.GRANTED--HIVE-2655.D915.1.patch, > ASF.LICENSE.NOT.GRANTED--HIVE-2655.D915.2.patch, > ASF.LICENSE.NOT.GRANTED--HIVE-2655.D915.3.patch, > ASF.LICENSE.NOT.GRANTED--HIVE-2655.D915.4.patch, HIVE-2655-10.patch, > HIVE-2655-10.patch, HIVE-2655-9.patch > > > Ability to create functions in HQL as a substitute for creating them in Java. > Jonathan Chang requested I create this issue. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-2655) Ability to define functions in HQL
[ https://issues.apache.org/jira/browse/HIVE-2655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14742964#comment-14742964 ] Lefty Leverenz commented on HIVE-2655: -- Doc note: This needs to be documented in the DDL wikidoc. * [Language Manual -- DDL | https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL] Thanks go to Elliot West for requesting this on the Hive user mailing list. * [user@hive "Hive Macros roadmap" Sept. 11, 2015 | http://mail-archives.apache.org/mod_mbox/hive-user/201509.mbox/%3cCAC3gpCaXGL75aBf-Z_yrdCDHT-6iwPESDkMZMGp5vYMF=0x...@mail.gmail.com%3e] > Ability to define functions in HQL > -- > > Key: HIVE-2655 > URL: https://issues.apache.org/jira/browse/HIVE-2655 > Project: Hive > Issue Type: New Feature > Components: SQL >Reporter: Jonathan Perlow >Assignee: Brock Noland > Labels: TODOC12 > Fix For: 0.12.0 > > Attachments: ASF.LICENSE.NOT.GRANTED--HIVE-2655.D915.1.patch, > ASF.LICENSE.NOT.GRANTED--HIVE-2655.D915.2.patch, > ASF.LICENSE.NOT.GRANTED--HIVE-2655.D915.3.patch, > ASF.LICENSE.NOT.GRANTED--HIVE-2655.D915.4.patch, HIVE-2655-10.patch, > HIVE-2655-10.patch, HIVE-2655-9.patch > > > Ability to create functions in HQL as a substitute for creating them in Java. > Jonathan Chang requested I create this issue. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HIVE-11810) LLAP: Exception is ignored if MiniLlap cluster fails to start
[ https://issues.apache.org/jira/browse/HIVE-11810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran resolved HIVE-11810. -- Resolution: Fixed Fix Version/s: llap Committed to llap branch. > LLAP: Exception is ignored if MiniLlap cluster fails to start > - > > Key: HIVE-11810 > URL: https://issues.apache.org/jira/browse/HIVE-11810 > Project: Hive > Issue Type: Sub-task >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran > Fix For: llap > > Attachments: HIVE-11810.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-11780) Add "set role none" support
[ https://issues.apache.org/jira/browse/HIVE-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14742974#comment-14742974 ] Hive QA commented on HIVE-11780: {color:red}Overall{color}: -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12755645/HIVE-11780.001.patch {color:red}ERROR:{color} -1 due to 3 failed/errored test(s), 9439 tests executed *Failed tests:* {noformat} org.apache.hive.hcatalog.api.TestHCatClient.testTableSchemaPropagation org.apache.hive.hcatalog.streaming.TestStreaming.testRemainingTransactions org.apache.hive.hcatalog.streaming.TestStreaming.testTransactionBatchCommit_Delimited {noformat} Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5268/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5268/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-5268/ Messages: {noformat} Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 3 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12755645 - PreCommit-HIVE-TRUNK-Build > Add "set role none" support > --- > > Key: HIVE-11780 > URL: https://issues.apache.org/jira/browse/HIVE-11780 > Project: Hive > Issue Type: Improvement > Components: Authorization >Affects Versions: 1.3.0, 2.0.0, 1.2.2 >Reporter: Dapeng Sun >Assignee: Dapeng Sun > Fix For: 1.3.0, 2.0.0, 1.2.2 > > Attachments: HIVE-11780.001.patch, HIVE-11780.001.patch > > > HIVE should allow user to disable all roles granted for current session by > the statement {{SET ROLE NONE;}} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Assigned] (HIVE-5623) ORC accessing array column that's empty will fail with java out of bound exception
[ https://issues.apache.org/jira/browse/HIVE-5623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran reassigned HIVE-5623: --- Assignee: Prasanth Jayachandran > ORC accessing array column that's empty will fail with java out of bound > exception > -- > > Key: HIVE-5623 > URL: https://issues.apache.org/jira/browse/HIVE-5623 > Project: Hive > Issue Type: Bug > Components: File Formats >Affects Versions: 0.11.0 >Reporter: Eric Chu >Assignee: Prasanth Jayachandran >Priority: Critical > Labels: orcfile > Attachments: HIVE-5623.patch > > > In our ORC tests we saw that queries that work on RCFile failed on the > corresponding ORC version with Java IndexOutOfBoundsException in > OrcStruct.java. The queries failed b/c the table has an array type column and > there are rows with an empty array. We noticed that the getList(Object list, > int i) method in OrcStruct.java simply returns the i-th element from list > without checking if list is not null or if i is within valid range. After > fixing that the queries run fine. The fix is really simple, but maybe there > are other similar cases that need to be handled. > The fix is to check if listObj is null and if i falls within range: > public Object getListElement(Object listObj, int i) { > if (listObj == null) { > return null; > } > List list = ((List) listObj); > if (i < 0 || i >= list.size()) { > return null; > } > return list.get(i); > } -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-5623) ORC accessing array column that's empty will fail with java out of bound exception
[ https://issues.apache.org/jira/browse/HIVE-5623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-5623: Attachment: HIVE-5623.patch > ORC accessing array column that's empty will fail with java out of bound > exception > -- > > Key: HIVE-5623 > URL: https://issues.apache.org/jira/browse/HIVE-5623 > Project: Hive > Issue Type: Bug > Components: File Formats >Affects Versions: 0.11.0 >Reporter: Eric Chu >Priority: Critical > Labels: orcfile > Attachments: HIVE-5623.patch > > > In our ORC tests we saw that queries that work on RCFile failed on the > corresponding ORC version with Java IndexOutOfBoundsException in > OrcStruct.java. The queries failed b/c the table has an array type column and > there are rows with an empty array. We noticed that the getList(Object list, > int i) method in OrcStruct.java simply returns the i-th element from list > without checking if list is not null or if i is within valid range. After > fixing that the queries run fine. The fix is really simple, but maybe there > are other similar cases that need to be handled. > The fix is to check if listObj is null and if i falls within range: > public Object getListElement(Object listObj, int i) { > if (listObj == null) { > return null; > } > List list = ((List) listObj); > if (i < 0 || i >= list.size()) { > return null; > } > return list.get(i); > } -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-2655) Ability to define functions in HQL
[ https://issues.apache.org/jira/browse/HIVE-2655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14743007#comment-14743007 ] Carl Steinbach commented on HIVE-2655: -- bq. Marking resolved as this was committed in 54ec1cb0d0540edf7946738bc113e90adcc09a6d. Here's the actual commit post migration to Git: {noformat} commit 7f0d6e69ec7aae756d1e7cee034df60b744482ce Author: Edward Capriolo Date: Sat Jun 15 00:59:04 2013 + Submitted by: Brock Noland Jonathon Chang Reviewed by: Edward Capriolo Approved by: Edward Capriolo git-svn-id: https://svn.apache.org/repos/asf/hive/trunk@1493292 13f79535-47bb-0310-9956-ffa450edef68 ql/src/java/org/apache/hadoop/hive/ql/exec/ExprNodeEvaluator.java| 7 ++ ql/src/java/org/apache/hadoop/hive/ql/exec/ExprNodeGenericFuncEvaluator.java | 11 +++ ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionRegistry.java | 35 ++ ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionTask.java | 32 + ql/src/java/org/apache/hadoop/hive/ql/parse/BaseSemanticAnalyzer.java| 31 + ql/src/java/org/apache/hadoop/hive/ql/parse/HiveLexer.g | 1 + ql/src/java/org/apache/hadoop/hive/ql/parse/HiveParser.g | 19 ++ ql/src/java/org/apache/hadoop/hive/ql/parse/MacroSemanticAnalyzer.java | 146 +++ ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java| 2 +- ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzerFactory.java | 5 ++ ql/src/java/org/apache/hadoop/hive/ql/plan/CreateMacroDesc.java | 72 ql/src/java/org/apache/hadoop/hive/ql/plan/DropMacroDesc.java| 48 + ql/src/java/org/apache/hadoop/hive/ql/plan/FunctionWork.java | 18 + ql/src/java/org/apache/hadoop/hive/ql/plan/HiveOperation.java| 2 + ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFMacro.java | 171 ++ ql/src/test/org/apache/hadoop/hive/ql/parse/TestMacroSemanticAnalyzer.java | 133 ql/src/test/org/apache/hadoop/hive/ql/parse/TestSemanticAnalyzerFactory.java | 47 + ql/src/test/org/apache/hadoop/hive/ql/plan/TestCreateMacroDesc.java | 54 +++ ql/src/test/org/apache/hadoop/hive/ql/plan/TestDropMacroDesc.java| 36 ++ ql/src/test/org/apache/hadoop/hive/ql/udf/generic/TestGenericUDFMacro.java | 96 ++ ql/src/test/queries/clientnegative/macro_unused_parameter.q | 1 + ql/src/test/queries/clientpositive/macro.q | 26 +++ ql/src/test/queries/negative/macro_reserved_word.q | 1 + ql/src/test/results/clientnegative/macro_unused_parameter.q.out | 1 + ql/src/test/results/clientpositive/macro.q.out | 472 ++ ql/src/test/results/compiler/errors/macro_reserved_word.q.out| 1 + 26 files changed, 1453 insertions(+), 15 deletions(-) {noformat} > Ability to define functions in HQL > -- > > Key: HIVE-2655 > URL: https://issues.apache.org/jira/browse/HIVE-2655 > Project: Hive > Issue Type: New Feature > Components: SQL >Reporter: Jonathan Perlow >Assignee: Brock Noland > Labels: TODOC12 > Fix For: 0.12.0 > > Attachments: ASF.LICENSE.NOT.GRANTED--HIVE-2655.D915.1.patch, > ASF.LICENSE.NOT.GRANTED--HIVE-2655.D915.2.patch, > ASF.LICENSE.NOT.GRANTED--HIVE-2655.D915.3.patch, > ASF.LICENSE.NOT.GRANTED--HIVE-2655.D915.4.patch, HIVE-2655-10.patch, > HIVE-2655-10.patch, HIVE-2655-9.patch > > > Ability to create functions in HQL as a substitute for creating them in Java. > Jonathan Chang requested I create this issue. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-2655) Ability to define functions in HQL
[ https://issues.apache.org/jira/browse/HIVE-2655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-2655: - Component/s: Macros > Ability to define functions in HQL > -- > > Key: HIVE-2655 > URL: https://issues.apache.org/jira/browse/HIVE-2655 > Project: Hive > Issue Type: New Feature > Components: Macros, SQL >Reporter: Jonathan Perlow >Assignee: Brock Noland > Labels: TODOC12 > Fix For: 0.12.0 > > Attachments: ASF.LICENSE.NOT.GRANTED--HIVE-2655.D915.1.patch, > ASF.LICENSE.NOT.GRANTED--HIVE-2655.D915.2.patch, > ASF.LICENSE.NOT.GRANTED--HIVE-2655.D915.3.patch, > ASF.LICENSE.NOT.GRANTED--HIVE-2655.D915.4.patch, HIVE-2655-10.patch, > HIVE-2655-10.patch, HIVE-2655-9.patch > > > Ability to create functions in HQL as a substitute for creating them in Java. > Jonathan Chang requested I create this issue. -- This message was sent by Atlassian JIRA (v6.3.4#6332)