[jira] [Updated] (HIVE-27842) Backport HIVE-21866: LLAP status service driver may get stuck with wrong Yarn app ID
[ https://issues.apache.org/jira/browse/HIVE-27842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sruthi Mooriyathvariam updated HIVE-27842: -- https://github.com/apache/hive/pull/4848 > Backport HIVE-21866: LLAP status service driver may get stuck with wrong Yarn > app ID > > > Key: HIVE-27842 > URL: https://issues.apache.org/jira/browse/HIVE-27842 > Project: Hive > Issue Type: Sub-task >Reporter: Sruthi Mooriyathvariam >Assignee: Sruthi Mooriyathvariam >Priority: Major > Fix For: 3.2.0 > > > HIVE-21866: LLAP status service driver may get stuck with wrong Yarn app ID > (Adam Szita).This requires backport of HIVE-20807: Refactor > LlapStatusServiceDriver and HIVE-20752: In case of LLAP start failure add > info how to find YARN logs > h1. > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Work started] (HIVE-27842) Backport HIVE-21866: LLAP status service driver may get stuck with wrong Yarn app ID
[ https://issues.apache.org/jira/browse/HIVE-27842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-27842 started by Sruthi Mooriyathvariam. - > Backport HIVE-21866: LLAP status service driver may get stuck with wrong Yarn > app ID > > > Key: HIVE-27842 > URL: https://issues.apache.org/jira/browse/HIVE-27842 > Project: Hive > Issue Type: Sub-task >Reporter: Sruthi Mooriyathvariam >Assignee: Sruthi Mooriyathvariam >Priority: Major > Fix For: 3.2.0 > > > HIVE-21866: LLAP status service driver may get stuck with wrong Yarn app ID > (Adam Szita).This requires backport of HIVE-20807: Refactor > LlapStatusServiceDriver and HIVE-20752: In case of LLAP start failure add > info how to find YARN logs > h1. > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27845) Upgrade protobuf to 3.24.4 to fix CVEs
Akshat Mathur created HIVE-27845: Summary: Upgrade protobuf to 3.24.4 to fix CVEs Key: HIVE-27845 URL: https://issues.apache.org/jira/browse/HIVE-27845 Project: Hive Issue Type: Improvement Reporter: Akshat Mathur Assignee: Akshat Mathur Current protobuf-java(3.21.3) has the following CVE Direct vulnerabilities: [CVE-2022-3510|https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2022-3510] [CVE-2022-3509|https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2022-3509] [CVE-2022-3171|https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2022-3171] Vulnerabilities from dependencies: [CVE-2023-2976|https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2023-2976] [CVE-2020-8908|https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2020-8908] -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27844) Multi destination queries giving error for Not in operators
Diksha created HIVE-27844: - Summary: Multi destination queries giving error for Not in operators Key: HIVE-27844 URL: https://issues.apache.org/jira/browse/HIVE-27844 Project: Hive Issue Type: Bug Reporter: Diksha When a filter operator is added to resolve the Not in bug for when cbo is disabled, multi insert queries like : from t3 b * INSERT OVERWRITE TABLE t4 * select * * where b.age not in * (select a.age * from t3 a * ) * order by age * INSERT OVERWRITE TABLE t5 * select * * where b.age in * (select c.age * from t3 c * ); give a runtime error. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27843) Add QueryOperation to Hive proto logger for post execution hook information
Ramesh Kumar Thangarajan created HIVE-27843: --- Summary: Add QueryOperation to Hive proto logger for post execution hook information Key: HIVE-27843 URL: https://issues.apache.org/jira/browse/HIVE-27843 Project: Hive Issue Type: Task Reporter: Ramesh Kumar Thangarajan Assignee: Ramesh Kumar Thangarajan Currently the query operation type is missing in the proto logger Add QueryOperation to Hive proto logger for post execution hook information -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-22390) Remove Dependency on JODA Time Library
[
https://issues.apache.org/jira/browse/HIVE-22390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HIVE-22390:
--
Labels: pull-request-available (was: )
> Remove Dependency on JODA Time Library
> --
>
> Key: HIVE-22390
> URL: https://issues.apache.org/jira/browse/HIVE-22390
> Project: Hive
> Issue Type: Sub-task
>Reporter: David Mollitor
>Assignee: David Mollitor
>Priority: Major
> Labels: pull-request-available
>
> Hive uses Joda time library.
> {quote}
> Joda-Time is the de facto standard date and time library for Java prior to
> Java SE 8. Users are now asked to migrate to java.time (JSR-310).
> https://www.joda.org/joda-time/
> {quote}
> Remove this dependency from classes, POM files, and licence files.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Updated] (HIVE-21866) LLAP status service driver may get stuck with wrong Yarn app ID
[
https://issues.apache.org/jira/browse/HIVE-21866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HIVE-21866:
--
Labels: pull-request-available (was: )
> LLAP status service driver may get stuck with wrong Yarn app ID
> ---
>
> Key: HIVE-21866
> URL: https://issues.apache.org/jira/browse/HIVE-21866
> Project: Hive
> Issue Type: Bug
>Reporter: Ádám Szita
>Assignee: Ádám Szita
>Priority: Major
> Labels: pull-request-available
> Fix For: 4.0.0-alpha-1
>
> Attachments: HIVE-21866.0.patch
>
>
> LLAPStatusDriver might get stuck polling status from Yarn if the following
> happen in this order:
> * there was a running LLAP Yarn app previously which is now finished / killed
> * Yarn was restarted
> * LLAPStatusDriver is invoked before any new LLAP app gets kicked off
> * LLAPStatusDriver receives the old app ID, which is then cached in the Yarn
> serviceClient object (no evicition)
> * In the meantime if any new LLAP app gets kicked off, LLAPStatusDriver will
> not see it, as it constantly retries fetching info about the wrong, old app
> ID (this is because we don't create new serviceClient objects)
> {code:java}
> ERROR status.LlapStatusServiceDriver: FAILED: 20: Failed to get Yarn AppReport
> org.apache.hadoop.hive.llap.cli.status.LlapStatusCliException: 20: Failed to
> get Yarn AppReport
> at
> org.apache.hadoop.hive.llap.cli.status.LlapStatusServiceDriver.getAppReport(LlapStatusServiceDriver.java:292)
> [hive-llap-server-3.1.0.7.0.0.0-112.jar:3.1.0.7.0.0.0-134]
> at
> org.apache.hadoop.hive.llap.cli.status.LlapStatusServiceDriver.run(LlapStatusServiceDriver.java:209)
> [hive-llap-server-3.1.0.7.0.0.0-112.jar:3.1.0.7.0.0.0-134]
> at
> org.apache.hadoop.hive.llap.cli.status.LlapStatusServiceDriver.main(LlapStatusServiceDriver.java:537)
> [hive-llap-server-3.1.0.7.0.0.0-112.jar:3.1.0.7.0.0.0-134]{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Assigned] (HIVE-27842) Backport HIVE-21866: LLAP status service driver may get stuck with wrong Yarn app ID
[ https://issues.apache.org/jira/browse/HIVE-27842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sruthi Mooriyathvariam reassigned HIVE-27842: - Assignee: Sruthi Mooriyathvariam > Backport HIVE-21866: LLAP status service driver may get stuck with wrong Yarn > app ID > > > Key: HIVE-27842 > URL: https://issues.apache.org/jira/browse/HIVE-27842 > Project: Hive > Issue Type: Sub-task >Reporter: Sruthi Mooriyathvariam >Assignee: Sruthi Mooriyathvariam >Priority: Major > Fix For: 3.2.0 > > > HIVE-21866: LLAP status service driver may get stuck with wrong Yarn app ID > (Adam Szita).This requires backport of HIVE-20807: Refactor > LlapStatusServiceDriver and HIVE-20752: In case of LLAP start failure add > info how to find YARN logs > h1. > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27842) Backport HIVE-21866: LLAP status service driver may get stuck with wrong Yarn app ID
Sruthi Mooriyathvariam created HIVE-27842: - Summary: Backport HIVE-21866: LLAP status service driver may get stuck with wrong Yarn app ID Key: HIVE-27842 URL: https://issues.apache.org/jira/browse/HIVE-27842 Project: Hive Issue Type: Sub-task Reporter: Sruthi Mooriyathvariam Fix For: 3.2.0 HIVE-21866: LLAP status service driver may get stuck with wrong Yarn app ID (Adam Szita).This requires backport of HIVE-20807: Refactor LlapStatusServiceDriver and HIVE-20752: In case of LLAP start failure add info how to find YARN logs h1. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-27841) Backport of HIVE-21862: ORC ppd produces wrong result with timestamp
[ https://issues.apache.org/jira/browse/HIVE-27841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-27841: -- Labels: pull-request-available (was: ) > Backport of HIVE-21862: ORC ppd produces wrong result with timestamp > > > Key: HIVE-27841 > URL: https://issues.apache.org/jira/browse/HIVE-27841 > Project: Hive > Issue Type: Sub-task >Reporter: Shefali Singh >Assignee: Shefali Singh >Priority: Major > Labels: pull-request-available > Fix For: 3.2.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (HIVE-27841) Backport of HIVE-21862: ORC ppd produces wrong result with timestamp
[ https://issues.apache.org/jira/browse/HIVE-27841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shefali Singh reassigned HIVE-27841: Assignee: Shefali Singh > Backport of HIVE-21862: ORC ppd produces wrong result with timestamp > > > Key: HIVE-27841 > URL: https://issues.apache.org/jira/browse/HIVE-27841 > Project: Hive > Issue Type: Sub-task >Reporter: Shefali Singh >Assignee: Shefali Singh >Priority: Major > Fix For: 3.2.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27841) Backport of HIVE-21862: ORC ppd produces wrong result with timestamp
Shefali Singh created HIVE-27841: Summary: Backport of HIVE-21862: ORC ppd produces wrong result with timestamp Key: HIVE-27841 URL: https://issues.apache.org/jira/browse/HIVE-27841 Project: Hive Issue Type: Sub-task Reporter: Shefali Singh Fix For: 3.2.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-27840) Backport of HIVE-21729: Arrow serializer sometimes shifts timestamp by one second
[ https://issues.apache.org/jira/browse/HIVE-27840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-27840: -- Labels: pull-request-available (was: ) > Backport of HIVE-21729: Arrow serializer sometimes shifts timestamp by one > second > - > > Key: HIVE-27840 > URL: https://issues.apache.org/jira/browse/HIVE-27840 > Project: Hive > Issue Type: Sub-task >Reporter: Shefali Singh >Assignee: Shefali Singh >Priority: Major > Labels: pull-request-available > Fix For: 3.2.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27840) Backport of HIVE-21729: Arrow serializer sometimes shifts timestamp by one second
Shefali Singh created HIVE-27840: Summary: Backport of HIVE-21729: Arrow serializer sometimes shifts timestamp by one second Key: HIVE-27840 URL: https://issues.apache.org/jira/browse/HIVE-27840 Project: Hive Issue Type: Sub-task Reporter: Shefali Singh Fix For: 3.2.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (HIVE-27840) Backport of HIVE-21729: Arrow serializer sometimes shifts timestamp by one second
[ https://issues.apache.org/jira/browse/HIVE-27840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shefali Singh reassigned HIVE-27840: Assignee: Shefali Singh > Backport of HIVE-21729: Arrow serializer sometimes shifts timestamp by one > second > - > > Key: HIVE-27840 > URL: https://issues.apache.org/jira/browse/HIVE-27840 > Project: Hive > Issue Type: Sub-task >Reporter: Shefali Singh >Assignee: Shefali Singh >Priority: Major > Fix For: 3.2.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-27839) Backport of HIVE-20437: Handle schema evolution from Float, Double and Decimal.
[ https://issues.apache.org/jira/browse/HIVE-27839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-27839: -- Labels: pull-request-available (was: ) > Backport of HIVE-20437: Handle schema evolution from Float, Double and > Decimal. > --- > > Key: HIVE-27839 > URL: https://issues.apache.org/jira/browse/HIVE-27839 > Project: Hive > Issue Type: Sub-task >Reporter: Shefali Singh >Assignee: Shefali Singh >Priority: Major > Labels: pull-request-available > Fix For: 3.2.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27839) Backport of HIVE-20437: Handle schema evolution from Float, Double and Decimal.
Shefali Singh created HIVE-27839: Summary: Backport of HIVE-20437: Handle schema evolution from Float, Double and Decimal. Key: HIVE-27839 URL: https://issues.apache.org/jira/browse/HIVE-27839 Project: Hive Issue Type: Sub-task Reporter: Shefali Singh Fix For: 3.2.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (HIVE-27839) Backport of HIVE-20437: Handle schema evolution from Float, Double and Decimal.
[ https://issues.apache.org/jira/browse/HIVE-27839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shefali Singh reassigned HIVE-27839: Assignee: Shefali Singh > Backport of HIVE-20437: Handle schema evolution from Float, Double and > Decimal. > --- > > Key: HIVE-27839 > URL: https://issues.apache.org/jira/browse/HIVE-27839 > Project: Hive > Issue Type: Sub-task >Reporter: Shefali Singh >Assignee: Shefali Singh >Priority: Major > Fix For: 3.2.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Comment Edited] (HIVE-27835) java.lang.NoClassDefFoundError: net/jpountz/lz4/LZ4Factory for DruidStorageHandler
[
https://issues.apache.org/jira/browse/HIVE-27835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17781745#comment-17781745
]
Basapuram Kumar edited comment on HIVE-27835 at 11/1/23 2:17 PM:
-
Adding the {color:#00875a}lz4-java-1.7.1.jar{color} into the
{color:#0747a6}HIVE_AUX_JARS_PATH{color} from {color:#0747a6}hive-env{color}
would help to fix this issue/
{code:java}
export
HIVE_AUX_JARS_PATH=${HIVE_AUX_JARS_PATH}:/usr/odp/3.2.2.0-1/hive/lib/lz4-java-1.7.1.jar
{code}
Followed by restart the hive.
And from beeline, we see that this change got reflected.
{code:java}
0: jdbc:hive2://odp01.ubuntu.ad.ce:2181,odp02> set hive.aux.jars.path;
++
| set |
++
|
hive.aux.jars.path=file:///usr/odp/current/hive-webhcat/share/hcatalog/hive-hcatalog-core.jar,file:///usr/odp/3.2.2.0-1/hive/lib/lz4-java-1.7.1.jar
| {code}
was (Author: JIRAUSER295887):
Adding the {color:#00875a}lz4-java-1.7.1.jar{color} into the
{color:#0747a6}HIVE_AUX_JARS_PATH{color} from {color:#0747a6}hive-env{color}
would help to fix this issue/
{code:java}
export
HIVE_AUX_JARS_PATH=${HIVE_AUX_JARS_PATH}:/usr/odp/3.2.2.0-1/hive/lib/lz4-java-1.7.1.jar
{code}
> java.lang.NoClassDefFoundError: net/jpountz/lz4/LZ4Factory for
> DruidStorageHandler
> --
>
> Key: HIVE-27835
> URL: https://issues.apache.org/jira/browse/HIVE-27835
> Project: Hive
> Issue Type: Task
> Components: Hive
>Affects Versions: 4.0.0-alpha-1
> Environment: hive-4-alpha-1
> Druid-27.0.0
>Reporter: Basapuram Kumar
>Assignee: Basapuram Kumar
>Priority: Major
>
> Hello Team,
> I am trying to use Druid storage handler to create a table.
> Steps to repro
> Create table
>
> {code:java}
> CREATE TABLE emp_zlib_3110_2038 (
> `__time` TIMESTAMP,
> id int,
> name string,
> age int,
> gender string)
> STORED AS ORC
> TBLPROPERTIES ('transactional'='true',"orc.compress"="ZLIB");
> {code}
> insert data
> {code:java}
> insert into emp_zlib_3110_2038 values(CURRENT_TIMESTAMP(),10,'basa',30,'M');
> {code}
> Create a DruidStorageHandler table
> {code:java}
> CREATE TABLE druid_hive_table_3110_2038_02
> STORED BY 'org.apache.hadoop.hive.druid.DruidStorageHandler'
> TBLPROPERTIES ("druid.datasource" = "druid_hive_table_3110_2038_02")
> AS
> select `__time`, id,name,age,gender from emp_zlib_3110_2038 ; {code}
> Error:
> {code:java}
> INFO : Status: Running (Executing on YARN cluster with App id
> application_1698753624381_0021)
> --
>
> VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED
> KILLED
> --
> Map 1 .. container SUCCEEDED 1 1 0 0
> 0 0
> Reducer 2 ... container RUNNING 2 1 0 1
> 4 0
> --
> VERTICES: 01/02 [=>>-] 66% ELAPSED TIME: 37.91 s
> --
> ERROR : Status: FailedERROR : Vertex failed, vertexName=Reducer 2,
> vertexId=vertex_1698753624381_0021_3_01, diagnostics=[Task failed,
> taskId=task_1698753624381_0021_3_01_00, diagnostics=[TaskAttempt 0
> failed, info=[Error: Error while running task ( failure ) :
> attempt_1698753624381_0021_3_01_00_0:java.lang.RuntimeException:
> java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:
> Hive Runtime Error while processing row
> at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:348)
>
> at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:276)
> at
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:381)
>
> at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:82)
>
> at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69)
>
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1762)
>
> at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:69)
>
> at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:39)
>
[jira] (HIVE-27835) java.lang.NoClassDefFoundError: net/jpountz/lz4/LZ4Factory for DruidStorageHandler
[ https://issues.apache.org/jira/browse/HIVE-27835 ]
Basapuram Kumar deleted comment on HIVE-27835:
was (Author: JIRAUSER295887):
Adding the {color:#00875a}lz4-java-1.7.1.jar{color} into the
{color:#0747a6}HIVE_AUX_JARS_PATH{color} from {color:#0747a6}hive-env{color}
would help to fix this issue/
{code:java}
export
HIVE_AUX_JARS_PATH=${HIVE_AUX_JARS_PATH}:/usr/odp/3.2.2.0-1/hive/lib/lz4-java-1.7.1.jar
{code}
> java.lang.NoClassDefFoundError: net/jpountz/lz4/LZ4Factory for
> DruidStorageHandler
> --
>
> Key: HIVE-27835
> URL: https://issues.apache.org/jira/browse/HIVE-27835
> Project: Hive
> Issue Type: Task
> Components: Hive
>Affects Versions: 4.0.0-alpha-1
> Environment: hive-4-alpha-1
> Druid-27.0.0
>Reporter: Basapuram Kumar
>Assignee: Basapuram Kumar
>Priority: Major
>
> Hello Team,
> I am trying to use Druid storage handler to create a table.
> Steps to repro
> Create table
>
> {code:java}
> CREATE TABLE emp_zlib_3110_2038 (
> `__time` TIMESTAMP,
> id int,
> name string,
> age int,
> gender string)
> STORED AS ORC
> TBLPROPERTIES ('transactional'='true',"orc.compress"="ZLIB");
> {code}
> insert data
> {code:java}
> insert into emp_zlib_3110_2038 values(CURRENT_TIMESTAMP(),10,'basa',30,'M');
> {code}
> Create a DruidStorageHandler table
> {code:java}
> CREATE TABLE druid_hive_table_3110_2038_02
> STORED BY 'org.apache.hadoop.hive.druid.DruidStorageHandler'
> TBLPROPERTIES ("druid.datasource" = "druid_hive_table_3110_2038_02")
> AS
> select `__time`, id,name,age,gender from emp_zlib_3110_2038 ; {code}
> Error:
> {code:java}
> INFO : Status: Running (Executing on YARN cluster with App id
> application_1698753624381_0021)
> --
>
> VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED
> KILLED
> --
> Map 1 .. container SUCCEEDED 1 1 0 0
> 0 0
> Reducer 2 ... container RUNNING 2 1 0 1
> 4 0
> --
> VERTICES: 01/02 [=>>-] 66% ELAPSED TIME: 37.91 s
> --
> ERROR : Status: FailedERROR : Vertex failed, vertexName=Reducer 2,
> vertexId=vertex_1698753624381_0021_3_01, diagnostics=[Task failed,
> taskId=task_1698753624381_0021_3_01_00, diagnostics=[TaskAttempt 0
> failed, info=[Error: Error while running task ( failure ) :
> attempt_1698753624381_0021_3_01_00_0:java.lang.RuntimeException:
> java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:
> Hive Runtime Error while processing row
> at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:348)
>
> at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:276)
> at
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:381)
>
> at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:82)
>
> at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69)
>
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1762)
>
> at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:69)
>
> at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:39)
>
> at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
> at
> com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
>
> at
> com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
>
> at
> com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
>
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>
> at java.lang.Thread.run(Thread.java:750)Caused by:
> java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:
> Hive Runtime Error while processing row
> at
>
[jira] [Resolved] (HIVE-27835) java.lang.NoClassDefFoundError: net/jpountz/lz4/LZ4Factory for DruidStorageHandler
[
https://issues.apache.org/jira/browse/HIVE-27835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Basapuram Kumar resolved HIVE-27835.
Resolution: Workaround
Adding the {color:#00875a}lz4-java-1.7.1.jar{color} into the
{color:#0747a6}HIVE_AUX_JARS_PATH{color} from {color:#0747a6}hive-env{color}
would help to fix this issue/
{code:java}
export
HIVE_AUX_JARS_PATH=${HIVE_AUX_JARS_PATH}:/usr/odp/3.2.2.0-1/hive/lib/lz4-java-1.7.1.jar
{code}
> java.lang.NoClassDefFoundError: net/jpountz/lz4/LZ4Factory for
> DruidStorageHandler
> --
>
> Key: HIVE-27835
> URL: https://issues.apache.org/jira/browse/HIVE-27835
> Project: Hive
> Issue Type: Task
> Components: Hive
>Affects Versions: 4.0.0-alpha-1
> Environment: hive-4-alpha-1
> Druid-27.0.0
>Reporter: Basapuram Kumar
>Assignee: Basapuram Kumar
>Priority: Major
>
> Hello Team,
> I am trying to use Druid storage handler to create a table.
> Steps to repro
> Create table
>
> {code:java}
> CREATE TABLE emp_zlib_3110_2038 (
> `__time` TIMESTAMP,
> id int,
> name string,
> age int,
> gender string)
> STORED AS ORC
> TBLPROPERTIES ('transactional'='true',"orc.compress"="ZLIB");
> {code}
> insert data
> {code:java}
> insert into emp_zlib_3110_2038 values(CURRENT_TIMESTAMP(),10,'basa',30,'M');
> {code}
> Create a DruidStorageHandler table
> {code:java}
> CREATE TABLE druid_hive_table_3110_2038_02
> STORED BY 'org.apache.hadoop.hive.druid.DruidStorageHandler'
> TBLPROPERTIES ("druid.datasource" = "druid_hive_table_3110_2038_02")
> AS
> select `__time`, id,name,age,gender from emp_zlib_3110_2038 ; {code}
> Error:
> {code:java}
> INFO : Status: Running (Executing on YARN cluster with App id
> application_1698753624381_0021)
> --
>
> VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED
> KILLED
> --
> Map 1 .. container SUCCEEDED 1 1 0 0
> 0 0
> Reducer 2 ... container RUNNING 2 1 0 1
> 4 0
> --
> VERTICES: 01/02 [=>>-] 66% ELAPSED TIME: 37.91 s
> --
> ERROR : Status: FailedERROR : Vertex failed, vertexName=Reducer 2,
> vertexId=vertex_1698753624381_0021_3_01, diagnostics=[Task failed,
> taskId=task_1698753624381_0021_3_01_00, diagnostics=[TaskAttempt 0
> failed, info=[Error: Error while running task ( failure ) :
> attempt_1698753624381_0021_3_01_00_0:java.lang.RuntimeException:
> java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:
> Hive Runtime Error while processing row
> at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:348)
>
> at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:276)
> at
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:381)
>
> at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:82)
>
> at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69)
>
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1762)
>
> at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:69)
>
> at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:39)
>
> at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
> at
> com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
>
> at
> com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
>
> at
> com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
>
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>
> at java.lang.Thread.run(Thread.java:750)Caused by:
> java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:
> Hive Runtime Error while processing row
> at
>
[jira] [Assigned] (HIVE-27835) java.lang.NoClassDefFoundError: net/jpountz/lz4/LZ4Factory for DruidStorageHandler
[
https://issues.apache.org/jira/browse/HIVE-27835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Basapuram Kumar reassigned HIVE-27835:
--
Assignee: Basapuram Kumar
> java.lang.NoClassDefFoundError: net/jpountz/lz4/LZ4Factory for
> DruidStorageHandler
> --
>
> Key: HIVE-27835
> URL: https://issues.apache.org/jira/browse/HIVE-27835
> Project: Hive
> Issue Type: Task
> Components: Hive
>Affects Versions: 4.0.0-alpha-1
> Environment: hive-4-alpha-1
> Druid-27.0.0
>Reporter: Basapuram Kumar
>Assignee: Basapuram Kumar
>Priority: Major
>
> Hello Team,
> I am trying to use Druid storage handler to create a table.
> Steps to repro
> Create table
>
> {code:java}
> CREATE TABLE emp_zlib_3110_2038 (
> `__time` TIMESTAMP,
> id int,
> name string,
> age int,
> gender string)
> STORED AS ORC
> TBLPROPERTIES ('transactional'='true',"orc.compress"="ZLIB");
> {code}
> insert data
> {code:java}
> insert into emp_zlib_3110_2038 values(CURRENT_TIMESTAMP(),10,'basa',30,'M');
> {code}
> Create a DruidStorageHandler table
> {code:java}
> CREATE TABLE druid_hive_table_3110_2038_02
> STORED BY 'org.apache.hadoop.hive.druid.DruidStorageHandler'
> TBLPROPERTIES ("druid.datasource" = "druid_hive_table_3110_2038_02")
> AS
> select `__time`, id,name,age,gender from emp_zlib_3110_2038 ; {code}
> Error:
> {code:java}
> INFO : Status: Running (Executing on YARN cluster with App id
> application_1698753624381_0021)
> --
>
> VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED
> KILLED
> --
> Map 1 .. container SUCCEEDED 1 1 0 0
> 0 0
> Reducer 2 ... container RUNNING 2 1 0 1
> 4 0
> --
> VERTICES: 01/02 [=>>-] 66% ELAPSED TIME: 37.91 s
> --
> ERROR : Status: FailedERROR : Vertex failed, vertexName=Reducer 2,
> vertexId=vertex_1698753624381_0021_3_01, diagnostics=[Task failed,
> taskId=task_1698753624381_0021_3_01_00, diagnostics=[TaskAttempt 0
> failed, info=[Error: Error while running task ( failure ) :
> attempt_1698753624381_0021_3_01_00_0:java.lang.RuntimeException:
> java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:
> Hive Runtime Error while processing row
> at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:348)
>
> at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:276)
> at
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:381)
>
> at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:82)
>
> at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69)
>
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1762)
>
> at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:69)
>
> at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:39)
>
> at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
> at
> com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
>
> at
> com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
>
> at
> com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
>
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>
> at java.lang.Thread.run(Thread.java:750)Caused by:
> java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:
> Hive Runtime Error while processing row
> at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:311)
>
> at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:291)
>
> at
>
[jira] [Commented] (HIVE-27835) java.lang.NoClassDefFoundError: net/jpountz/lz4/LZ4Factory for DruidStorageHandler
[
https://issues.apache.org/jira/browse/HIVE-27835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17781744#comment-17781744
]
Basapuram Kumar commented on HIVE-27835:
Adding the {color:#00875a}lz4-java-1.7.1.jar{color} into the
{color:#0747a6}HIVE_AUX_JARS_PATH{color} from {color:#0747a6}hive-env{color}
would help to fix this issue/
{code:java}
export
HIVE_AUX_JARS_PATH=${HIVE_AUX_JARS_PATH}:/usr/odp/3.2.2.0-1/hive/lib/lz4-java-1.7.1.jar
{code}
> java.lang.NoClassDefFoundError: net/jpountz/lz4/LZ4Factory for
> DruidStorageHandler
> --
>
> Key: HIVE-27835
> URL: https://issues.apache.org/jira/browse/HIVE-27835
> Project: Hive
> Issue Type: Task
> Components: Hive
>Affects Versions: 4.0.0-alpha-1
> Environment: hive-4-alpha-1
> Druid-27.0.0
>Reporter: Basapuram Kumar
>Priority: Major
>
> Hello Team,
> I am trying to use Druid storage handler to create a table.
> Steps to repro
> Create table
>
> {code:java}
> CREATE TABLE emp_zlib_3110_2038 (
> `__time` TIMESTAMP,
> id int,
> name string,
> age int,
> gender string)
> STORED AS ORC
> TBLPROPERTIES ('transactional'='true',"orc.compress"="ZLIB");
> {code}
> insert data
> {code:java}
> insert into emp_zlib_3110_2038 values(CURRENT_TIMESTAMP(),10,'basa',30,'M');
> {code}
> Create a DruidStorageHandler table
> {code:java}
> CREATE TABLE druid_hive_table_3110_2038_02
> STORED BY 'org.apache.hadoop.hive.druid.DruidStorageHandler'
> TBLPROPERTIES ("druid.datasource" = "druid_hive_table_3110_2038_02")
> AS
> select `__time`, id,name,age,gender from emp_zlib_3110_2038 ; {code}
> Error:
> {code:java}
> INFO : Status: Running (Executing on YARN cluster with App id
> application_1698753624381_0021)
> --
>
> VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED
> KILLED
> --
> Map 1 .. container SUCCEEDED 1 1 0 0
> 0 0
> Reducer 2 ... container RUNNING 2 1 0 1
> 4 0
> --
> VERTICES: 01/02 [=>>-] 66% ELAPSED TIME: 37.91 s
> --
> ERROR : Status: FailedERROR : Vertex failed, vertexName=Reducer 2,
> vertexId=vertex_1698753624381_0021_3_01, diagnostics=[Task failed,
> taskId=task_1698753624381_0021_3_01_00, diagnostics=[TaskAttempt 0
> failed, info=[Error: Error while running task ( failure ) :
> attempt_1698753624381_0021_3_01_00_0:java.lang.RuntimeException:
> java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:
> Hive Runtime Error while processing row
> at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:348)
>
> at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:276)
> at
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:381)
>
> at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:82)
>
> at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69)
>
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1762)
>
> at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:69)
>
> at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:39)
>
> at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
> at
> com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
>
> at
> com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
>
> at
> com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
>
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>
> at java.lang.Thread.run(Thread.java:750)Caused by:
> java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:
> Hive Runtime Error while processing row
> at
>
[jira] [Commented] (HIVE-27161) MetaException when executing CTAS query in Druid storage handler
[
https://issues.apache.org/jira/browse/HIVE-27161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17781743#comment-17781743
]
Basapuram Kumar commented on HIVE-27161:
I am facing this issue in hive-4.0.0-alpha-1 too.
Here are the steps to repro.
{code:java}
1.
CREATE TABLE emp_zlib_3110_2038 (
`__time` TIMESTAMP,
id int,
name string,
age int,
gender string)
STORED AS ORC
TBLPROPERTIES ('transactional'='true',"orc.compress"="ZLIB");
2.
insert into emp_zlib_3110_2038 values(CURRENT_TIMESTAMP(),10,'basa',30,'M');
3.
CREATE EXTERNAL TABLE druid_table_0111
STORED BY 'org.apache.hadoop.hive.druid.DruidStorageHandler'
TBLPROPERTIES ("druid.datasource" =
"basa_druid_table_01112023","orc.compress"="ZLIB")
AS
select `__time`, id,name,age,gender from emp_zlib_3110_2038;
{code}
Error as follwed.
{code:java}
INFO : Status: Running (Executing on YARN cluster with App id
application_1698753624381_0028)
--
VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING
FAILED KILLED
--
Map 1 .. container SUCCEEDED 1 1 0 0
0 0
Reducer 2 .. container SUCCEEDED 2 2 0 0
0 0
--
VERTICES: 02/02 [==>>] 100% ELAPSED TIME: 18.13 s
--
INFO : Starting task [Stage-4:DDL] in serial modeERROR :
Failedorg.apache.hadoop.hive.ql.metadata.HiveException:
MetaException(message:LOCATION may not be specified for Druid)
at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:1313)
~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:1318)
~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at
org.apache.hadoop.hive.ql.ddl.table.create.CreateTableOperation.createTableNonReplaceMode(CreateTableOperation.java:140)
~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at
org.apache.hadoop.hive.ql.ddl.table.create.CreateTableOperation.execute(CreateTableOperation.java:98)
~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at org.apache.hadoop.hive.ql.ddl.DDLTask.execute(DDLTask.java:84)
~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:212)
~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:105)
~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at org.apache.hadoop.hive.ql.Executor.launchTask(Executor.java:361)
~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at org.apache.hadoop.hive.ql.Executor.launchTasks(Executor.java:334)
~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at org.apache.hadoop.hive.ql.Executor.runTasks(Executor.java:245)
~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at org.apache.hadoop.hive.ql.Executor.execute(Executor.java:106)
~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:348)
~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:204)
~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:153)
~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:148)
~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:185)
~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at
org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:233)
~[hive-service-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at
org.apache.hive.service.cli.operation.SQLOperation.access$500(SQLOperation.java:88)
~[hive-service-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at
org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork$1.run(SQLOperation.java:336)
~[hive-service-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_382]
at javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_382]
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1762)
~[hadoop-common-3.2.3.3.2.2.0-1.jar:?]
at
org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork.run(SQLOperation.java:356)
~[hive-service-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
~[?:1.8.0_382]
at
[jira] [Comment Edited] (HIVE-27161) MetaException when executing CTAS query in Druid storage handler
[
https://issues.apache.org/jira/browse/HIVE-27161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17781743#comment-17781743
]
Basapuram Kumar edited comment on HIVE-27161 at 11/1/23 2:07 PM:
-
I am facing this issue in hive-4.0.0-alpha-1 too.
Here are the steps to repro.
{code:java}
1.
CREATE TABLE emp_zlib_3110_2038 (
`__time` TIMESTAMP,
id int,
name string,
age int,
gender string)
STORED AS ORC
TBLPROPERTIES ('transactional'='true',"orc.compress"="ZLIB");
2.
insert into emp_zlib_3110_2038 values(CURRENT_TIMESTAMP(),10,'basa',30,'M');
3.
CREATE EXTERNAL TABLE druid_table_0111
STORED BY 'org.apache.hadoop.hive.druid.DruidStorageHandler'
TBLPROPERTIES ("druid.datasource" =
"basa_druid_table_01112023","orc.compress"="ZLIB")
AS
select `__time`, id,name,age,gender from emp_zlib_3110_2038;
{code}
Error as followed.
{code:java}
INFO : Status: Running (Executing on YARN cluster with App id
application_1698753624381_0028)
--
VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING
FAILED KILLED
--
Map 1 .. container SUCCEEDED 1 1 0 0
0 0
Reducer 2 .. container SUCCEEDED 2 2 0 0
0 0
--
VERTICES: 02/02 [==>>] 100% ELAPSED TIME: 18.13 s
--
INFO : Starting task [Stage-4:DDL] in serial modeERROR :
Failedorg.apache.hadoop.hive.ql.metadata.HiveException:
MetaException(message:LOCATION may not be specified for Druid)
at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:1313)
~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:1318)
~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at
org.apache.hadoop.hive.ql.ddl.table.create.CreateTableOperation.createTableNonReplaceMode(CreateTableOperation.java:140)
~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at
org.apache.hadoop.hive.ql.ddl.table.create.CreateTableOperation.execute(CreateTableOperation.java:98)
~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at org.apache.hadoop.hive.ql.ddl.DDLTask.execute(DDLTask.java:84)
~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:212)
~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:105)
~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at org.apache.hadoop.hive.ql.Executor.launchTask(Executor.java:361)
~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at org.apache.hadoop.hive.ql.Executor.launchTasks(Executor.java:334)
~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at org.apache.hadoop.hive.ql.Executor.runTasks(Executor.java:245)
~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at org.apache.hadoop.hive.ql.Executor.execute(Executor.java:106)
~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:348)
~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:204)
~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:153)
~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:148)
~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:185)
~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at
org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:233)
~[hive-service-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at
org.apache.hive.service.cli.operation.SQLOperation.access$500(SQLOperation.java:88)
~[hive-service-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at
org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork$1.run(SQLOperation.java:336)
~[hive-service-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_382]
at javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_382]
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1762)
~[hadoop-common-3.2.3.3.2.2.0-1.jar:?]
at
org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork.run(SQLOperation.java:356)
~[hive-service-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
~[?:1.8.0_382]
[jira] [Updated] (HIVE-27838) Backport of HIVE-22840: Race condition in formatters of TimestampColumnVector and DateColumnVector
[ https://issues.apache.org/jira/browse/HIVE-27838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-27838: -- Labels: pull-request-available (was: ) > Backport of HIVE-22840: Race condition in formatters of TimestampColumnVector > and DateColumnVector > -- > > Key: HIVE-27838 > URL: https://issues.apache.org/jira/browse/HIVE-27838 > Project: Hive > Issue Type: Sub-task >Reporter: Shefali Singh >Assignee: Shefali Singh >Priority: Major > Labels: pull-request-available > Fix For: 3.2.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (HIVE-27838) Backport of HIVE-22840: Race condition in formatters of TimestampColumnVector and DateColumnVector
[ https://issues.apache.org/jira/browse/HIVE-27838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shefali Singh reassigned HIVE-27838: Assignee: Shefali Singh > Backport of HIVE-22840: Race condition in formatters of TimestampColumnVector > and DateColumnVector > -- > > Key: HIVE-27838 > URL: https://issues.apache.org/jira/browse/HIVE-27838 > Project: Hive > Issue Type: Sub-task >Reporter: Shefali Singh >Assignee: Shefali Singh >Priority: Major > Fix For: 3.2.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27838) Backport of HIVE-22840: Race condition in formatters of TimestampColumnVector and DateColumnVector
Shefali Singh created HIVE-27838: Summary: Backport of HIVE-22840: Race condition in formatters of TimestampColumnVector and DateColumnVector Key: HIVE-27838 URL: https://issues.apache.org/jira/browse/HIVE-27838 Project: Hive Issue Type: Sub-task Reporter: Shefali Singh Fix For: 3.2.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-27837) Backport of HIVE-25093 and HIVE-25268
[ https://issues.apache.org/jira/browse/HIVE-27837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shefali Singh updated HIVE-27837: - Summary: Backport of HIVE-25093 and HIVE-25268 (was: Backport of HIVE-25093: date_format() UDF is returning output in UTC time zone only) > Backport of HIVE-25093 and HIVE-25268 > - > > Key: HIVE-27837 > URL: https://issues.apache.org/jira/browse/HIVE-27837 > Project: Hive > Issue Type: Sub-task >Reporter: Shefali Singh >Assignee: Shefali Singh >Priority: Major > Labels: pull-request-available > Fix For: 3.2.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-27837) Backport of HIVE-25093: date_format() UDF is returning output in UTC time zone only
[ https://issues.apache.org/jira/browse/HIVE-27837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-27837: -- Labels: pull-request-available (was: ) > Backport of HIVE-25093: date_format() UDF is returning output in UTC time > zone only > --- > > Key: HIVE-27837 > URL: https://issues.apache.org/jira/browse/HIVE-27837 > Project: Hive > Issue Type: Sub-task >Reporter: Shefali Singh >Assignee: Shefali Singh >Priority: Major > Labels: pull-request-available > Fix For: 3.2.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (HIVE-27837) Backport of HIVE-25093: date_format() UDF is returning output in UTC time zone only
[ https://issues.apache.org/jira/browse/HIVE-27837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shefali Singh reassigned HIVE-27837: Assignee: Shefali Singh > Backport of HIVE-25093: date_format() UDF is returning output in UTC time > zone only > --- > > Key: HIVE-27837 > URL: https://issues.apache.org/jira/browse/HIVE-27837 > Project: Hive > Issue Type: Sub-task >Reporter: Shefali Singh >Assignee: Shefali Singh >Priority: Major > Fix For: 3.2.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27837) Backport of HIVE-25093: date_format() UDF is returning output in UTC time zone only
Shefali Singh created HIVE-27837: Summary: Backport of HIVE-25093: date_format() UDF is returning output in UTC time zone only Key: HIVE-27837 URL: https://issues.apache.org/jira/browse/HIVE-27837 Project: Hive Issue Type: Sub-task Reporter: Shefali Singh Fix For: 3.2.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-27836) Backport HIVE-25250: Fix TestHS2ImpersonationWithRemoteMS.testImpersonation
[ https://issues.apache.org/jira/browse/HIVE-27836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-27836: -- Labels: pull-request-available (was: ) > Backport HIVE-25250: Fix TestHS2ImpersonationWithRemoteMS.testImpersonation > --- > > Key: HIVE-27836 > URL: https://issues.apache.org/jira/browse/HIVE-27836 > Project: Hive > Issue Type: Sub-task >Reporter: Shefali Singh >Assignee: Shefali Singh >Priority: Major > Labels: pull-request-available > Fix For: 3.2.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (HIVE-27836) Backport HIVE-25250: Fix TestHS2ImpersonationWithRemoteMS.testImpersonation
[ https://issues.apache.org/jira/browse/HIVE-27836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shefali Singh reassigned HIVE-27836: Assignee: Shefali Singh > Backport HIVE-25250: Fix TestHS2ImpersonationWithRemoteMS.testImpersonation > --- > > Key: HIVE-27836 > URL: https://issues.apache.org/jira/browse/HIVE-27836 > Project: Hive > Issue Type: Sub-task >Reporter: Shefali Singh >Assignee: Shefali Singh >Priority: Major > Fix For: 3.2.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27836) Backport HIVE-25250: Fix TestHS2ImpersonationWithRemoteMS.testImpersonation
Shefali Singh created HIVE-27836: Summary: Backport HIVE-25250: Fix TestHS2ImpersonationWithRemoteMS.testImpersonation Key: HIVE-27836 URL: https://issues.apache.org/jira/browse/HIVE-27836 Project: Hive Issue Type: Sub-task Reporter: Shefali Singh Fix For: 3.2.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
