[jira] [Comment Edited] (HIVE-27858) OOM happens when selecting many columns and JOIN.

2024-02-20 Thread Ryu Kobayashi (Jira)


[ 
https://issues.apache.org/jira/browse/HIVE-27858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17819047#comment-17819047
 ] 

Ryu Kobayashi edited comment on HIVE-27858 at 2/21/24 3:38 AM:
---

[~dkuzmenko] I agree with your opinion. I think it is a no problem to postpone 
this because there is a workaround. Or, I think there is no problem with making 
this ticket void.


was (Author: ryu_kobayashi):
[~dkuzmenko] I agree with your opinion. I think it is a no problem to postpone 
this because there is a workaround.

> OOM happens when selecting many columns and  JOIN.
> --
>
> Key: HIVE-27858
> URL: https://issues.apache.org/jira/browse/HIVE-27858
> Project: Hive
>  Issue Type: Bug
>  Components: Query Planning
>Affects Versions: 4.0.0-beta-1
>Reporter: Ryu Kobayashi
>Assignee: okumin
>Priority: Critical
>  Labels: hive-4.0.0-must
> Fix For: Not Applicable
>
> Attachments: HIVE-27858.full.q, HIVE-27858.less.columns.q, ddl.sql, 
> query.sql
>
>
> OOM happens when executing [^query.sql] using a table in [^ddl.sql]. These 
> did not happen in Hive 2 previously.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (HIVE-27858) OOM happens when selecting many columns and JOIN.

2024-02-20 Thread Ryu Kobayashi (Jira)


[ 
https://issues.apache.org/jira/browse/HIVE-27858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17819047#comment-17819047
 ] 

Ryu Kobayashi commented on HIVE-27858:
--

[~dkuzmenko] I agree with your opinion. I think it is a no problem to postpone 
this because there is a workaround.

> OOM happens when selecting many columns and  JOIN.
> --
>
> Key: HIVE-27858
> URL: https://issues.apache.org/jira/browse/HIVE-27858
> Project: Hive
>  Issue Type: Bug
>  Components: Query Planning
>Affects Versions: 4.0.0-beta-1
>Reporter: Ryu Kobayashi
>Assignee: okumin
>Priority: Critical
>  Labels: hive-4.0.0-must
> Fix For: Not Applicable
>
> Attachments: HIVE-27858.full.q, HIVE-27858.less.columns.q, ddl.sql, 
> query.sql
>
>
> OOM happens when executing [^query.sql] using a table in [^ddl.sql]. These 
> did not happen in Hive 2 previously.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (HIVE-28083) Enable HMS client cache and HMS query cache for Explain plans

2024-02-20 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/HIVE-28083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated HIVE-28083:
--
Labels: pull-request-available  (was: )

> Enable HMS client cache and HMS query cache for Explain plans
> -
>
> Key: HIVE-28083
> URL: https://issues.apache.org/jira/browse/HIVE-28083
> Project: Hive
>  Issue Type: Improvement
>  Components: Hive
>Affects Versions: 4.0.0-beta-1
>Reporter: Soumyakanti Das
>Assignee: Soumyakanti Das
>Priority: Minor
>  Labels: pull-request-available
>
> Currently explain plans don't go through the HMS caches. We should enable 
> them to get better compilation time for ACID tables.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (HIVE-28019) Fix query type information in proto files for load and explain queries

2024-02-20 Thread Ramesh Kumar Thangarajan (Jira)


 [ 
https://issues.apache.org/jira/browse/HIVE-28019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ramesh Kumar Thangarajan updated HIVE-28019:

Summary: Fix query type information in proto files for load and explain 
queries  (was: Fix query type information in proto files for load, export, 
import and explain queries)

> Fix query type information in proto files for load and explain queries
> --
>
> Key: HIVE-28019
> URL: https://issues.apache.org/jira/browse/HIVE-28019
> Project: Hive
>  Issue Type: Task
>  Components: HiveServer2
>Reporter: Ramesh Kumar Thangarajan
>Assignee: Ramesh Kumar Thangarajan
>Priority: Major
>  Labels: pull-request-available
>
> Certain query types like LOAD, export, import and explain queries did not 
> produce the right Hive operation type



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (HIVE-28083) Enable HMS client cache and HMS query cache for Explain plans

2024-02-20 Thread Soumyakanti Das (Jira)
Soumyakanti Das created HIVE-28083:
--

 Summary: Enable HMS client cache and HMS query cache for Explain 
plans
 Key: HIVE-28083
 URL: https://issues.apache.org/jira/browse/HIVE-28083
 Project: Hive
  Issue Type: Improvement
  Components: Hive
Affects Versions: 4.0.0-beta-1
Reporter: Soumyakanti Das
Assignee: Soumyakanti Das


Currently explain plans don't go through the HMS caches. We should enable them 
to get better compilation time for ACID tables.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (HIVE-27858) OOM happens when selecting many columns and JOIN.

2024-02-20 Thread Denys Kuzmenko (Jira)


[ 
https://issues.apache.org/jira/browse/HIVE-27858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17818850#comment-17818850
 ] 

Denys Kuzmenko commented on HIVE-27858:
---

[~ryukobayashi], that query works with Hive3, however, it looks a bit extreme. 
If there is an agreement we can postpone the fix until the next release and add 
it to the TSB: https://issues.apache.org/jira/browse/HIVE-27945
PS: in Hive4 we are disabling cte materialiization to prevent NPE when 
compiling TPC-DS query14.

> OOM happens when selecting many columns and  JOIN.
> --
>
> Key: HIVE-27858
> URL: https://issues.apache.org/jira/browse/HIVE-27858
> Project: Hive
>  Issue Type: Bug
>  Components: Query Planning
>Affects Versions: 4.0.0-beta-1
>Reporter: Ryu Kobayashi
>Assignee: okumin
>Priority: Critical
>  Labels: hive-4.0.0-must
> Fix For: Not Applicable
>
> Attachments: HIVE-27858.full.q, HIVE-27858.less.columns.q, ddl.sql, 
> query.sql
>
>
> OOM happens when executing [^query.sql] using a table in [^ddl.sql]. These 
> did not happen in Hive 2 previously.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (HIVE-28073) Upgrade jackson version to 2.16.1

2024-02-20 Thread Araika Singh (Jira)


 [ 
https://issues.apache.org/jira/browse/HIVE-28073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Araika Singh updated HIVE-28073:

Description: 
Jackson-databind through 2.15.2 allows attackers to cause a denial of service 
or other unspecified impact via a crafted object that uses cyclic dependencies.
[https://nvd.nist.gov/vuln/detail/CVE-2023-35116]
https://github.com/FasterXML/jackson-databind/issues/3972

  was:https://github.com/FasterXML/jackson/wiki/Jackson-Release-2.15


> Upgrade jackson version to 2.16.1
> -
>
> Key: HIVE-28073
> URL: https://issues.apache.org/jira/browse/HIVE-28073
> Project: Hive
>  Issue Type: Bug
>Reporter: Araika Singh
>Assignee: Araika Singh
>Priority: Major
>  Labels: pull-request-available
>
> Jackson-databind through 2.15.2 allows attackers to cause a denial of service 
> or other unspecified impact via a crafted object that uses cyclic 
> dependencies.
> [https://nvd.nist.gov/vuln/detail/CVE-2023-35116]
> https://github.com/FasterXML/jackson-databind/issues/3972



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (HIVE-28073) Upgrade jackson version to 2.16.1

2024-02-20 Thread Araika Singh (Jira)


 [ 
https://issues.apache.org/jira/browse/HIVE-28073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Araika Singh updated HIVE-28073:

Summary: Upgrade jackson version to 2.16.1  (was: Bump jackson version to 
2.15.0 )

> Upgrade jackson version to 2.16.1
> -
>
> Key: HIVE-28073
> URL: https://issues.apache.org/jira/browse/HIVE-28073
> Project: Hive
>  Issue Type: Improvement
>Reporter: Araika Singh
>Assignee: Araika Singh
>Priority: Major
>  Labels: pull-request-available
>
> https://github.com/FasterXML/jackson/wiki/Jackson-Release-2.15



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (HIVE-28073) Upgrade jackson version to 2.16.1

2024-02-20 Thread Araika Singh (Jira)


 [ 
https://issues.apache.org/jira/browse/HIVE-28073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Araika Singh updated HIVE-28073:

Issue Type: Bug  (was: Improvement)

> Upgrade jackson version to 2.16.1
> -
>
> Key: HIVE-28073
> URL: https://issues.apache.org/jira/browse/HIVE-28073
> Project: Hive
>  Issue Type: Bug
>Reporter: Araika Singh
>Assignee: Araika Singh
>Priority: Major
>  Labels: pull-request-available
>
> https://github.com/FasterXML/jackson/wiki/Jackson-Release-2.15



--
This message was sent by Atlassian Jira
(v8.20.10#820010)