Re: [ANNOUNCE] New PMC Member: Krisztian Kasa
Congratulations Krisztian :) Regards, Akshat On Mon, Jan 30, 2023 at 10:23 PM Alessandro Solimando < alessandro.solima...@gmail.com> wrote: > Congratulations Krisztian, very well deserved! :) > > On Mon, 30 Jan 2023 at 17:34, László Bodor > wrote: > >> Yay! Very well deserved. Krisztian has a broad knowledge of Hive and an >> extremely deep level of experience with the compiler itself (which is a >> huge beast we all know), looking forward to seeing further contributions! >> >> Naveen Gangam ezt írta (időpont: 2023. >> jan. 30., H, 17:23): >> >>> Hello Hive Community, >>> Apache Hive PMC is pleased to announce that Krisztian Kasa (username: >>> krisztiankasa) has accepted the Apache Hive PMC's invitation to become >>> PMC >>> Member, and is now our newest PMC member. Please join me in >>> congratulating >>> Krisztian !!! >>> >>> He has been an active member in the hive community across many aspects of >>> the project. Many thanks to Krisztian for all the contributions he has >>> made >>> and looking forward to many more future contributions in the expanded >>> role. >>> >>> https://github.com/apache/hive/commits?author=kasakrisz >>> >>> * 162 commits in master >>> * 124 reviews in master >>> * Reported 159 JIRAS >>> >>> Cheers, >>> Naveen (on behalf of Hive PMC) >>> >>
[jira] [Created] (HIVE-27005) Iceberg: Col stats are not used in queries
Rajesh Balamohan created HIVE-27005:
---
Summary: Iceberg: Col stats are not used in queries
Key: HIVE-27005
URL: https://issues.apache.org/jira/browse/HIVE-27005
Project: Hive
Issue Type: Improvement
Components: Iceberg integration
Reporter: Rajesh Balamohan
Attachments: col_stats.txt
1. Though, insert-queries compute colstats during runtime, they are not
persisted in HMS during final call.
2. Due to #1, col stats are not available during runtime for hive queries. This
includes col stats, NDV etc. So unless users explicitly run "analyse table"
statements, queries can be have suboptimal plans.
E.g
[col_stats.txt{^}!https://jira.cloudera.com/images/icons/link_attachment_7.gif|width=7,height=7!{^}|https://jira.cloudera.com/secure/attachment/658390/658390_col_stats.txt](note
that there is no col stats being used)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (HIVE-27004) DateTimeFormatterBuilder cannot parse 'UTC+' in Java versions higher than 8
Anmol Sundaram created HIVE-27004:
-
Summary: DateTimeFormatterBuilder cannot parse 'UTC+' in Java
versions higher than 8
Key: HIVE-27004
URL: https://issues.apache.org/jira/browse/HIVE-27004
Project: Hive
Issue Type: Bug
Components: Hive
Environment: Java version used
{{}}
{code:java}
openjdk version "11.0.16.1" 2022-08-12 LTS OpenJDK Runtime Environment
Corretto-11.0.16.9.1 (build 11.0.16.1+9-LTS) OpenJDK 64-Bit Server VM
Corretto-11.0.16.9.1 (build 11.0.16.1+9-LTS, mixed mode{code}
{{}}
Reporter: Anmol Sundaram
Assignee: Anmol Sundaram
Some of the unit tests related to _DateTimeFormatter_ were failing in Java
versions greater than 8 while working in Java 8.
Example of a failing Unit Test :
_org.apache.hadoop.hive.common.type.TestTimestampTZ#testComparision_
{code:java}
java.time.format.DateTimeParseException: Text '2017-04-14 18:00:00 UTC+08:00'
could not be parsed, unparsed text found at index 23 at
java.base/java.time.format.DateTimeFormatter.parseResolved0(DateTimeFormatter.java:2049)
at
java.base/java.time.format.DateTimeFormatter.parse(DateTimeFormatter.java:1874)
at
org.apache.hadoop.hive.common.type.TimestampTZUtil.parse(TimestampTZUtil.java:76)
at
org.apache.hadoop.hive.common.type.TimestampTZUtil.parse(TimestampTZUtil.java:64)
at
org.apache.hadoop.hive.common.type.TestTimestampTZ.testComparison(TestTimestampTZ.java:44)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
Method){code}
The {{appendZoneText(TextStyle)}} method of
[DateTimeFormatteBuilder|https://github.com/apache/hive/blob/master/common/src/java/org/apache/hadoop/hive/common/type/TimestampTZUtil.java#L82]
is not able to parse the {{+}} symbol in {{2017-04-14 18:00:00 UTC+08:00}}
when running [the
test|https://github.com/apache/hive/blob/master/common/src/test/org/apache/hadoop/hive/common/type/TestTimestampTZ.java#L37]
in Java 11 , while it is working fine with Java 8.
According to the
[doc|https://developer.android.com/reference/java/time/format/DateTimeFormatterBuilder#appendZoneText(java.time.format.TextStyle)]
, {{appendZoneText(TextStyle)}} should be able to parse {{either the textual
zone name, the zone ID or the offset}} and UTC+08:00 should come under offset
as per the same
[doc|https://developer.android.com/reference/java/time/format/DateTimeFormatterBuilder#appendOffset(java.lang.String,%20java.lang.String)].
It seems, however, that "UTC" was explicitly removed [when parsed as ZoneText
for higher Java
versions|https://github.com/openjdk/jdk/commit/5c3a01591c5c945926636fdc9f164d60b5b4f29e?diff=unified#diff-5fcf976db1c06e8f44a8671356d7e34fdfbf5b057baa852e7c3e015c8797c889R4263]
As a workaround, we can use {{appendZoneOrOffsetId()}} rather than
{{appendZoneText().}}
This ensures the tests are passing for Java 8+ and based on my testing, I
didn’t see any regression of the change.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (HIVE-27003) Iceberg: Vectorization missed out for update/delete due to virtual columns
Rajesh Balamohan created HIVE-27003: --- Summary: Iceberg: Vectorization missed out for update/delete due to virtual columns Key: HIVE-27003 URL: https://issues.apache.org/jira/browse/HIVE-27003 Project: Hive Issue Type: Improvement Components: Iceberg integration Reporter: Rajesh Balamohan Attachments: delete_iceberg_vect.txt, update_iceberg_vect.txt Vectorization is missed out during table scan due to the addition of virtual columns during scans. I will attach the plan details here with. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27002) PART_COL_STATS metastore query not hitting the index
Steve Carlin created HIVE-27002: --- Summary: PART_COL_STATS metastore query not hitting the index Key: HIVE-27002 URL: https://issues.apache.org/jira/browse/HIVE-27002 Project: Hive Issue Type: Bug Components: Standalone Metastore Reporter: Steve Carlin h4. The query located here: [https://github.com/apache/hive/blob/master/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/txn/CompactionTxnHandler.java#L1029-L1032] is not hitting an index. The index contains CAT_NAME whereas this query does not. This was a change made in Hive 3.0, I think. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27000) Improve the modularity of the *ColumnStatsMerger classes
Alessandro Solimando created HIVE-27000: --- Summary: Improve the modularity of the *ColumnStatsMerger classes Key: HIVE-27000 URL: https://issues.apache.org/jira/browse/HIVE-27000 Project: Hive Issue Type: Improvement Components: Statistics Affects Versions: 4.0.0-alpha-2 Reporter: Alessandro Solimando Assignee: Alessandro Solimando *ColumnStatsMerger classes contain a lot of duplicate code which is not specific to the data type, and that could therefore be lifted to a common parent class. This phenomenon is bound to become even worse if we keep enriching further our supported set of statistics as we did in the context of HIVE-26221. The current ticket aims at improving the modularity and code reuse of the *ColumnStatsMerger classes, while improving unit-test coverage to cover all classes and support more use-cases. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27001) Backport HIVE-26633 to branch-3
Vihang Karajgaonkar created HIVE-27001: -- Summary: Backport HIVE-26633 to branch-3 Key: HIVE-27001 URL: https://issues.apache.org/jira/browse/HIVE-27001 Project: Hive Issue Type: Improvement Components: Standalone Metastore Reporter: Vihang Karajgaonkar HIVE-26633 fixes the maximum response size in metastore http mode. We should backport this to branch-3. -- This message was sent by Atlassian Jira (v8.20.10#820010)
Re: [ANNOUNCE] New PMC Member: Krisztian Kasa
Congratulations Krisztian, very well deserved! :) On Mon, 30 Jan 2023 at 17:34, László Bodor wrote: > Yay! Very well deserved. Krisztian has a broad knowledge of Hive and an > extremely deep level of experience with the compiler itself (which is a > huge beast we all know), looking forward to seeing further contributions! > > Naveen Gangam ezt írta (időpont: 2023. > jan. 30., H, 17:23): > >> Hello Hive Community, >> Apache Hive PMC is pleased to announce that Krisztian Kasa (username: >> krisztiankasa) has accepted the Apache Hive PMC's invitation to become PMC >> Member, and is now our newest PMC member. Please join me in congratulating >> Krisztian !!! >> >> He has been an active member in the hive community across many aspects of >> the project. Many thanks to Krisztian for all the contributions he has >> made >> and looking forward to many more future contributions in the expanded >> role. >> >> https://github.com/apache/hive/commits?author=kasakrisz >> >> * 162 commits in master >> * 124 reviews in master >> * Reported 159 JIRAS >> >> Cheers, >> Naveen (on behalf of Hive PMC) >> >
Re: [ANNOUNCE] New PMC Member: Krisztian Kasa
Yay! Very well deserved. Krisztian has a broad knowledge of Hive and an extremely deep level of experience with the compiler itself (which is a huge beast we all know), looking forward to seeing further contributions! Naveen Gangam ezt írta (időpont: 2023. jan. 30., H, 17:23): > Hello Hive Community, > Apache Hive PMC is pleased to announce that Krisztian Kasa (username: > krisztiankasa) has accepted the Apache Hive PMC's invitation to become PMC > Member, and is now our newest PMC member. Please join me in congratulating > Krisztian !!! > > He has been an active member in the hive community across many aspects of > the project. Many thanks to Krisztian for all the contributions he has made > and looking forward to many more future contributions in the expanded role. > > https://github.com/apache/hive/commits?author=kasakrisz > > * 162 commits in master > * 124 reviews in master > * Reported 159 JIRAS > > Cheers, > Naveen (on behalf of Hive PMC) >
[ANNOUNCE] New PMC Member: Krisztian Kasa
Hello Hive Community, Apache Hive PMC is pleased to announce that Krisztian Kasa (username: krisztiankasa) has accepted the Apache Hive PMC's invitation to become PMC Member, and is now our newest PMC member. Please join me in congratulating Krisztian !!! He has been an active member in the hive community across many aspects of the project. Many thanks to Krisztian for all the contributions he has made and looking forward to many more future contributions in the expanded role. https://github.com/apache/hive/commits?author=kasakrisz * 162 commits in master * 124 reviews in master * Reported 159 JIRAS Cheers, Naveen (on behalf of Hive PMC)
[jira] [Created] (HIVE-26999) Upgrade MySQL Connector Java due to security CVEs
Devaspati Krishnatri created HIVE-26999: --- Summary: Upgrade MySQL Connector Java due to security CVEs Key: HIVE-26999 URL: https://issues.apache.org/jira/browse/HIVE-26999 Project: Hive Issue Type: Task Reporter: Devaspati Krishnatri The following CVEs impact older versions of [MySQL Connector Java|https://mvnrepository.com/artifact/mysql/mysql-connector-java] * *CVE-2021-3711* : Critical - Impacts all versions up to (including) 8.0.27 (ref: [https://nvd.nist.gov/vuln/detail/CVE-2021-3711]) * *CVE-2021-3712* - High - Impacts all versions up to (including) 8.0.27 (ref: [https://nvd.nist.gov/vuln/detail/CVE-2021-37112)|https://nvd.nist.gov/vuln/detail/CVE-2021-3711] * *CVE-2021-44531* - High - Impacts all versions up to (including) 8.0.28 (ref: [https://nvd.nist.gov/vuln/detail/CVE-2021-44531]) * *CVE-2022-21824* - High - Impacts all versions up to (including) 8.0.28 (ref:[https://nvd.nist.gov/vuln/detail/CVE-2022-21824)] Recommendation: *Upgrade* [*MySQL Connector Java*|https://mvnrepository.com/artifact/mysql/mysql-connector-java] *to* [*8.0.31*|https://mvnrepository.com/artifact/mysql/mysql-connector-java/8.0.31] *or above* -- This message was sent by Atlassian Jira (v8.20.10#820010)
Re: [ANNOUNCE] New PMC Member: Laszlo Bodor
Congratulations Laszlo!! On Mon, Jan 30, 2023 at 10:00 AM Stamatis Zampetakis wrote: > While the numbers give some insight, they do not tell the complete story > of how much Laszlo has helped drive the project forward. > > Congrats Laszlo and thanks for everything that you have done for the > project. > > Best, > Stamatis > > On Sun, Jan 29, 2023 at 11:05 PM Sai Hemanth Gantasala < > saihema...@cloudera.com> wrote: > >> Congratulations Laszlo!! >> >> On Sat, Jan 28, 2023 at 8:42 AM Simhadri G wrote: >> >>> Congratulations Laszlo Bodor! :) >>> >>> >>> >>> On Sat, 28 Jan 2023, 20:26 Akshat m, wrote: >>> Congratulations Laszlo Regards, Akshat On Sat, Jan 28, 2023 at 3:03 AM Naveen Gangam wrote: > Hello Hive Community, > Apache Hive PMC is pleased to announce that Laszlo Bodor > (username:abstractdog) has accepted the Apache Hive PMC's invitation to > become PMC Member, and is now our newest PMC member. Please join me in > congratulating Laszlo !!! > > He has been an active member in the hive community across many aspects of > the project. Many thanks to Laszlo for all the contributions he has made > and looking forward to many more future contributions in the expanded role. > > https://github.com/apache/hive/commits?author=abstractdog > > * 96 commits in master [2] > * 66 reviews in master [3] > * Reported 163 JIRAS [6] > > Cheers, > Naveen (on behalf of Hive PMC) > >>>
Re: [ANNOUNCE] New PMC Member: Laszlo Bodor
While the numbers give some insight, they do not tell the complete story of how much Laszlo has helped drive the project forward. Congrats Laszlo and thanks for everything that you have done for the project. Best, Stamatis On Sun, Jan 29, 2023 at 11:05 PM Sai Hemanth Gantasala < saihema...@cloudera.com> wrote: > Congratulations Laszlo!! > > On Sat, Jan 28, 2023 at 8:42 AM Simhadri G wrote: > >> Congratulations Laszlo Bodor! :) >> >> >> >> On Sat, 28 Jan 2023, 20:26 Akshat m, wrote: >> >>> Congratulations Laszlo >>> >>> Regards, >>> Akshat >>> >>> On Sat, Jan 28, 2023 at 3:03 AM Naveen Gangam >>> >>> wrote: >>> >>> > Hello Hive Community, >>> > Apache Hive PMC is pleased to announce that Laszlo Bodor >>> > (username:abstractdog) has accepted the Apache Hive PMC's invitation to >>> > become PMC Member, and is now our newest PMC member. Please join me in >>> > congratulating Laszlo !!! >>> > >>> > He has been an active member in the hive community across many aspects >>> of >>> > the project. Many thanks to Laszlo for all the contributions he has >>> made >>> > and looking forward to many more future contributions in the expanded >>> role. >>> > >>> > https://github.com/apache/hive/commits?author=abstractdog >>> > >>> > * 96 commits in master [2] >>> > * 66 reviews in master [3] >>> > * Reported 163 JIRAS [6] >>> > >>> > Cheers, >>> > Naveen (on behalf of Hive PMC) >>> > >>> >>
[jira] [Created] (HIVE-26998) Can not find correct root task on compute column statistics for views
chiranjeevi created HIVE-26998: -- Summary: Can not find correct root task on compute column statistics for views Key: HIVE-26998 URL: https://issues.apache.org/jira/browse/HIVE-26998 Project: Hive Issue Type: Bug Reporter: chiranjeevi When you run ANALYZE TABLE view_name COMPUTE STATISTICS FOR COLUMNS; Server should notify *Expected Result :* ANALYZE is not supported for views (state=42000,code=10091) like it does for table stat *Actual result:* Error: Error while compiling statement: FAILED: SemanticException Can not find correct root task -- This message was sent by Atlassian Jira (v8.20.10#820010)
