[jira] [Updated] (HIVE-27842) Backport HIVE-21866: LLAP status service driver may get stuck with wrong Yarn app ID
[ https://issues.apache.org/jira/browse/HIVE-27842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sruthi Mooriyathvariam updated HIVE-27842: -- https://github.com/apache/hive/pull/4848 > Backport HIVE-21866: LLAP status service driver may get stuck with wrong Yarn > app ID > > > Key: HIVE-27842 > URL: https://issues.apache.org/jira/browse/HIVE-27842 > Project: Hive > Issue Type: Sub-task >Reporter: Sruthi Mooriyathvariam >Assignee: Sruthi Mooriyathvariam >Priority: Major > Fix For: 3.2.0 > > > HIVE-21866: LLAP status service driver may get stuck with wrong Yarn app ID > (Adam Szita).This requires backport of HIVE-20807: Refactor > LlapStatusServiceDriver and HIVE-20752: In case of LLAP start failure add > info how to find YARN logs > h1. > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Work started] (HIVE-27842) Backport HIVE-21866: LLAP status service driver may get stuck with wrong Yarn app ID
[ https://issues.apache.org/jira/browse/HIVE-27842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-27842 started by Sruthi Mooriyathvariam. - > Backport HIVE-21866: LLAP status service driver may get stuck with wrong Yarn > app ID > > > Key: HIVE-27842 > URL: https://issues.apache.org/jira/browse/HIVE-27842 > Project: Hive > Issue Type: Sub-task >Reporter: Sruthi Mooriyathvariam >Assignee: Sruthi Mooriyathvariam >Priority: Major > Fix For: 3.2.0 > > > HIVE-21866: LLAP status service driver may get stuck with wrong Yarn app ID > (Adam Szita).This requires backport of HIVE-20807: Refactor > LlapStatusServiceDriver and HIVE-20752: In case of LLAP start failure add > info how to find YARN logs > h1. > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (HIVE-27842) Backport HIVE-21866: LLAP status service driver may get stuck with wrong Yarn app ID
[ https://issues.apache.org/jira/browse/HIVE-27842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sruthi Mooriyathvariam reassigned HIVE-27842: - Assignee: Sruthi Mooriyathvariam > Backport HIVE-21866: LLAP status service driver may get stuck with wrong Yarn > app ID > > > Key: HIVE-27842 > URL: https://issues.apache.org/jira/browse/HIVE-27842 > Project: Hive > Issue Type: Sub-task >Reporter: Sruthi Mooriyathvariam >Assignee: Sruthi Mooriyathvariam >Priority: Major > Fix For: 3.2.0 > > > HIVE-21866: LLAP status service driver may get stuck with wrong Yarn app ID > (Adam Szita).This requires backport of HIVE-20807: Refactor > LlapStatusServiceDriver and HIVE-20752: In case of LLAP start failure add > info how to find YARN logs > h1. > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27842) Backport HIVE-21866: LLAP status service driver may get stuck with wrong Yarn app ID
Sruthi Mooriyathvariam created HIVE-27842: - Summary: Backport HIVE-21866: LLAP status service driver may get stuck with wrong Yarn app ID Key: HIVE-27842 URL: https://issues.apache.org/jira/browse/HIVE-27842 Project: Hive Issue Type: Sub-task Reporter: Sruthi Mooriyathvariam Fix For: 3.2.0 HIVE-21866: LLAP status service driver may get stuck with wrong Yarn app ID (Adam Szita).This requires backport of HIVE-20807: Refactor LlapStatusServiceDriver and HIVE-20752: In case of LLAP start failure add info how to find YARN logs h1. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (HIVE-25584) [llap-ext-client] Load data from a Text file for Map dataType is giving errors
[ https://issues.apache.org/jira/browse/HIVE-25584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sruthi Mooriyathvariam resolved HIVE-25584. --- Resolution: Fixed > [llap-ext-client] Load data from a Text file for Map dataType is giving errors > -- > > Key: HIVE-25584 > URL: https://issues.apache.org/jira/browse/HIVE-25584 > Project: Hive > Issue Type: Task > Components: llap >Reporter: Sruthi Mooriyathvariam >Assignee: Sruthi Mooriyathvariam >Priority: Minor > Fix For: 4.0.0 > > > Currently, there is no support for non-ORC writes (text and parquet) for the > llap-ext-client. Thus loading data from a text file leads to errors for Map > data type. This has to be fixed while adding support for non-ORC writes. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Assigned] (HIVE-25555) ArrowColumnarBatchSerDe should store map natively instead of converting to list
[ https://issues.apache.org/jira/browse/HIVE-2?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sruthi Mooriyathvariam reassigned HIVE-2: - Assignee: Sruthi Mooriyathvariam (was: Adesh Kumar Rao) > ArrowColumnarBatchSerDe should store map natively instead of converting to > list > --- > > Key: HIVE-2 > URL: https://issues.apache.org/jira/browse/HIVE-2 > Project: Hive > Issue Type: Sub-task >Reporter: Adesh Kumar Rao >Assignee: Sruthi Mooriyathvariam >Priority: Major > > This should also take of creating non-nullable struct and non-nullable key > type for the map data-type. Currently, list does not care about child type to > be nullable/non-nullable. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HIVE-25554) Upgrade arrow version to 0.15
[ https://issues.apache.org/jira/browse/HIVE-25554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sruthi Mooriyathvariam reassigned HIVE-25554: - Assignee: Sruthi Mooriyathvariam (was: Adesh Kumar Rao) > Upgrade arrow version to 0.15 > - > > Key: HIVE-25554 > URL: https://issues.apache.org/jira/browse/HIVE-25554 > Project: Hive > Issue Type: Sub-task >Reporter: Adesh Kumar Rao >Assignee: Sruthi Mooriyathvariam >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HIVE-25553) Support Map data-type natively in Arrow format
[ https://issues.apache.org/jira/browse/HIVE-25553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sruthi Mooriyathvariam reassigned HIVE-25553: - Assignee: Sruthi Mooriyathvariam (was: Adesh Kumar Rao) > Support Map data-type natively in Arrow format > -- > > Key: HIVE-25553 > URL: https://issues.apache.org/jira/browse/HIVE-25553 > Project: Hive > Issue Type: Improvement > Components: llap, Serializers/Deserializers >Reporter: Adesh Kumar Rao >Assignee: Sruthi Mooriyathvariam >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > Time Spent: 2h 10m > Remaining Estimate: 0h > > Currently ArrowColumnarBatchSerDe converts map datatype as a list of structs > data-type (where stuct is containing the key-value pair of the map). This > causes issues when reading Map datatype using llap-ext-client as it reads a > list of structs instead. > HiveWarehouseConnector which uses the llap-ext-client throws exception when > the schema (containing Map data type) is different from actual data (list of > structs). > > Fixing this issue requires upgrading arrow version (where map data-type is > supported), modifying ArrowColumnarBatchSerDe and corresponding > Serializer/Deserializer to not use list as a workaround for map and use the > arrow map data-type instead. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HIVE-25584) [llap-ext-client] Load data from a Text file for Map dataType is giving errors
[ https://issues.apache.org/jira/browse/HIVE-25584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sruthi Mooriyathvariam reassigned HIVE-25584: - > [llap-ext-client] Load data from a Text file for Map dataType is giving errors > -- > > Key: HIVE-25584 > URL: https://issues.apache.org/jira/browse/HIVE-25584 > Project: Hive > Issue Type: Task > Components: llap >Reporter: Sruthi Mooriyathvariam >Assignee: Sruthi Mooriyathvariam >Priority: Minor > Fix For: 4.0.0 > > > Currently, there is no support for non-ORC writes (text and parquet) for the > llap-ext-client. Thus loading data from a text file leads to errors for Map > data type. This has to be fixed while adding support for non-ORC writes. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-25464) Refactor GenericUDFToUnixTimeStamp
[ https://issues.apache.org/jira/browse/HIVE-25464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sruthi Mooriyathvariam updated HIVE-25464: -- Parent: HIVE-25333 Issue Type: Sub-task (was: Task) > Refactor GenericUDFToUnixTimeStamp > -- > > Key: HIVE-25464 > URL: https://issues.apache.org/jira/browse/HIVE-25464 > Project: Hive > Issue Type: Sub-task > Components: UDF >Affects Versions: All Versions >Reporter: Sruthi Mooriyathvariam >Assignee: Sruthi Mooriyathvariam >Priority: Minor > Fix For: 4.0.0 > > > Remove redundant code and refactor the entire GenericUDFToUnixTimeStamp code -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HIVE-25464) Refactor GenericUDFToUnixTimeStamp
[ https://issues.apache.org/jira/browse/HIVE-25464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sruthi Mooriyathvariam reassigned HIVE-25464: - > Refactor GenericUDFToUnixTimeStamp > -- > > Key: HIVE-25464 > URL: https://issues.apache.org/jira/browse/HIVE-25464 > Project: Hive > Issue Type: Task > Components: UDF >Affects Versions: All Versions >Reporter: Sruthi Mooriyathvariam >Assignee: Sruthi Mooriyathvariam >Priority: Minor > Fix For: 4.0.0 > > > Remove redundant code and refactor the entire GenericUDFToUnixTimeStamp code -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-25403) from_unixtime() does not consider leap seconds
[ https://issues.apache.org/jira/browse/HIVE-25403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sruthi Mooriyathvariam updated HIVE-25403: -- Parent: HIVE-25333 Issue Type: Sub-task (was: Bug) > from_unixtime() does not consider leap seconds > --- > > Key: HIVE-25403 > URL: https://issues.apache.org/jira/browse/HIVE-25403 > Project: Hive > Issue Type: Sub-task > Components: Hive >Reporter: Sruthi Mooriyathvariam >Assignee: Sruthi Mooriyathvariam >Priority: Major > Labels: pull-request-available > Fix For: 3.1.2 > > Attachments: image-2021-07-29-14-42-49-806.png > > Time Spent: 40m > Remaining Estimate: 0h > > The Unix_timestamp() considers "leap second" while the from_unixtime is not; > which results in to wrong result as below: > !image-2021-07-29-14-42-49-806.png! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work started] (HIVE-25403) from_unixtime() does not consider leap seconds
[ https://issues.apache.org/jira/browse/HIVE-25403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-25403 started by Sruthi Mooriyathvariam. - > from_unixtime() does not consider leap seconds > --- > > Key: HIVE-25403 > URL: https://issues.apache.org/jira/browse/HIVE-25403 > Project: Hive > Issue Type: Bug > Components: Hive >Reporter: Sruthi Mooriyathvariam >Assignee: Sruthi Mooriyathvariam >Priority: Major > Labels: pull-request-available > Fix For: 3.1.2 > > Attachments: image-2021-07-29-14-42-49-806.png > > Time Spent: 40m > Remaining Estimate: 0h > > The Unix_timestamp() considers "leap second" while the from_unixtime is not; > which results in to wrong result as below: > !image-2021-07-29-14-42-49-806.png! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HIVE-25403) from_unixtime() does not consider leap seconds
[ https://issues.apache.org/jira/browse/HIVE-25403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sruthi Mooriyathvariam reassigned HIVE-25403: - > from_unixtime() does not consider leap seconds > --- > > Key: HIVE-25403 > URL: https://issues.apache.org/jira/browse/HIVE-25403 > Project: Hive > Issue Type: Bug > Components: Hive >Reporter: Sruthi Mooriyathvariam >Assignee: Sruthi Mooriyathvariam >Priority: Major > Fix For: 3.1.2 > > Attachments: image-2021-07-29-14-42-49-806.png > > > The Unix_timestamp() considers "leap second" while the from_unixtime is not; > which results in to wrong result as below: > !image-2021-07-29-14-42-49-806.png! -- This message was sent by Atlassian Jira (v8.3.4#803005)
