[jira] [Commented] (HIVE-20000) woooohoo20000ooooooo
[
https://issues.apache.org/jira/browse/HIVE-2?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524239#comment-16524239
]
Prasanth Jayachandran commented on HIVE-2:
--
Yes. This is complete rewrite "v2" of HIVE-1
> whoo2ooo
>
>
> Key: HIVE-2
> URL: https://issues.apache.org/jira/browse/HIVE-2
> Project: Hive
> Issue Type: New Feature
> Components: Hive
>Affects Versions: All Versions
>Reporter: Prasanth Jayachandran
>Assignee: Hive QA
>Priority: Blocker
> Fix For: All Versions
>
>
> {code:java}
> ::: ::: ::: :::
> :+::+::+: :+::+: :+::+: :+::+: :+:
> +:+ +:+ :+:++:+ :+:++:+ :+:++:+ :+:+
> +#+ +#+ + +:++#+ + +:++#+ + +:++#+ + +:+
> +#+ +#+# +#++#+# +#++#+# +#++#+# +#+
> #+# #+# #+##+# #+##+# #+##+# #+#
> ## ### ### ### ###
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Assigned] (HIVE-20000) woooohoo20000ooooooo
[
https://issues.apache.org/jira/browse/HIVE-2?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran reassigned HIVE-2:
Assignee: Hive QA
> whoo2ooo
>
>
> Key: HIVE-2
> URL: https://issues.apache.org/jira/browse/HIVE-2
> Project: Hive
> Issue Type: New Feature
> Components: Hive
>Affects Versions: All Versions
>Reporter: Prasanth Jayachandran
>Assignee: Hive QA
>Priority: Blocker
> Fix For: All Versions
>
>
> {code:java}
> ::: ::: ::: :::
> :+::+::+: :+::+: :+::+: :+::+: :+:
> +:+ +:+ :+:++:+ :+:++:+ :+:++:+ :+:+
> +#+ +#+ + +:++#+ + +:++#+ + +:++#+ + +:+
> +#+ +#+# +#++#+# +#++#+# +#++#+# +#+
> #+# #+# #+##+# #+##+# #+##+# #+#
> ## ### ### ### ###
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-20000) woooohoo20000ooooooo
[
https://issues.apache.org/jira/browse/HIVE-2?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran updated HIVE-2:
-
Description:
{code:java}
::: ::: ::: :::
:+::+::+: :+::+: :+::+: :+::+: :+:
+:+ +:+ :+:++:+ :+:++:+ :+:++:+ :+:+
+#+ +#+ + +:++#+ + +:++#+ + +:++#+ + +:+
+#+ +#+# +#++#+# +#++#+# +#++#+# +#+
#+# #+# #+##+# #+##+# #+##+# #+#
## ### ### ### ###
{code}
> whoo2ooo
>
>
> Key: HIVE-2
> URL: https://issues.apache.org/jira/browse/HIVE-2
> Project: Hive
> Issue Type: New Feature
> Components: Hive
>Affects Versions: All Versions
>Reporter: Prasanth Jayachandran
>Priority: Blocker
> Fix For: All Versions
>
>
> {code:java}
> ::: ::: ::: :::
> :+::+::+: :+::+: :+::+: :+::+: :+:
> +:+ +:+ :+:++:+ :+:++:+ :+:++:+ :+:+
> +#+ +#+ + +:++#+ + +:++#+ + +:++#+ + +:+
> +#+ +#+# +#++#+# +#++#+# +#++#+# +#+
> #+# #+# #+##+# #+##+# #+##+# #+#
> ## ### ### ### ###
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-19980) GenericUDTFGetSplits fails when order by query returns 0 rows
[
https://issues.apache.org/jira/browse/HIVE-19980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran updated HIVE-19980:
-
Resolution: Fixed
Fix Version/s: 4.0.0
3.1.0
Status: Resolved (was: Patch Available)
Committed to branch-3 and master. Thanks for the review!
> GenericUDTFGetSplits fails when order by query returns 0 rows
> -
>
> Key: HIVE-19980
> URL: https://issues.apache.org/jira/browse/HIVE-19980
> Project: Hive
> Issue Type: Bug
>Affects Versions: 3.1.0, 4.0.0
>Reporter: Kshitij Badani
>Assignee: Prasanth Jayachandran
>Priority: Major
> Fix For: 3.1.0, 4.0.0
>
> Attachments: HIVE-19980.1.patch, HIVE-19980.2.patch,
> HIVE-19980.3.patch
>
>
> When order by query returns 0 rows, there will not be any files in temporary
> table location for GenericUDTFGetSplits
> which results in the following exception
> {code:java}
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 0
> at
> org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.initialize(HiveSplitGenerator.java:217)
> at
> org.apache.hadoop.hive.ql.udf.generic.GenericUDTFGetSplits.getSplits(GenericUDTFGetSplits.java:420)
> ... 52 more{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-19951) Vectorization: Need to disable encoded LLAP I/O for ORC when there is data type conversion (Schema Evolution)
[ https://issues.apache.org/jira/browse/HIVE-19951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16523135#comment-16523135 ] Prasanth Jayachandran commented on HIVE-19951: -- +1, pending tests. Could you also create a followup Jira and link it here so that when orc-1.5.2 is released this redundant method can be removed? > Vectorization: Need to disable encoded LLAP I/O for ORC when there is data > type conversion (Schema Evolution) > -- > > Key: HIVE-19951 > URL: https://issues.apache.org/jira/browse/HIVE-19951 > Project: Hive > Issue Type: Bug > Components: Hive >Reporter: Matt McCline >Assignee: Matt McCline >Priority: Critical > Attachments: HIVE-19951.01.patch, HIVE-19951.02.patch, > HIVE-19951.03.patch, HIVE-19951.04.patch, HIVE-19951.05.patch, > HIVE-19951.06.patch > > > Currently, reading encoded ORC data does not support data type conversion. > So, encoded reading and cache populating needs to be disabled. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-19980) GenericUDTFGetSplits fails when order by query returns 0 rows
[
https://issues.apache.org/jira/browse/HIVE-19980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran updated HIVE-19980:
-
Attachment: HIVE-19980.3.patch
> GenericUDTFGetSplits fails when order by query returns 0 rows
> -
>
> Key: HIVE-19980
> URL: https://issues.apache.org/jira/browse/HIVE-19980
> Project: Hive
> Issue Type: Bug
>Affects Versions: 3.1.0, 4.0.0
>Reporter: Kshitij Badani
>Assignee: Prasanth Jayachandran
>Priority: Major
> Attachments: HIVE-19980.1.patch, HIVE-19980.2.patch,
> HIVE-19980.3.patch
>
>
> When order by query returns 0 rows, there will not be any files in temporary
> table location for GenericUDTFGetSplits
> which results in the following exception
> {code:java}
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 0
> at
> org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.initialize(HiveSplitGenerator.java:217)
> at
> org.apache.hadoop.hive.ql.udf.generic.GenericUDTFGetSplits.getSplits(GenericUDTFGetSplits.java:420)
> ... 52 more{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-19980) GenericUDTFGetSplits fails when order by query returns 0 rows
[
https://issues.apache.org/jira/browse/HIVE-19980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16522823#comment-16522823
]
Prasanth Jayachandran commented on HIVE-19980:
--
not sure why precommit failed the .1 patch. Another try..
> GenericUDTFGetSplits fails when order by query returns 0 rows
> -
>
> Key: HIVE-19980
> URL: https://issues.apache.org/jira/browse/HIVE-19980
> Project: Hive
> Issue Type: Bug
>Affects Versions: 3.1.0, 4.0.0
>Reporter: Kshitij Badani
>Assignee: Prasanth Jayachandran
>Priority: Major
> Attachments: HIVE-19980.1.patch, HIVE-19980.2.patch
>
>
> When order by query returns 0 rows, there will not be any files in temporary
> table location for GenericUDTFGetSplits
> which results in the following exception
> {code:java}
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 0
> at
> org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.initialize(HiveSplitGenerator.java:217)
> at
> org.apache.hadoop.hive.ql.udf.generic.GenericUDTFGetSplits.getSplits(GenericUDTFGetSplits.java:420)
> ... 52 more{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-19980) GenericUDTFGetSplits fails when order by query returns 0 rows
[
https://issues.apache.org/jira/browse/HIVE-19980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran updated HIVE-19980:
-
Attachment: HIVE-19980.2.patch
> GenericUDTFGetSplits fails when order by query returns 0 rows
> -
>
> Key: HIVE-19980
> URL: https://issues.apache.org/jira/browse/HIVE-19980
> Project: Hive
> Issue Type: Bug
>Affects Versions: 3.1.0, 4.0.0
>Reporter: Kshitij Badani
>Assignee: Prasanth Jayachandran
>Priority: Major
> Attachments: HIVE-19980.1.patch, HIVE-19980.2.patch
>
>
> When order by query returns 0 rows, there will not be any files in temporary
> table location for GenericUDTFGetSplits
> which results in the following exception
> {code:java}
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 0
> at
> org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.initialize(HiveSplitGenerator.java:217)
> at
> org.apache.hadoop.hive.ql.udf.generic.GenericUDTFGetSplits.getSplits(GenericUDTFGetSplits.java:420)
> ... 52 more{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-19964) Apply resource plan fails if trigger expression has quotes
[
https://issues.apache.org/jira/browse/HIVE-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran updated HIVE-19964:
-
Resolution: Fixed
Fix Version/s: 4.0.0
3.1.0
Status: Resolved (was: Patch Available)
Committed to branch-3 and master
> Apply resource plan fails if trigger expression has quotes
> --
>
> Key: HIVE-19964
> URL: https://issues.apache.org/jira/browse/HIVE-19964
> Project: Hive
> Issue Type: Bug
>Affects Versions: 3.1.0, 4.0.0
>Reporter: Aswathy Chellammal Sreekumar
>Assignee: Sergey Shelukhin
>Priority: Major
> Fix For: 3.1.0, 4.0.0
>
> Attachments: HIVE-19964.1.patch, HIVE-19964.2.patch,
> HIVE-19964.3.patch
>
>
> {code:java}
> 0: jdbc:hive2://localhost:1> CREATE TRIGGER global.big_hdfs_read WHEN
> HDFS_BYTES_READ > '300kb' DO KILL;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890):
> CREATE TRIGGER global.big_hdfs_read WHEN HDFS_BYTES_READ > '300kb' DO KILL
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890);
> Time taken: 0.015 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890):
> CREATE TRIGGER global.big_hdfs_read WHEN HDFS_BYTES_READ > '300kb' DO KILL
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890);
> Time taken: 0.025 seconds
> INFO : OK
> No rows affected (0.054 seconds)
> 0: jdbc:hive2://localhost:1> ALTER TRIGGER global.big_hdfs_read ADD TO
> UNMANAGED;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5):
> ALTER TRIGGER global.big_hdfs_read ADD TO UNMANAGED
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5);
> Time taken: 0.014 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5):
> ALTER TRIGGER global.big_hdfs_read ADD TO UNMANAGED
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5);
> Time taken: 0.029 seconds
> INFO : OK
> No rows affected (0.054 seconds)
> 0: jdbc:hive2://localhost:1> ALTER RESOURCE PLAN global ENABLE;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e):
> ALTER RESOURCE PLAN global ENABLE
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e);
> Time taken: 0.012 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e):
> ALTER RESOURCE PLAN global ENABLE
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e);
> Time taken: 0.021 seconds
> INFO : OK
> No rows affected (0.045 seconds)
> 0: jdbc:hive2://localhost:1> ALTER RESOURCE PLAN global ACTIVATE;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b):
> ALTER RESOURCE PLAN global ACTIVATE
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b);
> Time taken: 0.017 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b):
> ALTER RESOURCE PLAN global ACTIVATE
> INFO : Starting task [Stage-0:DDL] in serial mode
> ERROR : FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.DDLTask. Invalid expression: HDFS_BYTES_READ >
> 300kb
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b);
> Time taken: 0.037 seconds
> Error: Error while processing statement: FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Invalid expression:
> HDFS_BYTES_READ > 300kb (state=08S01,code=1){code}
--
This message was sent by Atlassian JIRA
(v7.6
[jira] [Assigned] (HIVE-19964) Apply resource plan fails if trigger expression has quotes
[
https://issues.apache.org/jira/browse/HIVE-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran reassigned HIVE-19964:
Assignee: Sergey Shelukhin (was: Prasanth Jayachandran)
> Apply resource plan fails if trigger expression has quotes
> --
>
> Key: HIVE-19964
> URL: https://issues.apache.org/jira/browse/HIVE-19964
> Project: Hive
> Issue Type: Bug
>Affects Versions: 3.1.0, 4.0.0
>Reporter: Aswathy Chellammal Sreekumar
>Assignee: Sergey Shelukhin
>Priority: Major
> Attachments: HIVE-19964.1.patch, HIVE-19964.2.patch,
> HIVE-19964.3.patch
>
>
> {code:java}
> 0: jdbc:hive2://localhost:1> CREATE TRIGGER global.big_hdfs_read WHEN
> HDFS_BYTES_READ > '300kb' DO KILL;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890):
> CREATE TRIGGER global.big_hdfs_read WHEN HDFS_BYTES_READ > '300kb' DO KILL
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890);
> Time taken: 0.015 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890):
> CREATE TRIGGER global.big_hdfs_read WHEN HDFS_BYTES_READ > '300kb' DO KILL
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890);
> Time taken: 0.025 seconds
> INFO : OK
> No rows affected (0.054 seconds)
> 0: jdbc:hive2://localhost:1> ALTER TRIGGER global.big_hdfs_read ADD TO
> UNMANAGED;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5):
> ALTER TRIGGER global.big_hdfs_read ADD TO UNMANAGED
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5);
> Time taken: 0.014 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5):
> ALTER TRIGGER global.big_hdfs_read ADD TO UNMANAGED
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5);
> Time taken: 0.029 seconds
> INFO : OK
> No rows affected (0.054 seconds)
> 0: jdbc:hive2://localhost:1> ALTER RESOURCE PLAN global ENABLE;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e):
> ALTER RESOURCE PLAN global ENABLE
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e);
> Time taken: 0.012 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e):
> ALTER RESOURCE PLAN global ENABLE
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e);
> Time taken: 0.021 seconds
> INFO : OK
> No rows affected (0.045 seconds)
> 0: jdbc:hive2://localhost:1> ALTER RESOURCE PLAN global ACTIVATE;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b):
> ALTER RESOURCE PLAN global ACTIVATE
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b);
> Time taken: 0.017 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b):
> ALTER RESOURCE PLAN global ACTIVATE
> INFO : Starting task [Stage-0:DDL] in serial mode
> ERROR : FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.DDLTask. Invalid expression: HDFS_BYTES_READ >
> 300kb
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b);
> Time taken: 0.037 seconds
> Error: Error while processing statement: FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Invalid expression:
> HDFS_BYTES_READ > 300kb (state=08S01,code=1){code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-19980) GenericUDTFGetSplits fails when order by query returns 0 rows
[
https://issues.apache.org/jira/browse/HIVE-19980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran updated HIVE-19980:
-
Reporter: Kshitij Badani (was: Prasanth Jayachandran)
> GenericUDTFGetSplits fails when order by query returns 0 rows
> -
>
> Key: HIVE-19980
> URL: https://issues.apache.org/jira/browse/HIVE-19980
> Project: Hive
> Issue Type: Bug
>Affects Versions: 3.1.0, 4.0.0
>Reporter: Kshitij Badani
>Assignee: Prasanth Jayachandran
>Priority: Major
> Attachments: HIVE-19980.1.patch
>
>
> When order by query returns 0 rows, there will not be any files in temporary
> table location for GenericUDTFGetSplits
> which results in the following exception
> {code:java}
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 0
> at
> org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.initialize(HiveSplitGenerator.java:217)
> at
> org.apache.hadoop.hive.ql.udf.generic.GenericUDTFGetSplits.getSplits(GenericUDTFGetSplits.java:420)
> ... 52 more{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-19980) GenericUDTFGetSplits fails when order by query returns 0 rows
[
https://issues.apache.org/jira/browse/HIVE-19980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran updated HIVE-19980:
-
Status: Patch Available (was: Open)
> GenericUDTFGetSplits fails when order by query returns 0 rows
> -
>
> Key: HIVE-19980
> URL: https://issues.apache.org/jira/browse/HIVE-19980
> Project: Hive
> Issue Type: Bug
>Affects Versions: 3.1.0, 4.0.0
>Reporter: Prasanth Jayachandran
>Assignee: Prasanth Jayachandran
>Priority: Major
> Attachments: HIVE-19980.1.patch
>
>
> When order by query returns 0 rows, there will not be any files in temporary
> table location for GenericUDTFGetSplits
> which results in the following exception
> {code:java}
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 0
> at
> org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.initialize(HiveSplitGenerator.java:217)
> at
> org.apache.hadoop.hive.ql.udf.generic.GenericUDTFGetSplits.getSplits(GenericUDTFGetSplits.java:420)
> ... 52 more{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-19980) GenericUDTFGetSplits fails when order by query returns 0 rows
[
https://issues.apache.org/jira/browse/HIVE-19980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16522651#comment-16522651
]
Prasanth Jayachandran commented on HIVE-19980:
--
[~jdere] can you please take a look? small patch
> GenericUDTFGetSplits fails when order by query returns 0 rows
> -
>
> Key: HIVE-19980
> URL: https://issues.apache.org/jira/browse/HIVE-19980
> Project: Hive
> Issue Type: Bug
>Affects Versions: 3.1.0, 4.0.0
>Reporter: Prasanth Jayachandran
>Assignee: Prasanth Jayachandran
>Priority: Major
> Attachments: HIVE-19980.1.patch
>
>
> When order by query returns 0 rows, there will not be any files in temporary
> table location for GenericUDTFGetSplits
> which results in the following exception
> {code:java}
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 0
> at
> org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.initialize(HiveSplitGenerator.java:217)
> at
> org.apache.hadoop.hive.ql.udf.generic.GenericUDTFGetSplits.getSplits(GenericUDTFGetSplits.java:420)
> ... 52 more{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-19980) GenericUDTFGetSplits fails when order by query returns 0 rows
[
https://issues.apache.org/jira/browse/HIVE-19980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran updated HIVE-19980:
-
Attachment: HIVE-19980.1.patch
> GenericUDTFGetSplits fails when order by query returns 0 rows
> -
>
> Key: HIVE-19980
> URL: https://issues.apache.org/jira/browse/HIVE-19980
> Project: Hive
> Issue Type: Bug
>Affects Versions: 3.1.0, 4.0.0
>Reporter: Prasanth Jayachandran
>Assignee: Prasanth Jayachandran
>Priority: Major
> Attachments: HIVE-19980.1.patch
>
>
> When order by query returns 0 rows, there will not be any files in temporary
> table location for GenericUDTFGetSplits
> which results in the following exception
> {code:java}
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 0
> at
> org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.initialize(HiveSplitGenerator.java:217)
> at
> org.apache.hadoop.hive.ql.udf.generic.GenericUDTFGetSplits.getSplits(GenericUDTFGetSplits.java:420)
> ... 52 more{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Assigned] (HIVE-19980) GenericUDTFGetSplits fails when order by query returns 0 rows
[
https://issues.apache.org/jira/browse/HIVE-19980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran reassigned HIVE-19980:
> GenericUDTFGetSplits fails when order by query returns 0 rows
> -
>
> Key: HIVE-19980
> URL: https://issues.apache.org/jira/browse/HIVE-19980
> Project: Hive
> Issue Type: Bug
>Affects Versions: 3.1.0, 4.0.0
>Reporter: Prasanth Jayachandran
>Assignee: Prasanth Jayachandran
>Priority: Major
>
> When order by query returns 0 rows, there will not be any files in temporary
> table location for GenericUDTFGetSplits
> which results in the following exception
> {code:java}
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 0
> at
> org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.initialize(HiveSplitGenerator.java:217)
> at
> org.apache.hadoop.hive.ql.udf.generic.GenericUDTFGetSplits.getSplits(GenericUDTFGetSplits.java:420)
> ... 52 more{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-19964) Apply resource plan fails if trigger expression has quotes
[
https://issues.apache.org/jira/browse/HIVE-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran updated HIVE-19964:
-
Attachment: HIVE-19964.3.patch
> Apply resource plan fails if trigger expression has quotes
> --
>
> Key: HIVE-19964
> URL: https://issues.apache.org/jira/browse/HIVE-19964
> Project: Hive
> Issue Type: Bug
>Affects Versions: 3.1.0, 4.0.0
>Reporter: Aswathy Chellammal Sreekumar
>Assignee: Prasanth Jayachandran
>Priority: Major
> Attachments: HIVE-19964.1.patch, HIVE-19964.2.patch,
> HIVE-19964.3.patch
>
>
> {code:java}
> 0: jdbc:hive2://localhost:1> CREATE TRIGGER global.big_hdfs_read WHEN
> HDFS_BYTES_READ > '300kb' DO KILL;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890):
> CREATE TRIGGER global.big_hdfs_read WHEN HDFS_BYTES_READ > '300kb' DO KILL
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890);
> Time taken: 0.015 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890):
> CREATE TRIGGER global.big_hdfs_read WHEN HDFS_BYTES_READ > '300kb' DO KILL
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890);
> Time taken: 0.025 seconds
> INFO : OK
> No rows affected (0.054 seconds)
> 0: jdbc:hive2://localhost:1> ALTER TRIGGER global.big_hdfs_read ADD TO
> UNMANAGED;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5):
> ALTER TRIGGER global.big_hdfs_read ADD TO UNMANAGED
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5);
> Time taken: 0.014 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5):
> ALTER TRIGGER global.big_hdfs_read ADD TO UNMANAGED
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5);
> Time taken: 0.029 seconds
> INFO : OK
> No rows affected (0.054 seconds)
> 0: jdbc:hive2://localhost:1> ALTER RESOURCE PLAN global ENABLE;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e):
> ALTER RESOURCE PLAN global ENABLE
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e);
> Time taken: 0.012 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e):
> ALTER RESOURCE PLAN global ENABLE
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e);
> Time taken: 0.021 seconds
> INFO : OK
> No rows affected (0.045 seconds)
> 0: jdbc:hive2://localhost:1> ALTER RESOURCE PLAN global ACTIVATE;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b):
> ALTER RESOURCE PLAN global ACTIVATE
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b);
> Time taken: 0.017 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b):
> ALTER RESOURCE PLAN global ACTIVATE
> INFO : Starting task [Stage-0:DDL] in serial mode
> ERROR : FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.DDLTask. Invalid expression: HDFS_BYTES_READ >
> 300kb
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b);
> Time taken: 0.037 seconds
> Error: Error while processing statement: FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Invalid expression:
> HDFS_BYTES_READ > 300kb (state=08S01,code=1){code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-19964) Apply resource plan fails if trigger expression has quotes
[
https://issues.apache.org/jira/browse/HIVE-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16522588#comment-16522588
]
Prasanth Jayachandran commented on HIVE-19964:
--
another try..
> Apply resource plan fails if trigger expression has quotes
> --
>
> Key: HIVE-19964
> URL: https://issues.apache.org/jira/browse/HIVE-19964
> Project: Hive
> Issue Type: Bug
>Affects Versions: 3.1.0, 4.0.0
>Reporter: Aswathy Chellammal Sreekumar
>Assignee: Prasanth Jayachandran
>Priority: Major
> Attachments: HIVE-19964.1.patch, HIVE-19964.2.patch,
> HIVE-19964.3.patch
>
>
> {code:java}
> 0: jdbc:hive2://localhost:1> CREATE TRIGGER global.big_hdfs_read WHEN
> HDFS_BYTES_READ > '300kb' DO KILL;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890):
> CREATE TRIGGER global.big_hdfs_read WHEN HDFS_BYTES_READ > '300kb' DO KILL
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890);
> Time taken: 0.015 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890):
> CREATE TRIGGER global.big_hdfs_read WHEN HDFS_BYTES_READ > '300kb' DO KILL
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890);
> Time taken: 0.025 seconds
> INFO : OK
> No rows affected (0.054 seconds)
> 0: jdbc:hive2://localhost:1> ALTER TRIGGER global.big_hdfs_read ADD TO
> UNMANAGED;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5):
> ALTER TRIGGER global.big_hdfs_read ADD TO UNMANAGED
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5);
> Time taken: 0.014 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5):
> ALTER TRIGGER global.big_hdfs_read ADD TO UNMANAGED
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5);
> Time taken: 0.029 seconds
> INFO : OK
> No rows affected (0.054 seconds)
> 0: jdbc:hive2://localhost:1> ALTER RESOURCE PLAN global ENABLE;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e):
> ALTER RESOURCE PLAN global ENABLE
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e);
> Time taken: 0.012 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e):
> ALTER RESOURCE PLAN global ENABLE
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e);
> Time taken: 0.021 seconds
> INFO : OK
> No rows affected (0.045 seconds)
> 0: jdbc:hive2://localhost:1> ALTER RESOURCE PLAN global ACTIVATE;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b):
> ALTER RESOURCE PLAN global ACTIVATE
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b);
> Time taken: 0.017 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b):
> ALTER RESOURCE PLAN global ACTIVATE
> INFO : Starting task [Stage-0:DDL] in serial mode
> ERROR : FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.DDLTask. Invalid expression: HDFS_BYTES_READ >
> 300kb
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b);
> Time taken: 0.037 seconds
> Error: Error while processing statement: FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Invalid expression:
> HDFS_BYTES_READ > 300kb (state=08S01,code=1){code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-19964) Apply resource plan fails if trigger expression has quotes
[
https://issues.apache.org/jira/browse/HIVE-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16522587#comment-16522587
]
Prasanth Jayachandran commented on HIVE-19964:
--
HIVE-12192 broke build causing this failure.
> Apply resource plan fails if trigger expression has quotes
> --
>
> Key: HIVE-19964
> URL: https://issues.apache.org/jira/browse/HIVE-19964
> Project: Hive
> Issue Type: Bug
>Affects Versions: 3.1.0, 4.0.0
>Reporter: Aswathy Chellammal Sreekumar
>Assignee: Prasanth Jayachandran
>Priority: Major
> Attachments: HIVE-19964.1.patch, HIVE-19964.2.patch
>
>
> {code:java}
> 0: jdbc:hive2://localhost:1> CREATE TRIGGER global.big_hdfs_read WHEN
> HDFS_BYTES_READ > '300kb' DO KILL;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890):
> CREATE TRIGGER global.big_hdfs_read WHEN HDFS_BYTES_READ > '300kb' DO KILL
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890);
> Time taken: 0.015 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890):
> CREATE TRIGGER global.big_hdfs_read WHEN HDFS_BYTES_READ > '300kb' DO KILL
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890);
> Time taken: 0.025 seconds
> INFO : OK
> No rows affected (0.054 seconds)
> 0: jdbc:hive2://localhost:1> ALTER TRIGGER global.big_hdfs_read ADD TO
> UNMANAGED;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5):
> ALTER TRIGGER global.big_hdfs_read ADD TO UNMANAGED
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5);
> Time taken: 0.014 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5):
> ALTER TRIGGER global.big_hdfs_read ADD TO UNMANAGED
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5);
> Time taken: 0.029 seconds
> INFO : OK
> No rows affected (0.054 seconds)
> 0: jdbc:hive2://localhost:1> ALTER RESOURCE PLAN global ENABLE;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e):
> ALTER RESOURCE PLAN global ENABLE
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e);
> Time taken: 0.012 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e):
> ALTER RESOURCE PLAN global ENABLE
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e);
> Time taken: 0.021 seconds
> INFO : OK
> No rows affected (0.045 seconds)
> 0: jdbc:hive2://localhost:1> ALTER RESOURCE PLAN global ACTIVATE;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b):
> ALTER RESOURCE PLAN global ACTIVATE
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b);
> Time taken: 0.017 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b):
> ALTER RESOURCE PLAN global ACTIVATE
> INFO : Starting task [Stage-0:DDL] in serial mode
> ERROR : FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.DDLTask. Invalid expression: HDFS_BYTES_READ >
> 300kb
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b);
> Time taken: 0.037 seconds
> Error: Error while processing statement: FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Invalid expression:
> HDFS_BYTES_READ > 300kb (state=08S01,code=1){code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Reopened] (HIVE-12192) Hive should carry out timestamp computations in UTC
[
https://issues.apache.org/jira/browse/HIVE-12192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran reopened HIVE-12192:
--
> Hive should carry out timestamp computations in UTC
> ---
>
> Key: HIVE-12192
> URL: https://issues.apache.org/jira/browse/HIVE-12192
> Project: Hive
> Issue Type: Sub-task
> Components: Hive
>Reporter: Ryan Blue
>Assignee: Jesus Camacho Rodriguez
>Priority: Blocker
> Labels: timestamp
> Fix For: 3.1.0
>
> Attachments: HIVE-12192.01.patch, HIVE-12192.02.patch,
> HIVE-12192.03.patch, HIVE-12192.04.patch, HIVE-12192.05.patch,
> HIVE-12192.06.patch, HIVE-12192.07.patch, HIVE-12192.08.patch,
> HIVE-12192.09.patch, HIVE-12192.10.patch, HIVE-12192.11.patch,
> HIVE-12192.12.patch, HIVE-12192.13.patch, HIVE-12192.14.patch,
> HIVE-12192.15.patch, HIVE-12192.16.patch, HIVE-12192.17.patch,
> HIVE-12192.18.patch, HIVE-12192.19.patch, HIVE-12192.20.patch,
> HIVE-12192.21.patch, HIVE-12192.22.patch, HIVE-12192.23.patch,
> HIVE-12192.24.patch, HIVE-12192.25.patch, HIVE-12192.patch
>
>
> Hive currently uses the "local" time of a java.sql.Timestamp to represent the
> SQL data type TIMESTAMP WITHOUT TIME ZONE. The purpose is to be able to use
> {{Timestamp#getYear()}} and similar methods to implement SQL functions like
> {{year}}.
> When the SQL session's time zone is a DST zone, such as America/Los_Angeles
> that alternates between PST and PDT, there are times that cannot be
> represented because the effective zone skips them.
> {code}
> hive> select TIMESTAMP '2015-03-08 02:10:00.101';
> 2015-03-08 03:10:00.101
> {code}
> Using UTC instead of the SQL session time zone as the underlying zone for a
> java.sql.Timestamp avoids this bug, while still returning correct values for
> {{getYear}} etc. Using UTC as the convenience representation (timestamp
> without time zone has no real zone) would make timestamp calculations more
> consistent and avoid similar problems in the future.
> Notably, this would break the {{unix_timestamp}} UDF that specifies the
> result is with respect to ["the default timezone and default
> locale"|https://cwiki.apache.org/confluence/display/Hive/LanguageManual+UDF#LanguageManualUDF-DateFunctions].
> That function would need to be updated to use the
> {{System.getProperty("user.timezone")}} zone.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-19951) Vectorization: Need to disable encoded LLAP I/O for ORC when there is data type conversion (Schema Evolution)
[ https://issues.apache.org/jira/browse/HIVE-19951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16521691#comment-16521691 ] Prasanth Jayachandran commented on HIVE-19951: -- orc_ppd_schema_evol_3a is a stable test. The test diff here is expected since llap io is completely disable for schema evolution. > Vectorization: Need to disable encoded LLAP I/O for ORC when there is data > type conversion (Schema Evolution) > -- > > Key: HIVE-19951 > URL: https://issues.apache.org/jira/browse/HIVE-19951 > Project: Hive > Issue Type: Bug > Components: Hive >Reporter: Matt McCline >Assignee: Matt McCline >Priority: Critical > Attachments: HIVE-19951.01.patch, HIVE-19951.02.patch, > HIVE-19951.03.patch > > > Currently, reading encoded ORC data does not support data type conversion. > So, encoded reading and cache populating needs to be disabled. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-19956) Include yarn registry classes to jdbc standalone jar
[ https://issues.apache.org/jira/browse/HIVE-19956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-19956: - Resolution: Fixed Fix Version/s: 3.1.0 Status: Resolved (was: Patch Available) Committed to branch-3 as well. > Include yarn registry classes to jdbc standalone jar > > > Key: HIVE-19956 > URL: https://issues.apache.org/jira/browse/HIVE-19956 > Project: Hive > Issue Type: Bug > Components: JDBC >Affects Versions: 3.1.0, 4.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Major > Fix For: 3.1.0, 4.0.0 > > Attachments: HIVE-19956.1.patch, HIVE-19956.2.patch, > HIVE-19956.3.patch > > > HS2 Active/Passive HA requires some yarn registry classes. Include it in JDBC > standalone jar. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-19801) JDBC: Add some missing classes to jdbc standalone jar and remove hbase classes
[ https://issues.apache.org/jira/browse/HIVE-19801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-19801: - Resolution: Fixed Fix Version/s: 3.1.0 Status: Resolved (was: Patch Available) Committed to branch-3 as well. > JDBC: Add some missing classes to jdbc standalone jar and remove hbase classes > -- > > Key: HIVE-19801 > URL: https://issues.apache.org/jira/browse/HIVE-19801 > Project: Hive > Issue Type: Bug > Components: JDBC >Affects Versions: 3.0.0, 3.1.0 >Reporter: Vaibhav Gumashta >Assignee: Thejas M Nair >Priority: Major > Fix For: 3.1.0, 4.0.0 > > Attachments: HIVE-19801-branch-3.patch, HIVE-19801.1-branch-3.patch, > HIVE-19801.1-branch-3.patch, HIVE-19801.1.patch > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-19801) JDBC: Add some missing classes to jdbc standalone jar and remove hbase classes
[ https://issues.apache.org/jira/browse/HIVE-19801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16521682#comment-16521682 ] Prasanth Jayachandran commented on HIVE-19801: -- Test failures look unrelated. HIVE-19965 also has same set of failures. > JDBC: Add some missing classes to jdbc standalone jar and remove hbase classes > -- > > Key: HIVE-19801 > URL: https://issues.apache.org/jira/browse/HIVE-19801 > Project: Hive > Issue Type: Bug > Components: JDBC >Affects Versions: 3.0.0, 3.1.0 >Reporter: Vaibhav Gumashta >Assignee: Thejas M Nair >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-19801-branch-3.patch, HIVE-19801.1-branch-3.patch, > HIVE-19801.1-branch-3.patch, HIVE-19801.1.patch > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-19964) Apply resource plan fails if trigger expression has quotes
[
https://issues.apache.org/jira/browse/HIVE-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16521581#comment-16521581
]
Prasanth Jayachandran commented on HIVE-19964:
--
Patch from different Jira was uploaded mistakenly. Uploading correct patch.
> Apply resource plan fails if trigger expression has quotes
> --
>
> Key: HIVE-19964
> URL: https://issues.apache.org/jira/browse/HIVE-19964
> Project: Hive
> Issue Type: Bug
>Affects Versions: 3.1.0, 4.0.0
>Reporter: Aswathy Chellammal Sreekumar
>Assignee: Prasanth Jayachandran
>Priority: Major
> Attachments: HIVE-19964.1.patch, HIVE-19964.2.patch
>
>
> {code:java}
> 0: jdbc:hive2://localhost:1> CREATE TRIGGER global.big_hdfs_read WHEN
> HDFS_BYTES_READ > '300kb' DO KILL;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890):
> CREATE TRIGGER global.big_hdfs_read WHEN HDFS_BYTES_READ > '300kb' DO KILL
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890);
> Time taken: 0.015 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890):
> CREATE TRIGGER global.big_hdfs_read WHEN HDFS_BYTES_READ > '300kb' DO KILL
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890);
> Time taken: 0.025 seconds
> INFO : OK
> No rows affected (0.054 seconds)
> 0: jdbc:hive2://localhost:1> ALTER TRIGGER global.big_hdfs_read ADD TO
> UNMANAGED;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5):
> ALTER TRIGGER global.big_hdfs_read ADD TO UNMANAGED
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5);
> Time taken: 0.014 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5):
> ALTER TRIGGER global.big_hdfs_read ADD TO UNMANAGED
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5);
> Time taken: 0.029 seconds
> INFO : OK
> No rows affected (0.054 seconds)
> 0: jdbc:hive2://localhost:1> ALTER RESOURCE PLAN global ENABLE;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e):
> ALTER RESOURCE PLAN global ENABLE
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e);
> Time taken: 0.012 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e):
> ALTER RESOURCE PLAN global ENABLE
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e);
> Time taken: 0.021 seconds
> INFO : OK
> No rows affected (0.045 seconds)
> 0: jdbc:hive2://localhost:1> ALTER RESOURCE PLAN global ACTIVATE;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b):
> ALTER RESOURCE PLAN global ACTIVATE
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b);
> Time taken: 0.017 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b):
> ALTER RESOURCE PLAN global ACTIVATE
> INFO : Starting task [Stage-0:DDL] in serial mode
> ERROR : FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.DDLTask. Invalid expression: HDFS_BYTES_READ >
> 300kb
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b);
> Time taken: 0.037 seconds
> Error: Error while processing statement: FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Invalid expression:
> HDFS_BYTES_READ > 300kb (state=08S01,code=1){code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-19956) Include yarn registry classes to jdbc standalone jar
[ https://issues.apache.org/jira/browse/HIVE-19956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-19956: - Fix Version/s: 4.0.0 > Include yarn registry classes to jdbc standalone jar > > > Key: HIVE-19956 > URL: https://issues.apache.org/jira/browse/HIVE-19956 > Project: Hive > Issue Type: Bug > Components: JDBC >Affects Versions: 3.1.0, 4.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-19956.1.patch, HIVE-19956.2.patch, > HIVE-19956.3.patch > > > HS2 Active/Passive HA requires some yarn registry classes. Include it in JDBC > standalone jar. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-19956) Include yarn registry classes to jdbc standalone jar
[ https://issues.apache.org/jira/browse/HIVE-19956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16521580#comment-16521580 ] Prasanth Jayachandran commented on HIVE-19956: -- committed to master. > Include yarn registry classes to jdbc standalone jar > > > Key: HIVE-19956 > URL: https://issues.apache.org/jira/browse/HIVE-19956 > Project: Hive > Issue Type: Bug > Components: JDBC >Affects Versions: 3.1.0, 4.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-19956.1.patch, HIVE-19956.2.patch, > HIVE-19956.3.patch > > > HS2 Active/Passive HA requires some yarn registry classes. Include it in JDBC > standalone jar. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-19956) Include yarn registry classes to jdbc standalone jar
[ https://issues.apache.org/jira/browse/HIVE-19956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16521579#comment-16521579 ] Prasanth Jayachandran commented on HIVE-19956: -- branch-3 commit is pending HIVE-19801 because of conflicts. > Include yarn registry classes to jdbc standalone jar > > > Key: HIVE-19956 > URL: https://issues.apache.org/jira/browse/HIVE-19956 > Project: Hive > Issue Type: Bug > Components: JDBC >Affects Versions: 3.1.0, 4.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-19956.1.patch, HIVE-19956.2.patch, > HIVE-19956.3.patch > > > HS2 Active/Passive HA requires some yarn registry classes. Include it in JDBC > standalone jar. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-19801) JDBC: Add some missing classes to jdbc standalone jar and remove hbase classes
[ https://issues.apache.org/jira/browse/HIVE-19801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16521577#comment-16521577 ] Prasanth Jayachandran commented on HIVE-19801: -- The patch was not picked. Trying with different name. > JDBC: Add some missing classes to jdbc standalone jar and remove hbase classes > -- > > Key: HIVE-19801 > URL: https://issues.apache.org/jira/browse/HIVE-19801 > Project: Hive > Issue Type: Bug > Components: JDBC >Affects Versions: 3.0.0, 3.1.0 >Reporter: Vaibhav Gumashta >Assignee: Thejas M Nair >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-19801-branch-3.patch, HIVE-19801.1-branch-3.patch, > HIVE-19801.1-branch-3.patch, HIVE-19801.1.patch > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (HIVE-19801) JDBC: Add some missing classes to jdbc standalone jar and remove hbase classes
[ https://issues.apache.org/jira/browse/HIVE-19801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran reassigned HIVE-19801: Assignee: Thejas M Nair (was: Prasanth Jayachandran) > JDBC: Add some missing classes to jdbc standalone jar and remove hbase classes > -- > > Key: HIVE-19801 > URL: https://issues.apache.org/jira/browse/HIVE-19801 > Project: Hive > Issue Type: Bug > Components: JDBC >Affects Versions: 3.0.0, 3.1.0 >Reporter: Vaibhav Gumashta >Assignee: Thejas M Nair >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-19801-branch-3.patch, HIVE-19801.1-branch-3.patch, > HIVE-19801.1-branch-3.patch, HIVE-19801.1.patch > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-19801) JDBC: Add some missing classes to jdbc standalone jar and remove hbase classes
[ https://issues.apache.org/jira/browse/HIVE-19801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-19801: - Attachment: HIVE-19801-branch-3.patch > JDBC: Add some missing classes to jdbc standalone jar and remove hbase classes > -- > > Key: HIVE-19801 > URL: https://issues.apache.org/jira/browse/HIVE-19801 > Project: Hive > Issue Type: Bug > Components: JDBC >Affects Versions: 3.0.0, 3.1.0 >Reporter: Vaibhav Gumashta >Assignee: Prasanth Jayachandran >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-19801-branch-3.patch, HIVE-19801.1-branch-3.patch, > HIVE-19801.1-branch-3.patch, HIVE-19801.1.patch > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (HIVE-19801) JDBC: Add some missing classes to jdbc standalone jar and remove hbase classes
[ https://issues.apache.org/jira/browse/HIVE-19801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran reassigned HIVE-19801: Assignee: Prasanth Jayachandran (was: Thejas M Nair) > JDBC: Add some missing classes to jdbc standalone jar and remove hbase classes > -- > > Key: HIVE-19801 > URL: https://issues.apache.org/jira/browse/HIVE-19801 > Project: Hive > Issue Type: Bug > Components: JDBC >Affects Versions: 3.0.0, 3.1.0 >Reporter: Vaibhav Gumashta >Assignee: Prasanth Jayachandran >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-19801.1-branch-3.patch, > HIVE-19801.1-branch-3.patch, HIVE-19801.1.patch > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-19964) Apply resource plan fails if trigger expression has quotes
[
https://issues.apache.org/jira/browse/HIVE-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran updated HIVE-19964:
-
Attachment: HIVE-19964.2.patch
> Apply resource plan fails if trigger expression has quotes
> --
>
> Key: HIVE-19964
> URL: https://issues.apache.org/jira/browse/HIVE-19964
> Project: Hive
> Issue Type: Bug
>Affects Versions: 3.1.0, 4.0.0
>Reporter: Aswathy Chellammal Sreekumar
>Assignee: Prasanth Jayachandran
>Priority: Major
> Attachments: HIVE-19964.1.patch, HIVE-19964.2.patch
>
>
> {code:java}
> 0: jdbc:hive2://localhost:1> CREATE TRIGGER global.big_hdfs_read WHEN
> HDFS_BYTES_READ > '300kb' DO KILL;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890):
> CREATE TRIGGER global.big_hdfs_read WHEN HDFS_BYTES_READ > '300kb' DO KILL
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890);
> Time taken: 0.015 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890):
> CREATE TRIGGER global.big_hdfs_read WHEN HDFS_BYTES_READ > '300kb' DO KILL
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890);
> Time taken: 0.025 seconds
> INFO : OK
> No rows affected (0.054 seconds)
> 0: jdbc:hive2://localhost:1> ALTER TRIGGER global.big_hdfs_read ADD TO
> UNMANAGED;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5):
> ALTER TRIGGER global.big_hdfs_read ADD TO UNMANAGED
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5);
> Time taken: 0.014 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5):
> ALTER TRIGGER global.big_hdfs_read ADD TO UNMANAGED
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5);
> Time taken: 0.029 seconds
> INFO : OK
> No rows affected (0.054 seconds)
> 0: jdbc:hive2://localhost:1> ALTER RESOURCE PLAN global ENABLE;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e):
> ALTER RESOURCE PLAN global ENABLE
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e);
> Time taken: 0.012 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e):
> ALTER RESOURCE PLAN global ENABLE
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e);
> Time taken: 0.021 seconds
> INFO : OK
> No rows affected (0.045 seconds)
> 0: jdbc:hive2://localhost:1> ALTER RESOURCE PLAN global ACTIVATE;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b):
> ALTER RESOURCE PLAN global ACTIVATE
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b);
> Time taken: 0.017 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b):
> ALTER RESOURCE PLAN global ACTIVATE
> INFO : Starting task [Stage-0:DDL] in serial mode
> ERROR : FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.DDLTask. Invalid expression: HDFS_BYTES_READ >
> 300kb
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b);
> Time taken: 0.037 seconds
> Error: Error while processing statement: FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Invalid expression:
> HDFS_BYTES_READ > 300kb (state=08S01,code=1){code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Assigned] (HIVE-19964) Apply resource plan fails if trigger expression has quotes
[
https://issues.apache.org/jira/browse/HIVE-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran reassigned HIVE-19964:
Assignee: Prasanth Jayachandran (was: Sergey Shelukhin)
> Apply resource plan fails if trigger expression has quotes
> --
>
> Key: HIVE-19964
> URL: https://issues.apache.org/jira/browse/HIVE-19964
> Project: Hive
> Issue Type: Bug
>Affects Versions: 3.1.0, 4.0.0
>Reporter: Aswathy Chellammal Sreekumar
>Assignee: Prasanth Jayachandran
>Priority: Major
> Attachments: HIVE-19964.1.patch
>
>
> {code:java}
> 0: jdbc:hive2://localhost:1> CREATE TRIGGER global.big_hdfs_read WHEN
> HDFS_BYTES_READ > '300kb' DO KILL;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890):
> CREATE TRIGGER global.big_hdfs_read WHEN HDFS_BYTES_READ > '300kb' DO KILL
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890);
> Time taken: 0.015 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890):
> CREATE TRIGGER global.big_hdfs_read WHEN HDFS_BYTES_READ > '300kb' DO KILL
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890);
> Time taken: 0.025 seconds
> INFO : OK
> No rows affected (0.054 seconds)
> 0: jdbc:hive2://localhost:1> ALTER TRIGGER global.big_hdfs_read ADD TO
> UNMANAGED;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5):
> ALTER TRIGGER global.big_hdfs_read ADD TO UNMANAGED
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5);
> Time taken: 0.014 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5):
> ALTER TRIGGER global.big_hdfs_read ADD TO UNMANAGED
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5);
> Time taken: 0.029 seconds
> INFO : OK
> No rows affected (0.054 seconds)
> 0: jdbc:hive2://localhost:1> ALTER RESOURCE PLAN global ENABLE;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e):
> ALTER RESOURCE PLAN global ENABLE
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e);
> Time taken: 0.012 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e):
> ALTER RESOURCE PLAN global ENABLE
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e);
> Time taken: 0.021 seconds
> INFO : OK
> No rows affected (0.045 seconds)
> 0: jdbc:hive2://localhost:1> ALTER RESOURCE PLAN global ACTIVATE;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b):
> ALTER RESOURCE PLAN global ACTIVATE
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b);
> Time taken: 0.017 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b):
> ALTER RESOURCE PLAN global ACTIVATE
> INFO : Starting task [Stage-0:DDL] in serial mode
> ERROR : FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.DDLTask. Invalid expression: HDFS_BYTES_READ >
> 300kb
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b);
> Time taken: 0.037 seconds
> Error: Error while processing statement: FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Invalid expression:
> HDFS_BYTES_READ > 300kb (state=08S01,code=1){code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Assigned] (HIVE-19964) Apply resource plan fails if trigger expression has quotes
[
https://issues.apache.org/jira/browse/HIVE-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran reassigned HIVE-19964:
Assignee: Sergey Shelukhin (was: Prasanth Jayachandran)
> Apply resource plan fails if trigger expression has quotes
> --
>
> Key: HIVE-19964
> URL: https://issues.apache.org/jira/browse/HIVE-19964
> Project: Hive
> Issue Type: Bug
>Affects Versions: 3.1.0, 4.0.0
>Reporter: Aswathy Chellammal Sreekumar
>Assignee: Sergey Shelukhin
>Priority: Major
> Attachments: HIVE-19964.1.patch
>
>
> {code:java}
> 0: jdbc:hive2://localhost:1> CREATE TRIGGER global.big_hdfs_read WHEN
> HDFS_BYTES_READ > '300kb' DO KILL;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890):
> CREATE TRIGGER global.big_hdfs_read WHEN HDFS_BYTES_READ > '300kb' DO KILL
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890);
> Time taken: 0.015 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890):
> CREATE TRIGGER global.big_hdfs_read WHEN HDFS_BYTES_READ > '300kb' DO KILL
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890);
> Time taken: 0.025 seconds
> INFO : OK
> No rows affected (0.054 seconds)
> 0: jdbc:hive2://localhost:1> ALTER TRIGGER global.big_hdfs_read ADD TO
> UNMANAGED;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5):
> ALTER TRIGGER global.big_hdfs_read ADD TO UNMANAGED
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5);
> Time taken: 0.014 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5):
> ALTER TRIGGER global.big_hdfs_read ADD TO UNMANAGED
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5);
> Time taken: 0.029 seconds
> INFO : OK
> No rows affected (0.054 seconds)
> 0: jdbc:hive2://localhost:1> ALTER RESOURCE PLAN global ENABLE;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e):
> ALTER RESOURCE PLAN global ENABLE
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e);
> Time taken: 0.012 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e):
> ALTER RESOURCE PLAN global ENABLE
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e);
> Time taken: 0.021 seconds
> INFO : OK
> No rows affected (0.045 seconds)
> 0: jdbc:hive2://localhost:1> ALTER RESOURCE PLAN global ACTIVATE;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b):
> ALTER RESOURCE PLAN global ACTIVATE
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b);
> Time taken: 0.017 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b):
> ALTER RESOURCE PLAN global ACTIVATE
> INFO : Starting task [Stage-0:DDL] in serial mode
> ERROR : FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.DDLTask. Invalid expression: HDFS_BYTES_READ >
> 300kb
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b);
> Time taken: 0.037 seconds
> Error: Error while processing statement: FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Invalid expression:
> HDFS_BYTES_READ > 300kb (state=08S01,code=1){code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-19964) Apply resource plan fails if trigger expression has quotes
[
https://issues.apache.org/jira/browse/HIVE-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran updated HIVE-19964:
-
Attachment: (was: HIVE-19956.2.patch)
> Apply resource plan fails if trigger expression has quotes
> --
>
> Key: HIVE-19964
> URL: https://issues.apache.org/jira/browse/HIVE-19964
> Project: Hive
> Issue Type: Bug
>Affects Versions: 3.1.0, 4.0.0
>Reporter: Aswathy Chellammal Sreekumar
>Assignee: Sergey Shelukhin
>Priority: Major
> Attachments: HIVE-19964.1.patch
>
>
> {code:java}
> 0: jdbc:hive2://localhost:1> CREATE TRIGGER global.big_hdfs_read WHEN
> HDFS_BYTES_READ > '300kb' DO KILL;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890):
> CREATE TRIGGER global.big_hdfs_read WHEN HDFS_BYTES_READ > '300kb' DO KILL
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890);
> Time taken: 0.015 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890):
> CREATE TRIGGER global.big_hdfs_read WHEN HDFS_BYTES_READ > '300kb' DO KILL
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890);
> Time taken: 0.025 seconds
> INFO : OK
> No rows affected (0.054 seconds)
> 0: jdbc:hive2://localhost:1> ALTER TRIGGER global.big_hdfs_read ADD TO
> UNMANAGED;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5):
> ALTER TRIGGER global.big_hdfs_read ADD TO UNMANAGED
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5);
> Time taken: 0.014 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5):
> ALTER TRIGGER global.big_hdfs_read ADD TO UNMANAGED
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5);
> Time taken: 0.029 seconds
> INFO : OK
> No rows affected (0.054 seconds)
> 0: jdbc:hive2://localhost:1> ALTER RESOURCE PLAN global ENABLE;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e):
> ALTER RESOURCE PLAN global ENABLE
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e);
> Time taken: 0.012 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e):
> ALTER RESOURCE PLAN global ENABLE
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e);
> Time taken: 0.021 seconds
> INFO : OK
> No rows affected (0.045 seconds)
> 0: jdbc:hive2://localhost:1> ALTER RESOURCE PLAN global ACTIVATE;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b):
> ALTER RESOURCE PLAN global ACTIVATE
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b);
> Time taken: 0.017 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b):
> ALTER RESOURCE PLAN global ACTIVATE
> INFO : Starting task [Stage-0:DDL] in serial mode
> ERROR : FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.DDLTask. Invalid expression: HDFS_BYTES_READ >
> 300kb
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b);
> Time taken: 0.037 seconds
> Error: Error while processing statement: FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Invalid expression:
> HDFS_BYTES_READ > 300kb (state=08S01,code=1){code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-19926) Remove deprecated hcatalog streaming
[ https://issues.apache.org/jira/browse/HIVE-19926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-19926: - Attachment: HIVE-19926.3.patch > Remove deprecated hcatalog streaming > > > Key: HIVE-19926 > URL: https://issues.apache.org/jira/browse/HIVE-19926 > Project: Hive > Issue Type: Improvement > Components: Streaming >Affects Versions: 4.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Major > Attachments: HIVE-19926.1.patch, HIVE-19926.2.patch, > HIVE-19926.3.patch > > > hcatalog streaming is deprecated in 3.0.0. We should remove it in 4.0.0. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-19956) Include yarn registry classes to jdbc standalone jar
[ https://issues.apache.org/jira/browse/HIVE-19956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16521282#comment-16521282 ] Prasanth Jayachandran commented on HIVE-19956: -- HIVE-19564 broke build causing the above failure. > Include yarn registry classes to jdbc standalone jar > > > Key: HIVE-19956 > URL: https://issues.apache.org/jira/browse/HIVE-19956 > Project: Hive > Issue Type: Bug > Components: JDBC >Affects Versions: 3.1.0, 4.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Major > Attachments: HIVE-19956.1.patch, HIVE-19956.2.patch, > HIVE-19956.3.patch > > > HS2 Active/Passive HA requires some yarn registry classes. Include it in JDBC > standalone jar. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-19956) Include yarn registry classes to jdbc standalone jar
[ https://issues.apache.org/jira/browse/HIVE-19956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-19956: - Attachment: HIVE-19956.3.patch > Include yarn registry classes to jdbc standalone jar > > > Key: HIVE-19956 > URL: https://issues.apache.org/jira/browse/HIVE-19956 > Project: Hive > Issue Type: Bug > Components: JDBC >Affects Versions: 3.1.0, 4.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Major > Attachments: HIVE-19956.1.patch, HIVE-19956.2.patch, > HIVE-19956.3.patch > > > HS2 Active/Passive HA requires some yarn registry classes. Include it in JDBC > standalone jar. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-19564) Vectorization: Fix NULL / Wrong Results issues in Arithmetic
[ https://issues.apache.org/jira/browse/HIVE-19564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16521280#comment-16521280 ] Prasanth Jayachandran commented on HIVE-19564: -- This is breaking the build on master. Reverted the master patch. > Vectorization: Fix NULL / Wrong Results issues in Arithmetic > > > Key: HIVE-19564 > URL: https://issues.apache.org/jira/browse/HIVE-19564 > Project: Hive > Issue Type: Bug > Components: Hive >Reporter: Matt McCline >Assignee: Matt McCline >Priority: Critical > Fix For: 4.0.0 > > Attachments: HIVE-19564.01.patch, HIVE-19564.02.patch > > > Write new UT tests that use random data and intentional isRepeating batches > to checks for NULL and Wrong Results for vectorized arithmetic (+,-,*,/,%) > Divide by 0 bug found in Long Scalar % Column. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-19964) Apply resource plan fails if trigger expression has quotes
[
https://issues.apache.org/jira/browse/HIVE-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16521232#comment-16521232
]
Prasanth Jayachandran commented on HIVE-19964:
--
Another try
> Apply resource plan fails if trigger expression has quotes
> --
>
> Key: HIVE-19964
> URL: https://issues.apache.org/jira/browse/HIVE-19964
> Project: Hive
> Issue Type: Bug
>Affects Versions: 3.1.0, 4.0.0
>Reporter: Aswathy Chellammal Sreekumar
>Assignee: Prasanth Jayachandran
>Priority: Major
> Attachments: HIVE-19956.2.patch, HIVE-19964.1.patch
>
>
> {code:java}
> 0: jdbc:hive2://localhost:1> CREATE TRIGGER global.big_hdfs_read WHEN
> HDFS_BYTES_READ > '300kb' DO KILL;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890):
> CREATE TRIGGER global.big_hdfs_read WHEN HDFS_BYTES_READ > '300kb' DO KILL
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890);
> Time taken: 0.015 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890):
> CREATE TRIGGER global.big_hdfs_read WHEN HDFS_BYTES_READ > '300kb' DO KILL
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890);
> Time taken: 0.025 seconds
> INFO : OK
> No rows affected (0.054 seconds)
> 0: jdbc:hive2://localhost:1> ALTER TRIGGER global.big_hdfs_read ADD TO
> UNMANAGED;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5):
> ALTER TRIGGER global.big_hdfs_read ADD TO UNMANAGED
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5);
> Time taken: 0.014 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5):
> ALTER TRIGGER global.big_hdfs_read ADD TO UNMANAGED
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5);
> Time taken: 0.029 seconds
> INFO : OK
> No rows affected (0.054 seconds)
> 0: jdbc:hive2://localhost:1> ALTER RESOURCE PLAN global ENABLE;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e):
> ALTER RESOURCE PLAN global ENABLE
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e);
> Time taken: 0.012 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e):
> ALTER RESOURCE PLAN global ENABLE
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e);
> Time taken: 0.021 seconds
> INFO : OK
> No rows affected (0.045 seconds)
> 0: jdbc:hive2://localhost:1> ALTER RESOURCE PLAN global ACTIVATE;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b):
> ALTER RESOURCE PLAN global ACTIVATE
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b);
> Time taken: 0.017 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b):
> ALTER RESOURCE PLAN global ACTIVATE
> INFO : Starting task [Stage-0:DDL] in serial mode
> ERROR : FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.DDLTask. Invalid expression: HDFS_BYTES_READ >
> 300kb
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b);
> Time taken: 0.037 seconds
> Error: Error while processing statement: FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Invalid expression:
> HDFS_BYTES_READ > 300kb (state=08S01,code=1){code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-19964) Apply resource plan fails if trigger expression has quotes
[
https://issues.apache.org/jira/browse/HIVE-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran updated HIVE-19964:
-
Attachment: HIVE-19956.2.patch
> Apply resource plan fails if trigger expression has quotes
> --
>
> Key: HIVE-19964
> URL: https://issues.apache.org/jira/browse/HIVE-19964
> Project: Hive
> Issue Type: Bug
>Affects Versions: 3.1.0, 4.0.0
>Reporter: Aswathy Chellammal Sreekumar
>Assignee: Prasanth Jayachandran
>Priority: Major
> Attachments: HIVE-19956.2.patch, HIVE-19964.1.patch
>
>
> {code:java}
> 0: jdbc:hive2://localhost:1> CREATE TRIGGER global.big_hdfs_read WHEN
> HDFS_BYTES_READ > '300kb' DO KILL;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890):
> CREATE TRIGGER global.big_hdfs_read WHEN HDFS_BYTES_READ > '300kb' DO KILL
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890);
> Time taken: 0.015 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890):
> CREATE TRIGGER global.big_hdfs_read WHEN HDFS_BYTES_READ > '300kb' DO KILL
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890);
> Time taken: 0.025 seconds
> INFO : OK
> No rows affected (0.054 seconds)
> 0: jdbc:hive2://localhost:1> ALTER TRIGGER global.big_hdfs_read ADD TO
> UNMANAGED;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5):
> ALTER TRIGGER global.big_hdfs_read ADD TO UNMANAGED
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5);
> Time taken: 0.014 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5):
> ALTER TRIGGER global.big_hdfs_read ADD TO UNMANAGED
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5);
> Time taken: 0.029 seconds
> INFO : OK
> No rows affected (0.054 seconds)
> 0: jdbc:hive2://localhost:1> ALTER RESOURCE PLAN global ENABLE;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e):
> ALTER RESOURCE PLAN global ENABLE
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e);
> Time taken: 0.012 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e):
> ALTER RESOURCE PLAN global ENABLE
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e);
> Time taken: 0.021 seconds
> INFO : OK
> No rows affected (0.045 seconds)
> 0: jdbc:hive2://localhost:1> ALTER RESOURCE PLAN global ACTIVATE;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b):
> ALTER RESOURCE PLAN global ACTIVATE
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b);
> Time taken: 0.017 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b):
> ALTER RESOURCE PLAN global ACTIVATE
> INFO : Starting task [Stage-0:DDL] in serial mode
> ERROR : FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.DDLTask. Invalid expression: HDFS_BYTES_READ >
> 300kb
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b);
> Time taken: 0.037 seconds
> Error: Error while processing statement: FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Invalid expression:
> HDFS_BYTES_READ > 300kb (state=08S01,code=1){code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Assigned] (HIVE-19964) Apply resource plan fails if trigger expression has quotes
[
https://issues.apache.org/jira/browse/HIVE-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran reassigned HIVE-19964:
Assignee: Prasanth Jayachandran (was: Sergey Shelukhin)
> Apply resource plan fails if trigger expression has quotes
> --
>
> Key: HIVE-19964
> URL: https://issues.apache.org/jira/browse/HIVE-19964
> Project: Hive
> Issue Type: Bug
>Affects Versions: 3.1.0, 4.0.0
>Reporter: Aswathy Chellammal Sreekumar
>Assignee: Prasanth Jayachandran
>Priority: Major
> Attachments: HIVE-19956.2.patch, HIVE-19964.1.patch
>
>
> {code:java}
> 0: jdbc:hive2://localhost:1> CREATE TRIGGER global.big_hdfs_read WHEN
> HDFS_BYTES_READ > '300kb' DO KILL;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890):
> CREATE TRIGGER global.big_hdfs_read WHEN HDFS_BYTES_READ > '300kb' DO KILL
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890);
> Time taken: 0.015 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890):
> CREATE TRIGGER global.big_hdfs_read WHEN HDFS_BYTES_READ > '300kb' DO KILL
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890);
> Time taken: 0.025 seconds
> INFO : OK
> No rows affected (0.054 seconds)
> 0: jdbc:hive2://localhost:1> ALTER TRIGGER global.big_hdfs_read ADD TO
> UNMANAGED;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5):
> ALTER TRIGGER global.big_hdfs_read ADD TO UNMANAGED
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5);
> Time taken: 0.014 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5):
> ALTER TRIGGER global.big_hdfs_read ADD TO UNMANAGED
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5);
> Time taken: 0.029 seconds
> INFO : OK
> No rows affected (0.054 seconds)
> 0: jdbc:hive2://localhost:1> ALTER RESOURCE PLAN global ENABLE;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e):
> ALTER RESOURCE PLAN global ENABLE
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e);
> Time taken: 0.012 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e):
> ALTER RESOURCE PLAN global ENABLE
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e);
> Time taken: 0.021 seconds
> INFO : OK
> No rows affected (0.045 seconds)
> 0: jdbc:hive2://localhost:1> ALTER RESOURCE PLAN global ACTIVATE;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b):
> ALTER RESOURCE PLAN global ACTIVATE
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b);
> Time taken: 0.017 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b):
> ALTER RESOURCE PLAN global ACTIVATE
> INFO : Starting task [Stage-0:DDL] in serial mode
> ERROR : FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.DDLTask. Invalid expression: HDFS_BYTES_READ >
> 300kb
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b);
> Time taken: 0.037 seconds
> Error: Error while processing statement: FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Invalid expression:
> HDFS_BYTES_READ > 300kb (state=08S01,code=1){code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-19965) Make HiveEndPoint use IMetaStoreClient.add_partition
[ https://issues.apache.org/jira/browse/HIVE-19965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16520664#comment-16520664 ] Prasanth Jayachandran commented on HIVE-19965: -- +1, pending tests > Make HiveEndPoint use IMetaStoreClient.add_partition > > > Key: HIVE-19965 > URL: https://issues.apache.org/jira/browse/HIVE-19965 > Project: Hive > Issue Type: Bug > Components: Transactions >Affects Versions: 3.0.0 >Reporter: Eugene Koifman >Assignee: Eugene Koifman >Priority: Blocker > Attachments: HIVE-19965.01.patch > > > it currently uses "alter table add partition if exists..." > which since HIVE-18814 requires X lock on the table which blocks other > streaming writers from making progress. > HIVE-19961 to investigate if X lock can be relaxed, etc. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-19956) Include yarn registry classes to jdbc standalone jar
[ https://issues.apache.org/jira/browse/HIVE-19956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16520118#comment-16520118 ] Prasanth Jayachandran commented on HIVE-19956: -- Ran it couple of times locally but entire TestJdbcWithMiniHS2 test suite seems to pass. So I guess the failure is flaky. Giving it one more try. > Include yarn registry classes to jdbc standalone jar > > > Key: HIVE-19956 > URL: https://issues.apache.org/jira/browse/HIVE-19956 > Project: Hive > Issue Type: Bug > Components: JDBC >Affects Versions: 3.1.0, 4.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Major > Attachments: HIVE-19956.1.patch, HIVE-19956.2.patch > > > HS2 Active/Passive HA requires some yarn registry classes. Include it in JDBC > standalone jar. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-19956) Include yarn registry classes to jdbc standalone jar
[ https://issues.apache.org/jira/browse/HIVE-19956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-19956: - Attachment: HIVE-19956.2.patch > Include yarn registry classes to jdbc standalone jar > > > Key: HIVE-19956 > URL: https://issues.apache.org/jira/browse/HIVE-19956 > Project: Hive > Issue Type: Bug > Components: JDBC >Affects Versions: 3.1.0, 4.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Major > Attachments: HIVE-19956.1.patch, HIVE-19956.2.patch > > > HS2 Active/Passive HA requires some yarn registry classes. Include it in JDBC > standalone jar. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-19966) Compile error when using open-jdk
[
https://issues.apache.org/jira/browse/HIVE-19966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16520004#comment-16520004
]
Prasanth Jayachandran commented on HIVE-19966:
--
[~vihangk1] Is that warning or error? open-jdk should have sun.misc.cleaner
> Compile error when using open-jdk
> -
>
> Key: HIVE-19966
> URL: https://issues.apache.org/jira/browse/HIVE-19966
> Project: Hive
> Issue Type: Bug
>Reporter: Vihang Karajgaonkar
>Priority: Major
>
> When you compile Hive using open-jdk-8 you see this error
> {noformat}
> hive/ql/src/java/org/apache/hadoop/hive/ql/io/orc/encoded/EncodedReaderImpl.java:[72,16]
> sun.misc.Cleaner is internal proprietary API and may be removed in a future
> release
> [ERROR] -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
> switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions, please
> read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR] mvn -rf :hive-exec
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-19964) Apply resource plan fails if trigger expression has quotes
[
https://issues.apache.org/jira/browse/HIVE-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16519744#comment-16519744
]
Prasanth Jayachandran commented on HIVE-19964:
--
Uploading [~sershe]'s patch.
lgtm, +1. Pending tests.
> Apply resource plan fails if trigger expression has quotes
> --
>
> Key: HIVE-19964
> URL: https://issues.apache.org/jira/browse/HIVE-19964
> Project: Hive
> Issue Type: Bug
>Affects Versions: 3.1.0, 4.0.0
>Reporter: Aswathy Chellammal Sreekumar
>Assignee: Sergey Shelukhin
>Priority: Major
> Attachments: HIVE-19964.1.patch
>
>
> {code:java}
> 0: jdbc:hive2://localhost:1> CREATE TRIGGER global.big_hdfs_read WHEN
> HDFS_BYTES_READ > '300kb' DO KILL;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890):
> CREATE TRIGGER global.big_hdfs_read WHEN HDFS_BYTES_READ > '300kb' DO KILL
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890);
> Time taken: 0.015 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890):
> CREATE TRIGGER global.big_hdfs_read WHEN HDFS_BYTES_READ > '300kb' DO KILL
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890);
> Time taken: 0.025 seconds
> INFO : OK
> No rows affected (0.054 seconds)
> 0: jdbc:hive2://localhost:1> ALTER TRIGGER global.big_hdfs_read ADD TO
> UNMANAGED;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5):
> ALTER TRIGGER global.big_hdfs_read ADD TO UNMANAGED
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5);
> Time taken: 0.014 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5):
> ALTER TRIGGER global.big_hdfs_read ADD TO UNMANAGED
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5);
> Time taken: 0.029 seconds
> INFO : OK
> No rows affected (0.054 seconds)
> 0: jdbc:hive2://localhost:1> ALTER RESOURCE PLAN global ENABLE;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e):
> ALTER RESOURCE PLAN global ENABLE
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e);
> Time taken: 0.012 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e):
> ALTER RESOURCE PLAN global ENABLE
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e);
> Time taken: 0.021 seconds
> INFO : OK
> No rows affected (0.045 seconds)
> 0: jdbc:hive2://localhost:1> ALTER RESOURCE PLAN global ACTIVATE;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b):
> ALTER RESOURCE PLAN global ACTIVATE
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b);
> Time taken: 0.017 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b):
> ALTER RESOURCE PLAN global ACTIVATE
> INFO : Starting task [Stage-0:DDL] in serial mode
> ERROR : FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.DDLTask. Invalid expression: HDFS_BYTES_READ >
> 300kb
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b);
> Time taken: 0.037 seconds
> Error: Error while processing statement: FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Invalid expression:
> HDFS_BYTES_READ > 300kb (state=08S01,code=1){code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-19964) Apply resource plan fails if trigger expression has quotes
[
https://issues.apache.org/jira/browse/HIVE-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran updated HIVE-19964:
-
Status: Patch Available (was: Open)
> Apply resource plan fails if trigger expression has quotes
> --
>
> Key: HIVE-19964
> URL: https://issues.apache.org/jira/browse/HIVE-19964
> Project: Hive
> Issue Type: Bug
>Affects Versions: 3.1.0, 4.0.0
>Reporter: Aswathy Chellammal Sreekumar
>Assignee: Prasanth Jayachandran
>Priority: Major
> Attachments: HIVE-19964.1.patch
>
>
> {code:java}
> 0: jdbc:hive2://localhost:1> CREATE TRIGGER global.big_hdfs_read WHEN
> HDFS_BYTES_READ > '300kb' DO KILL;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890):
> CREATE TRIGGER global.big_hdfs_read WHEN HDFS_BYTES_READ > '300kb' DO KILL
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890);
> Time taken: 0.015 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890):
> CREATE TRIGGER global.big_hdfs_read WHEN HDFS_BYTES_READ > '300kb' DO KILL
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890);
> Time taken: 0.025 seconds
> INFO : OK
> No rows affected (0.054 seconds)
> 0: jdbc:hive2://localhost:1> ALTER TRIGGER global.big_hdfs_read ADD TO
> UNMANAGED;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5):
> ALTER TRIGGER global.big_hdfs_read ADD TO UNMANAGED
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5);
> Time taken: 0.014 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5):
> ALTER TRIGGER global.big_hdfs_read ADD TO UNMANAGED
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5);
> Time taken: 0.029 seconds
> INFO : OK
> No rows affected (0.054 seconds)
> 0: jdbc:hive2://localhost:1> ALTER RESOURCE PLAN global ENABLE;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e):
> ALTER RESOURCE PLAN global ENABLE
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e);
> Time taken: 0.012 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e):
> ALTER RESOURCE PLAN global ENABLE
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e);
> Time taken: 0.021 seconds
> INFO : OK
> No rows affected (0.045 seconds)
> 0: jdbc:hive2://localhost:1> ALTER RESOURCE PLAN global ACTIVATE;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b):
> ALTER RESOURCE PLAN global ACTIVATE
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b);
> Time taken: 0.017 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b):
> ALTER RESOURCE PLAN global ACTIVATE
> INFO : Starting task [Stage-0:DDL] in serial mode
> ERROR : FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.DDLTask. Invalid expression: HDFS_BYTES_READ >
> 300kb
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b);
> Time taken: 0.037 seconds
> Error: Error while processing statement: FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Invalid expression:
> HDFS_BYTES_READ > 300kb (state=08S01,code=1){code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-19964) Apply resource plan fails if trigger expression has quotes
[
https://issues.apache.org/jira/browse/HIVE-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran updated HIVE-19964:
-
Attachment: HIVE-19964.1.patch
> Apply resource plan fails if trigger expression has quotes
> --
>
> Key: HIVE-19964
> URL: https://issues.apache.org/jira/browse/HIVE-19964
> Project: Hive
> Issue Type: Bug
>Affects Versions: 3.1.0, 4.0.0
>Reporter: Aswathy Chellammal Sreekumar
>Assignee: Prasanth Jayachandran
>Priority: Major
> Attachments: HIVE-19964.1.patch
>
>
> {code:java}
> 0: jdbc:hive2://localhost:1> CREATE TRIGGER global.big_hdfs_read WHEN
> HDFS_BYTES_READ > '300kb' DO KILL;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890):
> CREATE TRIGGER global.big_hdfs_read WHEN HDFS_BYTES_READ > '300kb' DO KILL
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890);
> Time taken: 0.015 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890):
> CREATE TRIGGER global.big_hdfs_read WHEN HDFS_BYTES_READ > '300kb' DO KILL
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890);
> Time taken: 0.025 seconds
> INFO : OK
> No rows affected (0.054 seconds)
> 0: jdbc:hive2://localhost:1> ALTER TRIGGER global.big_hdfs_read ADD TO
> UNMANAGED;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5):
> ALTER TRIGGER global.big_hdfs_read ADD TO UNMANAGED
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5);
> Time taken: 0.014 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5):
> ALTER TRIGGER global.big_hdfs_read ADD TO UNMANAGED
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5);
> Time taken: 0.029 seconds
> INFO : OK
> No rows affected (0.054 seconds)
> 0: jdbc:hive2://localhost:1> ALTER RESOURCE PLAN global ENABLE;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e):
> ALTER RESOURCE PLAN global ENABLE
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e);
> Time taken: 0.012 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e):
> ALTER RESOURCE PLAN global ENABLE
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e);
> Time taken: 0.021 seconds
> INFO : OK
> No rows affected (0.045 seconds)
> 0: jdbc:hive2://localhost:1> ALTER RESOURCE PLAN global ACTIVATE;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b):
> ALTER RESOURCE PLAN global ACTIVATE
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b);
> Time taken: 0.017 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b):
> ALTER RESOURCE PLAN global ACTIVATE
> INFO : Starting task [Stage-0:DDL] in serial mode
> ERROR : FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.DDLTask. Invalid expression: HDFS_BYTES_READ >
> 300kb
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b);
> Time taken: 0.037 seconds
> Error: Error while processing statement: FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Invalid expression:
> HDFS_BYTES_READ > 300kb (state=08S01,code=1){code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Assigned] (HIVE-19964) Apply resource plan fails if trigger expression has quotes
[
https://issues.apache.org/jira/browse/HIVE-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran reassigned HIVE-19964:
Assignee: Sergey Shelukhin (was: Prasanth Jayachandran)
> Apply resource plan fails if trigger expression has quotes
> --
>
> Key: HIVE-19964
> URL: https://issues.apache.org/jira/browse/HIVE-19964
> Project: Hive
> Issue Type: Bug
>Affects Versions: 3.1.0, 4.0.0
>Reporter: Aswathy Chellammal Sreekumar
>Assignee: Sergey Shelukhin
>Priority: Major
> Attachments: HIVE-19964.1.patch
>
>
> {code:java}
> 0: jdbc:hive2://localhost:1> CREATE TRIGGER global.big_hdfs_read WHEN
> HDFS_BYTES_READ > '300kb' DO KILL;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890):
> CREATE TRIGGER global.big_hdfs_read WHEN HDFS_BYTES_READ > '300kb' DO KILL
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890);
> Time taken: 0.015 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890):
> CREATE TRIGGER global.big_hdfs_read WHEN HDFS_BYTES_READ > '300kb' DO KILL
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890);
> Time taken: 0.025 seconds
> INFO : OK
> No rows affected (0.054 seconds)
> 0: jdbc:hive2://localhost:1> ALTER TRIGGER global.big_hdfs_read ADD TO
> UNMANAGED;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5):
> ALTER TRIGGER global.big_hdfs_read ADD TO UNMANAGED
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5);
> Time taken: 0.014 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5):
> ALTER TRIGGER global.big_hdfs_read ADD TO UNMANAGED
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5);
> Time taken: 0.029 seconds
> INFO : OK
> No rows affected (0.054 seconds)
> 0: jdbc:hive2://localhost:1> ALTER RESOURCE PLAN global ENABLE;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e):
> ALTER RESOURCE PLAN global ENABLE
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e);
> Time taken: 0.012 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e):
> ALTER RESOURCE PLAN global ENABLE
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e);
> Time taken: 0.021 seconds
> INFO : OK
> No rows affected (0.045 seconds)
> 0: jdbc:hive2://localhost:1> ALTER RESOURCE PLAN global ACTIVATE;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b):
> ALTER RESOURCE PLAN global ACTIVATE
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b);
> Time taken: 0.017 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b):
> ALTER RESOURCE PLAN global ACTIVATE
> INFO : Starting task [Stage-0:DDL] in serial mode
> ERROR : FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.DDLTask. Invalid expression: HDFS_BYTES_READ >
> 300kb
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b);
> Time taken: 0.037 seconds
> Error: Error while processing statement: FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Invalid expression:
> HDFS_BYTES_READ > 300kb (state=08S01,code=1){code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Assigned] (HIVE-19964) Apply resource plan fails if trigger expression has quotes
[
https://issues.apache.org/jira/browse/HIVE-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran reassigned HIVE-19964:
Assignee: Prasanth Jayachandran
> Apply resource plan fails if trigger expression has quotes
> --
>
> Key: HIVE-19964
> URL: https://issues.apache.org/jira/browse/HIVE-19964
> Project: Hive
> Issue Type: Bug
>Affects Versions: 3.1.0, 4.0.0
>Reporter: Aswathy Chellammal Sreekumar
>Assignee: Prasanth Jayachandran
>Priority: Major
>
> {code:java}
> 0: jdbc:hive2://localhost:1> CREATE TRIGGER global.big_hdfs_read WHEN
> HDFS_BYTES_READ > '300kb' DO KILL;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890):
> CREATE TRIGGER global.big_hdfs_read WHEN HDFS_BYTES_READ > '300kb' DO KILL
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890);
> Time taken: 0.015 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890):
> CREATE TRIGGER global.big_hdfs_read WHEN HDFS_BYTES_READ > '300kb' DO KILL
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131017_72b1441b-d790-4db7-83ca-479735843890);
> Time taken: 0.025 seconds
> INFO : OK
> No rows affected (0.054 seconds)
> 0: jdbc:hive2://localhost:1> ALTER TRIGGER global.big_hdfs_read ADD TO
> UNMANAGED;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5):
> ALTER TRIGGER global.big_hdfs_read ADD TO UNMANAGED
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5);
> Time taken: 0.014 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5):
> ALTER TRIGGER global.big_hdfs_read ADD TO UNMANAGED
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131031_dd489324-db23-412f-9409-32ba697a10e5);
> Time taken: 0.029 seconds
> INFO : OK
> No rows affected (0.054 seconds)
> 0: jdbc:hive2://localhost:1> ALTER RESOURCE PLAN global ENABLE;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e):
> ALTER RESOURCE PLAN global ENABLE
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e);
> Time taken: 0.012 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e):
> ALTER RESOURCE PLAN global ENABLE
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131036_26a5f4f3-91e3-4bec-ab42-800adb90104e);
> Time taken: 0.021 seconds
> INFO : OK
> No rows affected (0.045 seconds)
> 0: jdbc:hive2://localhost:1> ALTER RESOURCE PLAN global ACTIVATE;
> INFO : Compiling
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b):
> ALTER RESOURCE PLAN global ACTIVATE
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b);
> Time taken: 0.017 seconds
> INFO : Executing
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b):
> ALTER RESOURCE PLAN global ACTIVATE
> INFO : Starting task [Stage-0:DDL] in serial mode
> ERROR : FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.DDLTask. Invalid expression: HDFS_BYTES_READ >
> 300kb
> INFO : Completed executing
> command(queryId=pjayachandran_20180621131037_551b2af0-321b-4638-8ac0-76771a159f4b);
> Time taken: 0.037 seconds
> Error: Error while processing statement: FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Invalid expression:
> HDFS_BYTES_READ > 300kb (state=08S01,code=1){code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-19956) Include yarn registry classes to jdbc standalone jar
[ https://issues.apache.org/jira/browse/HIVE-19956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-19956: - Status: Patch Available (was: Open) > Include yarn registry classes to jdbc standalone jar > > > Key: HIVE-19956 > URL: https://issues.apache.org/jira/browse/HIVE-19956 > Project: Hive > Issue Type: Bug > Components: JDBC >Affects Versions: 3.1.0, 4.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Major > Attachments: HIVE-19956.1.patch > > > HS2 Active/Passive HA requires some yarn registry classes. Include it in JDBC > standalone jar. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-19956) Include yarn registry classes to jdbc standalone jar
[ https://issues.apache.org/jira/browse/HIVE-19956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-19956: - Attachment: HIVE-19956.1.patch > Include yarn registry classes to jdbc standalone jar > > > Key: HIVE-19956 > URL: https://issues.apache.org/jira/browse/HIVE-19956 > Project: Hive > Issue Type: Bug > Components: JDBC >Affects Versions: 3.1.0, 4.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Major > Attachments: HIVE-19956.1.patch > > > HS2 Active/Passive HA requires some yarn registry classes. Include it in JDBC > standalone jar. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-19956) Include yarn registry classes to jdbc standalone jar
[ https://issues.apache.org/jira/browse/HIVE-19956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16519064#comment-16519064 ] Prasanth Jayachandran commented on HIVE-19956: -- [~thejas] can you please take a look? > Include yarn registry classes to jdbc standalone jar > > > Key: HIVE-19956 > URL: https://issues.apache.org/jira/browse/HIVE-19956 > Project: Hive > Issue Type: Bug > Components: JDBC >Affects Versions: 3.1.0, 4.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Major > Attachments: HIVE-19956.1.patch > > > HS2 Active/Passive HA requires some yarn registry classes. Include it in JDBC > standalone jar. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (HIVE-19956) Include yarn registry classes to jdbc standalone jar
[ https://issues.apache.org/jira/browse/HIVE-19956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran reassigned HIVE-19956: > Include yarn registry classes to jdbc standalone jar > > > Key: HIVE-19956 > URL: https://issues.apache.org/jira/browse/HIVE-19956 > Project: Hive > Issue Type: Bug > Components: JDBC >Affects Versions: 3.1.0, 4.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Major > > HS2 Active/Passive HA requires some yarn registry classes. Include it in JDBC > standalone jar. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-15190) Field names are not preserved in ORC files written with ACID
[
https://issues.apache.org/jira/browse/HIVE-15190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran updated HIVE-15190:
-
Resolution: Fixed
Fix Version/s: 4.0.0
3.1.0
Status: Resolved (was: Patch Available)
Committed to branch-3 and master. Thanks [~erwaman] for the contribution!
> Field names are not preserved in ORC files written with ACID
>
>
> Key: HIVE-15190
> URL: https://issues.apache.org/jira/browse/HIVE-15190
> Project: Hive
> Issue Type: Bug
>Affects Versions: 2.1.0, 2.2.0, 3.1.0, 4.0.0
>Reporter: Anthony Hsu
>Assignee: Anthony Hsu
>Priority: Critical
> Fix For: 3.1.0, 4.0.0
>
> Attachments: HIVE-15190.1.patch, HIVE-15190.2.patch,
> HIVE-15190.3.patch, HIVE-15190.4.patch, HIVE-15190.5.patch
>
>
> To repro:
> {noformat}
> drop table if exists orc_nonacid;
> drop table if exists orc_acid;
> create table orc_nonacid (a int) clustered by (a) into 2 buckets stored as
> orc;
> create table orc_acid (a int) clustered by (a) into 2 buckets stored as orc
> TBLPROPERTIES('transactional'='true');
> insert into table orc_nonacid values(1), (2);
> insert into table orc_acid values(1), (2);
> {noformat}
> Running {{hive --service orcfiledump }} on the files created by the
> {{insert}} statements above, you'll see that for {{orc_nonacid}}, the files
> have schema {{struct}} whereas for {{orc_acid}}, the files have schema
> {{struct>}}.
> The last field {{row}} should have schema {{struct}}.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Assigned] (HIVE-15190) Field names are not preserved in ORC files written with ACID
[
https://issues.apache.org/jira/browse/HIVE-15190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran reassigned HIVE-15190:
Assignee: Anthony Hsu (was: Prasanth Jayachandran)
> Field names are not preserved in ORC files written with ACID
>
>
> Key: HIVE-15190
> URL: https://issues.apache.org/jira/browse/HIVE-15190
> Project: Hive
> Issue Type: Bug
>Affects Versions: 2.1.0, 2.2.0, 3.1.0, 4.0.0
>Reporter: Anthony Hsu
>Assignee: Anthony Hsu
>Priority: Critical
> Fix For: 3.1.0, 4.0.0
>
> Attachments: HIVE-15190.1.patch, HIVE-15190.2.patch,
> HIVE-15190.3.patch, HIVE-15190.4.patch, HIVE-15190.5.patch
>
>
> To repro:
> {noformat}
> drop table if exists orc_nonacid;
> drop table if exists orc_acid;
> create table orc_nonacid (a int) clustered by (a) into 2 buckets stored as
> orc;
> create table orc_acid (a int) clustered by (a) into 2 buckets stored as orc
> TBLPROPERTIES('transactional'='true');
> insert into table orc_nonacid values(1), (2);
> insert into table orc_acid values(1), (2);
> {noformat}
> Running {{hive --service orcfiledump }} on the files created by the
> {{insert}} statements above, you'll see that for {{orc_nonacid}}, the files
> have schema {{struct}} whereas for {{orc_acid}}, the files have schema
> {{struct>}}.
> The last field {{row}} should have schema {{struct}}.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Assigned] (HIVE-15190) Field names are not preserved in ORC files written with ACID
[
https://issues.apache.org/jira/browse/HIVE-15190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran reassigned HIVE-15190:
Assignee: Prasanth Jayachandran (was: Anthony Hsu)
> Field names are not preserved in ORC files written with ACID
>
>
> Key: HIVE-15190
> URL: https://issues.apache.org/jira/browse/HIVE-15190
> Project: Hive
> Issue Type: Bug
>Affects Versions: 2.1.0, 2.2.0, 3.1.0, 4.0.0
>Reporter: Anthony Hsu
>Assignee: Prasanth Jayachandran
>Priority: Critical
> Attachments: HIVE-15190.1.patch, HIVE-15190.2.patch,
> HIVE-15190.3.patch, HIVE-15190.4.patch, HIVE-15190.5.patch
>
>
> To repro:
> {noformat}
> drop table if exists orc_nonacid;
> drop table if exists orc_acid;
> create table orc_nonacid (a int) clustered by (a) into 2 buckets stored as
> orc;
> create table orc_acid (a int) clustered by (a) into 2 buckets stored as orc
> TBLPROPERTIES('transactional'='true');
> insert into table orc_nonacid values(1), (2);
> insert into table orc_acid values(1), (2);
> {noformat}
> Running {{hive --service orcfiledump }} on the files created by the
> {{insert}} statements above, you'll see that for {{orc_nonacid}}, the files
> have schema {{struct}} whereas for {{orc_acid}}, the files have schema
> {{struct>}}.
> The last field {{row}} should have schema {{struct}}.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Assigned] (HIVE-15190) Field names are not preserved in ORC files written with ACID
[
https://issues.apache.org/jira/browse/HIVE-15190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran reassigned HIVE-15190:
Assignee: Anthony Hsu (was: Prasanth Jayachandran)
> Field names are not preserved in ORC files written with ACID
>
>
> Key: HIVE-15190
> URL: https://issues.apache.org/jira/browse/HIVE-15190
> Project: Hive
> Issue Type: Bug
>Affects Versions: 2.1.0, 2.2.0, 3.1.0, 4.0.0
>Reporter: Anthony Hsu
>Assignee: Anthony Hsu
>Priority: Critical
> Attachments: HIVE-15190.1.patch, HIVE-15190.2.patch,
> HIVE-15190.3.patch, HIVE-15190.4.patch, HIVE-15190.5.patch
>
>
> To repro:
> {noformat}
> drop table if exists orc_nonacid;
> drop table if exists orc_acid;
> create table orc_nonacid (a int) clustered by (a) into 2 buckets stored as
> orc;
> create table orc_acid (a int) clustered by (a) into 2 buckets stored as orc
> TBLPROPERTIES('transactional'='true');
> insert into table orc_nonacid values(1), (2);
> insert into table orc_acid values(1), (2);
> {noformat}
> Running {{hive --service orcfiledump }} on the files created by the
> {{insert}} statements above, you'll see that for {{orc_nonacid}}, the files
> have schema {{struct}} whereas for {{orc_acid}}, the files have schema
> {{struct>}}.
> The last field {{row}} should have schema {{struct}}.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Assigned] (HIVE-15190) Field names are not preserved in ORC files written with ACID
[
https://issues.apache.org/jira/browse/HIVE-15190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran reassigned HIVE-15190:
Assignee: Prasanth Jayachandran (was: Anthony Hsu)
> Field names are not preserved in ORC files written with ACID
>
>
> Key: HIVE-15190
> URL: https://issues.apache.org/jira/browse/HIVE-15190
> Project: Hive
> Issue Type: Bug
>Affects Versions: 2.1.0, 2.2.0, 3.1.0, 4.0.0
>Reporter: Anthony Hsu
>Assignee: Prasanth Jayachandran
>Priority: Critical
> Attachments: HIVE-15190.1.patch, HIVE-15190.2.patch,
> HIVE-15190.3.patch, HIVE-15190.4.patch, HIVE-15190.5.patch
>
>
> To repro:
> {noformat}
> drop table if exists orc_nonacid;
> drop table if exists orc_acid;
> create table orc_nonacid (a int) clustered by (a) into 2 buckets stored as
> orc;
> create table orc_acid (a int) clustered by (a) into 2 buckets stored as orc
> TBLPROPERTIES('transactional'='true');
> insert into table orc_nonacid values(1), (2);
> insert into table orc_acid values(1), (2);
> {noformat}
> Running {{hive --service orcfiledump }} on the files created by the
> {{insert}} statements above, you'll see that for {{orc_nonacid}}, the files
> have schema {{struct}} whereas for {{orc_acid}}, the files have schema
> {{struct>}}.
> The last field {{row}} should have schema {{struct}}.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Assigned] (HIVE-15190) Field names are not preserved in ORC files written with ACID
[
https://issues.apache.org/jira/browse/HIVE-15190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran reassigned HIVE-15190:
Assignee: Anthony Hsu (was: Prasanth Jayachandran)
> Field names are not preserved in ORC files written with ACID
>
>
> Key: HIVE-15190
> URL: https://issues.apache.org/jira/browse/HIVE-15190
> Project: Hive
> Issue Type: Bug
>Affects Versions: 2.1.0, 2.2.0, 3.1.0, 4.0.0
>Reporter: Anthony Hsu
>Assignee: Anthony Hsu
>Priority: Critical
> Attachments: HIVE-15190.1.patch, HIVE-15190.2.patch,
> HIVE-15190.3.patch, HIVE-15190.4.patch, HIVE-15190.5.patch
>
>
> To repro:
> {noformat}
> drop table if exists orc_nonacid;
> drop table if exists orc_acid;
> create table orc_nonacid (a int) clustered by (a) into 2 buckets stored as
> orc;
> create table orc_acid (a int) clustered by (a) into 2 buckets stored as orc
> TBLPROPERTIES('transactional'='true');
> insert into table orc_nonacid values(1), (2);
> insert into table orc_acid values(1), (2);
> {noformat}
> Running {{hive --service orcfiledump }} on the files created by the
> {{insert}} statements above, you'll see that for {{orc_nonacid}}, the files
> have schema {{struct}} whereas for {{orc_acid}}, the files have schema
> {{struct>}}.
> The last field {{row}} should have schema {{struct}}.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-19926) Remove deprecated hcatalog streaming
[ https://issues.apache.org/jira/browse/HIVE-19926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-19926: - Attachment: HIVE-19926.2.patch > Remove deprecated hcatalog streaming > > > Key: HIVE-19926 > URL: https://issues.apache.org/jira/browse/HIVE-19926 > Project: Hive > Issue Type: Improvement > Components: Streaming >Affects Versions: 4.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Major > Attachments: HIVE-19926.1.patch, HIVE-19926.2.patch > > > hcatalog streaming is deprecated in 3.0.0. We should remove it in 4.0.0. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-19926) Remove deprecated hcatalog streaming
[ https://issues.apache.org/jira/browse/HIVE-19926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16516500#comment-16516500 ] Prasanth Jayachandran commented on HIVE-19926: -- I don't know why this patch was not picked up by precommit queue. Retrying again. > Remove deprecated hcatalog streaming > > > Key: HIVE-19926 > URL: https://issues.apache.org/jira/browse/HIVE-19926 > Project: Hive > Issue Type: Improvement > Components: Streaming >Affects Versions: 4.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Major > Attachments: HIVE-19926.1.patch, HIVE-19926.2.patch > > > hcatalog streaming is deprecated in 3.0.0. We should remove it in 4.0.0. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18545) Add UDF to parse complex types from json
[ https://issues.apache.org/jira/browse/HIVE-18545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16516498#comment-16516498 ] Prasanth Jayachandran commented on HIVE-18545: -- I think it would be better to do this separately. HIVE-19901 can address removing JsonSerDe from hcatalog and moving TestJsonSerDe from hcatalog to serde2 (master only). This Jira can handle the rest of the improvement. > Add UDF to parse complex types from json > > > Key: HIVE-18545 > URL: https://issues.apache.org/jira/browse/HIVE-18545 > Project: Hive > Issue Type: Improvement >Affects Versions: 4.0.0 >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich >Priority: Major > Attachments: HIVE-18545.02.patch, HIVE-18545.03.patch, > HIVE-18545.04.patch, HIVE-18545.05.patch > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18545) Add UDF to parse complex types from json
[
https://issues.apache.org/jira/browse/HIVE-18545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16516496#comment-16516496
]
Prasanth Jayachandran commented on HIVE-18545:
--
{quote}bq. serde2.JsonSerDe was first introduced during streaming efforts - and
not released so far (and as of now it's only on master);
{quote}
streaming efforts got released in 3.0.0.
So removing JsonSerDe from serde2 packing will be breaking change.
> Add UDF to parse complex types from json
>
>
> Key: HIVE-18545
> URL: https://issues.apache.org/jira/browse/HIVE-18545
> Project: Hive
> Issue Type: Improvement
>Affects Versions: 4.0.0
>Reporter: Zoltan Haindrich
>Assignee: Zoltan Haindrich
>Priority: Major
> Attachments: HIVE-18545.02.patch, HIVE-18545.03.patch,
> HIVE-18545.04.patch, HIVE-18545.05.patch
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-15190) Field names are not preserved in ORC files written with ACID
[
https://issues.apache.org/jira/browse/HIVE-15190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16516478#comment-16516478
]
Prasanth Jayachandran commented on HIVE-15190:
--
We seem to have bad runs again. No recent green builds in master.
> Field names are not preserved in ORC files written with ACID
>
>
> Key: HIVE-15190
> URL: https://issues.apache.org/jira/browse/HIVE-15190
> Project: Hive
> Issue Type: Bug
>Affects Versions: 2.1.0, 2.2.0, 3.1.0, 4.0.0
>Reporter: Anthony Hsu
>Assignee: Prasanth Jayachandran
>Priority: Critical
> Attachments: HIVE-15190.1.patch, HIVE-15190.2.patch,
> HIVE-15190.3.patch, HIVE-15190.4.patch, HIVE-15190.5.patch
>
>
> To repro:
> {noformat}
> drop table if exists orc_nonacid;
> drop table if exists orc_acid;
> create table orc_nonacid (a int) clustered by (a) into 2 buckets stored as
> orc;
> create table orc_acid (a int) clustered by (a) into 2 buckets stored as orc
> TBLPROPERTIES('transactional'='true');
> insert into table orc_nonacid values(1), (2);
> insert into table orc_acid values(1), (2);
> {noformat}
> Running {{hive --service orcfiledump }} on the files created by the
> {{insert}} statements above, you'll see that for {{orc_nonacid}}, the files
> have schema {{struct}} whereas for {{orc_acid}}, the files have schema
> {{struct>}}.
> The last field {{row}} should have schema {{struct}}.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-15190) Field names are not preserved in ORC files written with ACID
[
https://issues.apache.org/jira/browse/HIVE-15190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran updated HIVE-15190:
-
Attachment: HIVE-15190.5.patch
> Field names are not preserved in ORC files written with ACID
>
>
> Key: HIVE-15190
> URL: https://issues.apache.org/jira/browse/HIVE-15190
> Project: Hive
> Issue Type: Bug
>Affects Versions: 2.1.0, 2.2.0, 3.1.0, 4.0.0
>Reporter: Anthony Hsu
>Assignee: Prasanth Jayachandran
>Priority: Critical
> Attachments: HIVE-15190.1.patch, HIVE-15190.2.patch,
> HIVE-15190.3.patch, HIVE-15190.4.patch, HIVE-15190.5.patch
>
>
> To repro:
> {noformat}
> drop table if exists orc_nonacid;
> drop table if exists orc_acid;
> create table orc_nonacid (a int) clustered by (a) into 2 buckets stored as
> orc;
> create table orc_acid (a int) clustered by (a) into 2 buckets stored as orc
> TBLPROPERTIES('transactional'='true');
> insert into table orc_nonacid values(1), (2);
> insert into table orc_acid values(1), (2);
> {noformat}
> Running {{hive --service orcfiledump }} on the files created by the
> {{insert}} statements above, you'll see that for {{orc_nonacid}}, the files
> have schema {{struct}} whereas for {{orc_acid}}, the files have schema
> {{struct>}}.
> The last field {{row}} should have schema {{struct}}.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-19908) Block Insert Overwrite with Union All on full CRUD ACID tables using HIVE_UNION_SUBDIR_
[ https://issues.apache.org/jira/browse/HIVE-19908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16516153#comment-16516153 ] Prasanth Jayachandran commented on HIVE-19908: -- +1 > Block Insert Overwrite with Union All on full CRUD ACID tables using > HIVE_UNION_SUBDIR_ > --- > > Key: HIVE-19908 > URL: https://issues.apache.org/jira/browse/HIVE-19908 > Project: Hive > Issue Type: Bug > Components: Transactions >Affects Versions: 3.0.0 >Reporter: Eugene Koifman >Assignee: Eugene Koifman >Priority: Blocker > Attachments: HIVE-19908.01.patch, HIVE-19908.02.patch > > > This currently results in data loss. Will block and suggest using truncate + > insert. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-19792) Enable schema evolution tests for decimal 64
[ https://issues.apache.org/jira/browse/HIVE-19792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16515345#comment-16515345 ] Prasanth Jayachandran commented on HIVE-19792: -- Tested the tests with ORC-379 and the tests worked as expected. Will wait for next orc release. > Enable schema evolution tests for decimal 64 > > > Key: HIVE-19792 > URL: https://issues.apache.org/jira/browse/HIVE-19792 > Project: Hive > Issue Type: Bug >Affects Versions: 4.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Major > Attachments: HIVE-19792.1.patch > > > Following tests are disabled in HIVE-19629 as orc ConvertTreeReaderFactory > does not handle Decimal64ColumnVectors. This jira is to re-enable those tests > after orc supports it. > 1) type_change_test_int_vectorized.q > 2) type_change_test_int.q > 3) orc_schema_evolution_float.q > 4) schema_evol_orc_nonvec_part_all_primitive.q > 5) schema_evol_orc_nonvec_part_all_primitive_llap_io.q > 6) schema_evol_orc_vec_part_all_primitive.q > 7) schema_evol_orc_vec_part_all_primitive_llap_io.q > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-19792) Enable schema evolution tests for decimal 64
[ https://issues.apache.org/jira/browse/HIVE-19792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-19792: - Attachment: HIVE-19792.1.patch > Enable schema evolution tests for decimal 64 > > > Key: HIVE-19792 > URL: https://issues.apache.org/jira/browse/HIVE-19792 > Project: Hive > Issue Type: Bug >Affects Versions: 4.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Major > Attachments: HIVE-19792.1.patch > > > Following tests are disabled in HIVE-19629 as orc ConvertTreeReaderFactory > does not handle Decimal64ColumnVectors. This jira is to re-enable those tests > after orc supports it. > 1) type_change_test_int_vectorized.q > 2) type_change_test_int.q > 3) orc_schema_evolution_float.q > 4) schema_evol_orc_nonvec_part_all_primitive.q > 5) schema_evol_orc_nonvec_part_all_primitive_llap_io.q > 6) schema_evol_orc_vec_part_all_primitive.q > 7) schema_evol_orc_vec_part_all_primitive_llap_io.q > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (HIVE-19792) Enable schema evolution tests for decimal 64
[ https://issues.apache.org/jira/browse/HIVE-19792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran reassigned HIVE-19792: Assignee: Prasanth Jayachandran > Enable schema evolution tests for decimal 64 > > > Key: HIVE-19792 > URL: https://issues.apache.org/jira/browse/HIVE-19792 > Project: Hive > Issue Type: Bug >Affects Versions: 4.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Major > > Following tests are disabled in HIVE-19629 as orc ConvertTreeReaderFactory > does not handle Decimal64ColumnVectors. This jira is to re-enable those tests > after orc supports it. > 1) type_change_test_int_vectorized.q > 2) type_change_test_int.q > 3) orc_schema_evolution_float.q > 4) schema_evol_orc_nonvec_part_all_primitive.q > 5) schema_evol_orc_nonvec_part_all_primitive_llap_io.q > 6) schema_evol_orc_vec_part_all_primitive.q > 7) schema_evol_orc_vec_part_all_primitive_llap_io.q > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-19926) Remove deprecated hcatalog streaming
[ https://issues.apache.org/jira/browse/HIVE-19926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-19926: - Status: Patch Available (was: Open) > Remove deprecated hcatalog streaming > > > Key: HIVE-19926 > URL: https://issues.apache.org/jira/browse/HIVE-19926 > Project: Hive > Issue Type: Improvement > Components: Streaming >Affects Versions: 4.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Major > Attachments: HIVE-19926.1.patch > > > hcatalog streaming is deprecated in 3.0.0. We should remove it in 4.0.0. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-19926) Remove deprecated hcatalog streaming
[ https://issues.apache.org/jira/browse/HIVE-19926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-19926: - Attachment: HIVE-19926.1.patch > Remove deprecated hcatalog streaming > > > Key: HIVE-19926 > URL: https://issues.apache.org/jira/browse/HIVE-19926 > Project: Hive > Issue Type: Improvement > Components: Streaming >Affects Versions: 4.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Major > Attachments: HIVE-19926.1.patch > > > hcatalog streaming is deprecated in 3.0.0. We should remove it in 4.0.0. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-19926) Remove deprecated hcatalog streaming
[ https://issues.apache.org/jira/browse/HIVE-19926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16515314#comment-16515314 ] Prasanth Jayachandran commented on HIVE-19926: -- [~ekoifman] can you please take a look? This removes hcatalog/streaming module altogether from 4.0.0. > Remove deprecated hcatalog streaming > > > Key: HIVE-19926 > URL: https://issues.apache.org/jira/browse/HIVE-19926 > Project: Hive > Issue Type: Improvement > Components: Streaming >Affects Versions: 4.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Major > Attachments: HIVE-19926.1.patch > > > hcatalog streaming is deprecated in 3.0.0. We should remove it in 4.0.0. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-15190) Field names are not preserved in ORC files written with ACID
[
https://issues.apache.org/jira/browse/HIVE-15190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16515263#comment-16515263
]
Prasanth Jayachandran commented on HIVE-15190:
--
Fixes tests
> Field names are not preserved in ORC files written with ACID
>
>
> Key: HIVE-15190
> URL: https://issues.apache.org/jira/browse/HIVE-15190
> Project: Hive
> Issue Type: Bug
>Affects Versions: 2.1.0, 2.2.0, 3.1.0, 4.0.0
>Reporter: Anthony Hsu
>Assignee: Prasanth Jayachandran
>Priority: Critical
> Attachments: HIVE-15190.1.patch, HIVE-15190.2.patch,
> HIVE-15190.3.patch, HIVE-15190.4.patch
>
>
> To repro:
> {noformat}
> drop table if exists orc_nonacid;
> drop table if exists orc_acid;
> create table orc_nonacid (a int) clustered by (a) into 2 buckets stored as
> orc;
> create table orc_acid (a int) clustered by (a) into 2 buckets stored as orc
> TBLPROPERTIES('transactional'='true');
> insert into table orc_nonacid values(1), (2);
> insert into table orc_acid values(1), (2);
> {noformat}
> Running {{hive --service orcfiledump }} on the files created by the
> {{insert}} statements above, you'll see that for {{orc_nonacid}}, the files
> have schema {{struct}} whereas for {{orc_acid}}, the files have schema
> {{struct>}}.
> The last field {{row}} should have schema {{struct}}.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-15190) Field names are not preserved in ORC files written with ACID
[
https://issues.apache.org/jira/browse/HIVE-15190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran updated HIVE-15190:
-
Attachment: HIVE-15190.4.patch
> Field names are not preserved in ORC files written with ACID
>
>
> Key: HIVE-15190
> URL: https://issues.apache.org/jira/browse/HIVE-15190
> Project: Hive
> Issue Type: Bug
>Affects Versions: 2.1.0, 2.2.0, 3.1.0, 4.0.0
>Reporter: Anthony Hsu
>Assignee: Prasanth Jayachandran
>Priority: Critical
> Attachments: HIVE-15190.1.patch, HIVE-15190.2.patch,
> HIVE-15190.3.patch, HIVE-15190.4.patch
>
>
> To repro:
> {noformat}
> drop table if exists orc_nonacid;
> drop table if exists orc_acid;
> create table orc_nonacid (a int) clustered by (a) into 2 buckets stored as
> orc;
> create table orc_acid (a int) clustered by (a) into 2 buckets stored as orc
> TBLPROPERTIES('transactional'='true');
> insert into table orc_nonacid values(1), (2);
> insert into table orc_acid values(1), (2);
> {noformat}
> Running {{hive --service orcfiledump }} on the files created by the
> {{insert}} statements above, you'll see that for {{orc_nonacid}}, the files
> have schema {{struct}} whereas for {{orc_acid}}, the files have schema
> {{struct>}}.
> The last field {{row}} should have schema {{struct}}.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Assigned] (HIVE-19926) Remove deprecated hcatalog streaming
[ https://issues.apache.org/jira/browse/HIVE-19926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran reassigned HIVE-19926: > Remove deprecated hcatalog streaming > > > Key: HIVE-19926 > URL: https://issues.apache.org/jira/browse/HIVE-19926 > Project: Hive > Issue Type: Improvement > Components: Streaming >Affects Versions: 4.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Major > > hcatalog streaming is deprecated in 3.0.0. We should remove it in 4.0.0. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-19629) Enable Decimal64 reader after orc version upgrade
[ https://issues.apache.org/jira/browse/HIVE-19629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-19629: - Resolution: Fixed Fix Version/s: 3.1.0 Status: Resolved (was: Patch Available) Committed to branch-3 as well. > Enable Decimal64 reader after orc version upgrade > - > > Key: HIVE-19629 > URL: https://issues.apache.org/jira/browse/HIVE-19629 > Project: Hive > Issue Type: Bug >Affects Versions: 3.1.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Major > Fix For: 3.1.0, 4.0.0 > > Attachments: HIVE-19629-branch-3.patch, HIVE-19629.1.patch, > HIVE-19629.10.patch, HIVE-19629.11.patch, HIVE-19629.12.patch, > HIVE-19629.13.patch, HIVE-19629.14.patch, HIVE-19629.15.patch, > HIVE-19629.16.patch, HIVE-19629.2.patch, HIVE-19629.3.patch, > HIVE-19629.4.patch, HIVE-19629.5.patch, HIVE-19629.6.patch, > HIVE-19629.7.patch, HIVE-19629.8.patch, HIVE-19629.9.patch > > > ORC 1.5.0 supports new fast decimal 64 reader. New VRB has to be created for > making use of decimal 64 column vectors. Also LLAP IO will need a new reader > to reader from long stream to decimal 64. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-19629) Enable Decimal64 reader after orc version upgrade
[ https://issues.apache.org/jira/browse/HIVE-19629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16515177#comment-16515177 ] Prasanth Jayachandran commented on HIVE-19629: -- branch-3 has several existing failures (refer HIVE-19881, HIVE-19739). The branch-3 failures are same as the ones in HIVE-19881 and HIVE-19739. I am not sure the test changes that went in for master also went into branch-3 that could have solved the branch-3 test issues (timeout changes, tmp directory changes, retry changes). > Enable Decimal64 reader after orc version upgrade > - > > Key: HIVE-19629 > URL: https://issues.apache.org/jira/browse/HIVE-19629 > Project: Hive > Issue Type: Bug >Affects Versions: 3.1.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-19629-branch-3.patch, HIVE-19629.1.patch, > HIVE-19629.10.patch, HIVE-19629.11.patch, HIVE-19629.12.patch, > HIVE-19629.13.patch, HIVE-19629.14.patch, HIVE-19629.15.patch, > HIVE-19629.16.patch, HIVE-19629.2.patch, HIVE-19629.3.patch, > HIVE-19629.4.patch, HIVE-19629.5.patch, HIVE-19629.6.patch, > HIVE-19629.7.patch, HIVE-19629.8.patch, HIVE-19629.9.patch > > > ORC 1.5.0 supports new fast decimal 64 reader. New VRB has to be created for > making use of decimal 64 column vectors. Also LLAP IO will need a new reader > to reader from long stream to decimal 64. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-19366) Vectorization causing TestStreaming.testStreamBucketingMatchesRegularBucketing to fail
[ https://issues.apache.org/jira/browse/HIVE-19366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-19366: - Resolution: Fixed Fix Version/s: 4.0.0 3.1.0 Status: Resolved (was: Patch Available) Committed to branch-3 and master. > Vectorization causing > TestStreaming.testStreamBucketingMatchesRegularBucketing to fail > -- > > Key: HIVE-19366 > URL: https://issues.apache.org/jira/browse/HIVE-19366 > Project: Hive > Issue Type: Sub-task > Components: Streaming >Affects Versions: 3.1.0, 4.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Major > Fix For: 3.1.0, 4.0.0 > > Attachments: HIVE-19366.1.patch > > > Disabled vectorization for > TestStreaming#testStreamBucketingMatchesRegularBucketing test case in > HIVE-19211 as it is giving incorrect results (the issue is mostly related to > wrong table directory location which returns 0 splits). -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-19629) Enable Decimal64 reader after orc version upgrade
[ https://issues.apache.org/jira/browse/HIVE-19629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-19629: - Attachment: HIVE-19629-branch-3.patch > Enable Decimal64 reader after orc version upgrade > - > > Key: HIVE-19629 > URL: https://issues.apache.org/jira/browse/HIVE-19629 > Project: Hive > Issue Type: Bug >Affects Versions: 3.1.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-19629-branch-3.patch, HIVE-19629.1.patch, > HIVE-19629.10.patch, HIVE-19629.11.patch, HIVE-19629.12.patch, > HIVE-19629.13.patch, HIVE-19629.14.patch, HIVE-19629.15.patch, > HIVE-19629.16.patch, HIVE-19629.2.patch, HIVE-19629.3.patch, > HIVE-19629.4.patch, HIVE-19629.5.patch, HIVE-19629.6.patch, > HIVE-19629.7.patch, HIVE-19629.8.patch, HIVE-19629.9.patch > > > ORC 1.5.0 supports new fast decimal 64 reader. New VRB has to be created for > making use of decimal 64 column vectors. Also LLAP IO will need a new reader > to reader from long stream to decimal 64. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-19629) Enable Decimal64 reader after orc version upgrade
[ https://issues.apache.org/jira/browse/HIVE-19629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16514876#comment-16514876 ] Prasanth Jayachandran commented on HIVE-19629: -- Committed to master. Will put up a patch for branch-3. > Enable Decimal64 reader after orc version upgrade > - > > Key: HIVE-19629 > URL: https://issues.apache.org/jira/browse/HIVE-19629 > Project: Hive > Issue Type: Bug >Affects Versions: 3.1.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-19629.1.patch, HIVE-19629.10.patch, > HIVE-19629.11.patch, HIVE-19629.12.patch, HIVE-19629.13.patch, > HIVE-19629.14.patch, HIVE-19629.15.patch, HIVE-19629.16.patch, > HIVE-19629.2.patch, HIVE-19629.3.patch, HIVE-19629.4.patch, > HIVE-19629.5.patch, HIVE-19629.6.patch, HIVE-19629.7.patch, > HIVE-19629.8.patch, HIVE-19629.9.patch > > > ORC 1.5.0 supports new fast decimal 64 reader. New VRB has to be created for > making use of decimal 64 column vectors. Also LLAP IO will need a new reader > to reader from long stream to decimal 64. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-19629) Enable Decimal64 reader after orc version upgrade
[ https://issues.apache.org/jira/browse/HIVE-19629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-19629: - Fix Version/s: 4.0.0 > Enable Decimal64 reader after orc version upgrade > - > > Key: HIVE-19629 > URL: https://issues.apache.org/jira/browse/HIVE-19629 > Project: Hive > Issue Type: Bug >Affects Versions: 3.1.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-19629.1.patch, HIVE-19629.10.patch, > HIVE-19629.11.patch, HIVE-19629.12.patch, HIVE-19629.13.patch, > HIVE-19629.14.patch, HIVE-19629.15.patch, HIVE-19629.16.patch, > HIVE-19629.2.patch, HIVE-19629.3.patch, HIVE-19629.4.patch, > HIVE-19629.5.patch, HIVE-19629.6.patch, HIVE-19629.7.patch, > HIVE-19629.8.patch, HIVE-19629.9.patch > > > ORC 1.5.0 supports new fast decimal 64 reader. New VRB has to be created for > making use of decimal 64 column vectors. Also LLAP IO will need a new reader > to reader from long stream to decimal 64. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-19918) IllegalArgumentException when getContext().getVertexTaskResource().getMemory() returns -1
[
https://issues.apache.org/jira/browse/HIVE-19918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16514472#comment-16514472
]
Prasanth Jayachandran commented on HIVE-19918:
--
Missing hive.tez.container.size?
> IllegalArgumentException when
> getContext().getVertexTaskResource().getMemory() returns -1
> -
>
> Key: HIVE-19918
> URL: https://issues.apache.org/jira/browse/HIVE-19918
> Project: Hive
> Issue Type: Bug
>Reporter: Jaume M
>Priority: Major
>
> {code}
> Beeline version 4.0.0-SNAPSHOT by Apache Hive
> ;: jdbc:hive2://hs2.example.com:1/> CREATE TABLE pokes (foo INT, bar
> STRING)
> No rows affected (3.834 seconds)
> G) PARTITIONED BY (ds STRING);m:1/> CREATE TABLE invites (foo INT, bar
> STRIN
> No rows affected (0.175 seconds)
> 0: jdbc:hive2://hs2.example.com:1/> SELECT * FROM pokes, invites;
> Error: Error while processing statement: FAILED: Execution Error, return code
> 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed,
> vertexName=Map 1, vertexId=vertex_1529099908701_0003_1_01,
> diagnostics=[Vertex vertex_1529099908701_0003_1_01 [Map 1] killed/failed due
> to:ROOT_INPUT_INIT_FAILURE, Vertex Input: pokes initializer failed,
> vertex=vertex_1529099908701_0003_1_01 [Map 1],
> java.lang.IllegalArgumentException: Illegal Capacity: -10444
> at java.util.ArrayList.(ArrayList.java:157)
> at
> org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:339)
> at
> org.apache.hadoop.hive.ql.io.HiveInputFormat.addSplitsForGroup(HiveInputFormat.java:519)
> at
> org.apache.hadoop.hive.ql.io.HiveInputFormat.getSplits(HiveInputFormat.java:768)
> at
> org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.initialize(HiveSplitGenerator.java:211)
> at
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:278)
> at
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:269)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1965)
> at
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:269)
> at
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:253)
> at
> com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:108)
> at
> com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:41)
> at
> com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:77)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> ]DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:0
> (state=08S01,code=2)
> {code}
> This is happening because
> [here|https://github.com/apache/hive/blob/bceb3dd82cbeb0334c3c33da7a21a74ad631810b/ql/src/java/org/apache/hadoop/hive/ql/exec/tez/HiveSplitGenerator.java#L188]
> the return is -1 and afterwards we request a negative number of splits.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-19875) increase LLAP IO queue size for perf
[ https://issues.apache.org/jira/browse/HIVE-19875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-19875: - Resolution: Fixed Fix Version/s: 4.0.0 3.0.1 3.1.0 Status: Resolved (was: Patch Available) Committed to branch-3, branch-3.0 and master. Thanks for the review! > increase LLAP IO queue size for perf > > > Key: HIVE-19875 > URL: https://issues.apache.org/jira/browse/HIVE-19875 > Project: Hive > Issue Type: Bug >Affects Versions: 3.1.0, 4.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Major > Fix For: 3.1.0, 3.0.1, 4.0.0 > > Attachments: HIVE-19875.1.patch, HIVE-19875.2.patch > > > According to [~gopalv] queue limit has perf impact, esp. during hashtable > load for mapjoin where in the past IO used to queue up more data for > processing to process. > 1) Overall the default limit could be adjusted higher. > 2) Depending on Decimal64 availability, the weight for decimal columns could > be reduced. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (HIVE-19912) Schema evolution checks prints a log line in INFO mode for each vectorized rowbatch, impacts performance
[
https://issues.apache.org/jira/browse/HIVE-19912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran reassigned HIVE-19912:
Assignee: Nita Dembla (was: Prasanth Jayachandran)
> Schema evolution checks prints a log line in INFO mode for each vectorized
> rowbatch, impacts performance
>
>
> Key: HIVE-19912
> URL: https://issues.apache.org/jira/browse/HIVE-19912
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Affects Versions: 3.0.0
>Reporter: Nita Dembla
>Assignee: Nita Dembla
>Priority: Major
> Fix For: 3.1.0, 3.0.1, 4.0.0
>
> Attachments: HIVE-19912.1.patch, HIVE-19912.2.patch
>
>
> While benchmarking query96, noticed 17K log lines printed for each vector
> rowbactch
>
> In file ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java
>
> {code:java}
> @@ -2554,8 +2554,8 @@ public static TypeDescription
> getDesiredRowTypeDescr(Configuration conf,
> }
> if (haveSchemaEvolutionProperties) {
> - if (LOG.isInfoEnabled()) {
> - LOG.info("Using schema evolution configuration variables
> schema.evolution.columns " +
> + if (LOG.isDebugEnabled()) {
> + LOG.debug("Using schema evolution configuration variables
> schema.evolution.columns " +
> schemaEvolutionColumnNames.toString() +
> " / schema.evolution.columns.types " +
> schemaEvolutionTypeDescrs.toString() +{code}
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Assigned] (HIVE-19912) Schema evolution checks prints a log line in INFO mode for each vectorized rowbatch, impacts performance
[
https://issues.apache.org/jira/browse/HIVE-19912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran reassigned HIVE-19912:
Assignee: Prasanth Jayachandran (was: Nita Dembla)
> Schema evolution checks prints a log line in INFO mode for each vectorized
> rowbatch, impacts performance
>
>
> Key: HIVE-19912
> URL: https://issues.apache.org/jira/browse/HIVE-19912
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Affects Versions: 3.0.0
>Reporter: Nita Dembla
>Assignee: Prasanth Jayachandran
>Priority: Major
> Fix For: 3.1.0, 3.0.1, 4.0.0
>
> Attachments: HIVE-19912.1.patch, HIVE-19912.2.patch
>
>
> While benchmarking query96, noticed 17K log lines printed for each vector
> rowbactch
>
> In file ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java
>
> {code:java}
> @@ -2554,8 +2554,8 @@ public static TypeDescription
> getDesiredRowTypeDescr(Configuration conf,
> }
> if (haveSchemaEvolutionProperties) {
> - if (LOG.isInfoEnabled()) {
> - LOG.info("Using schema evolution configuration variables
> schema.evolution.columns " +
> + if (LOG.isDebugEnabled()) {
> + LOG.debug("Using schema evolution configuration variables
> schema.evolution.columns " +
> schemaEvolutionColumnNames.toString() +
> " / schema.evolution.columns.types " +
> schemaEvolutionTypeDescrs.toString() +{code}
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-19912) Schema evolution checks prints a log line in INFO mode for each vectorized rowbatch, impacts performance
[
https://issues.apache.org/jira/browse/HIVE-19912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran updated HIVE-19912:
-
Attachment: HIVE-19912.2.patch
> Schema evolution checks prints a log line in INFO mode for each vectorized
> rowbatch, impacts performance
>
>
> Key: HIVE-19912
> URL: https://issues.apache.org/jira/browse/HIVE-19912
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Affects Versions: 3.0.0
>Reporter: Nita Dembla
>Assignee: Prasanth Jayachandran
>Priority: Major
> Fix For: 3.1.0, 3.0.1, 4.0.0
>
> Attachments: HIVE-19912.1.patch, HIVE-19912.2.patch
>
>
> While benchmarking query96, noticed 17K log lines printed for each vector
> rowbactch
>
> In file ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java
>
> {code:java}
> @@ -2554,8 +2554,8 @@ public static TypeDescription
> getDesiredRowTypeDescr(Configuration conf,
> }
> if (haveSchemaEvolutionProperties) {
> - if (LOG.isInfoEnabled()) {
> - LOG.info("Using schema evolution configuration variables
> schema.evolution.columns " +
> + if (LOG.isDebugEnabled()) {
> + LOG.debug("Using schema evolution configuration variables
> schema.evolution.columns " +
> schemaEvolutionColumnNames.toString() +
> " / schema.evolution.columns.types " +
> schemaEvolutionTypeDescrs.toString() +{code}
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-19912) Schema evolution checks prints a log line in INFO mode for each vectorized rowbatch, impacts performance
[
https://issues.apache.org/jira/browse/HIVE-19912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran updated HIVE-19912:
-
Resolution: Fixed
Fix Version/s: 4.0.0
3.1.0
Status: Resolved (was: Patch Available)
Committed to branch-3, branch-3.0 and master. Thanks for the patch!
> Schema evolution checks prints a log line in INFO mode for each vectorized
> rowbatch, impacts performance
>
>
> Key: HIVE-19912
> URL: https://issues.apache.org/jira/browse/HIVE-19912
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Affects Versions: 3.0.0
>Reporter: Nita Dembla
>Assignee: Nita Dembla
>Priority: Major
> Fix For: 3.1.0, 3.0.1, 4.0.0
>
> Attachments: HIVE-19912.1.patch, HIVE-19912.2.patch
>
>
> While benchmarking query96, noticed 17K log lines printed for each vector
> rowbactch
>
> In file ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java
>
> {code:java}
> @@ -2554,8 +2554,8 @@ public static TypeDescription
> getDesiredRowTypeDescr(Configuration conf,
> }
> if (haveSchemaEvolutionProperties) {
> - if (LOG.isInfoEnabled()) {
> - LOG.info("Using schema evolution configuration variables
> schema.evolution.columns " +
> + if (LOG.isDebugEnabled()) {
> + LOG.debug("Using schema evolution configuration variables
> schema.evolution.columns " +
> schemaEvolutionColumnNames.toString() +
> " / schema.evolution.columns.types " +
> schemaEvolutionTypeDescrs.toString() +{code}
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-19912) Schema evolution checks prints a log line in INFO mode for each vectorized rowbatch, impacts performance
[
https://issues.apache.org/jira/browse/HIVE-19912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16514213#comment-16514213
]
Prasanth Jayachandran commented on HIVE-19912:
--
Since this is logging only change, I don't think this needs a precommit run. I
will address the above comment and commit it.
> Schema evolution checks prints a log line in INFO mode for each vectorized
> rowbatch, impacts performance
>
>
> Key: HIVE-19912
> URL: https://issues.apache.org/jira/browse/HIVE-19912
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Affects Versions: 3.0.0
>Reporter: Nita Dembla
>Assignee: Nita Dembla
>Priority: Major
> Fix For: 3.0.1
>
> Attachments: HIVE-19912.1.patch
>
>
> While benchmarking query96, noticed 17K log lines printed for each vector
> rowbactch
>
> In file ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java
>
> {code:java}
> @@ -2554,8 +2554,8 @@ public static TypeDescription
> getDesiredRowTypeDescr(Configuration conf,
> }
> if (haveSchemaEvolutionProperties) {
> - if (LOG.isInfoEnabled()) {
> - LOG.info("Using schema evolution configuration variables
> schema.evolution.columns " +
> + if (LOG.isDebugEnabled()) {
> + LOG.debug("Using schema evolution configuration variables
> schema.evolution.columns " +
> schemaEvolutionColumnNames.toString() +
> " / schema.evolution.columns.types " +
> schemaEvolutionTypeDescrs.toString() +{code}
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-19912) Schema evolution checks prints a log line in INFO mode for each vectorized rowbatch, impacts performance
[
https://issues.apache.org/jira/browse/HIVE-19912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16514095#comment-16514095
]
Prasanth Jayachandran commented on HIVE-19912:
--
LOG.isInfoEnabled() -> LOG.isDebugEnabled() ?
> Schema evolution checks prints a log line in INFO mode for each vectorized
> rowbatch, impacts performance
>
>
> Key: HIVE-19912
> URL: https://issues.apache.org/jira/browse/HIVE-19912
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Affects Versions: 3.0.0
>Reporter: Nita Dembla
>Assignee: Nita Dembla
>Priority: Major
> Fix For: 3.0.1
>
> Attachments: HIVE-19912.1.patch
>
>
> While benchmarking query96, noticed 17K log lines printed for each vector
> rowbactch
>
> In file ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java
>
> {code:java}
> @@ -2554,8 +2554,8 @@ public static TypeDescription
> getDesiredRowTypeDescr(Configuration conf,
> }
> if (haveSchemaEvolutionProperties) {
> - if (LOG.isInfoEnabled()) {
> - LOG.info("Using schema evolution configuration variables
> schema.evolution.columns " +
> + if (LOG.isDebugEnabled()) {
> + LOG.debug("Using schema evolution configuration variables
> schema.evolution.columns " +
> schemaEvolutionColumnNames.toString() +
> " / schema.evolution.columns.types " +
> schemaEvolutionTypeDescrs.toString() +{code}
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Assigned] (HIVE-19912) Schema evolution checks prints a log line in INFO mode for each vectorized rowbatch, impacts performance
[
https://issues.apache.org/jira/browse/HIVE-19912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran reassigned HIVE-19912:
Assignee: (was: Prasanth Jayachandran)
> Schema evolution checks prints a log line in INFO mode for each vectorized
> rowbatch, impacts performance
>
>
> Key: HIVE-19912
> URL: https://issues.apache.org/jira/browse/HIVE-19912
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Affects Versions: 3.0.0
>Reporter: Nita Dembla
>Priority: Major
> Fix For: 3.0.1
>
>
> While benchmarking query96, noticed 17K log lines printed for each vector
> rowbactch
>
> In file ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java
>
> {code:java}
> @@ -2554,8 +2554,8 @@ public static TypeDescription
> getDesiredRowTypeDescr(Configuration conf,
> }
> if (haveSchemaEvolutionProperties) {
> - if (LOG.isInfoEnabled()) {
> - LOG.info("Using schema evolution configuration variables
> schema.evolution.columns " +
> + if (LOG.isDebugEnabled()) {
> + LOG.debug("Using schema evolution configuration variables
> schema.evolution.columns " +
> schemaEvolutionColumnNames.toString() +
> " / schema.evolution.columns.types " +
> schemaEvolutionTypeDescrs.toString() +{code}
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Assigned] (HIVE-19912) Schema evolution checks prints a log line in INFO mode for each vectorized rowbatch, impacts performance
[
https://issues.apache.org/jira/browse/HIVE-19912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran reassigned HIVE-19912:
Assignee: Prasanth Jayachandran
> Schema evolution checks prints a log line in INFO mode for each vectorized
> rowbatch, impacts performance
>
>
> Key: HIVE-19912
> URL: https://issues.apache.org/jira/browse/HIVE-19912
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Affects Versions: 3.0.0
>Reporter: Nita Dembla
>Assignee: Prasanth Jayachandran
>Priority: Major
> Fix For: 3.0.1
>
>
> While benchmarking query96, noticed 17K log lines printed for each vector
> rowbactch
>
> In file ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java
>
> {code:java}
> @@ -2554,8 +2554,8 @@ public static TypeDescription
> getDesiredRowTypeDescr(Configuration conf,
> }
> if (haveSchemaEvolutionProperties) {
> - if (LOG.isInfoEnabled()) {
> - LOG.info("Using schema evolution configuration variables
> schema.evolution.columns " +
> + if (LOG.isDebugEnabled()) {
> + LOG.debug("Using schema evolution configuration variables
> schema.evolution.columns " +
> schemaEvolutionColumnNames.toString() +
> " / schema.evolution.columns.types " +
> schemaEvolutionTypeDescrs.toString() +{code}
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-18545) Add UDF to parse complex types from json
[ https://issues.apache.org/jira/browse/HIVE-18545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16514075#comment-16514075 ] Prasanth Jayachandran commented on HIVE-18545: -- There are few incompatible changes (package rename, likely removal from hcatalog), so marking this ticket as 4.0.0 only. > Add UDF to parse complex types from json > > > Key: HIVE-18545 > URL: https://issues.apache.org/jira/browse/HIVE-18545 > Project: Hive > Issue Type: Improvement >Affects Versions: 4.0.0 >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich >Priority: Major > Attachments: HIVE-18545.02.patch, HIVE-18545.03.patch, > HIVE-18545.04.patch > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-18545) Add UDF to parse complex types from json
[ https://issues.apache.org/jira/browse/HIVE-18545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-18545: - Affects Version/s: 4.0.0 > Add UDF to parse complex types from json > > > Key: HIVE-18545 > URL: https://issues.apache.org/jira/browse/HIVE-18545 > Project: Hive > Issue Type: Improvement >Affects Versions: 4.0.0 >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich >Priority: Major > Attachments: HIVE-18545.02.patch, HIVE-18545.03.patch, > HIVE-18545.04.patch > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18545) Add UDF to parse complex types from json
[ https://issues.apache.org/jira/browse/HIVE-18545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16514063#comment-16514063 ] Prasanth Jayachandran commented on HIVE-18545: -- I think in master, we should remove the JsonSerDe from hcatalog and use the one from serde2 package. In branch-3 we can mark the JsonSerDe in hcatalog as deprecated. Also TestJsonSerDe has to be moved to serde2 package. I left a TODO in there but forgot to do it in a follow up. I can take care of move TestJsonSerDe to serde2 if you like (in a separate ticket). > Add UDF to parse complex types from json > > > Key: HIVE-18545 > URL: https://issues.apache.org/jira/browse/HIVE-18545 > Project: Hive > Issue Type: Improvement >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich >Priority: Major > Attachments: HIVE-18545.02.patch, HIVE-18545.03.patch, > HIVE-18545.04.patch > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-19629) Enable Decimal64 reader after orc version upgrade
[ https://issues.apache.org/jira/browse/HIVE-19629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16513408#comment-16513408 ] Prasanth Jayachandran commented on HIVE-19629: -- yet another rebase > Enable Decimal64 reader after orc version upgrade > - > > Key: HIVE-19629 > URL: https://issues.apache.org/jira/browse/HIVE-19629 > Project: Hive > Issue Type: Bug >Affects Versions: 3.1.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Major > Attachments: HIVE-19629.1.patch, HIVE-19629.10.patch, > HIVE-19629.11.patch, HIVE-19629.12.patch, HIVE-19629.13.patch, > HIVE-19629.14.patch, HIVE-19629.15.patch, HIVE-19629.16.patch, > HIVE-19629.2.patch, HIVE-19629.3.patch, HIVE-19629.4.patch, > HIVE-19629.5.patch, HIVE-19629.6.patch, HIVE-19629.7.patch, > HIVE-19629.8.patch, HIVE-19629.9.patch > > > ORC 1.5.0 supports new fast decimal 64 reader. New VRB has to be created for > making use of decimal 64 column vectors. Also LLAP IO will need a new reader > to reader from long stream to decimal 64. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-19629) Enable Decimal64 reader after orc version upgrade
[ https://issues.apache.org/jira/browse/HIVE-19629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-19629: - Attachment: HIVE-19629.16.patch > Enable Decimal64 reader after orc version upgrade > - > > Key: HIVE-19629 > URL: https://issues.apache.org/jira/browse/HIVE-19629 > Project: Hive > Issue Type: Bug >Affects Versions: 3.1.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Major > Attachments: HIVE-19629.1.patch, HIVE-19629.10.patch, > HIVE-19629.11.patch, HIVE-19629.12.patch, HIVE-19629.13.patch, > HIVE-19629.14.patch, HIVE-19629.15.patch, HIVE-19629.16.patch, > HIVE-19629.2.patch, HIVE-19629.3.patch, HIVE-19629.4.patch, > HIVE-19629.5.patch, HIVE-19629.6.patch, HIVE-19629.7.patch, > HIVE-19629.8.patch, HIVE-19629.9.patch > > > ORC 1.5.0 supports new fast decimal 64 reader. New VRB has to be created for > making use of decimal 64 column vectors. Also LLAP IO will need a new reader > to reader from long stream to decimal 64. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-19877) Remove setting hive.execution.engine as mr in HiveStreamingConnection
[ https://issues.apache.org/jira/browse/HIVE-19877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-19877: - Resolution: Fixed Fix Version/s: 4.0.0 3.1.0 Status: Resolved (was: Patch Available) Committed to branch-3 and master. Thanks for the review! > Remove setting hive.execution.engine as mr in HiveStreamingConnection > - > > Key: HIVE-19877 > URL: https://issues.apache.org/jira/browse/HIVE-19877 > Project: Hive > Issue Type: Bug > Components: Streaming >Affects Versions: 3.1.0, 4.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Major > Fix For: 3.1.0, 4.0.0 > > Attachments: HIVE-19877.1.patch > > > HiveStreamingConnection explicitly sets execution engine to mr which was from > old code. It is no longer required. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-19864) Address TestTriggersWorkloadManager flakiness
[ https://issues.apache.org/jira/browse/HIVE-19864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-19864: - Resolution: Fixed Fix Version/s: 4.0.0 3.1.0 Status: Resolved (was: Patch Available) Committed to master and branch-3. Thanks for the review! > Address TestTriggersWorkloadManager flakiness > - > > Key: HIVE-19864 > URL: https://issues.apache.org/jira/browse/HIVE-19864 > Project: Hive > Issue Type: Bug >Affects Versions: 3.1.0, 4.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran >Priority: Major > Fix For: 3.1.0, 4.0.0 > > Attachments: HIVE-19864.1.patch > > > TestTriggersWorkloadManager seems flaky and all test cases gets timed out at > times. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
