[jira] [Commented] (HIVE-21237) [JDK 11] SessionState can't be initialized due to classloader problem
[ https://issues.apache.org/jira/browse/HIVE-21237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929902#comment-16929902 ] Yuming Wang commented on HIVE-21237: The issue should fixed by HIVE-21584. > [JDK 11] SessionState can't be initialized due to classloader problem > - > > Key: HIVE-21237 > URL: https://issues.apache.org/jira/browse/HIVE-21237 > Project: Hive > Issue Type: Sub-task >Affects Versions: 3.1.1 > Environment: JDK11, Hadoop-3, Hive 3.1.1 >Reporter: Uma Maheswara Rao G >Priority: Major > > When I start Hive with JDK11 > {{2019-02-08 22:29:51,500 INFO SessionState: Hive Session ID = > cecd9c34-d61a-44d0-9e52-a0a7d6413e49 > Exception in thread "main" java.lang.ClassCastException: class > jdk.internal.loader.ClassLoaders$AppClassLoader cannot be cast to class > java.net.URLClassLoader (jdk.internal.loader.ClassLoaders$AppClassLoader and > java.net.URLClassLoader are in module java.base of loader 'bootstrap') > at > org.apache.hadoop.hive.ql.session.SessionState.(SessionState.java:410) > at > org.apache.hadoop.hive.ql.session.SessionState.(SessionState.java:386) > at > org.apache.hadoop.hive.cli.CliSessionState.(CliSessionState.java:60) > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:705) > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:683) > at > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.base/java.lang.reflect.Method.invoke(Method.java:566) > at org.apache.hadoop.util.RunJar.run(RunJar.java:323) > at org.apache.hadoop.util.RunJar.main(RunJar.java:236)}} -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Commented] (HIVE-22200) Hash collision may cause column resolution to fail
[ https://issues.apache.org/jira/browse/HIVE-22200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929823#comment-16929823 ] Hive QA commented on HIVE-22200: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12980333/HIVE-22200.01.patch {color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified. {color:green}SUCCESS:{color} +1 due to 16759 tests passed Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/18604/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18604/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18604/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase {noformat} This message is automatically generated. ATTACHMENT ID: 12980333 - PreCommit-HIVE-Build > Hash collision may cause column resolution to fail > -- > > Key: HIVE-22200 > URL: https://issues.apache.org/jira/browse/HIVE-22200 > Project: Hive > Issue Type: Bug >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Critical > Labels: pull-request-available > Attachments: HIVE-22200.01.patch, HIVE-22200.patch, HIVE-22200.patch, > HIVE-22200.patch > > Time Spent: 10m > Remaining Estimate: 0h > > {{ExprNodeDescUtils.getExprNodeColumnDesc}} extracts the > {{ExprNodeColumnDesc}} (column descriptors) from an expression. In fact, it > creates a map from hash to the object itself. If same hash value is generated > for two different objects, this will result in a clash in the map and some > expressions not being part of its values. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Commented] (HIVE-22200) Hash collision may cause column resolution to fail
[ https://issues.apache.org/jira/browse/HIVE-22200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929818#comment-16929818 ] Hive QA commented on HIVE-22200: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m 52s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 2s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 41s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m 38s{color} | {color:blue} ql in master has 1574 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 56s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 19s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 2s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 2s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 39s{color} | {color:green} ql: The patch generated 0 new + 648 unchanged - 29 fixed = 648 total (was 677) {color} | | {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m 0s{color} | {color:red} The patch has 2 line(s) that end in whitespace. Use git apply --whitespace=fix <>. Refer https://git-scm.com/docs/git-apply {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 3m 50s{color} | {color:green} ql generated 0 new + 1573 unchanged - 1 fixed = 1573 total (was 1574) {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 54s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 12s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 22m 34s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-18604/dev-support/hive-personality.sh | | git revision | master / df452d3 | | Default Java | 1.8.0_111 | | findbugs | v3.0.1 | | whitespace | http://104.198.109.242/logs//PreCommit-HIVE-Build-18604/yetus/whitespace-eol.txt | | modules | C: ql U: ql | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-18604/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > Hash collision may cause column resolution to fail > -- > > Key: HIVE-22200 > URL: https://issues.apache.org/jira/browse/HIVE-22200 > Project: Hive > Issue Type: Bug >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Critical > Labels: pull-request-available > Attachments: HIVE-22200.01.patch, HIVE-22200.patch, HIVE-22200.patch, > HIVE-22200.patch > > Time Spent: 10m > Remaining Estimate: 0h > > {{ExprNodeDescUtils.getExprNodeColumnDesc}} extracts the > {{ExprNodeColumnDesc}} (column descriptors) from an expression. In fact, it > creates a map from hash to the object itself. If same hash value is generated > for two different objects, this will result in a clash in the map and some > expressions not being part of its values. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Commented] (HIVE-22200) Hash collision may cause column resolution to fail
[ https://issues.apache.org/jira/browse/HIVE-22200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929814#comment-16929814 ] Ashutosh Chauhan commented on HIVE-22200: - +1 > Hash collision may cause column resolution to fail > -- > > Key: HIVE-22200 > URL: https://issues.apache.org/jira/browse/HIVE-22200 > Project: Hive > Issue Type: Bug >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Critical > Labels: pull-request-available > Attachments: HIVE-22200.01.patch, HIVE-22200.patch, HIVE-22200.patch, > HIVE-22200.patch > > Time Spent: 10m > Remaining Estimate: 0h > > {{ExprNodeDescUtils.getExprNodeColumnDesc}} extracts the > {{ExprNodeColumnDesc}} (column descriptors) from an expression. In fact, it > creates a map from hash to the object itself. If same hash value is generated > for two different objects, this will result in a clash in the map and some > expressions not being part of its values. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Updated] (HIVE-22204) Beeline option to show/not show execution report
[ https://issues.apache.org/jira/browse/HIVE-22204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-22204: --- Labels: todoc4.0 (was: ) > Beeline option to show/not show execution report > > > Key: HIVE-22204 > URL: https://issues.apache.org/jira/browse/HIVE-22204 > Project: Hive > Issue Type: Improvement > Components: Beeline >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Minor > Labels: todoc4.0 > Fix For: 4.0.0 > > Attachments: HIVE-22204.patch, HIVE-22204.patch > > > Currently, {{\-\-silent=true}} will also remove the short report about > execution (includes number of rows returned by a query and execution time). > It would be interesting to control whether we want to show that report even > if {{\-\-silent=true}}, e.g., using an option {{\-\-report=true}}. Default > (existing) behavior should not change. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Updated] (HIVE-22055) select count gives incorrect result after loading data from text file
[ https://issues.apache.org/jira/browse/HIVE-22055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-22055: --- Fix Version/s: 4.0.0 Resolution: Fixed Status: Resolved (was: Patch Available) > select count gives incorrect result after loading data from text file > - > > Key: HIVE-22055 > URL: https://issues.apache.org/jira/browse/HIVE-22055 > Project: Hive > Issue Type: Task > Components: Hive >Reporter: Attila Magyar >Assignee: Attila Magyar >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-22055.2.patch > > > Add one more load to mm_loaddata.q: > Load data 3 times (both kv1.txt and kv2.txt contains 500 records) > {code:java} > create table load0_mm (key string, value string) stored as textfile > tblproperties("transactional"="true", > "transactional_properties"="insert_only"); > load data local inpath '../../data/files/kv1.txt' into table load0_mm; > select count(1) from load0_mm; > load data local inpath '../../data/files/kv2.txt' into table load0_mm; > select count(1) from load0_mm; > load data local inpath '../../data/files/kv2.txt' into table load0_mm; > select count(1) from load0_mm;{code} > Expected output > {code:java} > PREHOOK: query: load data local inpath '../../data/files/kv2.txt' into table > load0_mm > PREHOOK: type: LOAD > A masked pattern was here > PREHOOK: Output: default@load0_mm > POSTHOOK: query: load data local inpath '../../data/files/kv2.txt' into table > load0_mm > POSTHOOK: type: LOAD > A masked pattern was here > POSTHOOK: Output: default@load0_mm > PREHOOK: query: select count(1) from load0_mm > PREHOOK: type: QUERY > PREHOOK: Input: default@load0_mm > A masked pattern was here > POSTHOOK: query: select count(1) from load0_mm > POSTHOOK: type: QUERY > POSTHOOK: Input: default@load0_mm > A masked pattern was here > 1500{code} > Got: > [ERROR] TestMiniLlapLocalCliDriver.testCliDriver:59 Client Execution > succeeded but contained differences (error code = 1) after executing > mm_loaddata.q > 63c63 > < 1480 > — > > 1500 > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Commented] (HIVE-22055) select count gives incorrect result after loading data from text file
[ https://issues.apache.org/jira/browse/HIVE-22055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929812#comment-16929812 ] Jesus Camacho Rodriguez commented on HIVE-22055: +1 > select count gives incorrect result after loading data from text file > - > > Key: HIVE-22055 > URL: https://issues.apache.org/jira/browse/HIVE-22055 > Project: Hive > Issue Type: Task > Components: Hive >Reporter: Attila Magyar >Assignee: Attila Magyar >Priority: Major > Attachments: HIVE-22055.2.patch > > > Add one more load to mm_loaddata.q: > Load data 3 times (both kv1.txt and kv2.txt contains 500 records) > {code:java} > create table load0_mm (key string, value string) stored as textfile > tblproperties("transactional"="true", > "transactional_properties"="insert_only"); > load data local inpath '../../data/files/kv1.txt' into table load0_mm; > select count(1) from load0_mm; > load data local inpath '../../data/files/kv2.txt' into table load0_mm; > select count(1) from load0_mm; > load data local inpath '../../data/files/kv2.txt' into table load0_mm; > select count(1) from load0_mm;{code} > Expected output > {code:java} > PREHOOK: query: load data local inpath '../../data/files/kv2.txt' into table > load0_mm > PREHOOK: type: LOAD > A masked pattern was here > PREHOOK: Output: default@load0_mm > POSTHOOK: query: load data local inpath '../../data/files/kv2.txt' into table > load0_mm > POSTHOOK: type: LOAD > A masked pattern was here > POSTHOOK: Output: default@load0_mm > PREHOOK: query: select count(1) from load0_mm > PREHOOK: type: QUERY > PREHOOK: Input: default@load0_mm > A masked pattern was here > POSTHOOK: query: select count(1) from load0_mm > POSTHOOK: type: QUERY > POSTHOOK: Input: default@load0_mm > A masked pattern was here > 1500{code} > Got: > [ERROR] TestMiniLlapLocalCliDriver.testCliDriver:59 Client Execution > succeeded but contained differences (error code = 1) after executing > mm_loaddata.q > 63c63 > < 1480 > — > > 1500 > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Updated] (HIVE-22200) Hash collision may cause column resolution to fail
[ https://issues.apache.org/jira/browse/HIVE-22200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-22200: -- Labels: pull-request-available (was: ) > Hash collision may cause column resolution to fail > -- > > Key: HIVE-22200 > URL: https://issues.apache.org/jira/browse/HIVE-22200 > Project: Hive > Issue Type: Bug >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Critical > Labels: pull-request-available > Attachments: HIVE-22200.01.patch, HIVE-22200.patch, HIVE-22200.patch, > HIVE-22200.patch > > > {{ExprNodeDescUtils.getExprNodeColumnDesc}} extracts the > {{ExprNodeColumnDesc}} (column descriptors) from an expression. In fact, it > creates a map from hash to the object itself. If same hash value is generated > for two different objects, this will result in a clash in the map and some > expressions not being part of its values. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (HIVE-22200) Hash collision may cause column resolution to fail
[ https://issues.apache.org/jira/browse/HIVE-22200?focusedWorklogId=312588=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-312588 ] ASF GitHub Bot logged work on HIVE-22200: - Author: ASF GitHub Bot Created on: 14/Sep/19 19:55 Start Date: 14/Sep/19 19:55 Worklog Time Spent: 10m Work Description: jcamachor commented on pull request #775: HIVE-22200 URL: https://github.com/apache/hive/pull/775 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 312588) Remaining Estimate: 0h Time Spent: 10m > Hash collision may cause column resolution to fail > -- > > Key: HIVE-22200 > URL: https://issues.apache.org/jira/browse/HIVE-22200 > Project: Hive > Issue Type: Bug >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Critical > Labels: pull-request-available > Attachments: HIVE-22200.01.patch, HIVE-22200.patch, HIVE-22200.patch, > HIVE-22200.patch > > Time Spent: 10m > Remaining Estimate: 0h > > {{ExprNodeDescUtils.getExprNodeColumnDesc}} extracts the > {{ExprNodeColumnDesc}} (column descriptors) from an expression. In fact, it > creates a map from hash to the object itself. If same hash value is generated > for two different objects, this will result in a clash in the map and some > expressions not being part of its values. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Updated] (HIVE-22200) Hash collision may cause column resolution to fail
[ https://issues.apache.org/jira/browse/HIVE-22200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-22200: --- Attachment: HIVE-22200.patch > Hash collision may cause column resolution to fail > -- > > Key: HIVE-22200 > URL: https://issues.apache.org/jira/browse/HIVE-22200 > Project: Hive > Issue Type: Bug >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Critical > Attachments: HIVE-22200.01.patch, HIVE-22200.patch, HIVE-22200.patch, > HIVE-22200.patch > > > {{ExprNodeDescUtils.getExprNodeColumnDesc}} extracts the > {{ExprNodeColumnDesc}} (column descriptors) from an expression. In fact, it > creates a map from hash to the object itself. If same hash value is generated > for two different objects, this will result in a clash in the map and some > expressions not being part of its values. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Updated] (HIVE-22200) Hash collision may cause column resolution to fail
[ https://issues.apache.org/jira/browse/HIVE-22200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-22200: --- Attachment: (was: HIVE-22200.patch) > Hash collision may cause column resolution to fail > -- > > Key: HIVE-22200 > URL: https://issues.apache.org/jira/browse/HIVE-22200 > Project: Hive > Issue Type: Bug >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Critical > Attachments: HIVE-22200.01.patch, HIVE-22200.patch, HIVE-22200.patch, > HIVE-22200.patch > > > {{ExprNodeDescUtils.getExprNodeColumnDesc}} extracts the > {{ExprNodeColumnDesc}} (column descriptors) from an expression. In fact, it > creates a map from hash to the object itself. If same hash value is generated > for two different objects, this will result in a clash in the map and some > expressions not being part of its values. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Updated] (HIVE-22200) Hash collision may cause column resolution to fail
[ https://issues.apache.org/jira/browse/HIVE-22200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-22200: --- Attachment: HIVE-22200.01.patch > Hash collision may cause column resolution to fail > -- > > Key: HIVE-22200 > URL: https://issues.apache.org/jira/browse/HIVE-22200 > Project: Hive > Issue Type: Bug >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Critical > Attachments: HIVE-22200.01.patch, HIVE-22200.patch, HIVE-22200.patch, > HIVE-22200.patch > > > {{ExprNodeDescUtils.getExprNodeColumnDesc}} extracts the > {{ExprNodeColumnDesc}} (column descriptors) from an expression. In fact, it > creates a map from hash to the object itself. If same hash value is generated > for two different objects, this will result in a clash in the map and some > expressions not being part of its values. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Commented] (HIVE-22170) from_unixtime and unix_timestamp should use user session time zone
[ https://issues.apache.org/jira/browse/HIVE-22170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929807#comment-16929807 ] Hive QA commented on HIVE-22170: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12980330/HIVE-22170.06.patch {color:red}ERROR:{color} -1 due to build exiting with an error Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/18603/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18603/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18603/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Tests exited with: Exception: Patch URL https://issues.apache.org/jira/secure/attachment/12980330/HIVE-22170.06.patch was found in seen patch url's cache and a test was probably run already on it. Aborting... {noformat} This message is automatically generated. ATTACHMENT ID: 12980330 - PreCommit-HIVE-Build > from_unixtime and unix_timestamp should use user session time zone > -- > > Key: HIVE-22170 > URL: https://issues.apache.org/jira/browse/HIVE-22170 > Project: Hive > Issue Type: Bug >Affects Versions: 3.1.0, 4.0.0, 3.2.0, 3.1.1, 3.1.2 >Reporter: Riju Trivedi >Assignee: Jesus Camacho Rodriguez >Priority: Major > Labels: pull-request-available > Attachments: HIVE-22170.01.patch, HIVE-22170.02.patch, > HIVE-22170.03.patch, HIVE-22170.04.patch, HIVE-22170.05.patch, > HIVE-22170.06.patch > > Time Spent: 50m > Remaining Estimate: 0h > > According to documentation, that is the expected behavior (since session time > zone was not present, system time zone was being used previously). This was > incorrectly changed by HIVE-12192 / HIVE-20007. This JIRA should fix this > issue. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Commented] (HIVE-22170) from_unixtime and unix_timestamp should use user session time zone
[ https://issues.apache.org/jira/browse/HIVE-22170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929806#comment-16929806 ] Hive QA commented on HIVE-22170: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12980330/HIVE-22170.06.patch {color:green}SUCCESS:{color} +1 due to 23 test(s) being added or modified. {color:green}SUCCESS:{color} +1 due to 16753 tests passed Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/18602/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18602/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18602/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase {noformat} This message is automatically generated. ATTACHMENT ID: 12980330 - PreCommit-HIVE-Build > from_unixtime and unix_timestamp should use user session time zone > -- > > Key: HIVE-22170 > URL: https://issues.apache.org/jira/browse/HIVE-22170 > Project: Hive > Issue Type: Bug >Affects Versions: 3.1.0, 4.0.0, 3.2.0, 3.1.1, 3.1.2 >Reporter: Riju Trivedi >Assignee: Jesus Camacho Rodriguez >Priority: Major > Labels: pull-request-available > Attachments: HIVE-22170.01.patch, HIVE-22170.02.patch, > HIVE-22170.03.patch, HIVE-22170.04.patch, HIVE-22170.05.patch, > HIVE-22170.06.patch > > Time Spent: 50m > Remaining Estimate: 0h > > According to documentation, that is the expected behavior (since session time > zone was not present, system time zone was being used previously). This was > incorrectly changed by HIVE-12192 / HIVE-20007. This JIRA should fix this > issue. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Updated] (HIVE-22204) Beeline option to show/not show execution report
[ https://issues.apache.org/jira/browse/HIVE-22204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-22204: --- Fix Version/s: 4.0.0 Resolution: Fixed Status: Resolved (was: Patch Available) > Beeline option to show/not show execution report > > > Key: HIVE-22204 > URL: https://issues.apache.org/jira/browse/HIVE-22204 > Project: Hive > Issue Type: Improvement > Components: Beeline >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Minor > Fix For: 4.0.0 > > Attachments: HIVE-22204.patch, HIVE-22204.patch > > > Currently, {{\-\-silent=true}} will also remove the short report about > execution (includes number of rows returned by a query and execution time). > It would be interesting to control whether we want to show that report even > if {{\-\-silent=true}}, e.g., using an option {{\-\-report=true}}. Default > (existing) behavior should not change. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Commented] (HIVE-22170) from_unixtime and unix_timestamp should use user session time zone
[ https://issues.apache.org/jira/browse/HIVE-22170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929803#comment-16929803 ] Hive QA commented on HIVE-22170: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m 49s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 0s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m 12s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m 47s{color} | {color:blue} ql in master has 1574 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 54s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 21s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 57s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 57s{color} | {color:green} the patch passed {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 1m 10s{color} | {color:red} ql: The patch generated 17 new + 4517 unchanged - 3 fixed = 4534 total (was 4520) {color} | | {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m 0s{color} | {color:red} The patch has 2 line(s) that end in whitespace. Use git apply --whitespace=fix <>. Refer https://git-scm.com/docs/git-apply {color} | | {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 3m 55s{color} | {color:red} ql generated 2 new + 1571 unchanged - 3 fixed = 1573 total (was 1574) {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 56s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 13s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 23m 56s{color} | {color:black} {color} | \\ \\ || Reason || Tests || | FindBugs | module:ql | | | Class org.apache.hadoop.hive.ql.exec.vector.expressions.VectorUDFUnixTimeStampDate defines non-transient non-serializable instance field date In VectorUDFUnixTimeStampDate.java:instance field date In VectorUDFUnixTimeStampDate.java | | | Class org.apache.hadoop.hive.ql.exec.vector.expressions.VectorUDFUnixTimeStampTimestamp defines non-transient non-serializable instance field timestamp In VectorUDFUnixTimeStampTimestamp.java:instance field timestamp In VectorUDFUnixTimeStampTimestamp.java | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-18602/dev-support/hive-personality.sh | | git revision | master / d8e2e40 | | Default Java | 1.8.0_111 | | findbugs | v3.0.1 | | checkstyle | http://104.198.109.242/logs//PreCommit-HIVE-Build-18602/yetus/diff-checkstyle-ql.txt | | whitespace | http://104.198.109.242/logs//PreCommit-HIVE-Build-18602/yetus/whitespace-eol.txt | | findbugs | http://104.198.109.242/logs//PreCommit-HIVE-Build-18602/yetus/new-findbugs-ql.html | | modules | C: ql U: ql | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-18602/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > from_unixtime and unix_timestamp should use user session time zone > -- > > Key: HIVE-22170 > URL: https://issues.apache.org/jira/browse/HIVE-22170 > Project: Hive > Issue Type: Bug >Affects Versions: 3.1.0, 4.0.0, 3.2.0, 3.1.1, 3.1.2 >Reporter: Riju Trivedi >Assignee: Jesus Camacho Rodriguez >Priority: Major > Labels: pull-request-available > Attachments: HIVE-22170.01.patch, HIVE-22170.02.patch, > HIVE-22170.03.patch, HIVE-22170.04.patch, HIVE-22170.05.patch, >
[jira] [Commented] (HIVE-22204) Beeline option to show/not show execution report
[ https://issues.apache.org/jira/browse/HIVE-22204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929799#comment-16929799 ] Hive QA commented on HIVE-22204: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12980328/HIVE-22204.patch {color:green}SUCCESS:{color} +1 due to 2 test(s) being added or modified. {color:green}SUCCESS:{color} +1 due to 16757 tests passed Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/18601/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18601/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18601/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase {noformat} This message is automatically generated. ATTACHMENT ID: 12980328 - PreCommit-HIVE-Build > Beeline option to show/not show execution report > > > Key: HIVE-22204 > URL: https://issues.apache.org/jira/browse/HIVE-22204 > Project: Hive > Issue Type: Improvement > Components: Beeline >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Minor > Attachments: HIVE-22204.patch, HIVE-22204.patch > > > Currently, {{\-\-silent=true}} will also remove the short report about > execution (includes number of rows returned by a query and execution time). > It would be interesting to control whether we want to show that report even > if {{\-\-silent=true}}, e.g., using an option {{\-\-report=true}}. Default > (existing) behavior should not change. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Updated] (HIVE-22170) from_unixtime and unix_timestamp should use user session time zone
[ https://issues.apache.org/jira/browse/HIVE-22170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-22170: --- Attachment: HIVE-22170.06.patch > from_unixtime and unix_timestamp should use user session time zone > -- > > Key: HIVE-22170 > URL: https://issues.apache.org/jira/browse/HIVE-22170 > Project: Hive > Issue Type: Bug >Affects Versions: 3.1.0, 4.0.0, 3.2.0, 3.1.1, 3.1.2 >Reporter: Riju Trivedi >Assignee: Jesus Camacho Rodriguez >Priority: Major > Labels: pull-request-available > Attachments: HIVE-22170.01.patch, HIVE-22170.02.patch, > HIVE-22170.03.patch, HIVE-22170.04.patch, HIVE-22170.05.patch, > HIVE-22170.06.patch > > Time Spent: 50m > Remaining Estimate: 0h > > According to documentation, that is the expected behavior (since session time > zone was not present, system time zone was being used previously). This was > incorrectly changed by HIVE-12192 / HIVE-20007. This JIRA should fix this > issue. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Commented] (HIVE-22204) Beeline option to show/not show execution report
[ https://issues.apache.org/jira/browse/HIVE-22204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929790#comment-16929790 ] Hive QA commented on HIVE-22204: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 36s{color} | {color:blue} Maven dependency ordering for branch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m 35s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 55s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 28s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 26s{color} | {color:blue} beeline in master has 48 extant Findbugs warnings. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 38s{color} | {color:blue} itests/hive-unit in master has 2 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 30s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 25s{color} | {color:blue} Maven dependency ordering for patch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m 54s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 55s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 55s{color} | {color:green} the patch passed {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m 11s{color} | {color:red} beeline: The patch generated 1 new + 72 unchanged - 0 fixed = 73 total (was 72) {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m 16s{color} | {color:red} itests/hive-unit: The patch generated 4 new + 156 unchanged - 0 fixed = 160 total (was 156) {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m 17s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 32s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 12s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 16m 17s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-18601/dev-support/hive-personality.sh | | git revision | master / d8e2e40 | | Default Java | 1.8.0_111 | | findbugs | v3.0.1 | | checkstyle | http://104.198.109.242/logs//PreCommit-HIVE-Build-18601/yetus/diff-checkstyle-beeline.txt | | checkstyle | http://104.198.109.242/logs//PreCommit-HIVE-Build-18601/yetus/diff-checkstyle-itests_hive-unit.txt | | modules | C: beeline itests/hive-unit U: . | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-18601/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > Beeline option to show/not show execution report > > > Key: HIVE-22204 > URL: https://issues.apache.org/jira/browse/HIVE-22204 > Project: Hive > Issue Type: Improvement > Components: Beeline >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Minor > Attachments: HIVE-22204.patch, HIVE-22204.patch > > > Currently, {{\-\-silent=true}} will also remove the short report about > execution (includes number of rows returned by a query and execution time). > It would be interesting to control whether we want to show that report even > if {{\-\-silent=true}}, e.g.,
[jira] [Updated] (HIVE-22170) from_unixtime and unix_timestamp should use user session time zone
[ https://issues.apache.org/jira/browse/HIVE-22170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-22170: --- Attachment: HIVE-22170.05.patch > from_unixtime and unix_timestamp should use user session time zone > -- > > Key: HIVE-22170 > URL: https://issues.apache.org/jira/browse/HIVE-22170 > Project: Hive > Issue Type: Bug >Affects Versions: 3.1.0, 4.0.0, 3.2.0, 3.1.1, 3.1.2 >Reporter: Riju Trivedi >Assignee: Jesus Camacho Rodriguez >Priority: Major > Labels: pull-request-available > Attachments: HIVE-22170.01.patch, HIVE-22170.02.patch, > HIVE-22170.03.patch, HIVE-22170.04.patch, HIVE-22170.05.patch > > Time Spent: 50m > Remaining Estimate: 0h > > According to documentation, that is the expected behavior (since session time > zone was not present, system time zone was being used previously). This was > incorrectly changed by HIVE-12192 / HIVE-20007. This JIRA should fix this > issue. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Updated] (HIVE-22204) Beeline option to show/not show execution report
[ https://issues.apache.org/jira/browse/HIVE-22204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-22204: --- Attachment: HIVE-22204.patch > Beeline option to show/not show execution report > > > Key: HIVE-22204 > URL: https://issues.apache.org/jira/browse/HIVE-22204 > Project: Hive > Issue Type: Improvement > Components: Beeline >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Minor > Attachments: HIVE-22204.patch, HIVE-22204.patch > > > Currently, {{\-\-silent=true}} will also remove the short report about > execution (includes number of rows returned by a query and execution time). > It would be interesting to control whether we want to show that report even > if {{\-\-silent=true}}, e.g., using an option {{\-\-report=true}}. Default > (existing) behavior should not change. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Commented] (HIVE-22203) Break up DDLSemanticAnalyzer - extract Process related analyzers
[ https://issues.apache.org/jira/browse/HIVE-22203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929757#comment-16929757 ] Hive QA commented on HIVE-22203: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12980321/HIVE-22203.02.patch {color:red}ERROR:{color} -1 due to no test(s) being added or modified. {color:green}SUCCESS:{color} +1 due to 16753 tests passed Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/18600/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18600/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18600/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase {noformat} This message is automatically generated. ATTACHMENT ID: 12980321 - PreCommit-HIVE-Build > Break up DDLSemanticAnalyzer - extract Process related analyzers > > > Key: HIVE-22203 > URL: https://issues.apache.org/jira/browse/HIVE-22203 > Project: Hive > Issue Type: Sub-task >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > Labels: pull-request-available, refactor-ddl > Attachments: HIVE-22203.01.patch, HIVE-22203.02.patch > > Time Spent: 10m > Remaining Estimate: 0h > > DDLSemanticAnalyzer is a huge class, more than 4000 lines long. The goal is > to refactor it in order to have everything cut into more handleable classes > under the package org.apache.hadoop.hive.ql.exec.ddl: > * have a separate class for each analyzers > * have a package for each operation, containing an analyzer, a description, > and an operation, so the amount of classes under a package is more manageable > Step #4: extract all the process related analyzers from DDLSemanticAnalyzer, > and move them under the new package. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Commented] (HIVE-22203) Break up DDLSemanticAnalyzer - extract Process related analyzers
[ https://issues.apache.org/jira/browse/HIVE-22203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929745#comment-16929745 ] Hive QA commented on HIVE-22203: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m 37s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 56s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 36s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m 36s{color} | {color:blue} ql in master has 1574 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 53s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 18s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 59s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 59s{color} | {color:green} the patch passed {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m 35s{color} | {color:red} ql: The patch generated 4 new + 201 unchanged - 4 fixed = 205 total (was 205) {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 3m 50s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 54s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 13s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 21m 55s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-18600/dev-support/hive-personality.sh | | git revision | master / d8e2e40 | | Default Java | 1.8.0_111 | | findbugs | v3.0.1 | | checkstyle | http://104.198.109.242/logs//PreCommit-HIVE-Build-18600/yetus/diff-checkstyle-ql.txt | | modules | C: ql U: ql | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-18600/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > Break up DDLSemanticAnalyzer - extract Process related analyzers > > > Key: HIVE-22203 > URL: https://issues.apache.org/jira/browse/HIVE-22203 > Project: Hive > Issue Type: Sub-task >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > Labels: pull-request-available, refactor-ddl > Attachments: HIVE-22203.01.patch, HIVE-22203.02.patch > > Time Spent: 10m > Remaining Estimate: 0h > > DDLSemanticAnalyzer is a huge class, more than 4000 lines long. The goal is > to refactor it in order to have everything cut into more handleable classes > under the package org.apache.hadoop.hive.ql.exec.ddl: > * have a separate class for each analyzers > * have a package for each operation, containing an analyzer, a description, > and an operation, so the amount of classes under a package is more manageable > Step #4: extract all the process related analyzers from DDLSemanticAnalyzer, > and move them under the new package. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Commented] (HIVE-22205) Upgrade zookeeper and curator versions
[ https://issues.apache.org/jira/browse/HIVE-22205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929741#comment-16929741 ] Hive QA commented on HIVE-22205: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12980317/HIVE-22205.patch {color:red}ERROR:{color} -1 due to no test(s) being added or modified. {color:red}ERROR:{color} -1 due to 240 failed/errored test(s), 11295 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.cli.TestAccumuloCliDriver.org.apache.hadoop.hive.cli.TestAccumuloCliDriver (batchId=289) org.apache.hadoop.hive.cli.TestBlobstoreCliDriver.org.apache.hadoop.hive.cli.TestBlobstoreCliDriver (batchId=300) org.apache.hadoop.hive.cli.TestBlobstoreNegativeCliDriver.org.apache.hadoop.hive.cli.TestBlobstoreNegativeCliDriver (batchId=300) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=1) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=10) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=100) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=11) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=12) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=13) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=14) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=15) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=16) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=17) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=18) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=19) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=2) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=20) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=21) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=22) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=23) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=24) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=25) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=26) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=27) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=28) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=29) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=3) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=30) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=31) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=32) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=33) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=34) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=35) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=36) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=37) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=38) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=39) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=4) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=40) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=41) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=42) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=43) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=44) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=45) org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver (batchId=46)
[jira] [Commented] (HIVE-22205) Upgrade zookeeper and curator versions
[ https://issues.apache.org/jira/browse/HIVE-22205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929739#comment-16929739 ] Hive QA commented on HIVE-22205: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m 34s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 5m 23s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 5m 39s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 6m 21s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 5m 38s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 5m 38s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m 1s{color} | {color:green} The patch has no ill-formed XML file. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 5m 49s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 11s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 37m 1s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc xml compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-18599/dev-support/hive-personality.sh | | git revision | master / d8e2e40 | | Default Java | 1.8.0_111 | | modules | C: . U: . | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-18599/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > Upgrade zookeeper and curator versions > -- > > Key: HIVE-22205 > URL: https://issues.apache.org/jira/browse/HIVE-22205 > Project: Hive > Issue Type: Improvement > Components: HiveServer2 >Affects Versions: 4.0.0 >Reporter: Naveen Gangam >Assignee: Naveen Gangam >Priority: Minor > Attachments: HIVE-22205.patch > > > Other components like hadoop have switched to using new ZK versions. So these > jars end up in classpath for hive services and could cause issues due to > in-compatible curator versions that hive uses. > So it makes sense for hive to upgrade the ZK and curator versions to try to > keep up. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Commented] (HIVE-22200) Hash collision may cause column resolution to fail
[ https://issues.apache.org/jira/browse/HIVE-22200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929731#comment-16929731 ] Hive QA commented on HIVE-22200: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12980315/HIVE-22200.patch {color:red}ERROR:{color} -1 due to no test(s) being added or modified. {color:green}SUCCESS:{color} +1 due to 16753 tests passed Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/18598/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18598/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18598/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase {noformat} This message is automatically generated. ATTACHMENT ID: 12980315 - PreCommit-HIVE-Build > Hash collision may cause column resolution to fail > -- > > Key: HIVE-22200 > URL: https://issues.apache.org/jira/browse/HIVE-22200 > Project: Hive > Issue Type: Bug >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Critical > Attachments: HIVE-22200.patch, HIVE-22200.patch, HIVE-22200.patch > > > {{ExprNodeDescUtils.getExprNodeColumnDesc}} extracts the > {{ExprNodeColumnDesc}} (column descriptors) from an expression. In fact, it > creates a map from hash to the object itself. If same hash value is generated > for two different objects, this will result in a clash in the map and some > expressions not being part of its values. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Commented] (HIVE-22200) Hash collision may cause column resolution to fail
[ https://issues.apache.org/jira/browse/HIVE-22200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929723#comment-16929723 ] Hive QA commented on HIVE-22200: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 9m 1s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 8s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 46s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m 15s{color} | {color:blue} ql in master has 1574 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 59s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 31s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 3s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 3s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 47s{color} | {color:green} ql: The patch generated 0 new + 648 unchanged - 29 fixed = 648 total (was 677) {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 3m 59s{color} | {color:green} ql generated 0 new + 1573 unchanged - 1 fixed = 1573 total (was 1574) {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 53s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 12s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 25m 10s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-18598/dev-support/hive-personality.sh | | git revision | master / d8e2e40 | | Default Java | 1.8.0_111 | | findbugs | v3.0.1 | | modules | C: ql U: ql | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-18598/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > Hash collision may cause column resolution to fail > -- > > Key: HIVE-22200 > URL: https://issues.apache.org/jira/browse/HIVE-22200 > Project: Hive > Issue Type: Bug >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Critical > Attachments: HIVE-22200.patch, HIVE-22200.patch, HIVE-22200.patch > > > {{ExprNodeDescUtils.getExprNodeColumnDesc}} extracts the > {{ExprNodeColumnDesc}} (column descriptors) from an expression. In fact, it > creates a map from hash to the object itself. If same hash value is generated > for two different objects, this will result in a clash in the map and some > expressions not being part of its values. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Commented] (HIVE-22204) Beeline option to show/not show execution report
[ https://issues.apache.org/jira/browse/HIVE-22204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929718#comment-16929718 ] Hive QA commented on HIVE-22204: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12980314/HIVE-22204.patch {color:green}SUCCESS:{color} +1 due to 2 test(s) being added or modified. {color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 16757 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.llap.cache.TestBuddyAllocator.testMTT[2] (batchId=361) {noformat} Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/18597/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18597/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18597/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 1 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12980314 - PreCommit-HIVE-Build > Beeline option to show/not show execution report > > > Key: HIVE-22204 > URL: https://issues.apache.org/jira/browse/HIVE-22204 > Project: Hive > Issue Type: Improvement > Components: Beeline >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Minor > Attachments: HIVE-22204.patch > > > Currently, {{\-\-silent=true}} will also remove the short report about > execution (includes number of rows returned by a query and execution time). > It would be interesting to control whether we want to show that report even > if {{\-\-silent=true}}, e.g., using an option {{\-\-report=true}}. Default > (existing) behavior should not change. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Updated] (HIVE-22203) Break up DDLSemanticAnalyzer - extract Process related analyzers
[ https://issues.apache.org/jira/browse/HIVE-22203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Gergely updated HIVE-22203: -- Attachment: HIVE-22203.02.patch > Break up DDLSemanticAnalyzer - extract Process related analyzers > > > Key: HIVE-22203 > URL: https://issues.apache.org/jira/browse/HIVE-22203 > Project: Hive > Issue Type: Sub-task >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > Labels: pull-request-available, refactor-ddl > Attachments: HIVE-22203.01.patch, HIVE-22203.02.patch > > Time Spent: 10m > Remaining Estimate: 0h > > DDLSemanticAnalyzer is a huge class, more than 4000 lines long. The goal is > to refactor it in order to have everything cut into more handleable classes > under the package org.apache.hadoop.hive.ql.exec.ddl: > * have a separate class for each analyzers > * have a package for each operation, containing an analyzer, a description, > and an operation, so the amount of classes under a package is more manageable > Step #4: extract all the process related analyzers from DDLSemanticAnalyzer, > and move them under the new package. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (HIVE-22199) Ugrade findbugs to 3.0.5
[ https://issues.apache.org/jira/browse/HIVE-22199?focusedWorklogId=312528=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-312528 ] ASF GitHub Bot logged work on HIVE-22199: - Author: ASF GitHub Bot Created on: 14/Sep/19 07:48 Start Date: 14/Sep/19 07:48 Worklog Time Spent: 10m Work Description: miklosgergely commented on pull request #773: HIVE-22199 Ugrade findbugs to 3.0.5 URL: https://github.com/apache/hive/pull/773 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 312528) Time Spent: 20m (was: 10m) > Ugrade findbugs to 3.0.5 > > > Key: HIVE-22199 > URL: https://issues.apache.org/jira/browse/HIVE-22199 > Project: Hive > Issue Type: Improvement > Components: Hive >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > Attachments: HIVE-22199.01.patch, HIVE-22199.02.patch > > Time Spent: 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (HIVE-22194) Break up DDLSemanticAnalyzer - extract Privilege related analyzers
[ https://issues.apache.org/jira/browse/HIVE-22194?focusedWorklogId=312529=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-312529 ] ASF GitHub Bot logged work on HIVE-22194: - Author: ASF GitHub Bot Created on: 14/Sep/19 07:48 Start Date: 14/Sep/19 07:48 Worklog Time Spent: 10m Work Description: miklosgergely commented on pull request #769: HIVE-22194 Break up DDLSemanticAnalyzer - extract Privilege related analyzers URL: https://github.com/apache/hive/pull/769 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 312529) Time Spent: 1h (was: 50m) > Break up DDLSemanticAnalyzer - extract Privilege related analyzers > -- > > Key: HIVE-22194 > URL: https://issues.apache.org/jira/browse/HIVE-22194 > Project: Hive > Issue Type: Sub-task >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > Labels: pull-request-available, refactor-ddl > Attachments: HIVE-22194.01.patch, HIVE-22194.02.patch, > HIVE-22194.03.patch > > Time Spent: 1h > Remaining Estimate: 0h > > DDLSemanticAnalyzer is a huge class, more than 4000 lines long. The goal is > to refactor it in order to have everything cut into more handleable classes > under the package org.apache.hadoop.hive.ql.exec.ddl: > * have a separate class for each analyzers > * have a package for each operation, containing an analyzer, a description, > and an operation, so the amount of classes under a package is more manageable > Step #3: extract all the privilege related analyzers from > DDLSemanticAnalyzer, and move them under the new package. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Updated] (HIVE-22199) Ugrade findbugs to 3.0.5
[ https://issues.apache.org/jira/browse/HIVE-22199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Gergely updated HIVE-22199: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Ugrade findbugs to 3.0.5 > > > Key: HIVE-22199 > URL: https://issues.apache.org/jira/browse/HIVE-22199 > Project: Hive > Issue Type: Improvement > Components: Hive >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > Attachments: HIVE-22199.01.patch, HIVE-22199.02.patch > > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Commented] (HIVE-22204) Beeline option to show/not show execution report
[ https://issues.apache.org/jira/browse/HIVE-22204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929707#comment-16929707 ] Hive QA commented on HIVE-22204: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 2m 3s{color} | {color:blue} Maven dependency ordering for branch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m 35s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 1s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 31s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 30s{color} | {color:blue} beeline in master has 44 extant Findbugs warnings. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 44s{color} | {color:blue} itests/hive-unit in master has 2 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 38s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 29s{color} | {color:blue} Maven dependency ordering for patch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 4s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 3s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 3s{color} | {color:green} the patch passed {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m 12s{color} | {color:red} beeline: The patch generated 1 new + 72 unchanged - 0 fixed = 73 total (was 72) {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m 18s{color} | {color:red} itests/hive-unit: The patch generated 4 new + 156 unchanged - 0 fixed = 160 total (was 156) {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m 25s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 38s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 14s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 19m 5s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-18597/dev-support/hive-personality.sh | | git revision | master / 396c161 | | Default Java | 1.8.0_111 | | findbugs | v3.0.0 | | checkstyle | http://104.198.109.242/logs//PreCommit-HIVE-Build-18597/yetus/diff-checkstyle-beeline.txt | | checkstyle | http://104.198.109.242/logs//PreCommit-HIVE-Build-18597/yetus/diff-checkstyle-itests_hive-unit.txt | | modules | C: beeline itests/hive-unit U: . | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-18597/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > Beeline option to show/not show execution report > > > Key: HIVE-22204 > URL: https://issues.apache.org/jira/browse/HIVE-22204 > Project: Hive > Issue Type: Improvement > Components: Beeline >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Minor > Attachments: HIVE-22204.patch > > > Currently, {{\-\-silent=true}} will also remove the short report about > execution (includes number of rows returned by a query and execution time). > It would be interesting to control whether we want to show that report even > if {{\-\-silent=true}}, e.g., using an option
[jira] [Commented] (HIVE-22203) Break up DDLSemanticAnalyzer - extract Process related analyzers
[ https://issues.apache.org/jira/browse/HIVE-22203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929704#comment-16929704 ] Hive QA commented on HIVE-22203: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12980307/HIVE-22203.01.patch {color:red}ERROR:{color} -1 due to no test(s) being added or modified. {color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 16723 tests executed *Failed tests:* {noformat} TestMiniLlapLocalCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=178) [union_top_level.q,vector_create_struct_table.q,llap_uncompressed.q,materialized_view_partitioned_2.q,murmur_hash_migration.q,mapjoin46.q,materialized_view_rewrite_1.q,materialized_view_create_rewrite_time_window_2.q,subquery_in_having.q,vectorized_string_funcs.q,drop_partition_with_stats.q,vectorization_1.q,fold_varchar.q,auto_join_filters.q,join0.q,mergejoin.q,vector_if_expr_2.q,orc_split_elimination.q,vector_outer_join0.q,vector_udf1.q,schema_evol_text_vec_part_all_primitive.q,vector_complex_all.q,ctas_empty_source.q,union3.q,windowing_windowspec2.q,auto_smb_mapjoin_14.q,vector_mapjoin_complex_values.q,results_cache_truncate.q,vector_join_filters.q,reduce_deduplicate_extended.q] org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[dbtxnmgr_showlocks] (batchId=87) {noformat} Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/18596/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18596/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18596/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 2 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12980307 - PreCommit-HIVE-Build > Break up DDLSemanticAnalyzer - extract Process related analyzers > > > Key: HIVE-22203 > URL: https://issues.apache.org/jira/browse/HIVE-22203 > Project: Hive > Issue Type: Sub-task >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > Labels: pull-request-available, refactor-ddl > Attachments: HIVE-22203.01.patch > > Time Spent: 10m > Remaining Estimate: 0h > > DDLSemanticAnalyzer is a huge class, more than 4000 lines long. The goal is > to refactor it in order to have everything cut into more handleable classes > under the package org.apache.hadoop.hive.ql.exec.ddl: > * have a separate class for each analyzers > * have a package for each operation, containing an analyzer, a description, > and an operation, so the amount of classes under a package is more manageable > Step #4: extract all the process related analyzers from DDLSemanticAnalyzer, > and move them under the new package. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Commented] (HIVE-22203) Break up DDLSemanticAnalyzer - extract Process related analyzers
[ https://issues.apache.org/jira/browse/HIVE-22203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929692#comment-16929692 ] Hive QA commented on HIVE-22203: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m 50s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 6s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 42s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m 1s{color} | {color:blue} ql in master has 2225 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 59s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 26s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 5s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 5s{color} | {color:green} the patch passed {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m 40s{color} | {color:red} ql: The patch generated 5 new + 201 unchanged - 4 fixed = 206 total (was 205) {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m 13s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 0s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 13s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 24m 50s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-18596/dev-support/hive-personality.sh | | git revision | master / 396c161 | | Default Java | 1.8.0_111 | | findbugs | v3.0.0 | | checkstyle | http://104.198.109.242/logs//PreCommit-HIVE-Build-18596/yetus/diff-checkstyle-ql.txt | | modules | C: ql U: ql | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-18596/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > Break up DDLSemanticAnalyzer - extract Process related analyzers > > > Key: HIVE-22203 > URL: https://issues.apache.org/jira/browse/HIVE-22203 > Project: Hive > Issue Type: Sub-task >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > Labels: pull-request-available, refactor-ddl > Attachments: HIVE-22203.01.patch > > Time Spent: 10m > Remaining Estimate: 0h > > DDLSemanticAnalyzer is a huge class, more than 4000 lines long. The goal is > to refactor it in order to have everything cut into more handleable classes > under the package org.apache.hadoop.hive.ql.exec.ddl: > * have a separate class for each analyzers > * have a package for each operation, containing an analyzer, a description, > and an operation, so the amount of classes under a package is more manageable > Step #4: extract all the process related analyzers from DDLSemanticAnalyzer, > and move them under the new package. -- This message was sent by Atlassian Jira (v8.3.2#803003)