[jira] [Commented] (HIVE-23429) LLAP: Optimize retrieving queryId details in LlapTaskCommunicator
[
https://issues.apache.org/jira/browse/HIVE-23429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104080#comment-17104080
]
Hive QA commented on HIVE-23429:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13002575/HIVE-23429.2.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 17246 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/22258/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/22258/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-22258/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13002575 - PreCommit-HIVE-Build
> LLAP: Optimize retrieving queryId details in LlapTaskCommunicator
> -
>
> Key: HIVE-23429
> URL: https://issues.apache.org/jira/browse/HIVE-23429
> Project: Hive
> Issue Type: Improvement
>Reporter: Rajesh Balamohan
>Assignee: Rajesh Balamohan
>Priority: Major
> Labels: performance
> Attachments: HIVE-23429.1.patch, HIVE-23429.2.patch
>
>
>
> [https://github.com/apache/hive/blob/master/llap-tez/src/java/org/apache/hadoop/hive/llap/tezplugins/LlapTaskCommunicator.java#L825]
>
> For small jobs, this becomes a bottleneck to unpack entire payload to lookup
> HIVEQUERYID parameter. It would be good to share HIVEQUERYID in dagConf and
> retrieve it back via DagInfo.
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23362) Repl dump returns dump location and repl id but doesn't write the ack in s3a FS
[ https://issues.apache.org/jira/browse/HIVE-23362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104063#comment-17104063 ] Anishek Agarwal commented on HIVE-23362: +1 > Repl dump returns dump location and repl id but doesn't write the ack in s3a > FS > --- > > Key: HIVE-23362 > URL: https://issues.apache.org/jira/browse/HIVE-23362 > Project: Hive > Issue Type: Task >Reporter: Aasha Medhi >Assignee: Aasha Medhi >Priority: Major > Attachments: HIVE-23362.01.patch, HIVE-23362.02.patch, > HIVE-23362.03.patch, HIVE-23362.04.patch, HIVE-23362.05.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23362) Repl dump returns dump location and repl id but doesn't write the ack in s3a FS
[ https://issues.apache.org/jira/browse/HIVE-23362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anishek Agarwal updated HIVE-23362: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to master, Thanks for the patch [~aasha]! > Repl dump returns dump location and repl id but doesn't write the ack in s3a > FS > --- > > Key: HIVE-23362 > URL: https://issues.apache.org/jira/browse/HIVE-23362 > Project: Hive > Issue Type: Task >Reporter: Aasha Medhi >Assignee: Aasha Medhi >Priority: Major > Attachments: HIVE-23362.01.patch, HIVE-23362.02.patch, > HIVE-23362.03.patch, HIVE-23362.04.patch, HIVE-23362.05.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23429) LLAP: Optimize retrieving queryId details in LlapTaskCommunicator
[
https://issues.apache.org/jira/browse/HIVE-23429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104053#comment-17104053
]
Hive QA commented on HIVE-23429:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m
38s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m
59s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
18s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
49s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
26s{color} | {color:blue} llap-tez in master has 17 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m
46s{color} | {color:blue} ql in master has 1527 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
5s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
29s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
42s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
17s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
17s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
10s{color} | {color:red} llap-tez: The patch generated 1 new + 36 unchanged - 0
fixed = 37 total (was 36) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
26s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
4s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
14s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 27m 40s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-22258/dev-support/hive-personality.sh
|
| git revision | master / 6491151 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.1 |
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22258/yetus/diff-checkstyle-llap-tez.txt
|
| modules | C: llap-tez ql U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22258/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> LLAP: Optimize retrieving queryId details in LlapTaskCommunicator
> -
>
> Key: HIVE-23429
> URL: https://issues.apache.org/jira/browse/HIVE-23429
> Project: Hive
> Issue Type: Improvement
>Reporter: Rajesh Balamohan
>Assignee: Rajesh Balamohan
>Priority: Major
> Labels: performance
> Attachments: HIVE-23429.1.patch, HIVE-23429.2.patch
>
>
>
> [https://github.com/apache/hive/blob/master/llap-tez/src/java/org/apache/hadoop/hive/llap/tezplugins/LlapTaskCommunicator.java#L825]
>
> For small jobs, this becomes a bottleneck to unpack entire payload to lookup
> HIVEQUERYID parameter. It would be good to share HIVEQUERYID in dagConf and
> retrieve it back via DagInfo.
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22320) Cluster and fs type settings can be replaced with a single minicluster setting in CliConfigs
[
https://issues.apache.org/jira/browse/HIVE-22320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ashutosh Chauhan updated HIVE-22320:
Resolution: Fixed
Status: Resolved (was: Patch Available)
Pushed to master. Thanks, Laszlo!
> Cluster and fs type settings can be replaced with a single minicluster
> setting in CliConfigs
>
>
> Key: HIVE-22320
> URL: https://issues.apache.org/jira/browse/HIVE-22320
> Project: Hive
> Issue Type: Bug
> Components: Test, Testing Infrastructure
>Reporter: László Bodor
>Assignee: László Bodor
>Priority: Minor
> Labels: newbie
> Fix For: 4.0.0
>
> Attachments: HIVE-22320.01.patch, HIVE-22320.02.patch,
> HIVE-22320.02.patch, HIVE-22320.02.patch, HIVE-22320.02.patch
>
>
> Fs + cluster types are already linked together in MiniClusterType, so it's
> confusing to set them in 2 steps, separately, if it covers an already defined
> minicluster type.
> https://github.com/apache/hive/blob/master/itests/util/src/main/java/org/apache/hadoop/hive/cli/control/CliConfigs.java
> {code}
> setClusterType(MiniClusterType.TEZ);
> setFsType(QTestMiniClusters.FsType.HDFS);
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Resolved] (HIVE-23430) Optimise ASTNode::getChildren
[ https://issues.apache.org/jira/browse/HIVE-23430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan resolved HIVE-23430. - Resolution: Duplicate > Optimise ASTNode::getChildren > -- > > Key: HIVE-23430 > URL: https://issues.apache.org/jira/browse/HIVE-23430 > Project: Hive > Issue Type: Improvement >Reporter: Rajesh Balamohan >Priority: Trivial > Attachments: image-2020-05-11-09-09-37-119.png > > > !image-2020-05-11-09-09-37-119.png|width=1276,height=930! > > Pink bars are from ASTNode::getChildren. Observed this, when large number of > small queries were executed in HS2 concurrently. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23430) Optimise ASTNode::getChildren
[ https://issues.apache.org/jira/browse/HIVE-23430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104047#comment-17104047 ] Rajesh Balamohan commented on HIVE-23430: - Yes, Marking this as duplicate. Just realized it is fixed in master. > Optimise ASTNode::getChildren > -- > > Key: HIVE-23430 > URL: https://issues.apache.org/jira/browse/HIVE-23430 > Project: Hive > Issue Type: Improvement >Reporter: Rajesh Balamohan >Priority: Trivial > Attachments: image-2020-05-11-09-09-37-119.png > > > !image-2020-05-11-09-09-37-119.png|width=1276,height=930! > > Pink bars are from ASTNode::getChildren. Observed this, when large number of > small queries were executed in HS2 concurrently. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23430) Optimise ASTNode::getChildren
[ https://issues.apache.org/jira/browse/HIVE-23430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104042#comment-17104042 ] Ashutosh Chauhan commented on HIVE-23430: - Dupe of HIVE-22629 ? > Optimise ASTNode::getChildren > -- > > Key: HIVE-23430 > URL: https://issues.apache.org/jira/browse/HIVE-23430 > Project: Hive > Issue Type: Improvement >Reporter: Rajesh Balamohan >Priority: Trivial > Attachments: image-2020-05-11-09-09-37-119.png > > > !image-2020-05-11-09-09-37-119.png|width=1276,height=930! > > Pink bars are from ASTNode::getChildren. Observed this, when large number of > small queries were executed in HS2 concurrently. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22325) variable expansion doesn't work in beeline-site.xml
[
https://issues.apache.org/jira/browse/HIVE-22325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ashutosh Chauhan updated HIVE-22325:
Fix Version/s: 4.0.0
Resolution: Duplicate
Status: Resolved (was: Patch Available)
Fixed via HIVE-22317
> variable expansion doesn't work in beeline-site.xml
> ---
>
> Key: HIVE-22325
> URL: https://issues.apache.org/jira/browse/HIVE-22325
> Project: Hive
> Issue Type: Bug
> Components: Beeline
>Affects Versions: 3.1.0, 3.1.1, 3.1.2
>Reporter: Allan Espinosa
>Assignee: Allan Espinosa
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-22325.1.patch, HIVE-22325.patch.txt
>
>
> I have a default jdbc connection string and I want to build on top on it to
> have customized connections like setting custom queue names.
> {code}
> $ cat .beeline/beeline-site.xml
> http://www.w3.org/2001/XInclude;>
>
> beeline.hs2.jdbc.url.base
> jdbc:hive2://localhost/
>
>
> beeline.hs2.jdbc.url.myqueue
> ${beeline.hs2.jdbc.url.base}?tez.queue.name=myqueue
>
>
> $ beeline -c myqueue
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in
> [jar:file:/usr/hdp/3.1.0.0-78/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in
> [jar:file:/usr/hdp/3.1.0.0-78/hadoop/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
> explanation.
> SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
> Error in parsing jdbc url:
> ${beeline.hs2.jdbc.url.base}?tez.queue.name=myqueue from beeline-site.xml
> Beeline version 3.1.0.3.1.0.0-78 by Apache Hive
> beeline>
> {code}
> Relevant code is found in
> https://github.com/apache/hive/blob/master/beeline/src/java/org/apache/hive/beeline/hs2connection/BeelineSiteParser.java#L94
> Entry#getValue() skips the variable expansion . Using
> Configuration#get(key) would make this work.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-23429) LLAP: Optimize retrieving queryId details in LlapTaskCommunicator
[ https://issues.apache.org/jira/browse/HIVE-23429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-23429: Attachment: HIVE-23429.2.patch > LLAP: Optimize retrieving queryId details in LlapTaskCommunicator > - > > Key: HIVE-23429 > URL: https://issues.apache.org/jira/browse/HIVE-23429 > Project: Hive > Issue Type: Improvement >Reporter: Rajesh Balamohan >Assignee: Rajesh Balamohan >Priority: Major > Labels: performance > Attachments: HIVE-23429.1.patch, HIVE-23429.2.patch > > > > [https://github.com/apache/hive/blob/master/llap-tez/src/java/org/apache/hadoop/hive/llap/tezplugins/LlapTaskCommunicator.java#L825] > > For small jobs, this becomes a bottleneck to unpack entire payload to lookup > HIVEQUERYID parameter. It would be good to share HIVEQUERYID in dagConf and > retrieve it back via DagInfo. > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23429) LLAP: Optimize retrieving queryId details in LlapTaskCommunicator
[ https://issues.apache.org/jira/browse/HIVE-23429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-23429: Status: Patch Available (was: Open) same patch reattach to retest. > LLAP: Optimize retrieving queryId details in LlapTaskCommunicator > - > > Key: HIVE-23429 > URL: https://issues.apache.org/jira/browse/HIVE-23429 > Project: Hive > Issue Type: Improvement >Reporter: Rajesh Balamohan >Assignee: Rajesh Balamohan >Priority: Major > Labels: performance > Attachments: HIVE-23429.1.patch, HIVE-23429.2.patch > > > > [https://github.com/apache/hive/blob/master/llap-tez/src/java/org/apache/hadoop/hive/llap/tezplugins/LlapTaskCommunicator.java#L825] > > For small jobs, this becomes a bottleneck to unpack entire payload to lookup > HIVEQUERYID parameter. It would be good to share HIVEQUERYID in dagConf and > retrieve it back via DagInfo. > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23429) LLAP: Optimize retrieving queryId details in LlapTaskCommunicator
[ https://issues.apache.org/jira/browse/HIVE-23429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-23429: Status: Open (was: Patch Available) > LLAP: Optimize retrieving queryId details in LlapTaskCommunicator > - > > Key: HIVE-23429 > URL: https://issues.apache.org/jira/browse/HIVE-23429 > Project: Hive > Issue Type: Improvement >Reporter: Rajesh Balamohan >Assignee: Rajesh Balamohan >Priority: Major > Labels: performance > Attachments: HIVE-23429.1.patch, HIVE-23429.2.patch > > > > [https://github.com/apache/hive/blob/master/llap-tez/src/java/org/apache/hadoop/hive/llap/tezplugins/LlapTaskCommunicator.java#L825] > > For small jobs, this becomes a bottleneck to unpack entire payload to lookup > HIVEQUERYID parameter. It would be good to share HIVEQUERYID in dagConf and > retrieve it back via DagInfo. > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23429) LLAP: Optimize retrieving queryId details in LlapTaskCommunicator
[ https://issues.apache.org/jira/browse/HIVE-23429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104031#comment-17104031 ] Ashutosh Chauhan commented on HIVE-23429: - +1 > LLAP: Optimize retrieving queryId details in LlapTaskCommunicator > - > > Key: HIVE-23429 > URL: https://issues.apache.org/jira/browse/HIVE-23429 > Project: Hive > Issue Type: Improvement >Reporter: Rajesh Balamohan >Assignee: Rajesh Balamohan >Priority: Major > Labels: performance > Attachments: HIVE-23429.1.patch, HIVE-23429.2.patch > > > > [https://github.com/apache/hive/blob/master/llap-tez/src/java/org/apache/hadoop/hive/llap/tezplugins/LlapTaskCommunicator.java#L825] > > For small jobs, this becomes a bottleneck to unpack entire payload to lookup > HIVEQUERYID parameter. It would be good to share HIVEQUERYID in dagConf and > retrieve it back via DagInfo. > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23429) LLAP: Optimize retrieving queryId details in LlapTaskCommunicator
[
https://issues.apache.org/jira/browse/HIVE-23429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104005#comment-17104005
]
Hive QA commented on HIVE-23429:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13002564/HIVE-23429.1.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 17226 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.ql.parse.TestTableLevelReplicationScenarios.org.apache.hadoop.hive.ql.parse.TestTableLevelReplicationScenarios
(batchId=187)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/22256/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/22256/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-22256/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13002564 - PreCommit-HIVE-Build
> LLAP: Optimize retrieving queryId details in LlapTaskCommunicator
> -
>
> Key: HIVE-23429
> URL: https://issues.apache.org/jira/browse/HIVE-23429
> Project: Hive
> Issue Type: Improvement
>Reporter: Rajesh Balamohan
>Assignee: Rajesh Balamohan
>Priority: Major
> Labels: performance
> Attachments: HIVE-23429.1.patch
>
>
>
> [https://github.com/apache/hive/blob/master/llap-tez/src/java/org/apache/hadoop/hive/llap/tezplugins/LlapTaskCommunicator.java#L825]
>
> For small jobs, this becomes a bottleneck to unpack entire payload to lookup
> HIVEQUERYID parameter. It would be good to share HIVEQUERYID in dagConf and
> retrieve it back via DagInfo.
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23429) LLAP: Optimize retrieving queryId details in LlapTaskCommunicator
[
https://issues.apache.org/jira/browse/HIVE-23429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103998#comment-17103998
]
Hive QA commented on HIVE-23429:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m
33s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
30s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
13s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
53s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
26s{color} | {color:blue} llap-tez in master has 17 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m
45s{color} | {color:blue} ql in master has 1527 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
5s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
28s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
40s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
18s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
18s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
10s{color} | {color:red} llap-tez: The patch generated 1 new + 36 unchanged - 0
fixed = 37 total (was 36) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
30s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
5s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
14s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 28m 4s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-22256/dev-support/hive-personality.sh
|
| git revision | master / 6491151 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.1 |
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22256/yetus/diff-checkstyle-llap-tez.txt
|
| modules | C: llap-tez ql U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22256/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> LLAP: Optimize retrieving queryId details in LlapTaskCommunicator
> -
>
> Key: HIVE-23429
> URL: https://issues.apache.org/jira/browse/HIVE-23429
> Project: Hive
> Issue Type: Improvement
>Reporter: Rajesh Balamohan
>Assignee: Rajesh Balamohan
>Priority: Major
> Labels: performance
> Attachments: HIVE-23429.1.patch
>
>
>
> [https://github.com/apache/hive/blob/master/llap-tez/src/java/org/apache/hadoop/hive/llap/tezplugins/LlapTaskCommunicator.java#L825]
>
> For small jobs, this becomes a bottleneck to unpack entire payload to lookup
> HIVEQUERYID parameter. It would be good to share HIVEQUERYID in dagConf and
> retrieve it back via DagInfo.
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22343) Fix incorrect spelling of 'artifectId' in pom.xml
[ https://issues.apache.org/jira/browse/HIVE-22343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-22343: Fix Version/s: (was: 3.2.0) Resolution: Fixed Status: Resolved (was: Patch Available) Pushed to master. Thanks, ice bai > Fix incorrect spelling of 'artifectId' in pom.xml > - > > Key: HIVE-22343 > URL: https://issues.apache.org/jira/browse/HIVE-22343 > Project: Hive > Issue Type: Improvement >Reporter: ice bai >Assignee: ice bai >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-22343.patch > > > There are some incorrect spelling of 'artifectId' in pom.xml or xxx/pom.xml > Such as: > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22343) Fix incorrect spelling of 'artifectId' in pom.xml
[ https://issues.apache.org/jira/browse/HIVE-22343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103990#comment-17103990 ] Ashutosh Chauhan commented on HIVE-22343: - +1 > Fix incorrect spelling of 'artifectId' in pom.xml > - > > Key: HIVE-22343 > URL: https://issues.apache.org/jira/browse/HIVE-22343 > Project: Hive > Issue Type: Improvement >Reporter: ice bai >Assignee: ice bai >Priority: Major > Fix For: 4.0.0, 3.2.0 > > Attachments: HIVE-22343.patch > > > There are some incorrect spelling of 'artifectId' in pom.xml or xxx/pom.xml > Such as: > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23429) LLAP: Optimize retrieving queryId details in LlapTaskCommunicator
[ https://issues.apache.org/jira/browse/HIVE-23429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23429: Assignee: Rajesh Balamohan Status: Patch Available (was: Open) > LLAP: Optimize retrieving queryId details in LlapTaskCommunicator > - > > Key: HIVE-23429 > URL: https://issues.apache.org/jira/browse/HIVE-23429 > Project: Hive > Issue Type: Improvement >Reporter: Rajesh Balamohan >Assignee: Rajesh Balamohan >Priority: Major > Labels: performance > Attachments: HIVE-23429.1.patch > > > > [https://github.com/apache/hive/blob/master/llap-tez/src/java/org/apache/hadoop/hive/llap/tezplugins/LlapTaskCommunicator.java#L825] > > For small jobs, this becomes a bottleneck to unpack entire payload to lookup > HIVEQUERYID parameter. It would be good to share HIVEQUERYID in dagConf and > retrieve it back via DagInfo. > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23429) LLAP: Optimize retrieving queryId details in LlapTaskCommunicator
[ https://issues.apache.org/jira/browse/HIVE-23429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23429: Attachment: HIVE-23429.1.patch > LLAP: Optimize retrieving queryId details in LlapTaskCommunicator > - > > Key: HIVE-23429 > URL: https://issues.apache.org/jira/browse/HIVE-23429 > Project: Hive > Issue Type: Improvement >Reporter: Rajesh Balamohan >Priority: Major > Labels: performance > Attachments: HIVE-23429.1.patch > > > > [https://github.com/apache/hive/blob/master/llap-tez/src/java/org/apache/hadoop/hive/llap/tezplugins/LlapTaskCommunicator.java#L825] > > For small jobs, this becomes a bottleneck to unpack entire payload to lookup > HIVEQUERYID parameter. It would be good to share HIVEQUERYID in dagConf and > retrieve it back via DagInfo. > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23429) LLAP: Optimize retrieving queryId details in LlapTaskCommunicator
[ https://issues.apache.org/jira/browse/HIVE-23429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103984#comment-17103984 ] Rajesh Balamohan commented on HIVE-23429: - Related ticket: https://issues.apache.org/jira/browse/TEZ-2672 > LLAP: Optimize retrieving queryId details in LlapTaskCommunicator > - > > Key: HIVE-23429 > URL: https://issues.apache.org/jira/browse/HIVE-23429 > Project: Hive > Issue Type: Improvement >Reporter: Rajesh Balamohan >Priority: Major > Labels: performance > > > [https://github.com/apache/hive/blob/master/llap-tez/src/java/org/apache/hadoop/hive/llap/tezplugins/LlapTaskCommunicator.java#L825] > > For small jobs, this becomes a bottleneck to unpack entire payload to lookup > HIVEQUERYID parameter. It would be good to share HIVEQUERYID in dagConf and > retrieve it back via DagInfo. > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23338) Bump jackson-databind version up to 2.9.10.4
[
https://issues.apache.org/jira/browse/HIVE-23338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103979#comment-17103979
]
Hive QA commented on HIVE-23338:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 2m
5s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
1s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 10m
39s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 10m
11s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
26s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 12m
44s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 10m
38s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 10m
38s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
9s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 10m
5s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
13s{color} | {color:red} The patch generated 3 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 66m 2s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc xml compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-22255/dev-support/hive-personality.sh
|
| git revision | master / 19e67cd |
| Default Java | 1.8.0_111 |
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22255/yetus/patch-asflicense-problems.txt
|
| modules | C: standalone-metastore common ql hcatalog/core
hcatalog/server-extensions hcatalog/webhcat/svr . itests/qtest-druid
testutils/ptest2 U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22255/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Bump jackson-databind version up to 2.9.10.4
>
>
> Key: HIVE-23338
> URL: https://issues.apache.org/jira/browse/HIVE-23338
> Project: Hive
> Issue Type: Improvement
>Reporter: Karen Coppage
>Assignee: Karen Coppage
>Priority: Major
> Attachments: HIVE-23338.01.patch, HIVE-23338.01.patch,
> HIVE-23338.01.patch, HIVE-23338.01.patch, HIVE-23338.02.patch,
> HIVE-23338.03.patch, HIVE-23338.03.patch, HIVE-23338.03.patch
>
>
> And exclude a transitive dependency on
> com.fasterxml.jackson.core:jackson-databind:2.6.5
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23338) Bump jackson-databind version up to 2.9.10.4
[
https://issues.apache.org/jira/browse/HIVE-23338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103978#comment-17103978
]
Hive QA commented on HIVE-23338:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13002556/HIVE-23338.03.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 17246 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/22255/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/22255/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-22255/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13002556 - PreCommit-HIVE-Build
> Bump jackson-databind version up to 2.9.10.4
>
>
> Key: HIVE-23338
> URL: https://issues.apache.org/jira/browse/HIVE-23338
> Project: Hive
> Issue Type: Improvement
>Reporter: Karen Coppage
>Assignee: Karen Coppage
>Priority: Major
> Attachments: HIVE-23338.01.patch, HIVE-23338.01.patch,
> HIVE-23338.01.patch, HIVE-23338.01.patch, HIVE-23338.02.patch,
> HIVE-23338.03.patch, HIVE-23338.03.patch, HIVE-23338.03.patch
>
>
> And exclude a transitive dependency on
> com.fasterxml.jackson.core:jackson-databind:2.6.5
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22933) Allow connecting kerberos-enabled Hive to connect to a non-kerberos druid cluster
[ https://issues.apache.org/jira/browse/HIVE-22933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-22933: Fix Version/s: 4.0.0 Resolution: Fixed Status: Resolved (was: Patch Available) Pushed to master. Thanks, Nishant! > Allow connecting kerberos-enabled Hive to connect to a non-kerberos druid > cluster > - > > Key: HIVE-22933 > URL: https://issues.apache.org/jira/browse/HIVE-22933 > Project: Hive > Issue Type: Bug >Reporter: Nishant Bangarwa >Assignee: Nishant Bangarwa >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-22933.1.patch, HIVE-22933.2.patch, > HIVE-22933.3.patch, HIVE-22933.4.patch, HIVE-22933.patch > > > Currently, If kerberos is enabled for hive, it can only connect to external > druid clusters which are kerberos enabled, Since the Druid client used to > connect to druid is always KerberosHTTPClient, This task is to allow a > kerberos enabled hiverserver2 to connect to non-kerberized druid cluster. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23344) Bump org.scala-lang:scala-compiler version to 2.12.4
[
https://issues.apache.org/jira/browse/HIVE-23344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103960#comment-17103960
]
Hive QA commented on HIVE-23344:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13002555/HIVE-23344.03.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 3 failed/errored test(s), 17246 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.ql.exec.spark.TestHiveSparkClient.testSetJobGroupAndDescription
(batchId=290)
org.apache.hadoop.hive.ql.exec.spark.TestSparkInvalidFileFormat.readTextFileAsParquet
(batchId=291)
org.apache.hadoop.hive.ql.exec.spark.TestSparkPlan.testSetRDDCallSite
(batchId=290)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/22254/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/22254/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-22254/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 3 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13002555 - PreCommit-HIVE-Build
> Bump org.scala-lang:scala-compiler version to 2.12.4
>
>
> Key: HIVE-23344
> URL: https://issues.apache.org/jira/browse/HIVE-23344
> Project: Hive
> Issue Type: Improvement
>Reporter: Karen Coppage
>Assignee: Karen Coppage
>Priority: Major
> Attachments: HIVE-23344.01.patch, HIVE-23344.01.patch,
> HIVE-23344.02.patch, HIVE-23344.03.patch, HIVE-23344.03.patch
>
>
> And bump up spark version, as 2.3.3 is not compatible with scala 2.12
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23344) Bump org.scala-lang:scala-compiler version to 2.12.4
[
https://issues.apache.org/jira/browse/HIVE-23344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103959#comment-17103959
]
Hive QA commented on HIVE-23344:
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 2m
0s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
4s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 7m
8s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 7m
11s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
27s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 9m
4s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 7m
15s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 7m
15s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
3s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 7m
8s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
13s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 49m 0s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc xml compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-22254/dev-support/hive-personality.sh
|
| git revision | master / 19e67cd |
| Default Java | 1.8.0_111 |
| modules | C: kafka-handler . itests/qtest-druid U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22254/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Bump org.scala-lang:scala-compiler version to 2.12.4
>
>
> Key: HIVE-23344
> URL: https://issues.apache.org/jira/browse/HIVE-23344
> Project: Hive
> Issue Type: Improvement
>Reporter: Karen Coppage
>Assignee: Karen Coppage
>Priority: Major
> Attachments: HIVE-23344.01.patch, HIVE-23344.01.patch,
> HIVE-23344.02.patch, HIVE-23344.03.patch, HIVE-23344.03.patch
>
>
> And bump up spark version, as 2.3.3 is not compatible with scala 2.12
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22933) Allow connecting kerberos-enabled Hive to connect to a non-kerberos druid cluster
[
https://issues.apache.org/jira/browse/HIVE-22933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103951#comment-17103951
]
Hive QA commented on HIVE-22933:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13002553/HIVE-22933.4.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 17246 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/22253/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/22253/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-22253/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13002553 - PreCommit-HIVE-Build
> Allow connecting kerberos-enabled Hive to connect to a non-kerberos druid
> cluster
> -
>
> Key: HIVE-22933
> URL: https://issues.apache.org/jira/browse/HIVE-22933
> Project: Hive
> Issue Type: Bug
>Reporter: Nishant Bangarwa
>Assignee: Nishant Bangarwa
>Priority: Major
> Attachments: HIVE-22933.1.patch, HIVE-22933.2.patch,
> HIVE-22933.3.patch, HIVE-22933.4.patch, HIVE-22933.patch
>
>
> Currently, If kerberos is enabled for hive, it can only connect to external
> druid clusters which are kerberos enabled, Since the Druid client used to
> connect to druid is always KerberosHTTPClient, This task is to allow a
> kerberos enabled hiverserver2 to connect to non-kerberized druid cluster.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-23338) Bump jackson-databind version up to 2.9.10.4
[ https://issues.apache.org/jira/browse/HIVE-23338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karen Coppage updated HIVE-23338: - Attachment: HIVE-23338.03.patch Status: Patch Available (was: Open) > Bump jackson-databind version up to 2.9.10.4 > > > Key: HIVE-23338 > URL: https://issues.apache.org/jira/browse/HIVE-23338 > Project: Hive > Issue Type: Improvement >Reporter: Karen Coppage >Assignee: Karen Coppage >Priority: Major > Attachments: HIVE-23338.01.patch, HIVE-23338.01.patch, > HIVE-23338.01.patch, HIVE-23338.01.patch, HIVE-23338.02.patch, > HIVE-23338.03.patch, HIVE-23338.03.patch, HIVE-23338.03.patch > > > And exclude a transitive dependency on > com.fasterxml.jackson.core:jackson-databind:2.6.5 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23338) Bump jackson-databind version up to 2.9.10.4
[ https://issues.apache.org/jira/browse/HIVE-23338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karen Coppage updated HIVE-23338: - Status: Open (was: Patch Available) > Bump jackson-databind version up to 2.9.10.4 > > > Key: HIVE-23338 > URL: https://issues.apache.org/jira/browse/HIVE-23338 > Project: Hive > Issue Type: Improvement >Reporter: Karen Coppage >Assignee: Karen Coppage >Priority: Major > Attachments: HIVE-23338.01.patch, HIVE-23338.01.patch, > HIVE-23338.01.patch, HIVE-23338.01.patch, HIVE-23338.02.patch, > HIVE-23338.03.patch, HIVE-23338.03.patch, HIVE-23338.03.patch > > > And exclude a transitive dependency on > com.fasterxml.jackson.core:jackson-databind:2.6.5 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23344) Bump org.scala-lang:scala-compiler version to 2.12.4
[ https://issues.apache.org/jira/browse/HIVE-23344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karen Coppage updated HIVE-23344: - Attachment: HIVE-23344.03.patch Status: Patch Available (was: Open) > Bump org.scala-lang:scala-compiler version to 2.12.4 > > > Key: HIVE-23344 > URL: https://issues.apache.org/jira/browse/HIVE-23344 > Project: Hive > Issue Type: Improvement >Reporter: Karen Coppage >Assignee: Karen Coppage >Priority: Major > Attachments: HIVE-23344.01.patch, HIVE-23344.01.patch, > HIVE-23344.02.patch, HIVE-23344.03.patch, HIVE-23344.03.patch > > > And bump up spark version, as 2.3.3 is not compatible with scala 2.12 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23344) Bump org.scala-lang:scala-compiler version to 2.12.4
[ https://issues.apache.org/jira/browse/HIVE-23344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karen Coppage updated HIVE-23344: - Status: Open (was: Patch Available) > Bump org.scala-lang:scala-compiler version to 2.12.4 > > > Key: HIVE-23344 > URL: https://issues.apache.org/jira/browse/HIVE-23344 > Project: Hive > Issue Type: Improvement >Reporter: Karen Coppage >Assignee: Karen Coppage >Priority: Major > Attachments: HIVE-23344.01.patch, HIVE-23344.01.patch, > HIVE-23344.02.patch, HIVE-23344.03.patch, HIVE-23344.03.patch > > > And bump up spark version, as 2.3.3 is not compatible with scala 2.12 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22933) Allow connecting kerberos-enabled Hive to connect to a non-kerberos druid cluster
[
https://issues.apache.org/jira/browse/HIVE-22933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103945#comment-17103945
]
Hive QA commented on HIVE-22933:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
1s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 2m
14s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
10s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
37s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
26s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
33s{color} | {color:blue} common in master has 63 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
32s{color} | {color:blue} druid-handler in master has 3 extant Findbugs
warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
27s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
26s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red} 0m
18s{color} | {color:red} druid-handler in the patch failed. {color} |
| {color:red}-1{color} | {color:red} compile {color} | {color:red} 0m
19s{color} | {color:red} druid-handler in the patch failed. {color} |
| {color:red}-1{color} | {color:red} javac {color} | {color:red} 0m 19s{color}
| {color:red} druid-handler in the patch failed. {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
11s{color} | {color:red} druid-handler: The patch generated 1 new + 0 unchanged
- 0 fixed = 1 total (was 0) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 0m
18s{color} | {color:red} druid-handler in the patch failed. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
28s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
14s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 17m 18s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-22253/dev-support/hive-personality.sh
|
| git revision | master / 19e67cd |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.1 |
| mvninstall |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22253/yetus/patch-mvninstall-druid-handler.txt
|
| compile |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22253/yetus/patch-compile-druid-handler.txt
|
| javac |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22253/yetus/patch-compile-druid-handler.txt
|
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22253/yetus/diff-checkstyle-druid-handler.txt
|
| findbugs |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22253/yetus/patch-findbugs-druid-handler.txt
|
| modules | C: common druid-handler U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22253/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Allow connecting kerberos-enabled Hive to connect to a non-kerberos druid
> cluster
> -
>
> Key: HIVE-22933
> URL: https://issues.apache.org/jira/browse/HIVE-22933
> Project: Hive
> Issue Type: Bug
>Reporter: Nishant Bangarwa
>Assignee: Nishant Bangarwa
>Priority: Major
> Attachments: HIVE-22933.1.patch, HIVE-22933.2.patch,
> HIVE-22933.3.patch, HIVE-22933.4.patch, HIVE-22933.patch
>
>
> Currently, If
[jira] [Commented] (HIVE-23403) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is different, batch 3
[
https://issues.apache.org/jira/browse/HIVE-23403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103938#comment-17103938
]
Hive QA commented on HIVE-23403:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13002552/HIVE-23403.06.patch
{color:red}ERROR:{color} -1 due to build exiting with an error
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/22252/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/22252/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-22252/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Tests exited with: Exception: Patch URL
https://issues.apache.org/jira/secure/attachment/13002552/HIVE-23403.06.patch
was found in seen patch url's cache and a test was probably run already on it.
Aborting...
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13002552 - PreCommit-HIVE-Build
> Move q tests to TestMiniLlapLocal from TestCliDriver where the output is
> different, batch 3
> ---
>
> Key: HIVE-23403
> URL: https://issues.apache.org/jira/browse/HIVE-23403
> Project: Hive
> Issue Type: Sub-task
>Reporter: Miklos Gergely
>Assignee: Miklos Gergely
>Priority: Major
> Attachments: HIVE-23403.01.patch, HIVE-23403.02.patch,
> HIVE-23403.03.patch, HIVE-23403.04.patch, HIVE-23403.05.patch,
> HIVE-23403.06.patch
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23403) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is different, batch 3
[
https://issues.apache.org/jira/browse/HIVE-23403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103937#comment-17103937
]
Hive QA commented on HIVE-23403:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13002552/HIVE-23403.06.patch
{color:green}SUCCESS:{color} +1 due to 21 test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 17246 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/22251/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/22251/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-22251/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13002552 - PreCommit-HIVE-Build
> Move q tests to TestMiniLlapLocal from TestCliDriver where the output is
> different, batch 3
> ---
>
> Key: HIVE-23403
> URL: https://issues.apache.org/jira/browse/HIVE-23403
> Project: Hive
> Issue Type: Sub-task
>Reporter: Miklos Gergely
>Assignee: Miklos Gergely
>Priority: Major
> Attachments: HIVE-23403.01.patch, HIVE-23403.02.patch,
> HIVE-23403.03.patch, HIVE-23403.04.patch, HIVE-23403.05.patch,
> HIVE-23403.06.patch
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22933) Allow connecting kerberos-enabled Hive to connect to a non-kerberos druid cluster
[ https://issues.apache.org/jira/browse/HIVE-22933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-22933: Attachment: HIVE-22933.4.patch > Allow connecting kerberos-enabled Hive to connect to a non-kerberos druid > cluster > - > > Key: HIVE-22933 > URL: https://issues.apache.org/jira/browse/HIVE-22933 > Project: Hive > Issue Type: Bug >Reporter: Nishant Bangarwa >Assignee: Nishant Bangarwa >Priority: Major > Attachments: HIVE-22933.1.patch, HIVE-22933.2.patch, > HIVE-22933.3.patch, HIVE-22933.4.patch, HIVE-22933.patch > > > Currently, If kerberos is enabled for hive, it can only connect to external > druid clusters which are kerberos enabled, Since the Druid client used to > connect to druid is always KerberosHTTPClient, This task is to allow a > kerberos enabled hiverserver2 to connect to non-kerberized druid cluster. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22933) Allow connecting kerberos-enabled Hive to connect to a non-kerberos druid cluster
[ https://issues.apache.org/jira/browse/HIVE-22933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-22933: Status: Patch Available (was: Open) > Allow connecting kerberos-enabled Hive to connect to a non-kerberos druid > cluster > - > > Key: HIVE-22933 > URL: https://issues.apache.org/jira/browse/HIVE-22933 > Project: Hive > Issue Type: Bug >Reporter: Nishant Bangarwa >Assignee: Nishant Bangarwa >Priority: Major > Attachments: HIVE-22933.1.patch, HIVE-22933.2.patch, > HIVE-22933.3.patch, HIVE-22933.4.patch, HIVE-22933.patch > > > Currently, If kerberos is enabled for hive, it can only connect to external > druid clusters which are kerberos enabled, Since the Druid client used to > connect to druid is always KerberosHTTPClient, This task is to allow a > kerberos enabled hiverserver2 to connect to non-kerberized druid cluster. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22933) Allow connecting kerberos-enabled Hive to connect to a non-kerberos druid cluster
[ https://issues.apache.org/jira/browse/HIVE-22933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-22933: Status: Open (was: Patch Available) > Allow connecting kerberos-enabled Hive to connect to a non-kerberos druid > cluster > - > > Key: HIVE-22933 > URL: https://issues.apache.org/jira/browse/HIVE-22933 > Project: Hive > Issue Type: Bug >Reporter: Nishant Bangarwa >Assignee: Nishant Bangarwa >Priority: Major > Attachments: HIVE-22933.1.patch, HIVE-22933.2.patch, > HIVE-22933.3.patch, HIVE-22933.4.patch, HIVE-22933.patch > > > Currently, If kerberos is enabled for hive, it can only connect to external > druid clusters which are kerberos enabled, Since the Druid client used to > connect to druid is always KerberosHTTPClient, This task is to allow a > kerberos enabled hiverserver2 to connect to non-kerberized druid cluster. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23403) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is different, batch 3
[
https://issues.apache.org/jira/browse/HIVE-23403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103926#comment-17103926
]
Hive QA commented on HIVE-23403:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m
52s{color} | {color:blue} Maven dependency ordering for branch {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
27s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m
2s{color} | {color:red} The patch has 3 line(s) that end in whitespace. Use git
apply --whitespace=fix <>. Refer https://git-scm.com/docs/git-apply
{color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
11s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 3m 43s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-22251/dev-support/hive-personality.sh
|
| git revision | master / 19e67cd |
| whitespace |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22251/yetus/whitespace-eol.txt
|
| modules | C: ql . itests U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22251/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Move q tests to TestMiniLlapLocal from TestCliDriver where the output is
> different, batch 3
> ---
>
> Key: HIVE-23403
> URL: https://issues.apache.org/jira/browse/HIVE-23403
> Project: Hive
> Issue Type: Sub-task
>Reporter: Miklos Gergely
>Assignee: Miklos Gergely
>Priority: Major
> Attachments: HIVE-23403.01.patch, HIVE-23403.02.patch,
> HIVE-23403.03.patch, HIVE-23403.04.patch, HIVE-23403.05.patch,
> HIVE-23403.06.patch
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-23403) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is different, batch 3
[ https://issues.apache.org/jira/browse/HIVE-23403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Gergely updated HIVE-23403: -- Attachment: HIVE-23403.06.patch > Move q tests to TestMiniLlapLocal from TestCliDriver where the output is > different, batch 3 > --- > > Key: HIVE-23403 > URL: https://issues.apache.org/jira/browse/HIVE-23403 > Project: Hive > Issue Type: Sub-task >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > Attachments: HIVE-23403.01.patch, HIVE-23403.02.patch, > HIVE-23403.03.patch, HIVE-23403.04.patch, HIVE-23403.05.patch, > HIVE-23403.06.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23403) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is different, batch 3
[ https://issues.apache.org/jira/browse/HIVE-23403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Gergely updated HIVE-23403: -- Attachment: (was: HIVE-23403.06.patch) > Move q tests to TestMiniLlapLocal from TestCliDriver where the output is > different, batch 3 > --- > > Key: HIVE-23403 > URL: https://issues.apache.org/jira/browse/HIVE-23403 > Project: Hive > Issue Type: Sub-task >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > Attachments: HIVE-23403.01.patch, HIVE-23403.02.patch, > HIVE-23403.03.patch, HIVE-23403.04.patch, HIVE-23403.05.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23403) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is different, batch 3
[
https://issues.apache.org/jira/browse/HIVE-23403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103924#comment-17103924
]
Hive QA commented on HIVE-23403:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13002551/HIVE-23403.06.patch
{color:green}SUCCESS:{color} +1 due to 21 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 17242 tests
executed
*Failed tests:*
{noformat}
TestStatsReplicationScenariosACID - did not produce a TEST-*.xml file (likely
timed out) (batchId=184)
org.apache.hadoop.hive.cli.TestMiniDruidCliDriver.testCliDriver[druid_materialized_view_rewrite_ssb]
(batchId=128)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/22250/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/22250/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-22250/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 2 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13002551 - PreCommit-HIVE-Build
> Move q tests to TestMiniLlapLocal from TestCliDriver where the output is
> different, batch 3
> ---
>
> Key: HIVE-23403
> URL: https://issues.apache.org/jira/browse/HIVE-23403
> Project: Hive
> Issue Type: Sub-task
>Reporter: Miklos Gergely
>Assignee: Miklos Gergely
>Priority: Major
> Attachments: HIVE-23403.01.patch, HIVE-23403.02.patch,
> HIVE-23403.03.patch, HIVE-23403.04.patch, HIVE-23403.05.patch,
> HIVE-23403.06.patch
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23389) FilterMergeRule can lead to AssertionError
[
https://issues.apache.org/jira/browse/HIVE-23389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103914#comment-17103914
]
Zoltan Haindrich commented on HIVE-23389:
-
+1
I'm not sure if we want to follow the "Bug" concept - right now I don't think
we have any way to track these kind of things; but if the check would actually
trigger some errors in case the dependency is updated: that might be usefull...
> FilterMergeRule can lead to AssertionError
> --
>
> Key: HIVE-23389
> URL: https://issues.apache.org/jira/browse/HIVE-23389
> Project: Hive
> Issue Type: Bug
> Components: CBO
>Reporter: Jesus Camacho Rodriguez
>Assignee: Jesus Camacho Rodriguez
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-23389.01.patch, HIVE-23389.01.patch,
> HIVE-23389.02.patch, HIVE-23389.patch
>
> Time Spent: 50m
> Remaining Estimate: 0h
>
> I have not been able to reproduce the issue in latest master. However, this
> could potentially happen since Filter creation has a check on whether the
> expression is flat
> ([here|https://github.com/apache/calcite/blob/master/core/src/main/java/org/apache/calcite/rel/core/Filter.java#L74])
> and Filter merge does not flatten an expression when it is created.
> {noformat}
> java.lang.AssertionError: AND(=($3, 100), OR(OR(null, IS NOT
> NULL(CAST(100):INTEGER)), =(CAST(100):INTEGER, CAST(200):INTEGER)))
> at org.apache.calcite.rel.core.Filter.(Filter.java:74)
> at
> org.apache.hadoop.hive.ql.optimizer.calcite.reloperators.HiveFilter.(HiveFilter.java:39)
> at
> org.apache.hadoop.hive.ql.optimizer.calcite.HiveRelFactories$HiveFilterFactoryImpl.createFilter(HiveRelFactories.java:126)
> at
> org.apache.hadoop.hive.ql.optimizer.calcite.HiveRelBuilder.filter(HiveRelBuilder.java:99)
> at org.apache.calcite.tools.RelBuilder.filter(RelBuilder.java:1055)
> at
> org.apache.calcite.rel.rules.FilterMergeRule.onMatch(FilterMergeRule.java:81)
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23403) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is different, batch 3
[
https://issues.apache.org/jira/browse/HIVE-23403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103903#comment-17103903
]
Hive QA commented on HIVE-23403:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m
49s{color} | {color:blue} Maven dependency ordering for branch {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
26s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m
2s{color} | {color:red} The patch has 3 line(s) that end in whitespace. Use git
apply --whitespace=fix <>. Refer https://git-scm.com/docs/git-apply
{color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
11s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 3m 46s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-22250/dev-support/hive-personality.sh
|
| git revision | master / 19e67cd |
| whitespace |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22250/yetus/whitespace-eol.txt
|
| modules | C: ql . itests U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22250/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Move q tests to TestMiniLlapLocal from TestCliDriver where the output is
> different, batch 3
> ---
>
> Key: HIVE-23403
> URL: https://issues.apache.org/jira/browse/HIVE-23403
> Project: Hive
> Issue Type: Sub-task
>Reporter: Miklos Gergely
>Assignee: Miklos Gergely
>Priority: Major
> Attachments: HIVE-23403.01.patch, HIVE-23403.02.patch,
> HIVE-23403.03.patch, HIVE-23403.04.patch, HIVE-23403.05.patch,
> HIVE-23403.06.patch
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22933) Allow connecting kerberos-enabled Hive to connect to a non-kerberos druid cluster
[
https://issues.apache.org/jira/browse/HIVE-22933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103899#comment-17103899
]
Hive QA commented on HIVE-22933:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13002550/HIVE-22933.3.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 17246 tests
executed
*Failed tests:*
{noformat}
org.apache.hive.jdbc.miniHS2.TestHs2ConnectionMetricsHttp.testOpenConnectionMetrics
(batchId=219)
org.apache.hive.service.auth.TestImproperTrustDomainAuthenticationBinary.org.apache.hive.service.auth.TestImproperTrustDomainAuthenticationBinary
(batchId=209)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/22249/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/22249/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-22249/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 2 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13002550 - PreCommit-HIVE-Build
> Allow connecting kerberos-enabled Hive to connect to a non-kerberos druid
> cluster
> -
>
> Key: HIVE-22933
> URL: https://issues.apache.org/jira/browse/HIVE-22933
> Project: Hive
> Issue Type: Bug
>Reporter: Nishant Bangarwa
>Assignee: Nishant Bangarwa
>Priority: Major
> Attachments: HIVE-22933.1.patch, HIVE-22933.2.patch,
> HIVE-22933.3.patch, HIVE-22933.patch
>
>
> Currently, If kerberos is enabled for hive, it can only connect to external
> druid clusters which are kerberos enabled, Since the Druid client used to
> connect to druid is always KerberosHTTPClient, This task is to allow a
> kerberos enabled hiverserver2 to connect to non-kerberized druid cluster.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22933) Allow connecting kerberos-enabled Hive to connect to a non-kerberos druid cluster
[
https://issues.apache.org/jira/browse/HIVE-22933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103882#comment-17103882
]
Hive QA commented on HIVE-22933:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 2m
15s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
47s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
38s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
27s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
39s{color} | {color:blue} common in master has 63 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
30s{color} | {color:blue} druid-handler in master has 3 extant Findbugs
warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
27s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
29s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red} 0m
18s{color} | {color:red} druid-handler in the patch failed. {color} |
| {color:red}-1{color} | {color:red} compile {color} | {color:red} 0m
17s{color} | {color:red} druid-handler in the patch failed. {color} |
| {color:red}-1{color} | {color:red} javac {color} | {color:red} 0m 17s{color}
| {color:red} druid-handler in the patch failed. {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
11s{color} | {color:red} druid-handler: The patch generated 1 new + 0 unchanged
- 0 fixed = 1 total (was 0) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 0m
18s{color} | {color:red} druid-handler in the patch failed. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
27s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
15s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 18m 3s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-22249/dev-support/hive-personality.sh
|
| git revision | master / 19e67cd |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.1 |
| mvninstall |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22249/yetus/patch-mvninstall-druid-handler.txt
|
| compile |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22249/yetus/patch-compile-druid-handler.txt
|
| javac |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22249/yetus/patch-compile-druid-handler.txt
|
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22249/yetus/diff-checkstyle-druid-handler.txt
|
| findbugs |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22249/yetus/patch-findbugs-druid-handler.txt
|
| modules | C: common druid-handler U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22249/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Allow connecting kerberos-enabled Hive to connect to a non-kerberos druid
> cluster
> -
>
> Key: HIVE-22933
> URL: https://issues.apache.org/jira/browse/HIVE-22933
> Project: Hive
> Issue Type: Bug
>Reporter: Nishant Bangarwa
>Assignee: Nishant Bangarwa
>Priority: Major
> Attachments: HIVE-22933.1.patch, HIVE-22933.2.patch,
> HIVE-22933.3.patch, HIVE-22933.patch
>
>
> Currently, If kerberos is enabled
[jira] [Updated] (HIVE-23403) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is different, batch 3
[ https://issues.apache.org/jira/browse/HIVE-23403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Gergely updated HIVE-23403: -- Attachment: HIVE-23403.06.patch > Move q tests to TestMiniLlapLocal from TestCliDriver where the output is > different, batch 3 > --- > > Key: HIVE-23403 > URL: https://issues.apache.org/jira/browse/HIVE-23403 > Project: Hive > Issue Type: Sub-task >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > Attachments: HIVE-23403.01.patch, HIVE-23403.02.patch, > HIVE-23403.03.patch, HIVE-23403.04.patch, HIVE-23403.05.patch, > HIVE-23403.06.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22933) Allow connecting kerberos-enabled Hive to connect to a non-kerberos druid cluster
[ https://issues.apache.org/jira/browse/HIVE-22933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-22933: Attachment: HIVE-22933.3.patch > Allow connecting kerberos-enabled Hive to connect to a non-kerberos druid > cluster > - > > Key: HIVE-22933 > URL: https://issues.apache.org/jira/browse/HIVE-22933 > Project: Hive > Issue Type: Bug >Reporter: Nishant Bangarwa >Assignee: Nishant Bangarwa >Priority: Major > Attachments: HIVE-22933.1.patch, HIVE-22933.2.patch, > HIVE-22933.3.patch, HIVE-22933.patch > > > Currently, If kerberos is enabled for hive, it can only connect to external > druid clusters which are kerberos enabled, Since the Druid client used to > connect to druid is always KerberosHTTPClient, This task is to allow a > kerberos enabled hiverserver2 to connect to non-kerberized druid cluster. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22933) Allow connecting kerberos-enabled Hive to connect to a non-kerberos druid cluster
[ https://issues.apache.org/jira/browse/HIVE-22933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-22933: Status: Open (was: Patch Available) > Allow connecting kerberos-enabled Hive to connect to a non-kerberos druid > cluster > - > > Key: HIVE-22933 > URL: https://issues.apache.org/jira/browse/HIVE-22933 > Project: Hive > Issue Type: Bug >Reporter: Nishant Bangarwa >Assignee: Nishant Bangarwa >Priority: Major > Attachments: HIVE-22933.1.patch, HIVE-22933.2.patch, > HIVE-22933.3.patch, HIVE-22933.patch > > > Currently, If kerberos is enabled for hive, it can only connect to external > druid clusters which are kerberos enabled, Since the Druid client used to > connect to druid is always KerberosHTTPClient, This task is to allow a > kerberos enabled hiverserver2 to connect to non-kerberized druid cluster. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22933) Allow connecting kerberos-enabled Hive to connect to a non-kerberos druid cluster
[ https://issues.apache.org/jira/browse/HIVE-22933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-22933: Status: Patch Available (was: Open) > Allow connecting kerberos-enabled Hive to connect to a non-kerberos druid > cluster > - > > Key: HIVE-22933 > URL: https://issues.apache.org/jira/browse/HIVE-22933 > Project: Hive > Issue Type: Bug >Reporter: Nishant Bangarwa >Assignee: Nishant Bangarwa >Priority: Major > Attachments: HIVE-22933.1.patch, HIVE-22933.2.patch, > HIVE-22933.3.patch, HIVE-22933.patch > > > Currently, If kerberos is enabled for hive, it can only connect to external > druid clusters which are kerberos enabled, Since the Druid client used to > connect to druid is always KerberosHTTPClient, This task is to allow a > kerberos enabled hiverserver2 to connect to non-kerberized druid cluster. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23403) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is different, batch 3
[ https://issues.apache.org/jira/browse/HIVE-23403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Gergely updated HIVE-23403: -- Attachment: HIVE-23403.05.patch > Move q tests to TestMiniLlapLocal from TestCliDriver where the output is > different, batch 3 > --- > > Key: HIVE-23403 > URL: https://issues.apache.org/jira/browse/HIVE-23403 > Project: Hive > Issue Type: Sub-task >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > Attachments: HIVE-23403.01.patch, HIVE-23403.02.patch, > HIVE-23403.03.patch, HIVE-23403.04.patch, HIVE-23403.05.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23403) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is different, batch 3
[ https://issues.apache.org/jira/browse/HIVE-23403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Gergely updated HIVE-23403: -- Attachment: (was: HIVE-23403.05.patch) > Move q tests to TestMiniLlapLocal from TestCliDriver where the output is > different, batch 3 > --- > > Key: HIVE-23403 > URL: https://issues.apache.org/jira/browse/HIVE-23403 > Project: Hive > Issue Type: Sub-task >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > Attachments: HIVE-23403.01.patch, HIVE-23403.02.patch, > HIVE-23403.03.patch, HIVE-23403.04.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23403) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is different, batch 3
[
https://issues.apache.org/jira/browse/HIVE-23403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103874#comment-17103874
]
Hive QA commented on HIVE-23403:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13002543/HIVE-23403.05.patch
{color:red}ERROR:{color} -1 due to build exiting with an error
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/22247/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/22247/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-22247/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Tests exited with: Exception: Patch URL
https://issues.apache.org/jira/secure/attachment/13002543/HIVE-23403.05.patch
was found in seen patch url's cache and a test was probably run already on it.
Aborting...
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13002543 - PreCommit-HIVE-Build
> Move q tests to TestMiniLlapLocal from TestCliDriver where the output is
> different, batch 3
> ---
>
> Key: HIVE-23403
> URL: https://issues.apache.org/jira/browse/HIVE-23403
> Project: Hive
> Issue Type: Sub-task
>Reporter: Miklos Gergely
>Assignee: Miklos Gergely
>Priority: Major
> Attachments: HIVE-23403.01.patch, HIVE-23403.02.patch,
> HIVE-23403.03.patch, HIVE-23403.04.patch, HIVE-23403.05.patch
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23403) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is different, batch 3
[
https://issues.apache.org/jira/browse/HIVE-23403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103873#comment-17103873
]
Hive QA commented on HIVE-23403:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13002543/HIVE-23403.05.patch
{color:green}SUCCESS:{color} +1 due to 21 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 17246 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[orc_int_type_promotion]
(batchId=75)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/22246/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/22246/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-22246/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13002543 - PreCommit-HIVE-Build
> Move q tests to TestMiniLlapLocal from TestCliDriver where the output is
> different, batch 3
> ---
>
> Key: HIVE-23403
> URL: https://issues.apache.org/jira/browse/HIVE-23403
> Project: Hive
> Issue Type: Sub-task
>Reporter: Miklos Gergely
>Assignee: Miklos Gergely
>Priority: Major
> Attachments: HIVE-23403.01.patch, HIVE-23403.02.patch,
> HIVE-23403.03.patch, HIVE-23403.04.patch, HIVE-23403.05.patch
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23426) Show create table for Views giving incomplete view definition
[ https://issues.apache.org/jira/browse/HIVE-23426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103865#comment-17103865 ] Miklos Gergely commented on HIVE-23426: --- [~sureshkumarscb] I couldn't reproduce it so far. Could you please send me the actual table and view creation scripts? Also, is this very urgent? > Show create table for Views giving incomplete view definition > - > > Key: HIVE-23426 > URL: https://issues.apache.org/jira/browse/HIVE-23426 > Project: Hive > Issue Type: Bug >Reporter: Sureshkumar >Assignee: Miklos Gergely >Priority: Major > > Show create table for View giving incomplete view definition -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22967) Support hive.reloadable.aux.jars.path for Hive on Tez
[
https://issues.apache.org/jira/browse/HIVE-22967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103849#comment-17103849
]
Toshihiko Uchida commented on HIVE-22967:
-
[~jdere] and [~ashutoshc] Thanks for your review!
> Support hive.reloadable.aux.jars.path for Hive on Tez
> -
>
> Key: HIVE-22967
> URL: https://issues.apache.org/jira/browse/HIVE-22967
> Project: Hive
> Issue Type: Bug
>Affects Versions: 3.1.2, 2.3.6
>Reporter: Toshihiko Uchida
>Assignee: Toshihiko Uchida
>Priority: Minor
> Fix For: 4.0.0
>
> Attachments: HIVE-22967.1.patch, HIVE-22967.2.patch
>
>
> The jars in hive.reloadable.aux.jars.path are not localized in Tez containers.
> As a result, any query utilizing those reloadable jars fails for Hive on Tez
> due to ClassNotFoundException.
> {code}
> Error: Error while processing statement: FAILED: Execution Error, return code
> 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed,
> vertexName=Map 1, vertexId=vertex_1578856704640_0087_1_00, diagnostics=[Task
> failed, taskId=task_1578856704640_0087_1_00_01, diagnostics=[TaskAttempt
> 0 failed, info=[Error: Error while running task ( failure) :
> attempt_1578856704640_0087_1_00_01_0:java.lang.RuntimeException:
> java.lang.RuntimeException: Map operator initialization failed
> at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:296)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:250)
> at
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374)
> at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)
> at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1729)
> at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)
> at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)
> at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
> at
> com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:108)
> at
> com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:41)
> at
> com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:77)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: java.lang.RuntimeException: Map operator initialization failed
> at
> org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:354)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:266)
> ... 16 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
> java.lang.RuntimeException: java.lang.ClassNotFoundException:
> com.example.hive.udf.Lower
> at
> org.apache.hadoop.hive.ql.exec.FilterOperator.initializeOp(FilterOperator.java:71)
> at
> org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator.initializeOp(VectorFilterOperator.java:83)
> at
> org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
> at
> org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:573)
> at
> org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:525)
> at
> org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:386)
> at
> org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator.initializeMapOperator(VectorMapOperator.java:591)
> at
> org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:317)
> ... 17 more
> Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException:
> com.example.hive.udf.Lower
> at
> org.apache.hadoop.hive.ql.udf.generic.GenericUDFBridge.getUdfClass(GenericUDFBridge.java:134)
> at
> org.apache.hadoop.hive.ql.exec.FunctionRegistry.isStateful(FunctionRegistry.java:1492)
> at
> org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator.(ExprNodeGenericFuncEvaluator.java:111)
> at
>
[jira] [Commented] (HIVE-23403) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is different, batch 3
[
https://issues.apache.org/jira/browse/HIVE-23403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103848#comment-17103848
]
Hive QA commented on HIVE-23403:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m
50s{color} | {color:blue} Maven dependency ordering for branch {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
28s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m
2s{color} | {color:red} The patch has 3 line(s) that end in whitespace. Use git
apply --whitespace=fix <>. Refer https://git-scm.com/docs/git-apply
{color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
11s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 3m 51s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-22246/dev-support/hive-personality.sh
|
| git revision | master / 19e67cd |
| whitespace |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22246/yetus/whitespace-eol.txt
|
| modules | C: ql . itests U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22246/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Move q tests to TestMiniLlapLocal from TestCliDriver where the output is
> different, batch 3
> ---
>
> Key: HIVE-23403
> URL: https://issues.apache.org/jira/browse/HIVE-23403
> Project: Hive
> Issue Type: Sub-task
>Reporter: Miklos Gergely
>Assignee: Miklos Gergely
>Priority: Major
> Attachments: HIVE-23403.01.patch, HIVE-23403.02.patch,
> HIVE-23403.03.patch, HIVE-23403.04.patch, HIVE-23403.05.patch
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23403) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is different, batch 3
[
https://issues.apache.org/jira/browse/HIVE-23403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103841#comment-17103841
]
Hive QA commented on HIVE-23403:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13002540/HIVE-23403.04.patch
{color:green}SUCCESS:{color} +1 due to 21 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 17246 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[orc_int_type_promotion]
(batchId=75)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/22245/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/22245/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-22245/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13002540 - PreCommit-HIVE-Build
> Move q tests to TestMiniLlapLocal from TestCliDriver where the output is
> different, batch 3
> ---
>
> Key: HIVE-23403
> URL: https://issues.apache.org/jira/browse/HIVE-23403
> Project: Hive
> Issue Type: Sub-task
>Reporter: Miklos Gergely
>Assignee: Miklos Gergely
>Priority: Major
> Attachments: HIVE-23403.01.patch, HIVE-23403.02.patch,
> HIVE-23403.03.patch, HIVE-23403.04.patch, HIVE-23403.05.patch
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23426) Show create table for Views giving incomplete view definition
[ https://issues.apache.org/jira/browse/HIVE-23426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103833#comment-17103833 ] Sureshkumar commented on HIVE-23426: Hi [~mgergely] - Did you got chance to check this? > Show create table for Views giving incomplete view definition > - > > Key: HIVE-23426 > URL: https://issues.apache.org/jira/browse/HIVE-23426 > Project: Hive > Issue Type: Bug >Reporter: Sureshkumar >Assignee: Miklos Gergely >Priority: Major > > Show create table for View giving incomplete view definition -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23403) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is different, batch 3
[ https://issues.apache.org/jira/browse/HIVE-23403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Gergely updated HIVE-23403: -- Attachment: HIVE-23403.05.patch > Move q tests to TestMiniLlapLocal from TestCliDriver where the output is > different, batch 3 > --- > > Key: HIVE-23403 > URL: https://issues.apache.org/jira/browse/HIVE-23403 > Project: Hive > Issue Type: Sub-task >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > Attachments: HIVE-23403.01.patch, HIVE-23403.02.patch, > HIVE-23403.03.patch, HIVE-23403.04.patch, HIVE-23403.05.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23403) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is different, batch 3
[
https://issues.apache.org/jira/browse/HIVE-23403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103821#comment-17103821
]
Hive QA commented on HIVE-23403:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m
52s{color} | {color:blue} Maven dependency ordering for branch {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
28s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m
2s{color} | {color:red} The patch has 3 line(s) that end in whitespace. Use git
apply --whitespace=fix <>. Refer https://git-scm.com/docs/git-apply
{color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
10s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 3m 50s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-22245/dev-support/hive-personality.sh
|
| git revision | master / 19e67cd |
| whitespace |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22245/yetus/whitespace-eol.txt
|
| modules | C: ql . itests U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22245/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Move q tests to TestMiniLlapLocal from TestCliDriver where the output is
> different, batch 3
> ---
>
> Key: HIVE-23403
> URL: https://issues.apache.org/jira/browse/HIVE-23403
> Project: Hive
> Issue Type: Sub-task
>Reporter: Miklos Gergely
>Assignee: Miklos Gergely
>Priority: Major
> Attachments: HIVE-23403.01.patch, HIVE-23403.02.patch,
> HIVE-23403.03.patch, HIVE-23403.04.patch
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23403) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is different, batch 3
[
https://issues.apache.org/jira/browse/HIVE-23403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103815#comment-17103815
]
Hive QA commented on HIVE-23403:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13002536/HIVE-23403.04.patch
{color:green}SUCCESS:{color} +1 due to 21 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 4 failed/errored test(s), 17246 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestMiniDruidCliDriver.testCliDriver[druid_materialized_view_rewrite_ssb]
(batchId=128)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[orc_int_type_promotion]
(batchId=75)
org.apache.hadoop.hive.llap.cache.TestBuddyAllocator.testMTT[2] (batchId=310)
org.apache.hadoop.hive.metastore.TestPartitionManagement.testPartitionDiscoveryTransactionalTable
(batchId=152)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/22244/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/22244/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-22244/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 4 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13002536 - PreCommit-HIVE-Build
> Move q tests to TestMiniLlapLocal from TestCliDriver where the output is
> different, batch 3
> ---
>
> Key: HIVE-23403
> URL: https://issues.apache.org/jira/browse/HIVE-23403
> Project: Hive
> Issue Type: Sub-task
>Reporter: Miklos Gergely
>Assignee: Miklos Gergely
>Priority: Major
> Attachments: HIVE-23403.01.patch, HIVE-23403.02.patch,
> HIVE-23403.03.patch, HIVE-23403.04.patch
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-23403) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is different, batch 3
[ https://issues.apache.org/jira/browse/HIVE-23403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Gergely updated HIVE-23403: -- Attachment: HIVE-23403.04.patch > Move q tests to TestMiniLlapLocal from TestCliDriver where the output is > different, batch 3 > --- > > Key: HIVE-23403 > URL: https://issues.apache.org/jira/browse/HIVE-23403 > Project: Hive > Issue Type: Sub-task >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > Attachments: HIVE-23403.01.patch, HIVE-23403.02.patch, > HIVE-23403.03.patch, HIVE-23403.04.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23403) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is different, batch 3
[ https://issues.apache.org/jira/browse/HIVE-23403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Gergely updated HIVE-23403: -- Attachment: (was: HIVE-23403.04.patch) > Move q tests to TestMiniLlapLocal from TestCliDriver where the output is > different, batch 3 > --- > > Key: HIVE-23403 > URL: https://issues.apache.org/jira/browse/HIVE-23403 > Project: Hive > Issue Type: Sub-task >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > Attachments: HIVE-23403.01.patch, HIVE-23403.02.patch, > HIVE-23403.03.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23403) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is different, batch 3
[
https://issues.apache.org/jira/browse/HIVE-23403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103789#comment-17103789
]
Hive QA commented on HIVE-23403:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m
47s{color} | {color:blue} Maven dependency ordering for branch {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
28s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m
1s{color} | {color:red} The patch has 3 line(s) that end in whitespace. Use git
apply --whitespace=fix <>. Refer https://git-scm.com/docs/git-apply
{color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
11s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 3m 48s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-22244/dev-support/hive-personality.sh
|
| git revision | master / 19e67cd |
| whitespace |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22244/yetus/whitespace-eol.txt
|
| modules | C: ql . itests U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22244/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Move q tests to TestMiniLlapLocal from TestCliDriver where the output is
> different, batch 3
> ---
>
> Key: HIVE-23403
> URL: https://issues.apache.org/jira/browse/HIVE-23403
> Project: Hive
> Issue Type: Sub-task
>Reporter: Miklos Gergely
>Assignee: Miklos Gergely
>Priority: Major
> Attachments: HIVE-23403.01.patch, HIVE-23403.02.patch,
> HIVE-23403.03.patch, HIVE-23403.04.patch
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-23403) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is different, batch 3
[ https://issues.apache.org/jira/browse/HIVE-23403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Gergely updated HIVE-23403: -- Attachment: HIVE-23403.04.patch > Move q tests to TestMiniLlapLocal from TestCliDriver where the output is > different, batch 3 > --- > > Key: HIVE-23403 > URL: https://issues.apache.org/jira/browse/HIVE-23403 > Project: Hive > Issue Type: Sub-task >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > Attachments: HIVE-23403.01.patch, HIVE-23403.02.patch, > HIVE-23403.03.patch, HIVE-23403.04.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23403) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is different, batch 3
[ https://issues.apache.org/jira/browse/HIVE-23403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Gergely updated HIVE-23403: -- Attachment: (was: HIVE-23403.04.patch) > Move q tests to TestMiniLlapLocal from TestCliDriver where the output is > different, batch 3 > --- > > Key: HIVE-23403 > URL: https://issues.apache.org/jira/browse/HIVE-23403 > Project: Hive > Issue Type: Sub-task >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > Attachments: HIVE-23403.01.patch, HIVE-23403.02.patch, > HIVE-23403.03.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23403) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is different, batch 3
[
https://issues.apache.org/jira/browse/HIVE-23403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103781#comment-17103781
]
Hive QA commented on HIVE-23403:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13002534/HIVE-23403.04.patch
{color:red}ERROR:{color} -1 due to build exiting with an error
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/22243/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/22243/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-22243/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Tests exited with: Exception: Patch URL
https://issues.apache.org/jira/secure/attachment/13002534/HIVE-23403.04.patch
was found in seen patch url's cache and a test was probably run already on it.
Aborting...
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13002534 - PreCommit-HIVE-Build
> Move q tests to TestMiniLlapLocal from TestCliDriver where the output is
> different, batch 3
> ---
>
> Key: HIVE-23403
> URL: https://issues.apache.org/jira/browse/HIVE-23403
> Project: Hive
> Issue Type: Sub-task
>Reporter: Miklos Gergely
>Assignee: Miklos Gergely
>Priority: Major
> Attachments: HIVE-23403.01.patch, HIVE-23403.02.patch,
> HIVE-23403.03.patch, HIVE-23403.04.patch
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23403) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is different, batch 3
[
https://issues.apache.org/jira/browse/HIVE-23403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103780#comment-17103780
]
Hive QA commented on HIVE-23403:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13002534/HIVE-23403.04.patch
{color:green}SUCCESS:{color} +1 due to 21 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 9 failed/errored test(s), 17246 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.metastore.client.TestNotNullConstraint.addNoSuchTable[Remote]
(batchId=154)
org.apache.hadoop.hive.metastore.client.TestNotNullConstraint.createGetDrop[Remote]
(batchId=154)
org.apache.hadoop.hive.metastore.client.TestNotNullConstraint.createTableWithConstraintsPkInOtherCatalog[Remote]
(batchId=154)
org.apache.hadoop.hive.metastore.client.TestNotNullConstraint.createTableWithConstraintsPk[Remote]
(batchId=154)
org.apache.hadoop.hive.metastore.client.TestNotNullConstraint.doubleAddNotNullConstraint[Remote]
(batchId=154)
org.apache.hadoop.hive.metastore.client.TestNotNullConstraint.getNoSuchCatalog[Remote]
(batchId=154)
org.apache.hadoop.hive.metastore.client.TestNotNullConstraint.getNoSuchDb[Remote]
(batchId=154)
org.apache.hadoop.hive.metastore.client.TestNotNullConstraint.getNoSuchTable[Remote]
(batchId=154)
org.apache.hadoop.hive.metastore.client.TestNotNullConstraint.inOtherCatalog[Remote]
(batchId=154)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/22242/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/22242/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-22242/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 9 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13002534 - PreCommit-HIVE-Build
> Move q tests to TestMiniLlapLocal from TestCliDriver where the output is
> different, batch 3
> ---
>
> Key: HIVE-23403
> URL: https://issues.apache.org/jira/browse/HIVE-23403
> Project: Hive
> Issue Type: Sub-task
>Reporter: Miklos Gergely
>Assignee: Miklos Gergely
>Priority: Major
> Attachments: HIVE-23403.01.patch, HIVE-23403.02.patch,
> HIVE-23403.03.patch, HIVE-23403.04.patch
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23403) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is different, batch 3
[
https://issues.apache.org/jira/browse/HIVE-23403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103767#comment-17103767
]
Hive QA commented on HIVE-23403:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
56s{color} | {color:blue} Maven dependency ordering for branch {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
31s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m
2s{color} | {color:red} The patch has 3 line(s) that end in whitespace. Use git
apply --whitespace=fix <>. Refer https://git-scm.com/docs/git-apply
{color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
11s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 3m 12s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-22242/dev-support/hive-personality.sh
|
| git revision | master / 19e67cd |
| whitespace |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22242/yetus/whitespace-eol.txt
|
| modules | C: ql . itests U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22242/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Move q tests to TestMiniLlapLocal from TestCliDriver where the output is
> different, batch 3
> ---
>
> Key: HIVE-23403
> URL: https://issues.apache.org/jira/browse/HIVE-23403
> Project: Hive
> Issue Type: Sub-task
>Reporter: Miklos Gergely
>Assignee: Miklos Gergely
>Priority: Major
> Attachments: HIVE-23403.01.patch, HIVE-23403.02.patch,
> HIVE-23403.03.patch, HIVE-23403.04.patch
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-23403) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is different, batch 3
[ https://issues.apache.org/jira/browse/HIVE-23403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Gergely updated HIVE-23403: -- Attachment: HIVE-23403.04.patch > Move q tests to TestMiniLlapLocal from TestCliDriver where the output is > different, batch 3 > --- > > Key: HIVE-23403 > URL: https://issues.apache.org/jira/browse/HIVE-23403 > Project: Hive > Issue Type: Sub-task >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > Attachments: HIVE-23403.01.patch, HIVE-23403.02.patch, > HIVE-23403.03.patch, HIVE-23403.04.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22933) Allow connecting kerberos-enabled Hive to connect to a non-kerberos druid cluster
[
https://issues.apache.org/jira/browse/HIVE-22933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103675#comment-17103675
]
Hive QA commented on HIVE-22933:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13002514/HIVE-22933.2.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 17241 tests
executed
*Failed tests:*
{noformat}
TestStatsReplicationScenariosACID - did not produce a TEST-*.xml file (likely
timed out) (batchId=184)
org.apache.hadoop.hive.cli.TestMiniDruidKafkaCliDriver.testCliDriver[druidkafkamini_delimited]
(batchId=225)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/22239/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/22239/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-22239/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 2 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13002514 - PreCommit-HIVE-Build
> Allow connecting kerberos-enabled Hive to connect to a non-kerberos druid
> cluster
> -
>
> Key: HIVE-22933
> URL: https://issues.apache.org/jira/browse/HIVE-22933
> Project: Hive
> Issue Type: Bug
>Reporter: Nishant Bangarwa
>Assignee: Nishant Bangarwa
>Priority: Major
> Attachments: HIVE-22933.1.patch, HIVE-22933.2.patch, HIVE-22933.patch
>
>
> Currently, If kerberos is enabled for hive, it can only connect to external
> druid clusters which are kerberos enabled, Since the Druid client used to
> connect to druid is always KerberosHTTPClient, This task is to allow a
> kerberos enabled hiverserver2 to connect to non-kerberized druid cluster.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22419) Improve Messages Emitted From HiveMetaStoreClient
[
https://issues.apache.org/jira/browse/HIVE-22419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ashutosh Chauhan updated HIVE-22419:
Fix Version/s: 4.0.0
Resolution: Fixed
Status: Resolved (was: Patch Available)
Pushed to master. Thanks, David!
> Improve Messages Emitted From HiveMetaStoreClient
> -
>
> Key: HIVE-22419
> URL: https://issues.apache.org/jira/browse/HIVE-22419
> Project: Hive
> Issue Type: Improvement
> Components: Standalone Metastore
>Affects Versions: 4.0.0, 3.2.0
>Reporter: David Mollitor
>Assignee: David Mollitor
>Priority: Minor
> Fix For: 4.0.0
>
> Attachments: HIVE-22419.1.patch
>
>
> After reviewing some logs and errors emitted during a QTest run, I would like
> to propose some improvements to logging in {{HiveMetaStoreClient}}.
> * Remove duplicate logging
> * Remove superfluous class {{StackTraceLogger}}
> * Do not use contractions in public-facing error messages and logs
> * Make all logging side-effect free (see {{connCount}})
> * Code simplification
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22933) Allow connecting kerberos-enabled Hive to connect to a non-kerberos druid cluster
[
https://issues.apache.org/jira/browse/HIVE-22933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103668#comment-17103668
]
Hive QA commented on HIVE-22933:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m
59s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
10s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
36s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
27s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
33s{color} | {color:blue} common in master has 63 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
30s{color} | {color:blue} druid-handler in master has 3 extant Findbugs
warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
27s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
29s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red} 0m
19s{color} | {color:red} druid-handler in the patch failed. {color} |
| {color:red}-1{color} | {color:red} compile {color} | {color:red} 0m
16s{color} | {color:red} druid-handler in the patch failed. {color} |
| {color:red}-1{color} | {color:red} javac {color} | {color:red} 0m 16s{color}
| {color:red} druid-handler in the patch failed. {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
11s{color} | {color:red} druid-handler: The patch generated 1 new + 0 unchanged
- 0 fixed = 1 total (was 0) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 0m
18s{color} | {color:red} druid-handler in the patch failed. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
26s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
15s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 17m 2s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-22239/dev-support/hive-personality.sh
|
| git revision | master / 0bf24c8 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.1 |
| mvninstall |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22239/yetus/patch-mvninstall-druid-handler.txt
|
| compile |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22239/yetus/patch-compile-druid-handler.txt
|
| javac |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22239/yetus/patch-compile-druid-handler.txt
|
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22239/yetus/diff-checkstyle-druid-handler.txt
|
| findbugs |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22239/yetus/patch-findbugs-druid-handler.txt
|
| modules | C: common druid-handler U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-22239/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Allow connecting kerberos-enabled Hive to connect to a non-kerberos druid
> cluster
> -
>
> Key: HIVE-22933
> URL: https://issues.apache.org/jira/browse/HIVE-22933
> Project: Hive
> Issue Type: Bug
>Reporter: Nishant Bangarwa
>Assignee: Nishant Bangarwa
>Priority: Major
> Attachments: HIVE-22933.1.patch, HIVE-22933.2.patch, HIVE-22933.patch
>
>
> Currently, If kerberos is enabled for hive, it can only
[jira] [Commented] (HIVE-22419) Improve Messages Emitted From HiveMetaStoreClient
[
https://issues.apache.org/jira/browse/HIVE-22419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103666#comment-17103666
]
Ashutosh Chauhan commented on HIVE-22419:
-
+1
> Improve Messages Emitted From HiveMetaStoreClient
> -
>
> Key: HIVE-22419
> URL: https://issues.apache.org/jira/browse/HIVE-22419
> Project: Hive
> Issue Type: Improvement
> Components: Standalone Metastore
>Affects Versions: 4.0.0, 3.2.0
>Reporter: David Mollitor
>Assignee: David Mollitor
>Priority: Minor
> Attachments: HIVE-22419.1.patch
>
>
> After reviewing some logs and errors emitted during a QTest run, I would like
> to propose some improvements to logging in {{HiveMetaStoreClient}}.
> * Remove duplicate logging
> * Remove superfluous class {{StackTraceLogger}}
> * Do not use contractions in public-facing error messages and logs
> * Make all logging side-effect free (see {{connCount}})
> * Code simplification
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22423) Improve Logging In HadoopThriftAuthBridge
[ https://issues.apache.org/jira/browse/HIVE-22423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-22423: Fix Version/s: 4.0.0 Resolution: Fixed Status: Resolved (was: Patch Available) Pushed to master. Thanks, David! > Improve Logging In HadoopThriftAuthBridge > - > > Key: HIVE-22423 > URL: https://issues.apache.org/jira/browse/HIVE-22423 > Project: Hive > Issue Type: Improvement >Reporter: David Mollitor >Assignee: David Mollitor >Priority: Minor > Fix For: 4.0.0 > > Attachments: HIVE-22423.1.patch > > > # Remove superfluous debug log guards > # Improve messages > # Improve message format -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22423) Improve Logging In HadoopThriftAuthBridge
[ https://issues.apache.org/jira/browse/HIVE-22423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103664#comment-17103664 ] Ashutosh Chauhan commented on HIVE-22423: - +1 > Improve Logging In HadoopThriftAuthBridge > - > > Key: HIVE-22423 > URL: https://issues.apache.org/jira/browse/HIVE-22423 > Project: Hive > Issue Type: Improvement >Reporter: David Mollitor >Assignee: David Mollitor >Priority: Minor > Attachments: HIVE-22423.1.patch > > > # Remove superfluous debug log guards > # Improve messages > # Improve message format -- This message was sent by Atlassian Jira (v8.3.4#803005)
