[jira] [Commented] (HIVE-23241) Reduce transitive dependencies
[
https://issues.apache.org/jira/browse/HIVE-23241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086767#comment-17086767
]
Hive QA commented on HIVE-23241:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 2m
16s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
47s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
39s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
58s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
31s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
54s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
40s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
40s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
5s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
54s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
16s{color} | {color:red} The patch generated 2 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 19m 42s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc xml compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-21765/dev-support/hive-personality.sh
|
| git revision | master / 11abab2 |
| Default Java | 1.8.0_111 |
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21765/yetus/patch-asflicense-problems.txt
|
| modules | C: druid-handler standalone-metastore/metastore-tools
standalone-metastore/metastore-tools/tools-common
standalone-metastore/metastore-tools/metastore-benchmarks U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21765/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Reduce transitive dependencies
> --
>
> Key: HIVE-23241
> URL: https://issues.apache.org/jira/browse/HIVE-23241
> Project: Hive
> Issue Type: Improvement
>Reporter: Ashutosh Chauhan
>Assignee: Ashutosh Chauhan
>Priority: Major
> Attachments: HIVE-23241.patch
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-19369) Locks: Add new lock implementations for always zero-wait readers
[
https://issues.apache.org/jira/browse/HIVE-19369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086747#comment-17086747
]
Hive QA commented on HIVE-19369:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000397/HIVE-19369.4.patch
{color:green}SUCCESS:{color} +1 due to 4 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 17153 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestTezPerfCliDriver.testCliDriver[cbo_query34]
(batchId=227)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/21764/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/21764/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-21764/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13000397 - PreCommit-HIVE-Build
> Locks: Add new lock implementations for always zero-wait readers
>
>
> Key: HIVE-19369
> URL: https://issues.apache.org/jira/browse/HIVE-19369
> Project: Hive
> Issue Type: Improvement
> Components: Transactions
>Reporter: Gopal Vijayaraghavan
>Assignee: Denys Kuzmenko
>Priority: Major
> Attachments: HIVE-19369.1.patch, HIVE-19369.2.patch,
> HIVE-19369.3.patch, HIVE-19369.4.patch
>
>
> Hive Locking with Micro-managed and full-ACID tables needs a better locking
> implementation which allows for no-wait readers always.
> EXCL_DROP
> EXCL_WRITE
> SHARED_WRITE
> SHARED_READ
> Short write-up
> EXCL_DROP is a "drop partition" or "drop table" and waits for all others to
> exit
> EXCL_WRITE excludes all writes and will wait for all existing SHARED_WRITE to
> exit.
> SHARED_WRITE allows all SHARED_WRITES to go through, but will wait for an
> EXCL_WRITE & EXCL_DROP (waiting so that you can do drop + insert in different
> threads).
> SHARED_READ does not wait for any lock - it fails fast for a pending
> EXCL_DROP, because even if there is an EXCL_WRITE or SHARED_WRITE pending,
> there's no semantic reason to wait for them to succeed before going ahead
> with a SHARED_WRITE.
> a select * => SHARED_READ
> an insert into => SHARED_WRITE
> an insert overwrite or MERGE => EXCL_WRITE
> a drop table => EXCL_DROP
> TODO:
> The fate of the compactor needs to be added to this before it is a complete
> description.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-19369) Locks: Add new lock implementations for always zero-wait readers
[
https://issues.apache.org/jira/browse/HIVE-19369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086745#comment-17086745
]
Hive QA commented on HIVE-19369:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 2m
11s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
40s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 2m
30s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
38s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 2m
43s{color} | {color:blue} standalone-metastore/metastore-common in master has
35 extant Findbugs warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
36s{color} | {color:blue} common in master has 63 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 1m
20s{color} | {color:blue} standalone-metastore/metastore-server in master has
191 extant Findbugs warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m
0s{color} | {color:blue} ql in master has 1528 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 2m
37s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
31s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 3m
6s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 2m
31s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 2m
31s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
12s{color} | {color:green} standalone-metastore/metastore-common: The patch
generated 0 new + 3 unchanged - 1 fixed = 3 total (was 4) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
17s{color} | {color:red} common: The patch generated 1 new + 378 unchanged - 0
fixed = 379 total (was 378) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
23s{color} | {color:red} standalone-metastore/metastore-server: The patch
generated 5 new + 506 unchanged - 33 fixed = 511 total (was 539) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
45s{color} | {color:red} ql: The patch generated 26 new + 234 unchanged - 119
fixed = 260 total (was 353) {color} |
| {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m
0s{color} | {color:red} The patch has 21 line(s) that end in whitespace. Use
git apply --whitespace=fix <>. Refer
https://git-scm.com/docs/git-apply {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 2m
56s{color} | {color:red} standalone-metastore/metastore-common generated 1 new
+ 35 unchanged - 0 fixed = 36 total (was 35) {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 0m
43s{color} | {color:green} common in the patch passed. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m
20s{color} | {color:green} standalone-metastore/metastore-server generated 0
new + 190 unchanged - 1 fixed = 190 total (was 191) {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
11s{color} | {color:green} ql in the patch passed. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 2m
38s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
15s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 47m 26s{color} |
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| FindBugs | module:standalone-metastore/metastore-common |
| | org.apache.hadoop.hive.metastore.LockTypeComparator implements Comparator
but not Serializable At
[jira] [Updated] (HIVE-23100) Create RexNode factory and use it in CalcitePlanner
[ https://issues.apache.org/jira/browse/HIVE-23100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-23100: --- Attachment: HIVE-23100.13.patch > Create RexNode factory and use it in CalcitePlanner > --- > > Key: HIVE-23100 > URL: https://issues.apache.org/jira/browse/HIVE-23100 > Project: Hive > Issue Type: Improvement > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Major > Attachments: HIVE-23100.01.patch, HIVE-23100.02.patch, > HIVE-23100.03.patch, HIVE-23100.04.patch, HIVE-23100.05.patch, > HIVE-23100.06.patch, HIVE-23100.07.patch, HIVE-23100.08.patch, > HIVE-23100.09.patch, HIVE-23100.10.patch, HIVE-23100.11.patch, > HIVE-23100.12.patch, HIVE-23100.13.patch, HIVE-23100.patch > > > Follow-up of HIVE-22746. > This will allow us to generate directly the RexNode from the AST nodes. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23241) Reduce transitive dependencies
[ https://issues.apache.org/jira/browse/HIVE-23241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-23241: Attachment: HIVE-23241.patch > Reduce transitive dependencies > -- > > Key: HIVE-23241 > URL: https://issues.apache.org/jira/browse/HIVE-23241 > Project: Hive > Issue Type: Improvement >Reporter: Ashutosh Chauhan >Assignee: Ashutosh Chauhan >Priority: Major > Attachments: HIVE-23241.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23241) Reduce transitive dependencies
[ https://issues.apache.org/jira/browse/HIVE-23241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-23241: Status: Patch Available (was: Open) > Reduce transitive dependencies > -- > > Key: HIVE-23241 > URL: https://issues.apache.org/jira/browse/HIVE-23241 > Project: Hive > Issue Type: Improvement >Reporter: Ashutosh Chauhan >Assignee: Ashutosh Chauhan >Priority: Major > Attachments: HIVE-23241.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HIVE-23241) Reduce transitive dependencies
[ https://issues.apache.org/jira/browse/HIVE-23241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan reassigned HIVE-23241: --- > Reduce transitive dependencies > -- > > Key: HIVE-23241 > URL: https://issues.apache.org/jira/browse/HIVE-23241 > Project: Hive > Issue Type: Improvement >Reporter: Ashutosh Chauhan >Assignee: Ashutosh Chauhan >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23100) Create RexNode factory and use it in CalcitePlanner
[
https://issues.apache.org/jira/browse/HIVE-23100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086737#comment-17086737
]
Hive QA commented on HIVE-23100:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000391/HIVE-23100.12.patch
{color:green}SUCCESS:{color} +1 due to 6 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 3 failed/errored test(s), 17139 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[vector_case_when_2]
(batchId=108)
org.apache.hadoop.hive.cli.control.TestDanglingQOuts.checkDanglingQOut
(batchId=170)
org.apache.hadoop.hive.metastore.TestMetastoreHousekeepingLeaderEmptyConfig.testHouseKeepingThreadExistence
(batchId=174)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/21763/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/21763/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-21763/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 3 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13000391 - PreCommit-HIVE-Build
> Create RexNode factory and use it in CalcitePlanner
> ---
>
> Key: HIVE-23100
> URL: https://issues.apache.org/jira/browse/HIVE-23100
> Project: Hive
> Issue Type: Improvement
> Components: CBO
>Reporter: Jesus Camacho Rodriguez
>Assignee: Jesus Camacho Rodriguez
>Priority: Major
> Attachments: HIVE-23100.01.patch, HIVE-23100.02.patch,
> HIVE-23100.03.patch, HIVE-23100.04.patch, HIVE-23100.05.patch,
> HIVE-23100.06.patch, HIVE-23100.07.patch, HIVE-23100.08.patch,
> HIVE-23100.09.patch, HIVE-23100.10.patch, HIVE-23100.11.patch,
> HIVE-23100.12.patch, HIVE-23100.patch
>
>
> Follow-up of HIVE-22746.
> This will allow us to generate directly the RexNode from the AST nodes.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-19369) Locks: Add new lock implementations for always zero-wait readers
[ https://issues.apache.org/jira/browse/HIVE-19369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denys Kuzmenko updated HIVE-19369: -- Attachment: HIVE-19369.4.patch > Locks: Add new lock implementations for always zero-wait readers > > > Key: HIVE-19369 > URL: https://issues.apache.org/jira/browse/HIVE-19369 > Project: Hive > Issue Type: Improvement > Components: Transactions >Reporter: Gopal Vijayaraghavan >Assignee: Denys Kuzmenko >Priority: Major > Attachments: HIVE-19369.1.patch, HIVE-19369.2.patch, > HIVE-19369.3.patch, HIVE-19369.4.patch > > > Hive Locking with Micro-managed and full-ACID tables needs a better locking > implementation which allows for no-wait readers always. > EXCL_DROP > EXCL_WRITE > SHARED_WRITE > SHARED_READ > Short write-up > EXCL_DROP is a "drop partition" or "drop table" and waits for all others to > exit > EXCL_WRITE excludes all writes and will wait for all existing SHARED_WRITE to > exit. > SHARED_WRITE allows all SHARED_WRITES to go through, but will wait for an > EXCL_WRITE & EXCL_DROP (waiting so that you can do drop + insert in different > threads). > SHARED_READ does not wait for any lock - it fails fast for a pending > EXCL_DROP, because even if there is an EXCL_WRITE or SHARED_WRITE pending, > there's no semantic reason to wait for them to succeed before going ahead > with a SHARED_WRITE. > a select * => SHARED_READ > an insert into => SHARED_WRITE > an insert overwrite or MERGE => EXCL_WRITE > a drop table => EXCL_DROP > TODO: > The fate of the compactor needs to be added to this before it is a complete > description. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23100) Create RexNode factory and use it in CalcitePlanner
[
https://issues.apache.org/jira/browse/HIVE-23100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086734#comment-17086734
]
Hive QA commented on HIVE-23100:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m
55s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
59s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
38s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
8s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m
53s{color} | {color:blue} ql in master has 1528 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
54s{color} | {color:blue} itests/util in master has 53 extant Findbugs
warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
19s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
32s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 2m
9s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
42s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
42s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
59s{color} | {color:red} ql: The patch generated 110 new + 988 unchanged - 44
fixed = 1098 total (was 1032) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
16s{color} | {color:red} itests/util: The patch generated 1 new + 36 unchanged
- 0 fixed = 37 total (was 36) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 4m
7s{color} | {color:red} ql generated 7 new + 1523 unchanged - 5 fixed = 1530
total (was 1528) {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
18s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
16s{color} | {color:red} The patch generated 2 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 33m 29s{color} |
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| FindBugs | module:ql |
| | Check for oddness that won't work for negative numbers in
org.apache.hadoop.hive.ql.optimizer.calcite.translator.RexNodeConverter.adjustCaseBranchTypes(List,
RelDataType, RexBuilder) At RexNodeConverter.java:work for negative numbers
in
org.apache.hadoop.hive.ql.optimizer.calcite.translator.RexNodeConverter.adjustCaseBranchTypes(List,
RelDataType, RexBuilder) At RexNodeConverter.java:[line 409] |
| | Check for oddness that won't work for negative numbers in
org.apache.hadoop.hive.ql.optimizer.calcite.translator.RexNodeConverter.rewriteCaseChildren(String,
List, RexBuilder) At RexNodeConverter.java:work for negative numbers in
org.apache.hadoop.hive.ql.optimizer.calcite.translator.RexNodeConverter.rewriteCaseChildren(String,
List, RexBuilder) At RexNodeConverter.java:[line 375] |
| | Dead store to inputPosMap in
org.apache.hadoop.hive.ql.parse.CalcitePlanner$CalcitePlannerAction.genLateralViewPlans(ASTNode,
Map) At
CalcitePlanner.java:org.apache.hadoop.hive.ql.parse.CalcitePlanner$CalcitePlannerAction.genLateralViewPlans(ASTNode,
Map) At CalcitePlanner.java:[line 3389] |
| | Exception is caught when Exception is not thrown in
org.apache.hadoop.hive.ql.parse.type.HiveFunctionHelper.getWindowAggregateFunctionInfo(boolean,
boolean, String, List) At HiveFunctionHelper.java:is not thrown in
org.apache.hadoop.hive.ql.parse.type.HiveFunctionHelper.getWindowAggregateFunctionInfo(boolean,
boolean, String, List) At HiveFunctionHelper.java:[line 425] |
| | Boxing/unboxing to parse a primitive
[jira] [Commented] (HIVE-23210) Fix shortestjobcomparator when jobs submitted have 1 task their vertices
[
https://issues.apache.org/jira/browse/HIVE-23210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086730#comment-17086730
]
Hive QA commented on HIVE-23210:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000390/HIVE-23210.04.patch
{color:green}SUCCESS:{color} +1 due to 2 test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 17144 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/21762/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/21762/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-21762/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13000390 - PreCommit-HIVE-Build
> Fix shortestjobcomparator when jobs submitted have 1 task their vertices
>
>
> Key: HIVE-23210
> URL: https://issues.apache.org/jira/browse/HIVE-23210
> Project: Hive
> Issue Type: Improvement
>Reporter: Rajesh Balamohan
>Assignee: Panagiotis Garefalakis
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-23210.01.patch, HIVE-23210.02.patch,
> HIVE-23210.03.patch, HIVE-23210.04.patch, HIVE-23210.wip.patch,
> TestShortestJobFirstComparator.java
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> In latency sensitive queries, lots of jobs can have vertices with 1 task.
> Currently shortestjobcomparator does not work correctly and returns tasks in
> random order.
> [https://github.com/apache/hive/blob/master/llap-server/src/java/org/apache/hadoop/hive/llap/daemon/impl/comparator/ShortestJobFirstComparator.java#L51]
> This causes delay in the job runtime. I will attach a simple test case
> shortly.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23210) Fix shortestjobcomparator when jobs submitted have 1 task their vertices
[
https://issues.apache.org/jira/browse/HIVE-23210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086726#comment-17086726
]
Hive QA commented on HIVE-23210:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 10m
41s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
25s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
14s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
46s{color} | {color:blue} llap-server in master has 89 extant Findbugs
warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
17s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
26s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
26s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
26s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
15s{color} | {color:red} llap-server: The patch generated 2 new + 13 unchanged
- 0 fixed = 15 total (was 13) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 0m
54s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
17s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
15s{color} | {color:red} The patch generated 2 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 15m 30s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-21762/dev-support/hive-personality.sh
|
| git revision | master / c3fb689 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.1 |
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21762/yetus/diff-checkstyle-llap-server.txt
|
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21762/yetus/patch-asflicense-problems.txt
|
| modules | C: llap-server U: llap-server |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21762/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Fix shortestjobcomparator when jobs submitted have 1 task their vertices
>
>
> Key: HIVE-23210
> URL: https://issues.apache.org/jira/browse/HIVE-23210
> Project: Hive
> Issue Type: Improvement
>Reporter: Rajesh Balamohan
>Assignee: Panagiotis Garefalakis
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-23210.01.patch, HIVE-23210.02.patch,
> HIVE-23210.03.patch, HIVE-23210.04.patch, HIVE-23210.wip.patch,
> TestShortestJobFirstComparator.java
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> In latency sensitive queries, lots of jobs can have vertices with 1 task.
> Currently shortestjobcomparator does not work correctly and returns tasks in
> random order.
> [https://github.com/apache/hive/blob/master/llap-server/src/java/org/apache/hadoop/hive/llap/daemon/impl/comparator/ShortestJobFirstComparator.java#L51]
> This causes delay in the job runtime. I will attach a simple test case
> shortly.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-20078) Remove ATSHook
[ https://issues.apache.org/jira/browse/HIVE-20078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-20078: Fix Version/s: 4.0.0 Resolution: Fixed Status: Resolved (was: Patch Available) Spark tests are not suppose to run anymore. Pushed to master. > Remove ATSHook > -- > > Key: HIVE-20078 > URL: https://issues.apache.org/jira/browse/HIVE-20078 > Project: Hive > Issue Type: Task > Components: Hooks >Reporter: Ashutosh Chauhan >Assignee: Ashutosh Chauhan >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-20078.2.patch, HIVE-20078.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23217) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is unchanged
[
https://issues.apache.org/jira/browse/HIVE-23217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086718#comment-17086718
]
Hive QA commented on HIVE-23217:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000389/HIVE-23217.04.patch
{color:green}SUCCESS:{color} +1 due to 5 test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 17141 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/21761/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/21761/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-21761/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13000389 - PreCommit-HIVE-Build
> Move q tests to TestMiniLlapLocal from TestCliDriver where the output is
> unchanged
> --
>
> Key: HIVE-23217
> URL: https://issues.apache.org/jira/browse/HIVE-23217
> Project: Hive
> Issue Type: Sub-task
> Components: Hive
>Reporter: Miklos Gergely
>Assignee: Miklos Gergely
>Priority: Major
> Attachments: HIVE-23217.01.patch, HIVE-23217.02.patch,
> HIVE-23217.03.patch, HIVE-23217.04.patch
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23217) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is unchanged
[
https://issues.apache.org/jira/browse/HIVE-23217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086709#comment-17086709
]
Hive QA commented on HIVE-23217:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
31s{color} | {color:blue} Maven dependency ordering for branch {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
29s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
2s{color} | {color:green} The patch has no whitespace issues. {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
11s{color} | {color:red} The patch generated 2 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 3m 7s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-21761/dev-support/hive-personality.sh
|
| git revision | master / c3fb689 |
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21761/yetus/patch-asflicense-problems.txt
|
| modules | C: ql itests U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21761/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Move q tests to TestMiniLlapLocal from TestCliDriver where the output is
> unchanged
> --
>
> Key: HIVE-23217
> URL: https://issues.apache.org/jira/browse/HIVE-23217
> Project: Hive
> Issue Type: Sub-task
> Components: Hive
>Reporter: Miklos Gergely
>Assignee: Miklos Gergely
>Priority: Major
> Attachments: HIVE-23217.01.patch, HIVE-23217.02.patch,
> HIVE-23217.03.patch, HIVE-23217.04.patch
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-19369) Locks: Add new lock implementations for always zero-wait readers
[
https://issues.apache.org/jira/browse/HIVE-19369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086708#comment-17086708
]
Hive QA commented on HIVE-19369:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000380/HIVE-19369.3.patch
{color:green}SUCCESS:{color} +1 due to 4 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 17154 tests
executed
*Failed tests:*
{noformat}
org.apache.hive.service.auth.TestImproperTrustDomainAuthenticationBinary.org.apache.hive.service.auth.TestImproperTrustDomainAuthenticationBinary
(batchId=209)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/21760/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/21760/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-21760/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13000380 - PreCommit-HIVE-Build
> Locks: Add new lock implementations for always zero-wait readers
>
>
> Key: HIVE-19369
> URL: https://issues.apache.org/jira/browse/HIVE-19369
> Project: Hive
> Issue Type: Improvement
> Components: Transactions
>Reporter: Gopal Vijayaraghavan
>Assignee: Denys Kuzmenko
>Priority: Major
> Attachments: HIVE-19369.1.patch, HIVE-19369.2.patch,
> HIVE-19369.3.patch
>
>
> Hive Locking with Micro-managed and full-ACID tables needs a better locking
> implementation which allows for no-wait readers always.
> EXCL_DROP
> EXCL_WRITE
> SHARED_WRITE
> SHARED_READ
> Short write-up
> EXCL_DROP is a "drop partition" or "drop table" and waits for all others to
> exit
> EXCL_WRITE excludes all writes and will wait for all existing SHARED_WRITE to
> exit.
> SHARED_WRITE allows all SHARED_WRITES to go through, but will wait for an
> EXCL_WRITE & EXCL_DROP (waiting so that you can do drop + insert in different
> threads).
> SHARED_READ does not wait for any lock - it fails fast for a pending
> EXCL_DROP, because even if there is an EXCL_WRITE or SHARED_WRITE pending,
> there's no semantic reason to wait for them to succeed before going ahead
> with a SHARED_WRITE.
> a select * => SHARED_READ
> an insert into => SHARED_WRITE
> an insert overwrite or MERGE => EXCL_WRITE
> a drop table => EXCL_DROP
> TODO:
> The fate of the compactor needs to be added to this before it is a complete
> description.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-19369) Locks: Add new lock implementations for always zero-wait readers
[
https://issues.apache.org/jira/browse/HIVE-19369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086707#comment-17086707
]
Hive QA commented on HIVE-19369:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 2m
28s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 10m
48s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 2m
25s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
39s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 2m
44s{color} | {color:blue} standalone-metastore/metastore-common in master has
35 extant Findbugs warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
34s{color} | {color:blue} common in master has 63 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 1m
22s{color} | {color:blue} standalone-metastore/metastore-server in master has
191 extant Findbugs warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m
58s{color} | {color:blue} ql in master has 1528 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 2m
38s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
31s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 3m
2s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 2m
27s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 2m
27s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
12s{color} | {color:green} standalone-metastore/metastore-common: The patch
generated 0 new + 3 unchanged - 1 fixed = 3 total (was 4) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
18s{color} | {color:red} common: The patch generated 1 new + 378 unchanged - 0
fixed = 379 total (was 378) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
23s{color} | {color:red} standalone-metastore/metastore-server: The patch
generated 5 new + 506 unchanged - 33 fixed = 511 total (was 539) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
47s{color} | {color:red} ql: The patch generated 26 new + 234 unchanged - 119
fixed = 260 total (was 353) {color} |
| {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m
0s{color} | {color:red} The patch has 21 line(s) that end in whitespace. Use
git apply --whitespace=fix <>. Refer
https://git-scm.com/docs/git-apply {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 2m
55s{color} | {color:red} standalone-metastore/metastore-common generated 1 new
+ 35 unchanged - 0 fixed = 36 total (was 35) {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 0m
41s{color} | {color:green} common in the patch passed. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m
27s{color} | {color:green} standalone-metastore/metastore-server generated 0
new + 190 unchanged - 1 fixed = 190 total (was 191) {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
13s{color} | {color:green} ql in the patch passed. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 2m
41s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
16s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 49m 47s{color} |
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| FindBugs | module:standalone-metastore/metastore-common |
| | org.apache.hadoop.hive.metastore.LockTypeComparator implements Comparator
but not Serializable At
[jira] [Updated] (HIVE-23100) Create RexNode factory and use it in CalcitePlanner
[ https://issues.apache.org/jira/browse/HIVE-23100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-23100: --- Attachment: HIVE-23100.12.patch > Create RexNode factory and use it in CalcitePlanner > --- > > Key: HIVE-23100 > URL: https://issues.apache.org/jira/browse/HIVE-23100 > Project: Hive > Issue Type: Improvement > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Major > Attachments: HIVE-23100.01.patch, HIVE-23100.02.patch, > HIVE-23100.03.patch, HIVE-23100.04.patch, HIVE-23100.05.patch, > HIVE-23100.06.patch, HIVE-23100.07.patch, HIVE-23100.08.patch, > HIVE-23100.09.patch, HIVE-23100.10.patch, HIVE-23100.11.patch, > HIVE-23100.12.patch, HIVE-23100.patch > > > Follow-up of HIVE-22746. > This will allow us to generate directly the RexNode from the AST nodes. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-20078) Remove ATSHook
[
https://issues.apache.org/jira/browse/HIVE-20078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086692#comment-17086692
]
Hive QA commented on HIVE-20078:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000379/HIVE-20078.2.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 17140 tests
executed
*Failed tests:*
{noformat}
org.apache.hive.spark.client.rpc.TestRpc.testClientTimeout (batchId=302)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/21759/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/21759/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-21759/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13000379 - PreCommit-HIVE-Build
> Remove ATSHook
> --
>
> Key: HIVE-20078
> URL: https://issues.apache.org/jira/browse/HIVE-20078
> Project: Hive
> Issue Type: Task
> Components: Hooks
>Reporter: Ashutosh Chauhan
>Assignee: Ashutosh Chauhan
>Priority: Major
> Attachments: HIVE-20078.2.patch, HIVE-20078.patch
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-20078) Remove ATSHook
[
https://issues.apache.org/jira/browse/HIVE-20078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086688#comment-17086688
]
Hive QA commented on HIVE-20078:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 2m
20s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 9m
11s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
25s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
3s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
37s{color} | {color:blue} common in master has 63 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m
4s{color} | {color:blue} ql in master has 1528 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
14s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
32s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
55s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
27s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
27s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
17s{color} | {color:green} The patch common passed checkstyle {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
46s{color} | {color:green} ql: The patch generated 0 new + 0 unchanged - 18
fixed = 0 total (was 18) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
54s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
17s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
16s{color} | {color:red} The patch generated 2 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 32m 3s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-21759/dev-support/hive-personality.sh
|
| git revision | master / c3fb689 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.1 |
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21759/yetus/patch-asflicense-problems.txt
|
| modules | C: common ql U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21759/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Remove ATSHook
> --
>
> Key: HIVE-20078
> URL: https://issues.apache.org/jira/browse/HIVE-20078
> Project: Hive
> Issue Type: Task
> Components: Hooks
>Reporter: Ashutosh Chauhan
>Assignee: Ashutosh Chauhan
>Priority: Major
> Attachments: HIVE-20078.2.patch, HIVE-20078.patch
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-23210) Fix shortestjobcomparator when jobs submitted have 1 task their vertices
[ https://issues.apache.org/jira/browse/HIVE-23210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Panagiotis Garefalakis updated HIVE-23210: -- Attachment: HIVE-23210.04.patch > Fix shortestjobcomparator when jobs submitted have 1 task their vertices > > > Key: HIVE-23210 > URL: https://issues.apache.org/jira/browse/HIVE-23210 > Project: Hive > Issue Type: Improvement >Reporter: Rajesh Balamohan >Assignee: Panagiotis Garefalakis >Priority: Major > Labels: pull-request-available > Attachments: HIVE-23210.01.patch, HIVE-23210.02.patch, > HIVE-23210.03.patch, HIVE-23210.04.patch, HIVE-23210.wip.patch, > TestShortestJobFirstComparator.java > > Time Spent: 10m > Remaining Estimate: 0h > > In latency sensitive queries, lots of jobs can have vertices with 1 task. > Currently shortestjobcomparator does not work correctly and returns tasks in > random order. > [https://github.com/apache/hive/blob/master/llap-server/src/java/org/apache/hadoop/hive/llap/daemon/impl/comparator/ShortestJobFirstComparator.java#L51] > This causes delay in the job runtime. I will attach a simple test case > shortly. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23217) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is unchanged
[ https://issues.apache.org/jira/browse/HIVE-23217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Gergely updated HIVE-23217: -- Attachment: HIVE-23217.04.patch > Move q tests to TestMiniLlapLocal from TestCliDriver where the output is > unchanged > -- > > Key: HIVE-23217 > URL: https://issues.apache.org/jira/browse/HIVE-23217 > Project: Hive > Issue Type: Sub-task > Components: Hive >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > Attachments: HIVE-23217.01.patch, HIVE-23217.02.patch, > HIVE-23217.03.patch, HIVE-23217.04.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23217) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is unchanged
[ https://issues.apache.org/jira/browse/HIVE-23217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Gergely updated HIVE-23217: -- Attachment: (was: HIVE-23217.03.patch) > Move q tests to TestMiniLlapLocal from TestCliDriver where the output is > unchanged > -- > > Key: HIVE-23217 > URL: https://issues.apache.org/jira/browse/HIVE-23217 > Project: Hive > Issue Type: Sub-task > Components: Hive >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > Attachments: HIVE-23217.01.patch, HIVE-23217.02.patch, > HIVE-23217.03.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23217) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is unchanged
[ https://issues.apache.org/jira/browse/HIVE-23217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Gergely updated HIVE-23217: -- Attachment: HIVE-23217.03.patch > Move q tests to TestMiniLlapLocal from TestCliDriver where the output is > unchanged > -- > > Key: HIVE-23217 > URL: https://issues.apache.org/jira/browse/HIVE-23217 > Project: Hive > Issue Type: Sub-task > Components: Hive >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > Attachments: HIVE-23217.01.patch, HIVE-23217.02.patch, > HIVE-23217.03.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23103) Oracle statement batching
[
https://issues.apache.org/jira/browse/HIVE-23103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086678#comment-17086678
]
Hive QA commented on HIVE-23103:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000375/HIVE-23103.07.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 17141 tests
executed
*Failed tests:*
{noformat}
org.apache.hive.beeline.hs2connection.TestBeelineWithUserHs2ConnectionFile.testBeelineConnectionSSL[0:
tranportMode=all] (batchId=208)
org.apache.hive.jdbc.TestJdbcWithServiceDiscovery.testKillQueryWithDifferentServerZKTurnedOff
(batchId=216)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/21758/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/21758/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-21758/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 2 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13000375 - PreCommit-HIVE-Build
> Oracle statement batching
> -
>
> Key: HIVE-23103
> URL: https://issues.apache.org/jira/browse/HIVE-23103
> Project: Hive
> Issue Type: Improvement
> Components: Transactions
>Reporter: Peter Vary
>Assignee: Peter Vary
>Priority: Major
> Attachments: HIVE-23103.02.patch, HIVE-23103.03.patch,
> HIVE-23103.04.patch, HIVE-23103.05.patch, HIVE-23103.06.patch,
> HIVE-23103.07.patch, HIVE-23103.patch
>
>
> Examine how to really get better performance for oracle statement batches.
> [Oracle JDBC
> doc|https://docs.oracle.com/cd/E11882_01/java.112/e16548/oraperf.htm#JJDBC28752]
> describes:
> {quote}The Oracle implementation of standard update batching does not
> implement true batching for generic statements and callable statements. Even
> though Oracle JDBC supports the use of standard batching for {{Statement}}
> and {{CallableStatement}} objects, you are unlikely to see performance
> improvement.
> {quote}
> I would look for connection properties to set, so it is handled anyway, or if
> not, then use:
> {code}
> begin
> query1;
> query2;
> query3;
> end;
> {code}
> to we will have only a single roundtrip for the db.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23103) Oracle statement batching
[
https://issues.apache.org/jira/browse/HIVE-23103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086672#comment-17086672
]
Hive QA commented on HIVE-23103:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 11m
3s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
30s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
26s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 1m
23s{color} | {color:blue} standalone-metastore/metastore-server in master has
191 extant Findbugs warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
23s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
37s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
31s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
31s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
26s{color} | {color:red} standalone-metastore/metastore-server: The patch
generated 1 new + 518 unchanged - 0 fixed = 519 total (was 518) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m
32s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
26s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
16s{color} | {color:red} The patch generated 2 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 18m 3s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-21758/dev-support/hive-personality.sh
|
| git revision | master / c3fb689 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.0 |
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21758/yetus/diff-checkstyle-standalone-metastore_metastore-server.txt
|
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21758/yetus/patch-asflicense-problems.txt
|
| modules | C: standalone-metastore/metastore-server U:
standalone-metastore/metastore-server |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21758/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Oracle statement batching
> -
>
> Key: HIVE-23103
> URL: https://issues.apache.org/jira/browse/HIVE-23103
> Project: Hive
> Issue Type: Improvement
> Components: Transactions
>Reporter: Peter Vary
>Assignee: Peter Vary
>Priority: Major
> Attachments: HIVE-23103.02.patch, HIVE-23103.03.patch,
> HIVE-23103.04.patch, HIVE-23103.05.patch, HIVE-23103.06.patch,
> HIVE-23103.07.patch, HIVE-23103.patch
>
>
> Examine how to really get better performance for oracle statement batches.
> [Oracle JDBC
> doc|https://docs.oracle.com/cd/E11882_01/java.112/e16548/oraperf.htm#JJDBC28752]
> describes:
> {quote}The Oracle implementation of standard update batching does not
> implement true batching for generic statements and callable statements. Even
> though Oracle JDBC supports the use of standard batching for {{Statement}}
> and {{CallableStatement}} objects, you are unlikely to see performance
> improvement.
> {quote}
> I would look for connection properties to set, so it is handled anyway, or if
> not, then use:
> {code}
> begin
> query1;
> query2;
> query3;
> end;
> {code}
> to we will have only a single roundtrip for the db.
--
This message
[jira] [Commented] (HIVE-23238) FIX PreemptionQueueComparator edge cases
[
https://issues.apache.org/jira/browse/HIVE-23238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086665#comment-17086665
]
Hive QA commented on HIVE-23238:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000373/HIVE-23238.02.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 17142 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/21757/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/21757/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-21757/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13000373 - PreCommit-HIVE-Build
> FIX PreemptionQueueComparator edge cases
>
>
> Key: HIVE-23238
> URL: https://issues.apache.org/jira/browse/HIVE-23238
> Project: Hive
> Issue Type: Improvement
>Reporter: Panagiotis Garefalakis
>Assignee: Panagiotis Garefalakis
>Priority: Major
> Labels: pull-request-available
> Fix For: llap
>
> Attachments: HIVE-23238.01.patch, HIVE-23238.02.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Properly handle preemption comparator edge cases where tasks are same type
> and have the same number or upstream tasks.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23238) FIX PreemptionQueueComparator edge cases
[
https://issues.apache.org/jira/browse/HIVE-23238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086649#comment-17086649
]
Hive QA commented on HIVE-23238:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 11m
7s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
27s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
16s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
49s{color} | {color:blue} llap-server in master has 89 extant Findbugs
warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
17s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
25s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
26s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
26s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
16s{color} | {color:red} llap-server: The patch generated 3 new + 79 unchanged
- 3 fixed = 82 total (was 82) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 0m
54s{color} | {color:red} llap-server generated 2 new + 88 unchanged - 1 fixed =
90 total (was 89) {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
17s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
16s{color} | {color:red} The patch generated 2 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 16m 4s{color} |
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| FindBugs | module:llap-server |
| |
org.apache.hadoop.hive.llap.daemon.impl.comparator.PreemptionQueueComparator.compare(TaskExecutorService$TaskWrapper,
TaskExecutorService$TaskWrapper) incorrectly handles double value At
PreemptionQueueComparator.java:value At PreemptionQueueComparator.java:[line
60] |
| |
org.apache.hadoop.hive.llap.daemon.impl.comparator.PreemptionQueueComparator
implements Comparator but not Serializable At
PreemptionQueueComparator.java:Serializable At
PreemptionQueueComparator.java:[lines 30-68] |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-21757/dev-support/hive-personality.sh
|
| git revision | master / c3fb689 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.1 |
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21757/yetus/diff-checkstyle-llap-server.txt
|
| findbugs |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21757/yetus/new-findbugs-llap-server.html
|
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21757/yetus/patch-asflicense-problems.txt
|
| modules | C: llap-server U: llap-server |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21757/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> FIX PreemptionQueueComparator edge cases
>
>
> Key: HIVE-23238
> URL: https://issues.apache.org/jira/browse/HIVE-23238
> Project: Hive
> Issue Type: Improvement
>Reporter: Panagiotis Garefalakis
>Assignee: Panagiotis Garefalakis
>Priority: Major
> Labels: pull-request-available
> Fix For: llap
>
> Attachments: HIVE-23238.01.patch, HIVE-23238.02.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Properly handle preemption comparator edge cases where tasks are same type
> and have the same number or upstream tasks.
[jira] [Updated] (HIVE-23153) deregister from zookeeper is not properly worked on kerberized environment
[
https://issues.apache.org/jira/browse/HIVE-23153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eugene Chung updated HIVE-23153:
Description:
Deregistering from Zookeeper, initiated by the command 'hive --service
hiveserver2 -deregister ', is not properly worked when HiveServer2
and Zookeeper are kerberized. Even though hive-site.xml has configuration for
Zookeeper Kerberos login (hive.server2.authentication.kerberos.principal and
keytab), it isn't used. I know that kinit with hiveserver2 keytab would make it
work. But as I said, hive-site.xml already has so that the user doesn't need to
do kinit.
* When Kerberos login to Zookeeper is failed and serverUri is not actually
removed from hiveserver2 namespace; {{Will not attempt to authenticate using
SASL (unknown error)}}
{code:java}
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper:
-78.jar:/usr/hdp/3.1.0.0-78/tez/lib/hadoop-azure-3.1.1.3.1.0.0-78.jar:/usr/hdp/3.1.0.0-78/tez/lib/hadoop-azure-datalake-3.1.1.3.1.0.0-78.jar:/usr/hdp/3.1.0.0-78/tez/lib/hadoop-hdfs-client-3.1.1.3.1.0.0-78.jar:/usr/hdp/3.1.0.0-78/tez/lib/hadoop-mapreduce-client-common-3.1.1.3.1.0.0-78.jar:/usr/hdp/3.1.0.0-78/tez/lib/hadoop-mapreduce-client-core-3.1.1.3.1.0.0-78.jar:/usr/hdp/3.1.0.0-78/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.1.1.3.1.0.0-78.jar:/usr/hdp/3.1.0.0-78/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.1.0.0-78/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.1.0.0-78/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.1.0.0-78/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.1.0.0-78/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.1.0.0-78/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.1.0.0-78/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.1.0.0-78/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.1.0.0-78/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.1.0.0-78/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.1.0.0-78/tez/conf
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: Client
environment:java.library.path=:
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: Client
environment:java.io.tmpdir=/tmp
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: Client
environment:java.compiler=
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: Client
environment:os.name=Linux
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: Client
environment:os.arch=amd64
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: Client
environment:os.version=...
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: Client
environment:user.name=...
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: Client
environment:user.home=...
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: Client
environment:user.dir=...
2020-04-08 04:45:44,699 INFO [main] zookeeper.ZooKeeper: Initiating client
connection, connectString=... sessionTimeout=6
watcher=org.apache.curator.ConnectionState@706eab5d
2020-04-08 04:45:44,725 INFO [main-SendThread(...)] zookeeper.ClientCnxn:
Opening socket connection to server ...:2181. Will not attempt to authenticate
using SASL (unknown error)
2020-04-08 04:45:44,731 INFO [main-SendThread(...:2181)] zookeeper.ClientCnxn:
Socket connection established to ...:2181, initiating session
2020-04-08 04:45:44,743 INFO [main-SendThread(...:2181)] zookeeper.ClientCnxn:
Session establishment complete on server ...:2181, sessionid =
0x27148fd2ab1002e, negotiated timeout = 6
2020-04-08 04:45:44,751 INFO [main-EventThread] state.ConnectionStateManager:
State change: CONNECTED
2020-04-08 04:45:44,760 WARN [main] server.HiveServer2: Will attempt to remove
the znode: /hiveserver2/serverUri=...;version=3.1.2;sequence=49 from
ZooKeeper
Will attempt to remove the znode:
/hiveserver2/serverUri=...;version=3.1.2;sequence=49 from ZooKeeper
2020-04-08 04:45:44,768 INFO [Curator-Framework-0] imps.CuratorFrameworkImpl:
backgroundOperationsLoop exiting
2020-04-08 04:45:44,771 INFO [main] zookeeper.ZooKeeper: Session:
0x27148fd2ab1002e closed
2020-04-08 04:45:44,771 INFO [main-EventThread] zookeeper.ClientCnxn:
EventThread shut down
2020-04-08 04:45:44,794 INFO [shutdown-hook-0] server.HiveServer2: SHUTDOWN_MSG:
/
SHUTDOWN_MSG: Shutting down HiveServer2 at ...
/{code}
Plus, the result code of CuratorEvent from DeleteCallback is not checked. In
the case that kerberos login is not done, the code is -102,
[https://zookeeper.apache.org/doc/r3.3.3/api/org/apache/zookeeper/KeeperException.Code.html#NOAUTH].
!Screen Shot 2020-04-08 at 5.00.40.png|width=742,height=201!
was:
Deregistering from Zookeeper, initiated by the command 'hive --service
hiveserver2 -deregister ', is not properly worked when HiveServer2
and Zookeeper are kerberized. Even though hive-site.xml has configuration for
Zookeeper Kerberos login
[jira] [Updated] (HIVE-23153) deregister from zookeeper is not properly worked on kerberized environment
[
https://issues.apache.org/jira/browse/HIVE-23153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eugene Chung updated HIVE-23153:
Description:
Deregistering from Zookeeper, initiated by the command 'hive --service
hiveserver2 -deregister ', is not properly worked when HiveServer2
and Zookeeper are kerberized. Even though hive-site.xml has configuration for
Zookeeper Kerberos login (hive.server2.authentication.kerberos.principal and
keytab), it isn't used. I know that kinit with hiveserver2 keytab would make it
work. But as I said, hive-site.xml already has so that the user doesn't need to
do kinit.
* When Kerberos login to Zookeeper is failed and serverUri is not actually
removed from hiveserver2 namespace; {{Will not attempt to authenticate using
SASL (unknown error)}}
{code:java}
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper:
-78.jar:/usr/hdp/3.1.0.0-78/tez/lib/hadoop-azure-3.1.1.3.1.0.0-78.jar:/usr/hdp/3.1.0.0-78/tez/lib/hadoop-azure-datalake-3.1.1.3.1.0.0-78.jar:/usr/hdp/3.1.0.0-78/tez/lib/hadoop-hdfs-client-3.1.1.3.1.0.0-78.jar:/usr/hdp/3.1.0.0-78/tez/lib/hadoop-mapreduce-client-common-3.1.1.3.1.0.0-78.jar:/usr/hdp/3.1.0.0-78/tez/lib/hadoop-mapreduce-client-core-3.1.1.3.1.0.0-78.jar:/usr/hdp/3.1.0.0-78/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.1.1.3.1.0.0-78.jar:/usr/hdp/3.1.0.0-78/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.1.0.0-78/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.1.0.0-78/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.1.0.0-78/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.1.0.0-78/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.1.0.0-78/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.1.0.0-78/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.1.0.0-78/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.1.0.0-78/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.1.0.0-78/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.1.0.0-78/tez/conf
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: Client
environment:java.library.path=:
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: Client
environment:java.io.tmpdir=/tmp
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: Client
environment:java.compiler=
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: Client
environment:os.name=Linux
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: Client
environment:os.arch=amd64
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: Client
environment:os.version=...
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: Client
environment:user.name=...
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: Client
environment:user.home=...
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: Client
environment:user.dir=...
2020-04-08 04:45:44,699 INFO [main] zookeeper.ZooKeeper: Initiating client
connection, connectString=... sessionTimeout=6
watcher=org.apache.curator.ConnectionState@706eab5d
2020-04-08 04:45:44,725 INFO [main-SendThread(...)] zookeeper.ClientCnxn:
Opening socket connection to server ...:2181. Will not attempt to authenticate
using SASL (unknown error)
2020-04-08 04:45:44,731 INFO [main-SendThread(...:2181)] zookeeper.ClientCnxn:
Socket connection established to ...:2181, initiating session
2020-04-08 04:45:44,743 INFO [main-SendThread(...:2181)] zookeeper.ClientCnxn:
Session establishment complete on server ...:2181, sessionid =
0x27148fd2ab1002e, negotiated timeout = 6
2020-04-08 04:45:44,751 INFO [main-EventThread] state.ConnectionStateManager:
State change: CONNECTED
2020-04-08 04:45:44,760 WARN [main] server.HiveServer2: Will attempt to remove
the znode: /hiveserver2/serverUri=...;version=3.1.2;sequence=49 from
ZooKeeper
Will attempt to remove the znode:
/hiveserver2/serverUri=...;version=3.1.2;sequence=49 from ZooKeeper
2020-04-08 04:45:44,768 INFO [Curator-Framework-0] imps.CuratorFrameworkImpl:
backgroundOperationsLoop exiting
2020-04-08 04:45:44,771 INFO [main] zookeeper.ZooKeeper: Session:
0x27148fd2ab1002e closed
2020-04-08 04:45:44,771 INFO [main-EventThread] zookeeper.ClientCnxn:
EventThread shut down
2020-04-08 04:45:44,794 INFO [shutdown-hook-0] server.HiveServer2: SHUTDOWN_MSG:
/
SHUTDOWN_MSG: Shutting down HiveServer2 at ...
/{code}
Plus, the result code of CuratorEvent from DeleteCallback is not checked. In
the case that kerberos login is not done, the code is -102
([KeeperException.Code.NoAuth|#NOAUTH]]).
!Screen Shot 2020-04-08 at 5.00.40.png|width=742,height=201!
was:
Deregistering from Zookeeper, initiated by the command 'hive --service
hiveserver2 -deregister ', is not properly worked when HiveServer2
and Zookeeper are kerberized. Even though hive-site.xml has configuration for
Zookeeper Kerberos login (hive.server2.authentication.kerberos.principal and
keytab), it isn't used. I know that kinit
[jira] [Updated] (HIVE-23153) deregister from zookeeper is not properly worked on kerberized environment
[
https://issues.apache.org/jira/browse/HIVE-23153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eugene Chung updated HIVE-23153:
Description:
Deregistering from Zookeeper, initiated by the command 'hive --service
hiveserver2 -deregister ', is not properly worked when HiveServer2
and Zookeeper are kerberized. Even though hive-site.xml has configuration for
Zookeeper Kerberos login (hive.server2.authentication.kerberos.principal and
keytab), it isn't used. I know that kinit with hiveserver2 keytab would make it
work. But as I said, hive-site.xml already has so that the user doesn't need to
do kinit.
* When Kerberos login to Zookeeper is failed and serverUri is not actually
removed from hiveserver2 namespace; {{Will not attempt to authenticate using
SASL (unknown error)}}
{code:java}
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper:
-78.jar:/usr/hdp/3.1.0.0-78/tez/lib/hadoop-azure-3.1.1.3.1.0.0-78.jar:/usr/hdp/3.1.0.0-78/tez/lib/hadoop-azure-datalake-3.1.1.3.1.0.0-78.jar:/usr/hdp/3.1.0.0-78/tez/lib/hadoop-hdfs-client-3.1.1.3.1.0.0-78.jar:/usr/hdp/3.1.0.0-78/tez/lib/hadoop-mapreduce-client-common-3.1.1.3.1.0.0-78.jar:/usr/hdp/3.1.0.0-78/tez/lib/hadoop-mapreduce-client-core-3.1.1.3.1.0.0-78.jar:/usr/hdp/3.1.0.0-78/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.1.1.3.1.0.0-78.jar:/usr/hdp/3.1.0.0-78/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.1.0.0-78/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.1.0.0-78/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.1.0.0-78/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.1.0.0-78/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.1.0.0-78/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.1.0.0-78/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.1.0.0-78/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.1.0.0-78/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.1.0.0-78/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.1.0.0-78/tez/conf
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: Client
environment:java.library.path=:
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: Client
environment:java.io.tmpdir=/tmp
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: Client
environment:java.compiler=
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: Client
environment:os.name=Linux
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: Client
environment:os.arch=amd64
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: Client
environment:os.version=...
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: Client
environment:user.name=...
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: Client
environment:user.home=...
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: Client
environment:user.dir=...
2020-04-08 04:45:44,699 INFO [main] zookeeper.ZooKeeper: Initiating client
connection, connectString=... sessionTimeout=6
watcher=org.apache.curator.ConnectionState@706eab5d
2020-04-08 04:45:44,725 INFO [main-SendThread(...)] zookeeper.ClientCnxn:
Opening socket connection to server ...:2181. Will not attempt to authenticate
using SASL (unknown error)
2020-04-08 04:45:44,731 INFO [main-SendThread(...:2181)] zookeeper.ClientCnxn:
Socket connection established to ...:2181, initiating session
2020-04-08 04:45:44,743 INFO [main-SendThread(...:2181)] zookeeper.ClientCnxn:
Session establishment complete on server ...:2181, sessionid =
0x27148fd2ab1002e, negotiated timeout = 6
2020-04-08 04:45:44,751 INFO [main-EventThread] state.ConnectionStateManager:
State change: CONNECTED
2020-04-08 04:45:44,760 WARN [main] server.HiveServer2: Will attempt to remove
the znode: /hiveserver2/serverUri=...;version=3.1.2;sequence=49 from
ZooKeeper
Will attempt to remove the znode:
/hiveserver2/serverUri=...;version=3.1.2;sequence=49 from ZooKeeper
2020-04-08 04:45:44,768 INFO [Curator-Framework-0] imps.CuratorFrameworkImpl:
backgroundOperationsLoop exiting
2020-04-08 04:45:44,771 INFO [main] zookeeper.ZooKeeper: Session:
0x27148fd2ab1002e closed
2020-04-08 04:45:44,771 INFO [main-EventThread] zookeeper.ClientCnxn:
EventThread shut down
2020-04-08 04:45:44,794 INFO [shutdown-hook-0] server.HiveServer2: SHUTDOWN_MSG:
/
SHUTDOWN_MSG: Shutting down HiveServer2 at ...
/{code}
Plus, the result code of CuratorEvent from DeleteCallback is not checked. In
the case that kerberos login is not done, the code is -102
[KeeperException.Code.NoAuth|[https://zookeeper.apache.org/doc/r3.3.3/api/org/apache/zookeeper/KeeperException.Code.html#NOAUTH]].
!Screen Shot 2020-04-08 at 5.00.40.png|width=742,height=201!
was:
Deregistering from Zookeeper, initiated by the command 'hive --service
hiveserver2 -deregister ', is not properly worked when HiveServer2
and Zookeeper are kerberized. Even though hive-site.xml has configuration for
Zookeeper Kerberos login
[jira] [Commented] (HIVE-23210) Fix shortestjobcomparator when jobs submitted have 1 task their vertices
[
https://issues.apache.org/jira/browse/HIVE-23210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086638#comment-17086638
]
Hive QA commented on HIVE-23210:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000372/HIVE-23210.03.patch
{color:green}SUCCESS:{color} +1 due to 2 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 17144 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestTezPerfConstraintsCliDriver.testCliDriver[cbo_query20]
(batchId=226)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/21756/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/21756/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-21756/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13000372 - PreCommit-HIVE-Build
> Fix shortestjobcomparator when jobs submitted have 1 task their vertices
>
>
> Key: HIVE-23210
> URL: https://issues.apache.org/jira/browse/HIVE-23210
> Project: Hive
> Issue Type: Improvement
>Reporter: Rajesh Balamohan
>Assignee: Panagiotis Garefalakis
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-23210.01.patch, HIVE-23210.02.patch,
> HIVE-23210.03.patch, HIVE-23210.wip.patch, TestShortestJobFirstComparator.java
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> In latency sensitive queries, lots of jobs can have vertices with 1 task.
> Currently shortestjobcomparator does not work correctly and returns tasks in
> random order.
> [https://github.com/apache/hive/blob/master/llap-server/src/java/org/apache/hadoop/hive/llap/daemon/impl/comparator/ShortestJobFirstComparator.java#L51]
> This causes delay in the job runtime. I will attach a simple test case
> shortly.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-19369) Locks: Add new lock implementations for always zero-wait readers
[ https://issues.apache.org/jira/browse/HIVE-19369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denys Kuzmenko updated HIVE-19369: -- Attachment: HIVE-19369.3.patch > Locks: Add new lock implementations for always zero-wait readers > > > Key: HIVE-19369 > URL: https://issues.apache.org/jira/browse/HIVE-19369 > Project: Hive > Issue Type: Improvement > Components: Transactions >Reporter: Gopal Vijayaraghavan >Assignee: Denys Kuzmenko >Priority: Major > Attachments: HIVE-19369.1.patch, HIVE-19369.2.patch, > HIVE-19369.3.patch > > > Hive Locking with Micro-managed and full-ACID tables needs a better locking > implementation which allows for no-wait readers always. > EXCL_DROP > EXCL_WRITE > SHARED_WRITE > SHARED_READ > Short write-up > EXCL_DROP is a "drop partition" or "drop table" and waits for all others to > exit > EXCL_WRITE excludes all writes and will wait for all existing SHARED_WRITE to > exit. > SHARED_WRITE allows all SHARED_WRITES to go through, but will wait for an > EXCL_WRITE & EXCL_DROP (waiting so that you can do drop + insert in different > threads). > SHARED_READ does not wait for any lock - it fails fast for a pending > EXCL_DROP, because even if there is an EXCL_WRITE or SHARED_WRITE pending, > there's no semantic reason to wait for them to succeed before going ahead > with a SHARED_WRITE. > a select * => SHARED_READ > an insert into => SHARED_WRITE > an insert overwrite or MERGE => EXCL_WRITE > a drop table => EXCL_DROP > TODO: > The fate of the compactor needs to be added to this before it is a complete > description. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23210) Fix shortestjobcomparator when jobs submitted have 1 task their vertices
[
https://issues.apache.org/jira/browse/HIVE-23210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086630#comment-17086630
]
Hive QA commented on HIVE-23210:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 11m
6s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
27s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
15s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
47s{color} | {color:blue} llap-server in master has 89 extant Findbugs
warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
16s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
26s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
26s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
26s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
14s{color} | {color:red} llap-server: The patch generated 2 new + 13 unchanged
- 0 fixed = 15 total (was 13) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 0m
55s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
16s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
16s{color} | {color:red} The patch generated 2 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 15m 59s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-21756/dev-support/hive-personality.sh
|
| git revision | master / c3fb689 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.1 |
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21756/yetus/diff-checkstyle-llap-server.txt
|
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21756/yetus/patch-asflicense-problems.txt
|
| modules | C: llap-server U: llap-server |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21756/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Fix shortestjobcomparator when jobs submitted have 1 task their vertices
>
>
> Key: HIVE-23210
> URL: https://issues.apache.org/jira/browse/HIVE-23210
> Project: Hive
> Issue Type: Improvement
>Reporter: Rajesh Balamohan
>Assignee: Panagiotis Garefalakis
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-23210.01.patch, HIVE-23210.02.patch,
> HIVE-23210.03.patch, HIVE-23210.wip.patch, TestShortestJobFirstComparator.java
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> In latency sensitive queries, lots of jobs can have vertices with 1 task.
> Currently shortestjobcomparator does not work correctly and returns tasks in
> random order.
> [https://github.com/apache/hive/blob/master/llap-server/src/java/org/apache/hadoop/hive/llap/daemon/impl/comparator/ShortestJobFirstComparator.java#L51]
> This causes delay in the job runtime. I will attach a simple test case
> shortly.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22698) Support Statement#closeOnCompletion()
[ https://issues.apache.org/jira/browse/HIVE-22698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086627#comment-17086627 ] Iwao AVE! commented on HIVE-22698: -- Thank you, Ashutosh! :D > Support Statement#closeOnCompletion() > - > > Key: HIVE-22698 > URL: https://issues.apache.org/jira/browse/HIVE-22698 > Project: Hive > Issue Type: Task > Components: JDBC >Affects Versions: 3.1.2, 2.3.6 >Reporter: Iwao AVE! >Assignee: Iwao AVE! >Priority: Major > Labels: patch > Fix For: 4.0.0 > > Attachments: HIVE-22698.2.patch, HIVE-22698.3.patch, HIVE-22698.patch > > > I am a member of [MyBatis|https://github.com/mybatis] team and a user > [reported|https://github.com/mybatis/mybatis-3/issues/1351#issuecomment-523771341] > that Hive does not support java.sql.Statement#closeOnCompletion() yet. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-20078) Remove ATSHook
[ https://issues.apache.org/jira/browse/HIVE-20078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-20078: Status: Patch Available (was: Open) > Remove ATSHook > -- > > Key: HIVE-20078 > URL: https://issues.apache.org/jira/browse/HIVE-20078 > Project: Hive > Issue Type: Task > Components: Hooks >Reporter: Ashutosh Chauhan >Assignee: Ashutosh Chauhan >Priority: Major > Attachments: HIVE-20078.2.patch, HIVE-20078.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-20078) Remove ATSHook
[ https://issues.apache.org/jira/browse/HIVE-20078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-20078: Attachment: HIVE-20078.2.patch > Remove ATSHook > -- > > Key: HIVE-20078 > URL: https://issues.apache.org/jira/browse/HIVE-20078 > Project: Hive > Issue Type: Task > Components: Hooks >Reporter: Ashutosh Chauhan >Assignee: Ashutosh Chauhan >Priority: Major > Attachments: HIVE-20078.2.patch, HIVE-20078.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-20078) Remove ATSHook
[ https://issues.apache.org/jira/browse/HIVE-20078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-20078: Status: Open (was: Patch Available) > Remove ATSHook > -- > > Key: HIVE-20078 > URL: https://issues.apache.org/jira/browse/HIVE-20078 > Project: Hive > Issue Type: Task > Components: Hooks >Reporter: Ashutosh Chauhan >Assignee: Ashutosh Chauhan >Priority: Major > Attachments: HIVE-20078.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22684) Run Eclipse Cleanup Against hbase-handler Module
[ https://issues.apache.org/jira/browse/HIVE-22684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-22684: Fix Version/s: 4.0.0 Resolution: Fixed Status: Resolved (was: Patch Available) Pushed to master. Thanks, David! > Run Eclipse Cleanup Against hbase-handler Module > > > Key: HIVE-22684 > URL: https://issues.apache.org/jira/browse/HIVE-22684 > Project: Hive > Issue Type: Sub-task >Reporter: David Mollitor >Assignee: David Mollitor >Priority: Minor > Fix For: 4.0.0 > > Attachments: HIVE-22684.1.patch, HIVE-22684.1.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23040) Checkpointing for repl dump incremental phase
[
https://issues.apache.org/jira/browse/HIVE-23040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086618#comment-17086618
]
Hive QA commented on HIVE-23040:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000370/HIVE-23040.02.patch
{color:green}SUCCESS:{color} +1 due to 5 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 17146 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.ql.parse.TestScheduledReplicationScenarios.testAcidTablesReplLoadBootstrapIncr
(batchId=205)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/21755/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/21755/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-21755/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13000370 - PreCommit-HIVE-Build
> Checkpointing for repl dump incremental phase
> -
>
> Key: HIVE-23040
> URL: https://issues.apache.org/jira/browse/HIVE-23040
> Project: Hive
> Issue Type: Improvement
>Reporter: Aasha Medhi
>Assignee: PRAVIN KUMAR SINHA
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-23040.01.patch, HIVE-23040.02.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22684) Run Eclipse Cleanup Against hbase-handler Module
[ https://issues.apache.org/jira/browse/HIVE-22684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086617#comment-17086617 ] Ashutosh Chauhan commented on HIVE-22684: - +1 > Run Eclipse Cleanup Against hbase-handler Module > > > Key: HIVE-22684 > URL: https://issues.apache.org/jira/browse/HIVE-22684 > Project: Hive > Issue Type: Sub-task >Reporter: David Mollitor >Assignee: David Mollitor >Priority: Minor > Attachments: HIVE-22684.1.patch, HIVE-22684.1.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22698) Support Statement#closeOnCompletion()
[ https://issues.apache.org/jira/browse/HIVE-22698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-22698: Fix Version/s: 4.0.0 Assignee: Iwao AVE! Resolution: Fixed Status: Resolved (was: Patch Available) Pushed to master. Thanks, Iwao Ave! > Support Statement#closeOnCompletion() > - > > Key: HIVE-22698 > URL: https://issues.apache.org/jira/browse/HIVE-22698 > Project: Hive > Issue Type: Task > Components: JDBC >Affects Versions: 3.1.2, 2.3.6 >Reporter: Iwao AVE! >Assignee: Iwao AVE! >Priority: Major > Labels: patch > Fix For: 4.0.0 > > Attachments: HIVE-22698.2.patch, HIVE-22698.3.patch, HIVE-22698.patch > > > I am a member of [MyBatis|https://github.com/mybatis] team and a user > [reported|https://github.com/mybatis/mybatis-3/issues/1351#issuecomment-523771341] > that Hive does not support java.sql.Statement#closeOnCompletion() yet. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22698) Support Statement#closeOnCompletion()
[ https://issues.apache.org/jira/browse/HIVE-22698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086611#comment-17086611 ] Ashutosh Chauhan commented on HIVE-22698: - +1 > Support Statement#closeOnCompletion() > - > > Key: HIVE-22698 > URL: https://issues.apache.org/jira/browse/HIVE-22698 > Project: Hive > Issue Type: Task > Components: JDBC >Affects Versions: 3.1.2, 2.3.6 >Reporter: Iwao AVE! >Priority: Major > Labels: patch > Attachments: HIVE-22698.2.patch, HIVE-22698.3.patch, HIVE-22698.patch > > > I am a member of [MyBatis|https://github.com/mybatis] team and a user > [reported|https://github.com/mybatis/mybatis-3/issues/1351#issuecomment-523771341] > that Hive does not support java.sql.Statement#closeOnCompletion() yet. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23040) Checkpointing for repl dump incremental phase
[
https://issues.apache.org/jira/browse/HIVE-23040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086599#comment-17086599
]
Hive QA commented on HIVE-23040:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 2m
8s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 9m
11s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
59s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
5s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m
5s{color} | {color:blue} ql in master has 1528 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
47s{color} | {color:blue} itests/hive-unit in master has 2 extant Findbugs
warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
31s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
32s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 2m
27s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
58s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
58s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
21s{color} | {color:red} itests/hive-unit: The patch generated 4 new + 202
unchanged - 0 fixed = 206 total (was 202) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 5m
15s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
29s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
17s{color} | {color:red} The patch generated 2 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 34m 45s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-21755/dev-support/hive-personality.sh
|
| git revision | master / f888527 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.1 |
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21755/yetus/diff-checkstyle-itests_hive-unit.txt
|
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21755/yetus/patch-asflicense-problems.txt
|
| modules | C: ql itests/hive-unit U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21755/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Checkpointing for repl dump incremental phase
> -
>
> Key: HIVE-23040
> URL: https://issues.apache.org/jira/browse/HIVE-23040
> Project: Hive
> Issue Type: Improvement
>Reporter: Aasha Medhi
>Assignee: PRAVIN KUMAR SINHA
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-23040.01.patch, HIVE-23040.02.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22933) Allow connecting kerberos-enabled Hive to connect to a non-kerberos druid cluster
[ https://issues.apache.org/jira/browse/HIVE-22933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086595#comment-17086595 ] Ashutosh Chauhan commented on HIVE-22933: - +1 > Allow connecting kerberos-enabled Hive to connect to a non-kerberos druid > cluster > - > > Key: HIVE-22933 > URL: https://issues.apache.org/jira/browse/HIVE-22933 > Project: Hive > Issue Type: Bug >Reporter: Nishant Bangarwa >Assignee: Nishant Bangarwa >Priority: Major > Attachments: HIVE-22933.patch > > > Currently, If kerberos is enabled for hive, it can only connect to external > druid clusters which are kerberos enabled, Since the Druid client used to > connect to druid is always KerberosHTTPClient, This task is to allow a > kerberos enabled hiverserver2 to connect to non-kerberized druid cluster. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23217) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is unchanged
[
https://issues.apache.org/jira/browse/HIVE-23217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086576#comment-17086576
]
Hive QA commented on HIVE-23217:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000369/HIVE-23217.03.patch
{color:green}SUCCESS:{color} +1 due to 5 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 17131 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[temp_table_multi_insert_partitioned]
(batchId=106)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[temp_table_orc_diff_part_cols]
(batchId=84)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/21754/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/21754/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-21754/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 2 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13000369 - PreCommit-HIVE-Build
> Move q tests to TestMiniLlapLocal from TestCliDriver where the output is
> unchanged
> --
>
> Key: HIVE-23217
> URL: https://issues.apache.org/jira/browse/HIVE-23217
> Project: Hive
> Issue Type: Sub-task
> Components: Hive
>Reporter: Miklos Gergely
>Assignee: Miklos Gergely
>Priority: Major
> Attachments: HIVE-23217.01.patch, HIVE-23217.02.patch,
> HIVE-23217.03.patch
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-23051) Clean up BucketCodec
[
https://issues.apache.org/jira/browse/HIVE-23051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ashutosh Chauhan updated HIVE-23051:
Fix Version/s: 4.0.0
Resolution: Fixed
Status: Resolved (was: Patch Available)
Pushed to master. Thanks, David!
> Clean up BucketCodec
>
>
> Key: HIVE-23051
> URL: https://issues.apache.org/jira/browse/HIVE-23051
> Project: Hive
> Issue Type: Improvement
>Reporter: David Mollitor
>Assignee: David Mollitor
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-23051.1.patch, HIVE-23051.2.patch,
> HIVE-23051.3.patch, HIVE-23051.4.patch, HIVE-23051.4.patch
>
>
> A couple of nagging things caught my eye with this class. The first thing:
> {code:java|title=BucketCodec.java}
> int statementId = options.getStatementId() >= 0 ?
> options.getStatementId() : 0;
> assert this.version >=0 && this.version <= MAX_VERSION
> : "Version out of range: " + version;
> if(!(options.getBucketId() >= 0 && options.getBucketId() <=
> MAX_BUCKET_ID)) {
> throw new IllegalArgumentException("bucketId out of range: " +
> options.getBucketId());
> }
> if(!(statementId >= 0 && statementId <= MAX_STATEMENT_ID)) {
> throw new IllegalArgumentException("statementId out of range: " +
> statementId);
> }
> {code}
> {{statementId}} gets capped, if it's less than 0, then it gets rounded up to
> 0. However, it later checks that the {{statementId}} is greater,... which is
> will always be 'true' since it's getting rounded.
> # Remove the rounding behavior.
> # Make better error message
> # Fail-fast in the constructor if the version is invalid
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23051) Clean up BucketCodec
[
https://issues.apache.org/jira/browse/HIVE-23051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086571#comment-17086571
]
Ashutosh Chauhan commented on HIVE-23051:
-
+1
> Clean up BucketCodec
>
>
> Key: HIVE-23051
> URL: https://issues.apache.org/jira/browse/HIVE-23051
> Project: Hive
> Issue Type: Improvement
>Reporter: David Mollitor
>Assignee: David Mollitor
>Priority: Major
> Attachments: HIVE-23051.1.patch, HIVE-23051.2.patch,
> HIVE-23051.3.patch, HIVE-23051.4.patch, HIVE-23051.4.patch
>
>
> A couple of nagging things caught my eye with this class. The first thing:
> {code:java|title=BucketCodec.java}
> int statementId = options.getStatementId() >= 0 ?
> options.getStatementId() : 0;
> assert this.version >=0 && this.version <= MAX_VERSION
> : "Version out of range: " + version;
> if(!(options.getBucketId() >= 0 && options.getBucketId() <=
> MAX_BUCKET_ID)) {
> throw new IllegalArgumentException("bucketId out of range: " +
> options.getBucketId());
> }
> if(!(statementId >= 0 && statementId <= MAX_STATEMENT_ID)) {
> throw new IllegalArgumentException("statementId out of range: " +
> statementId);
> }
> {code}
> {{statementId}} gets capped, if it's less than 0, then it gets rounded up to
> 0. However, it later checks that the {{statementId}} is greater,... which is
> will always be 'true' since it's getting rounded.
> # Remove the rounding behavior.
> # Make better error message
> # Fail-fast in the constructor if the version is invalid
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-23239) Remove snakeyaml lib from Hive distribution via transitive dependency
[ https://issues.apache.org/jira/browse/HIVE-23239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-23239: Fix Version/s: 4.0.0 Resolution: Fixed Status: Resolved (was: Patch Available) Pushed to master. Thanks, Roohi! > Remove snakeyaml lib from Hive distribution via transitive dependency > - > > Key: HIVE-23239 > URL: https://issues.apache.org/jira/browse/HIVE-23239 > Project: Hive > Issue Type: Bug >Reporter: Roohi Syeda >Assignee: Roohi Syeda >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-23239.01.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23239) Remove snakeyaml lib from Hive distribution via transitive dependency
[ https://issues.apache.org/jira/browse/HIVE-23239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086555#comment-17086555 ] Ashutosh Chauhan commented on HIVE-23239: - +1 > Remove snakeyaml lib from Hive distribution via transitive dependency > - > > Key: HIVE-23239 > URL: https://issues.apache.org/jira/browse/HIVE-23239 > Project: Hive > Issue Type: Bug >Reporter: Roohi Syeda >Assignee: Roohi Syeda >Priority: Major > Attachments: HIVE-23239.01.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23196) Reduce number of delete calls to NN during Context::clear
[
https://issues.apache.org/jira/browse/HIVE-23196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ashutosh Chauhan updated HIVE-23196:
Fix Version/s: 4.0.0
Resolution: Fixed
Status: Resolved (was: Patch Available)
Pushed to master. Thanks, Attila!
> Reduce number of delete calls to NN during Context::clear
> -
>
> Key: HIVE-23196
> URL: https://issues.apache.org/jira/browse/HIVE-23196
> Project: Hive
> Issue Type: Improvement
>Reporter: Rajesh Balamohan
>Assignee: Attila Magyar
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-23196.1.patch, HIVE-23196.2.patch
>
>
> {{Context::clear()}} ends up deleting same directories (or its subdirs)
> multiple times. It would be good to reduce the number of delete calls to NN
> for latency sensitive queries. This also has an impact on concurrent queries.
> {noformat}
> 2020-04-14T04:22:28,703 DEBUG [7c6a6b09-ab37-4bc8-93a5-5da6fb154899
> HiveServer2-Handler-Pool: Thread-378] ql.Context: Deleting result dir:
> hdfs://nn1:8020/tmp/hive/xyz/7c6a6b09-ab37-4bc8-93a5-5da6fb154899/hive_2020-04-14_04-22-24_335_8573832618972595103-13/-mr-1
> 2020-04-14T04:22:28,721 DEBUG [7c6a6b09-ab37-4bc8-93a5-5da6fb154899
> HiveServer2-Handler-Pool: Thread-378] ql.Context: Deleting scratch dir:
> hdfs://nn1:8020/tmp/hive/xyz/7c6a6b09-ab37-4bc8-93a5-5da6fb154899/hive_2020-04-14_04-22-24_335_8573832618972595103-13
> 2020-04-14T04:22:28,737 DEBUG [7c6a6b09-ab37-4bc8-93a5-5da6fb154899
> HiveServer2-Handler-Pool: Thread-378] ql.Context: Deleting scratch dir:
> hdfs://nn1:8020/tmp/hive/xyz/7c6a6b09-ab37-4bc8-93a5-5da6fb154899/hive_2020-04-14_04-22-24_335_8573832618972595103-13/-mr-1/.hive-staging_hive_2020-04-14_04-22-24_335_8573832618972595103-13{noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23217) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is unchanged
[
https://issues.apache.org/jira/browse/HIVE-23217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086546#comment-17086546
]
Hive QA commented on HIVE-23217:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
31s{color} | {color:blue} Maven dependency ordering for branch {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
31s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
2s{color} | {color:green} The patch has no whitespace issues. {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
11s{color} | {color:red} The patch generated 2 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 5m 10s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-21754/dev-support/hive-personality.sh
|
| git revision | master / 15ebf9e |
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21754/yetus/patch-asflicense-problems.txt
|
| modules | C: ql itests U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21754/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Move q tests to TestMiniLlapLocal from TestCliDriver where the output is
> unchanged
> --
>
> Key: HIVE-23217
> URL: https://issues.apache.org/jira/browse/HIVE-23217
> Project: Hive
> Issue Type: Sub-task
> Components: Hive
>Reporter: Miklos Gergely
>Assignee: Miklos Gergely
>Priority: Major
> Attachments: HIVE-23217.01.patch, HIVE-23217.02.patch,
> HIVE-23217.03.patch
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-19369) Locks: Add new lock implementations for always zero-wait readers
[
https://issues.apache.org/jira/browse/HIVE-19369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086541#comment-17086541
]
Hive QA commented on HIVE-19369:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000368/HIVE-19369.2.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 6 failed/errored test(s), 17140 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[explain_locks]
(batchId=36)
org.apache.hadoop.hive.metastore.txn.TestTxnHandler.testCheckLockAcquireAfterWaiting
(batchId=243)
org.apache.hadoop.hive.metastore.txn.TestTxnHandler.testLockSWSWSR (batchId=243)
org.apache.hadoop.hive.metastore.txn.TestTxnHandler.testLockSWSWSW (batchId=243)
org.apache.hadoop.hive.ql.lockmgr.TestDbTxnManager2.testDynamicPartitionInsert
(batchId=298)
org.apache.hadoop.hive.ql.lockmgr.TestDbTxnManager2.testShowLocksFilterOptions
(batchId=298)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/21753/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/21753/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-21753/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 6 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13000368 - PreCommit-HIVE-Build
> Locks: Add new lock implementations for always zero-wait readers
>
>
> Key: HIVE-19369
> URL: https://issues.apache.org/jira/browse/HIVE-19369
> Project: Hive
> Issue Type: Improvement
> Components: Transactions
>Reporter: Gopal Vijayaraghavan
>Assignee: Denys Kuzmenko
>Priority: Major
> Attachments: HIVE-19369.1.patch, HIVE-19369.2.patch
>
>
> Hive Locking with Micro-managed and full-ACID tables needs a better locking
> implementation which allows for no-wait readers always.
> EXCL_DROP
> EXCL_WRITE
> SHARED_WRITE
> SHARED_READ
> Short write-up
> EXCL_DROP is a "drop partition" or "drop table" and waits for all others to
> exit
> EXCL_WRITE excludes all writes and will wait for all existing SHARED_WRITE to
> exit.
> SHARED_WRITE allows all SHARED_WRITES to go through, but will wait for an
> EXCL_WRITE & EXCL_DROP (waiting so that you can do drop + insert in different
> threads).
> SHARED_READ does not wait for any lock - it fails fast for a pending
> EXCL_DROP, because even if there is an EXCL_WRITE or SHARED_WRITE pending,
> there's no semantic reason to wait for them to succeed before going ahead
> with a SHARED_WRITE.
> a select * => SHARED_READ
> an insert into => SHARED_WRITE
> an insert overwrite or MERGE => EXCL_WRITE
> a drop table => EXCL_DROP
> TODO:
> The fate of the compactor needs to be added to this before it is a complete
> description.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-19369) Locks: Add new lock implementations for always zero-wait readers
[
https://issues.apache.org/jira/browse/HIVE-19369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086536#comment-17086536
]
Hive QA commented on HIVE-19369:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 2m
0s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
51s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 2m
31s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
41s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 2m
42s{color} | {color:blue} standalone-metastore/metastore-common in master has
35 extant Findbugs warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
38s{color} | {color:blue} common in master has 63 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 1m
22s{color} | {color:blue} standalone-metastore/metastore-server in master has
191 extant Findbugs warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m
6s{color} | {color:blue} ql in master has 1528 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 2m
39s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
31s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 3m
10s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 2m
34s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 2m
34s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
12s{color} | {color:red} standalone-metastore/metastore-common: The patch
generated 3 new + 4 unchanged - 0 fixed = 7 total (was 4) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
18s{color} | {color:red} common: The patch generated 1 new + 378 unchanged - 0
fixed = 379 total (was 378) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
26s{color} | {color:red} standalone-metastore/metastore-server: The patch
generated 23 new + 511 unchanged - 13 fixed = 534 total (was 524) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
47s{color} | {color:red} ql: The patch generated 25 new + 202 unchanged - 118
fixed = 227 total (was 320) {color} |
| {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m
0s{color} | {color:red} The patch has 21 line(s) that end in whitespace. Use
git apply --whitespace=fix <>. Refer
https://git-scm.com/docs/git-apply {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 3m
1s{color} | {color:red} standalone-metastore/metastore-common generated 1 new +
35 unchanged - 0 fixed = 36 total (was 35) {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 0m
45s{color} | {color:green} common in the patch passed. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m
31s{color} | {color:green} standalone-metastore/metastore-server generated 0
new + 190 unchanged - 1 fixed = 190 total (was 191) {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
22s{color} | {color:green} ql in the patch passed. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 2m
40s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
15s{color} | {color:red} The patch generated 2 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 48m 30s{color} |
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| FindBugs | module:standalone-metastore/metastore-common |
| | org.apache.hadoop.hive.metastore.LockTypeComparator implements Comparator
but not Serializable At
[jira] [Commented] (HIVE-23203) Dummy jira for modifying ptest configuration - before the actual patch
[
https://issues.apache.org/jira/browse/HIVE-23203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086517#comment-17086517
]
Hive QA commented on HIVE-23203:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000365/HIVE-23203.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 17131 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.ql.schq.TestScheduledQueryStatements.testExecuteImmediate
(batchId=294)
org.apache.hive.jdbc.TestJdbcWithMiniLlapRow.testComplexQuery (batchId=214)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/21752/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/21752/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-21752/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 2 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13000365 - PreCommit-HIVE-Build
> Dummy jira for modifying ptest configuration - before the actual patch
> --
>
> Key: HIVE-23203
> URL: https://issues.apache.org/jira/browse/HIVE-23203
> Project: Hive
> Issue Type: Test
> Components: Hive
>Reporter: Miklos Gergely
>Priority: Major
> Attachments: HIVE-23203.patch
>
>
> If the ptest configuration is required to be modified, then the server must
> be restarted, which causes the actually processed patch to fail. In order not
> to cause trouble to others, this dummy Jira can be used by queueing this
> first, then the actual modification, finally the pair of this Jira.
> When the patch for this one is is processed, the ptest configuration can be
> modified, and the server can be restarted, thus this dummy jira's patch
> processing will fail. Then the actual modification comes, which will result
> in some way or the other. Then the other dummy Jira
> ([HIVE-23204|https://issues.apache.org/jira/browse/HIVE-23204]) comes, and
> the ptest modifications can be reverted, and the server can be restarted
> again.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23203) Dummy jira for modifying ptest configuration - before the actual patch
[
https://issues.apache.org/jira/browse/HIVE-23203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086516#comment-17086516
]
Hive QA commented on HIVE-23203:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 10m
34s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 7m
24s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 7m
36s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
26s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 7m
35s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 7m
35s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:red}-1{color} | {color:red} xml {color} | {color:red} 0m 1s{color} |
{color:red} The patch has 1 ill-formed XML file(s). {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 7m
30s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
14s{color} | {color:red} The patch generated 2 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 49m 46s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc xml compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-21752/dev-support/hive-personality.sh
|
| git revision | master / 15ebf9e |
| Default Java | 1.8.0_111 |
| xml | http://104.198.109.242/logs//PreCommit-HIVE-Build-21752/yetus/xml.txt |
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21752/yetus/patch-asflicense-problems.txt
|
| modules | C: . U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21752/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Dummy jira for modifying ptest configuration - before the actual patch
> --
>
> Key: HIVE-23203
> URL: https://issues.apache.org/jira/browse/HIVE-23203
> Project: Hive
> Issue Type: Test
> Components: Hive
>Reporter: Miklos Gergely
>Priority: Major
> Attachments: HIVE-23203.patch
>
>
> If the ptest configuration is required to be modified, then the server must
> be restarted, which causes the actually processed patch to fail. In order not
> to cause trouble to others, this dummy Jira can be used by queueing this
> first, then the actual modification, finally the pair of this Jira.
> When the patch for this one is is processed, the ptest configuration can be
> modified, and the server can be restarted, thus this dummy jira's patch
> processing will fail. Then the actual modification comes, which will result
> in some way or the other. Then the other dummy Jira
> ([HIVE-23204|https://issues.apache.org/jira/browse/HIVE-23204]) comes, and
> the ptest modifications can be reverted, and the server can be restarted
> again.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-23103) Oracle statement batching
[
https://issues.apache.org/jira/browse/HIVE-23103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Peter Vary updated HIVE-23103:
--
Attachment: HIVE-23103.07.patch
> Oracle statement batching
> -
>
> Key: HIVE-23103
> URL: https://issues.apache.org/jira/browse/HIVE-23103
> Project: Hive
> Issue Type: Improvement
> Components: Transactions
>Reporter: Peter Vary
>Assignee: Peter Vary
>Priority: Major
> Attachments: HIVE-23103.02.patch, HIVE-23103.03.patch,
> HIVE-23103.04.patch, HIVE-23103.05.patch, HIVE-23103.06.patch,
> HIVE-23103.07.patch, HIVE-23103.patch
>
>
> Examine how to really get better performance for oracle statement batches.
> [Oracle JDBC
> doc|https://docs.oracle.com/cd/E11882_01/java.112/e16548/oraperf.htm#JJDBC28752]
> describes:
> {quote}The Oracle implementation of standard update batching does not
> implement true batching for generic statements and callable statements. Even
> though Oracle JDBC supports the use of standard batching for {{Statement}}
> and {{CallableStatement}} objects, you are unlikely to see performance
> improvement.
> {quote}
> I would look for connection properties to set, so it is handled anyway, or if
> not, then use:
> {code}
> begin
> query1;
> query2;
> query3;
> end;
> {code}
> to we will have only a single roundtrip for the db.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23134) Hive & Kudu interaction not available on ARM
[
https://issues.apache.org/jira/browse/HIVE-23134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086484#comment-17086484
]
Hive QA commented on HIVE-23134:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000364/HIVE-23134.2.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 17131 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[schq_ingest]
(batchId=112)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/21751/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/21751/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-21751/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13000364 - PreCommit-HIVE-Build
> Hive & Kudu interaction not available on ARM
>
>
> Key: HIVE-23134
> URL: https://issues.apache.org/jira/browse/HIVE-23134
> Project: Hive
> Issue Type: Sub-task
>Reporter: Zhenyu Zheng
>Assignee: Zhenyu Zheng
>Priority: Major
> Attachments: HIVE-23134.1.patch, HIVE-23134.2.patch
>
>
> Currently, we have set up an ARM CI to test out how Hive works on ARM
> platform:
> https://builds.apache.org/view/H-L/view/Hive/job/Hive-linux-ARM-trunk/
> According to the results, Hive & Kudu interaction is not available on ARM
> platform:
> https://builds.apache.org/view/H-L/view/Hive/job/Hive-linux-ARM-trunk/25/testReport/org.apache.hadoop.hive.kudu/
> this is because that we use Kudu version 1.10 and that version does not come
> with ARM workable packages.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23238) FIX PreemptionQueueComparator edge cases
[ https://issues.apache.org/jira/browse/HIVE-23238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086481#comment-17086481 ] Panagiotis Garefalakis commented on HIVE-23238: --- Hey [~gopalv] thanks for the comments! Ignoring the number of completedTasks when preempting could indeed cause queries with lots of tasks that are near completion to be victimised in favour of shorter running ones. To avoid such cases, in [^HIVE-23238.02.patch] I added a completion percentage comparison that preserves the most amount of work completed instead (queries closer to completion will be preempted last). Task locality is another interesting property to take into account during preemption, but I believe this kind of decisions could also be taken into account from the AM side (when sending tasks to the TaskExecutorService) e.g., critical tasks with data locality could always be made Guaranteed. > FIX PreemptionQueueComparator edge cases > > > Key: HIVE-23238 > URL: https://issues.apache.org/jira/browse/HIVE-23238 > Project: Hive > Issue Type: Improvement >Reporter: Panagiotis Garefalakis >Assignee: Panagiotis Garefalakis >Priority: Major > Labels: pull-request-available > Fix For: llap > > Attachments: HIVE-23238.01.patch, HIVE-23238.02.patch > > Time Spent: 10m > Remaining Estimate: 0h > > Properly handle preemption comparator edge cases where tasks are same type > and have the same number or upstream tasks. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23238) FIX PreemptionQueueComparator edge cases
[ https://issues.apache.org/jira/browse/HIVE-23238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Panagiotis Garefalakis updated HIVE-23238: -- Status: Patch Available (was: Open) > FIX PreemptionQueueComparator edge cases > > > Key: HIVE-23238 > URL: https://issues.apache.org/jira/browse/HIVE-23238 > Project: Hive > Issue Type: Improvement >Reporter: Panagiotis Garefalakis >Assignee: Panagiotis Garefalakis >Priority: Major > Labels: pull-request-available > Fix For: llap > > Attachments: HIVE-23238.01.patch, HIVE-23238.02.patch > > Time Spent: 10m > Remaining Estimate: 0h > > Properly handle preemption comparator edge cases where tasks are same type > and have the same number or upstream tasks. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23238) FIX PreemptionQueueComparator edge cases
[ https://issues.apache.org/jira/browse/HIVE-23238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Panagiotis Garefalakis updated HIVE-23238: -- Attachment: HIVE-23238.02.patch > FIX PreemptionQueueComparator edge cases > > > Key: HIVE-23238 > URL: https://issues.apache.org/jira/browse/HIVE-23238 > Project: Hive > Issue Type: Improvement >Reporter: Panagiotis Garefalakis >Assignee: Panagiotis Garefalakis >Priority: Major > Labels: pull-request-available > Fix For: llap > > Attachments: HIVE-23238.01.patch, HIVE-23238.02.patch > > Time Spent: 10m > Remaining Estimate: 0h > > Properly handle preemption comparator edge cases where tasks are same type > and have the same number or upstream tasks. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23238) FIX PreemptionQueueComparator edge cases
[ https://issues.apache.org/jira/browse/HIVE-23238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Panagiotis Garefalakis updated HIVE-23238: -- Status: Open (was: Patch Available) > FIX PreemptionQueueComparator edge cases > > > Key: HIVE-23238 > URL: https://issues.apache.org/jira/browse/HIVE-23238 > Project: Hive > Issue Type: Improvement >Reporter: Panagiotis Garefalakis >Assignee: Panagiotis Garefalakis >Priority: Major > Labels: pull-request-available > Fix For: llap > > Attachments: HIVE-23238.01.patch, HIVE-23238.02.patch > > Time Spent: 10m > Remaining Estimate: 0h > > Properly handle preemption comparator edge cases where tasks are same type > and have the same number or upstream tasks. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23134) Hive & Kudu interaction not available on ARM
[
https://issues.apache.org/jira/browse/HIVE-23134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086472#comment-17086472
]
Hive QA commented on HIVE-23134:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 2m
17s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
49s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
45s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
28s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
30s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
49s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
44s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
44s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
2s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
29s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
15s{color} | {color:red} The patch generated 2 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 15m 35s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc xml compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-21751/dev-support/hive-personality.sh
|
| git revision | master / 15ebf9e |
| Default Java | 1.8.0_111 |
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21751/yetus/patch-asflicense-problems.txt
|
| modules | C: kudu-handler itests/qtest-kudu U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21751/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Hive & Kudu interaction not available on ARM
>
>
> Key: HIVE-23134
> URL: https://issues.apache.org/jira/browse/HIVE-23134
> Project: Hive
> Issue Type: Sub-task
>Reporter: Zhenyu Zheng
>Assignee: Zhenyu Zheng
>Priority: Major
> Attachments: HIVE-23134.1.patch, HIVE-23134.2.patch
>
>
> Currently, we have set up an ARM CI to test out how Hive works on ARM
> platform:
> https://builds.apache.org/view/H-L/view/Hive/job/Hive-linux-ARM-trunk/
> According to the results, Hive & Kudu interaction is not available on ARM
> platform:
> https://builds.apache.org/view/H-L/view/Hive/job/Hive-linux-ARM-trunk/25/testReport/org.apache.hadoop.hive.kudu/
> this is because that we use Kudu version 1.10 and that version does not come
> with ARM workable packages.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-23210) Fix shortestjobcomparator when jobs submitted have 1 task their vertices
[ https://issues.apache.org/jira/browse/HIVE-23210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Panagiotis Garefalakis updated HIVE-23210: -- Attachment: HIVE-23210.03.patch > Fix shortestjobcomparator when jobs submitted have 1 task their vertices > > > Key: HIVE-23210 > URL: https://issues.apache.org/jira/browse/HIVE-23210 > Project: Hive > Issue Type: Improvement >Reporter: Rajesh Balamohan >Assignee: Panagiotis Garefalakis >Priority: Major > Labels: pull-request-available > Attachments: HIVE-23210.01.patch, HIVE-23210.02.patch, > HIVE-23210.03.patch, HIVE-23210.wip.patch, TestShortestJobFirstComparator.java > > Time Spent: 10m > Remaining Estimate: 0h > > In latency sensitive queries, lots of jobs can have vertices with 1 task. > Currently shortestjobcomparator does not work correctly and returns tasks in > random order. > [https://github.com/apache/hive/blob/master/llap-server/src/java/org/apache/hadoop/hive/llap/daemon/impl/comparator/ShortestJobFirstComparator.java#L51] > This causes delay in the job runtime. I will attach a simple test case > shortly. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23219) Add test cleanup for TestHCatLoaderEncryption and TestSessionManagerMetrics
[
https://issues.apache.org/jira/browse/HIVE-23219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086461#comment-17086461
]
Hive QA commented on HIVE-23219:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000361/HIVE-23219.2.patch
{color:green}SUCCESS:{color} +1 due to 2 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 17131 tests
executed
*Failed tests:*
{noformat}
org.apache.hive.beeline.TestBeeLineWithArgs.testRowsAffected (batchId=208)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/21750/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/21750/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-21750/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13000361 - PreCommit-HIVE-Build
> Add test cleanup for TestHCatLoaderEncryption and TestSessionManagerMetrics
> ---
>
> Key: HIVE-23219
> URL: https://issues.apache.org/jira/browse/HIVE-23219
> Project: Hive
> Issue Type: Bug
>Reporter: RuiChen
>Assignee: RuiChen
>Priority: Minor
> Attachments: HIVE-23219.2.patch, HIVE-23219.patch
>
>
> 1.Test cases in TestHCatLoaderEncryption apply wrong test.jks in
> hive/ql/target path, it casue tests failing when we run some ql tests,
> then run TestHCatLoaderEncryption in local, fix it using TEST_DATA_DIR.
> 2.Add tearDown method to clean up static metrics instance, to avoid
> impacting each other between test cases in one class.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-23040) Checkpointing for repl dump incremental phase
[ https://issues.apache.org/jira/browse/HIVE-23040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] PRAVIN KUMAR SINHA updated HIVE-23040: -- Attachment: HIVE-23040.02.patch > Checkpointing for repl dump incremental phase > - > > Key: HIVE-23040 > URL: https://issues.apache.org/jira/browse/HIVE-23040 > Project: Hive > Issue Type: Improvement >Reporter: Aasha Medhi >Assignee: PRAVIN KUMAR SINHA >Priority: Major > Labels: pull-request-available > Attachments: HIVE-23040.01.patch, HIVE-23040.02.patch > > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23040) Checkpointing for repl dump incremental phase
[ https://issues.apache.org/jira/browse/HIVE-23040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] PRAVIN KUMAR SINHA updated HIVE-23040: -- Attachment: (was: HIVE-23040.02.patch) > Checkpointing for repl dump incremental phase > - > > Key: HIVE-23040 > URL: https://issues.apache.org/jira/browse/HIVE-23040 > Project: Hive > Issue Type: Improvement >Reporter: Aasha Medhi >Assignee: PRAVIN KUMAR SINHA >Priority: Major > Labels: pull-request-available > Attachments: HIVE-23040.01.patch, HIVE-23040.02.patch > > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23219) Add test cleanup for TestHCatLoaderEncryption and TestSessionManagerMetrics
[
https://issues.apache.org/jira/browse/HIVE-23219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086450#comment-17086450
]
Hive QA commented on HIVE-23219:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m
13s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 9m
22s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
48s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
25s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
39s{color} | {color:blue} service in master has 51 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
29s{color} | {color:blue} hcatalog/hcatalog-pig-adapter in master has 2 extant
Findbugs warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
33s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
30s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
50s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
50s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
50s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
13s{color} | {color:green} The patch service passed checkstyle {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
12s{color} | {color:green} hcatalog/hcatalog-pig-adapter: The patch generated 0
new + 14 unchanged - 1 fixed = 14 total (was 15) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m
22s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
32s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
15s{color} | {color:red} The patch generated 2 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 18m 47s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-21750/dev-support/hive-personality.sh
|
| git revision | master / 15ebf9e |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.1 |
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21750/yetus/patch-asflicense-problems.txt
|
| modules | C: service hcatalog/hcatalog-pig-adapter U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21750/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Add test cleanup for TestHCatLoaderEncryption and TestSessionManagerMetrics
> ---
>
> Key: HIVE-23219
> URL: https://issues.apache.org/jira/browse/HIVE-23219
> Project: Hive
> Issue Type: Bug
>Reporter: RuiChen
>Assignee: RuiChen
>Priority: Minor
> Attachments: HIVE-23219.2.patch, HIVE-23219.patch
>
>
> 1.Test cases in TestHCatLoaderEncryption apply wrong test.jks in
> hive/ql/target path, it casue tests failing when we run some ql tests,
> then run TestHCatLoaderEncryption in local, fix it using TEST_DATA_DIR.
> 2.Add tearDown method to clean up static metrics instance, to avoid
> impacting each other between test cases in one class.
--
This message was sent by Atlassian Jira
[jira] [Updated] (HIVE-23217) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is unchanged
[ https://issues.apache.org/jira/browse/HIVE-23217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Gergely updated HIVE-23217: -- Attachment: HIVE-23217.03.patch > Move q tests to TestMiniLlapLocal from TestCliDriver where the output is > unchanged > -- > > Key: HIVE-23217 > URL: https://issues.apache.org/jira/browse/HIVE-23217 > Project: Hive > Issue Type: Sub-task > Components: Hive >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > Attachments: HIVE-23217.01.patch, HIVE-23217.02.patch, > HIVE-23217.03.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23217) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is unchanged
[ https://issues.apache.org/jira/browse/HIVE-23217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Gergely updated HIVE-23217: -- Attachment: (was: HIVE-23217.03.patch) > Move q tests to TestMiniLlapLocal from TestCliDriver where the output is > unchanged > -- > > Key: HIVE-23217 > URL: https://issues.apache.org/jira/browse/HIVE-23217 > Project: Hive > Issue Type: Sub-task > Components: Hive >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > Attachments: HIVE-23217.01.patch, HIVE-23217.02.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-19369) Locks: Add new lock implementations for always zero-wait readers
[ https://issues.apache.org/jira/browse/HIVE-19369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denys Kuzmenko updated HIVE-19369: -- Attachment: HIVE-19369.2.patch > Locks: Add new lock implementations for always zero-wait readers > > > Key: HIVE-19369 > URL: https://issues.apache.org/jira/browse/HIVE-19369 > Project: Hive > Issue Type: Improvement > Components: Transactions >Reporter: Gopal Vijayaraghavan >Assignee: Denys Kuzmenko >Priority: Major > Attachments: HIVE-19369.1.patch, HIVE-19369.2.patch > > > Hive Locking with Micro-managed and full-ACID tables needs a better locking > implementation which allows for no-wait readers always. > EXCL_DROP > EXCL_WRITE > SHARED_WRITE > SHARED_READ > Short write-up > EXCL_DROP is a "drop partition" or "drop table" and waits for all others to > exit > EXCL_WRITE excludes all writes and will wait for all existing SHARED_WRITE to > exit. > SHARED_WRITE allows all SHARED_WRITES to go through, but will wait for an > EXCL_WRITE & EXCL_DROP (waiting so that you can do drop + insert in different > threads). > SHARED_READ does not wait for any lock - it fails fast for a pending > EXCL_DROP, because even if there is an EXCL_WRITE or SHARED_WRITE pending, > there's no semantic reason to wait for them to succeed before going ahead > with a SHARED_WRITE. > a select * => SHARED_READ > an insert into => SHARED_WRITE > an insert overwrite or MERGE => EXCL_WRITE > a drop table => EXCL_DROP > TODO: > The fate of the compactor needs to be added to this before it is a complete > description. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23239) Remove snakeyaml lib from Hive distribution via transitive dependency
[
https://issues.apache.org/jira/browse/HIVE-23239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086421#comment-17086421
]
Hive QA commented on HIVE-23239:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000334/HIVE-23239.01.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 17131 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/21744/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/21744/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-21744/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13000334 - PreCommit-HIVE-Build
> Remove snakeyaml lib from Hive distribution via transitive dependency
> -
>
> Key: HIVE-23239
> URL: https://issues.apache.org/jira/browse/HIVE-23239
> Project: Hive
> Issue Type: Bug
>Reporter: Roohi Syeda
>Assignee: Roohi Syeda
>Priority: Major
> Attachments: HIVE-23239.01.patch
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23239) Remove snakeyaml lib from Hive distribution via transitive dependency
[
https://issues.apache.org/jira/browse/HIVE-23239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086414#comment-17086414
]
Hive QA commented on HIVE-23239:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 2m
11s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
36s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
53s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
27s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
30s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 2m
20s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
49s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
49s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m
0s{color} | {color:red} The patch has 1 line(s) that end in whitespace. Use git
apply --whitespace=fix <>. Refer https://git-scm.com/docs/git-apply
{color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
4s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
24s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
14s{color} | {color:red} The patch generated 2 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 21m 3s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc xml compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-21744/dev-support/hive-personality.sh
|
| git revision | master / 15ebf9e |
| Default Java | 1.8.0_111 |
| whitespace |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21744/yetus/whitespace-eol.txt
|
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21744/yetus/patch-asflicense-problems.txt
|
| modules | C: ql llap-server kafka-handler U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21744/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Remove snakeyaml lib from Hive distribution via transitive dependency
> -
>
> Key: HIVE-23239
> URL: https://issues.apache.org/jira/browse/HIVE-23239
> Project: Hive
> Issue Type: Bug
>Reporter: Roohi Syeda
>Assignee: Roohi Syeda
>Priority: Major
> Attachments: HIVE-23239.01.patch
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23195) set hive.cluster.delegation.token.gc-interval to 15 minutes instead of an hour
[
https://issues.apache.org/jira/browse/HIVE-23195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086407#comment-17086407
]
Hive QA commented on HIVE-23195:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000360/HIVE-23195.2.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 17131 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.metastore.TestPartitionManagement.testPartitionDiscoveryEnabledBothTableTypes
(batchId=151)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/21743/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/21743/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-21743/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13000360 - PreCommit-HIVE-Build
> set hive.cluster.delegation.token.gc-interval to 15 minutes instead of an hour
> --
>
> Key: HIVE-23195
> URL: https://issues.apache.org/jira/browse/HIVE-23195
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Reporter: Richard Zhang
>Assignee: Richard Zhang
>Priority: Major
> Attachments: HIVE-23195.1.patch, HIVE-23195.2.patch
>
>
> the config "hive.cluster.delegation.token.gc-interval" is set as long
> duration, 1 hour. This created some issues in a heavy loaded cluster in which
> the tokens may not be cleaned up fast enough and the cleaner thread may fail
> to clean the tokens. This may cause issues like eating too much space or LLAP
> startup failures, or slow system startup.
> If this hive.cluster.delegation.token.gc-interval” is reduced from 1 hour to
> a relatively shorter period such as 15 mins, then the zookeeper tokens will
> be cleaned more timely and mitigate these issues.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23195) set hive.cluster.delegation.token.gc-interval to 15 minutes instead of an hour
[
https://issues.apache.org/jira/browse/HIVE-23195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086400#comment-17086400
]
Hive QA commented on HIVE-23195:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 10m
27s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
32s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
12s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 2m
41s{color} | {color:blue} standalone-metastore/metastore-common in master has
35 extant Findbugs warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
2s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
37s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
33s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
33s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
12s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m
51s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
5s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
16s{color} | {color:red} The patch generated 2 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 20m 55s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-21743/dev-support/hive-personality.sh
|
| git revision | master / 15ebf9e |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.0 |
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21743/yetus/patch-asflicense-problems.txt
|
| modules | C: standalone-metastore/metastore-common U:
standalone-metastore/metastore-common |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21743/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> set hive.cluster.delegation.token.gc-interval to 15 minutes instead of an hour
> --
>
> Key: HIVE-23195
> URL: https://issues.apache.org/jira/browse/HIVE-23195
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Reporter: Richard Zhang
>Assignee: Richard Zhang
>Priority: Major
> Attachments: HIVE-23195.1.patch, HIVE-23195.2.patch
>
>
> the config "hive.cluster.delegation.token.gc-interval" is set as long
> duration, 1 hour. This created some issues in a heavy loaded cluster in which
> the tokens may not be cleaned up fast enough and the cleaner thread may fail
> to clean the tokens. This may cause issues like eating too much space or LLAP
> startup failures, or slow system startup.
> If this hive.cluster.delegation.token.gc-interval” is reduced from 1 hour to
> a relatively shorter period such as 15 mins, then the zookeeper tokens will
> be cleaned more timely and mitigate these issues.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23219) Add test cleanup for TestHCatLoaderEncryption and TestSessionManagerMetrics
[ https://issues.apache.org/jira/browse/HIVE-23219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086391#comment-17086391 ] Zoltan Haindrich commented on HIVE-23219: - +1 pending tests > Add test cleanup for TestHCatLoaderEncryption and TestSessionManagerMetrics > --- > > Key: HIVE-23219 > URL: https://issues.apache.org/jira/browse/HIVE-23219 > Project: Hive > Issue Type: Bug >Reporter: RuiChen >Assignee: RuiChen >Priority: Minor > Attachments: HIVE-23219.2.patch, HIVE-23219.patch > > > 1.Test cases in TestHCatLoaderEncryption apply wrong test.jks in > hive/ql/target path, it casue tests failing when we run some ql tests, > then run TestHCatLoaderEncryption in local, fix it using TEST_DATA_DIR. > 2.Add tearDown method to clean up static metrics instance, to avoid > impacting each other between test cases in one class. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23203) Dummy jira for modifying ptest configuration - before the actual patch
[ https://issues.apache.org/jira/browse/HIVE-23203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Gergely updated HIVE-23203: -- Attachment: (was: HIVE-23203.patch) > Dummy jira for modifying ptest configuration - before the actual patch > -- > > Key: HIVE-23203 > URL: https://issues.apache.org/jira/browse/HIVE-23203 > Project: Hive > Issue Type: Test > Components: Hive >Reporter: Miklos Gergely >Priority: Major > Attachments: HIVE-23203.patch > > > If the ptest configuration is required to be modified, then the server must > be restarted, which causes the actually processed patch to fail. In order not > to cause trouble to others, this dummy Jira can be used by queueing this > first, then the actual modification, finally the pair of this Jira. > When the patch for this one is is processed, the ptest configuration can be > modified, and the server can be restarted, thus this dummy jira's patch > processing will fail. Then the actual modification comes, which will result > in some way or the other. Then the other dummy Jira > ([HIVE-23204|https://issues.apache.org/jira/browse/HIVE-23204]) comes, and > the ptest modifications can be reverted, and the server can be restarted > again. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23203) Dummy jira for modifying ptest configuration - before the actual patch
[ https://issues.apache.org/jira/browse/HIVE-23203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Gergely updated HIVE-23203: -- Attachment: HIVE-23203.patch > Dummy jira for modifying ptest configuration - before the actual patch > -- > > Key: HIVE-23203 > URL: https://issues.apache.org/jira/browse/HIVE-23203 > Project: Hive > Issue Type: Test > Components: Hive >Reporter: Miklos Gergely >Priority: Major > Attachments: HIVE-23203.patch > > > If the ptest configuration is required to be modified, then the server must > be restarted, which causes the actually processed patch to fail. In order not > to cause trouble to others, this dummy Jira can be used by queueing this > first, then the actual modification, finally the pair of this Jira. > When the patch for this one is is processed, the ptest configuration can be > modified, and the server can be restarted, thus this dummy jira's patch > processing will fail. Then the actual modification comes, which will result > in some way or the other. Then the other dummy Jira > ([HIVE-23204|https://issues.apache.org/jira/browse/HIVE-23204]) comes, and > the ptest modifications can be reverted, and the server can be restarted > again. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23103) Oracle statement batching
[
https://issues.apache.org/jira/browse/HIVE-23103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086387#comment-17086387
]
Hive QA commented on HIVE-23103:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000319/HIVE-23103.06.patch
{color:red}ERROR:{color} -1 due to build exiting with an error
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/21742/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/21742/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-21742/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Tests exited with: NonZeroExitCodeException
Command 'bash /data/hiveptest/working/scratch/source-prep.sh' failed with exit
status 1 and output '+ date '+%Y-%m-%d %T.%3N'
2020-04-18 09:08:46.618
+ [[ -n /usr/lib/jvm/java-8-openjdk-amd64 ]]
+ export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ export
PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+
PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+ export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m '
+ ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m '
+ export 'MAVEN_OPTS=-Xmx1g '
+ MAVEN_OPTS='-Xmx1g '
+ cd /data/hiveptest/working/
+ tee /data/hiveptest/logs/PreCommit-HIVE-Build-21742/source-prep.txt
+ [[ false == \t\r\u\e ]]
+ mkdir -p maven ivy
+ [[ git = \s\v\n ]]
+ [[ git = \g\i\t ]]
+ [[ -z master ]]
+ [[ -d apache-github-source-source ]]
+ [[ ! -d apache-github-source-source/.git ]]
+ [[ ! -d apache-github-source-source ]]
+ date '+%Y-%m-%d %T.%3N'
2020-04-18 09:08:46.620
+ cd apache-github-source-source
+ git fetch origin
+ git reset --hard HEAD
HEAD is now at 15ebf9e HIVE-23194 : Use Queue Instead of List for
CollectOperator (David Mollitor via Ashutosh Chauhan)
+ git clean -f -d
+ git checkout master
Already on 'master'
Your branch is up-to-date with 'origin/master'.
+ git reset --hard origin/master
HEAD is now at 15ebf9e HIVE-23194 : Use Queue Instead of List for
CollectOperator (David Mollitor via Ashutosh Chauhan)
+ git merge --ff-only origin/master
Already up-to-date.
+ date '+%Y-%m-%d %T.%3N'
2020-04-18 09:08:47.838
+ rm -rf ../yetus_PreCommit-HIVE-Build-21742
+ mkdir ../yetus_PreCommit-HIVE-Build-21742
+ git gc
+ cp -R . ../yetus_PreCommit-HIVE-Build-21742
+ mkdir /data/hiveptest/logs/PreCommit-HIVE-Build-21742/yetus
+ patchCommandPath=/data/hiveptest/working/scratch/smart-apply-patch.sh
+ patchFilePath=/data/hiveptest/working/scratch/build.patch
+ [[ -f /data/hiveptest/working/scratch/build.patch ]]
+ chmod +x /data/hiveptest/working/scratch/smart-apply-patch.sh
+ /data/hiveptest/working/scratch/smart-apply-patch.sh
/data/hiveptest/working/scratch/build.patch
Trying to apply the patch with -p0
Going to apply patch with: git apply -p0
+ [[ maven == \m\a\v\e\n ]]
+ rm -rf /data/hiveptest/working/maven/org/apache/hive
+ mvn -B clean install -DskipTests -T 4 -q
-Dmaven.repo.local=/data/hiveptest/working/maven
protoc-jar: executing: [/tmp/protoc6247308755754114112.exe, --version]
libprotoc 2.6.1
protoc-jar: executing: [/tmp/protoc6247308755754114112.exe,
-I/data/hiveptest/working/apache-github-source-source/standalone-metastore/metastore-common/src/main/protobuf/org/apache/hadoop/hive/metastore,
--java_out=/data/hiveptest/working/apache-github-source-source/standalone-metastore/metastore-common/target/generated-sources,
/data/hiveptest/working/apache-github-source-source/standalone-metastore/metastore-common/src/main/protobuf/org/apache/hadoop/hive/metastore/metastore.proto]
ANTLR Parser Generator Version 3.5.2
protoc-jar: executing: [/tmp/protoc3977630998860319135.exe, --version]
libprotoc 2.6.1
ANTLR Parser Generator Version 3.5.2
Output file
/data/hiveptest/working/apache-github-source-source/standalone-metastore/metastore-server/target/generated-sources/org/apache/hadoop/hive/metastore/parser/FilterParser.java
does not exist: must build
/data/hiveptest/working/apache-github-source-source/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/parser/Filter.g
org/apache/hadoop/hive/metastore/parser/Filter.g
ANTLR Parser Generator Version 3.5.2
Output file
/data/hiveptest/working/apache-github-source-source/parser/target/generated-sources/antlr3/org/apache/hadoop/hive/ql/parse/HiveLexer.java
does not exist: must build
/data/hiveptest/working/apache-github-source-source/parser/src/java/org/apache/hadoop/hive/ql/parse/HiveLexer.g
org/apache/hadoop/hive/ql/parse/HiveLexer.g
Output file
/data/hiveptest/working/apache-github-source-source/parser/target/generated-sources/antlr3/org/apache/hadoop/hive/ql/parse/HiveParser.java
does not exist: must build
[jira] [Commented] (HIVE-23100) Create RexNode factory and use it in CalcitePlanner
[
https://issues.apache.org/jira/browse/HIVE-23100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086386#comment-17086386
]
Hive QA commented on HIVE-23100:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000314/HIVE-23100.11.patch
{color:red}ERROR:{color} -1 due to build exiting with an error
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/21741/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/21741/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-21741/
Messages:
{noformat}
This message was trimmed, see log for full details
error:
a/ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/jdbc/JDBCExpandExpressionsRule.java:
does not exist in index
error:
a/ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/stats/HiveRelMdSize.java:
does not exist in index
error:
a/ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/translator/ExprNodeConverter.java:
does not exist in index
error:
a/ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/translator/RexNodeConverter.java:
does not exist in index
error:
a/ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/translator/SqlFunctionConverter.java:
does not exist in index
error:
a/ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/translator/TypeConverter.java:
does not exist in index
error:
a/ql/src/java/org/apache/hadoop/hive/ql/optimizer/listbucketingpruner/LBProcFactory.java:
does not exist in index
error: a/ql/src/java/org/apache/hadoop/hive/ql/parse/CalcitePlanner.java: does
not exist in index
error:
a/ql/src/java/org/apache/hadoop/hive/ql/parse/DruidSqlOperatorConverter.java:
does not exist in index
error: a/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java:
does not exist in index
error: a/ql/src/java/org/apache/hadoop/hive/ql/parse/type/ExprFactory.java:
does not exist in index
error:
a/ql/src/java/org/apache/hadoop/hive/ql/parse/type/ExprNodeDescExprFactory.java:
does not exist in index
error:
a/ql/src/java/org/apache/hadoop/hive/ql/parse/type/ExprNodeTypeCheck.java: does
not exist in index
error:
a/ql/src/java/org/apache/hadoop/hive/ql/parse/type/JoinCondTypeCheckProcFactory.java:
does not exist in index
error: a/ql/src/java/org/apache/hadoop/hive/ql/parse/type/TypeCheckCtx.java:
does not exist in index
error:
a/ql/src/java/org/apache/hadoop/hive/ql/parse/type/TypeCheckProcFactory.java:
does not exist in index
error:
a/ql/src/java/org/apache/hadoop/hive/ql/parse/type/TypeCheckProcFactoryUtils.java:
does not exist in index
error: a/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeDescUtils.java:
does not exist in index
error:
a/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeGenericFuncDesc.java: does
not exist in index
error:
a/ql/src/test/org/apache/hadoop/hive/ql/parse/type/TestTypeCheckProcFactory.java:
does not exist in index
error:
a/ql/src/test/org/apache/hadoop/hive/ql/plan/mapping/TestCounterMapping.java:
does not exist in index
error: a/ql/src/test/org/apache/hadoop/hive/ql/testutil/BaseScalarUdfTest.java:
does not exist in index
error:
a/ql/src/test/org/apache/hadoop/hive/ql/udf/generic/TestGenericUDFConcat.java:
does not exist in index
error:
a/ql/src/test/org/apache/hadoop/hive/ql/udf/generic/TestGenericUDFRound.java:
does not exist in index
error: a/ql/src/test/queries/clientpositive/partition_coltype_literals.q: does
not exist in index
error: a/ql/src/test/results/clientpositive/alter_partition_coltype.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/avrotblsjoin.q.out: does not exist
in index
error: a/ql/src/test/results/clientpositive/collision.q.out: does not exist in
index
error: a/ql/src/test/results/clientpositive/constprog_cast.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/decimal_precision2.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/druid/druid_timeseries.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/druid/druidkafkamini_basic.q.out:
does not exist in index
error:
a/ql/src/test/results/clientpositive/groupby_multi_single_reducer3.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/in_typecheck_char.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/in_typecheck_varchar.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/infer_const_type.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/llap/cbo_limit.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/llap/check_constraint.q.out: does
not exist in index
error:
a/ql/src/test/results/clientpositive/llap/constraints_optimization.q.out: does
not exist in index
error:
a/ql/src/test/results/clientpositive/llap/identity_project_remove_skip.q.out:
[jira] [Commented] (HIVE-22928) Allow hive.exec.stagingdir to be a fully qualified directory name
[
https://issues.apache.org/jira/browse/HIVE-22928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086385#comment-17086385
]
Hive QA commented on HIVE-22928:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000313/HIVE-22928.4.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 17132 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.ql.exec.TestContext.testStagingDirOnSameFSDespiteConfiguration
(batchId=266)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/21740/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/21740/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-21740/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13000313 - PreCommit-HIVE-Build
> Allow hive.exec.stagingdir to be a fully qualified directory name
> -
>
> Key: HIVE-22928
> URL: https://issues.apache.org/jira/browse/HIVE-22928
> Project: Hive
> Issue Type: Improvement
> Components: Configuration, Hive
>Affects Versions: 3.1.2
>Reporter: Thomas Poepping
>Assignee: Thomas Poepping
>Priority: Minor
> Attachments: HIVE-22928.2.patch, HIVE-22928.3.patch,
> HIVE-22928.4.patch, HIVE-22928.patch
>
>
> Currently, {{hive.exec.stagingdir}} can only be set as a relative directory
> name that, for operations like {{insert}} or {{insert overwrite}}, will be
> placed either under the table directory or the partition directory.
> For cases where an HDFS cluster is small but the data being inserted is very
> large (greater than the capacity of the HDFS cluster, as mentioned in a
> comment by [~ashutoshc] on [HIVE-14270]), the client may want to set their
> staging directory to be an explicit blobstore path (or any filesystem path),
> rather than relying on Hive to intelligently build the blobstore path based
> on an interpretation of the job. We may lose locality guarantees, but because
> renames are just as expensive on blobstores no matter what the prefix is,
> this isn't considered a terribly large loss (assuming only blobstore
> customers use this functionality).
> Note that {{hive.blobstore.use.blobstore.as.scratchdir}} doesn't actually
> suffice in this case, as the stagingdir is not the same.
> This commit enables Hive customers to set an absolute location for all
> staging directories. For instances where the configured stagingdir scheme is
> not the same as the scheme for the table location, the default stagingdir
> configuration is used. This avoids a cross-filesystem rename, which is
> impossible anyway.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22928) Allow hive.exec.stagingdir to be a fully qualified directory name
[
https://issues.apache.org/jira/browse/HIVE-22928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086374#comment-17086374
]
Hive QA commented on HIVE-22928:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 10m
27s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
5s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
43s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m
56s{color} | {color:blue} ql in master has 1528 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
55s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
31s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
3s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
3s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
43s{color} | {color:red} ql: The patch generated 24 new + 83 unchanged - 0
fixed = 107 total (was 83) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
7s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
57s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
15s{color} | {color:red} The patch generated 2 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 26m 16s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-21740/dev-support/hive-personality.sh
|
| git revision | master / 15ebf9e |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.1 |
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21740/yetus/diff-checkstyle-ql.txt
|
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21740/yetus/patch-asflicense-problems.txt
|
| modules | C: ql U: ql |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21740/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Allow hive.exec.stagingdir to be a fully qualified directory name
> -
>
> Key: HIVE-22928
> URL: https://issues.apache.org/jira/browse/HIVE-22928
> Project: Hive
> Issue Type: Improvement
> Components: Configuration, Hive
>Affects Versions: 3.1.2
>Reporter: Thomas Poepping
>Assignee: Thomas Poepping
>Priority: Minor
> Attachments: HIVE-22928.2.patch, HIVE-22928.3.patch,
> HIVE-22928.4.patch, HIVE-22928.patch
>
>
> Currently, {{hive.exec.stagingdir}} can only be set as a relative directory
> name that, for operations like {{insert}} or {{insert overwrite}}, will be
> placed either under the table directory or the partition directory.
> For cases where an HDFS cluster is small but the data being inserted is very
> large (greater than the capacity of the HDFS cluster, as mentioned in a
> comment by [~ashutoshc] on [HIVE-14270]), the client may want to set their
> staging directory to be an explicit blobstore path (or any filesystem path),
> rather than relying on Hive to intelligently build the blobstore path based
> on an interpretation of the job. We may lose locality guarantees, but because
> renames are just as expensive on blobstores no matter what the prefix is,
> this isn't considered a terribly large loss (assuming only blobstore
> customers use this
[jira] [Commented] (HIVE-23134) Hive & Kudu interaction not available on ARM
[ https://issues.apache.org/jira/browse/HIVE-23134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086368#comment-17086368 ] RuiChen commented on HIVE-23134: LGTM, let's using it as workaround until Kudu aarch64 release available. Thank you. > Hive & Kudu interaction not available on ARM > > > Key: HIVE-23134 > URL: https://issues.apache.org/jira/browse/HIVE-23134 > Project: Hive > Issue Type: Sub-task >Reporter: Zhenyu Zheng >Assignee: Zhenyu Zheng >Priority: Major > Attachments: HIVE-23134.1.patch, HIVE-23134.2.patch > > > Currently, we have set up an ARM CI to test out how Hive works on ARM > platform: > https://builds.apache.org/view/H-L/view/Hive/job/Hive-linux-ARM-trunk/ > According to the results, Hive & Kudu interaction is not available on ARM > platform: > https://builds.apache.org/view/H-L/view/Hive/job/Hive-linux-ARM-trunk/25/testReport/org.apache.hadoop.hive.kudu/ > this is because that we use Kudu version 1.10 and that version does not come > with ARM workable packages. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23134) Hive & Kudu interaction not available on ARM
[ https://issues.apache.org/jira/browse/HIVE-23134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenyu Zheng updated HIVE-23134: Attachment: HIVE-23134.2.patch Status: Patch Available (was: Open) re-trigger CI for patch v2 > Hive & Kudu interaction not available on ARM > > > Key: HIVE-23134 > URL: https://issues.apache.org/jira/browse/HIVE-23134 > Project: Hive > Issue Type: Sub-task >Reporter: Zhenyu Zheng >Assignee: Zhenyu Zheng >Priority: Major > Attachments: HIVE-23134.1.patch, HIVE-23134.2.patch > > > Currently, we have set up an ARM CI to test out how Hive works on ARM > platform: > https://builds.apache.org/view/H-L/view/Hive/job/Hive-linux-ARM-trunk/ > According to the results, Hive & Kudu interaction is not available on ARM > platform: > https://builds.apache.org/view/H-L/view/Hive/job/Hive-linux-ARM-trunk/25/testReport/org.apache.hadoop.hive.kudu/ > this is because that we use Kudu version 1.10 and that version does not come > with ARM workable packages. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22821) Add necessary endpoints for proactive cache eviction
[
https://issues.apache.org/jira/browse/HIVE-22821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086360#comment-17086360
]
Hive QA commented on HIVE-22821:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000286/HIVE-22821.5.patch
{color:green}SUCCESS:{color} +1 due to 2 test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 17131 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/21739/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/21739/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-21739/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13000286 - PreCommit-HIVE-Build
> Add necessary endpoints for proactive cache eviction
>
>
> Key: HIVE-22821
> URL: https://issues.apache.org/jira/browse/HIVE-22821
> Project: Hive
> Issue Type: Sub-task
> Components: llap
>Reporter: Ádám Szita
>Assignee: Ádám Szita
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-22821.0.patch, HIVE-22821.1.patch,
> HIVE-22821.2.patch, HIVE-22821.3.patch, HIVE-22821.4.patch, HIVE-22821.5.patch
>
> Time Spent: 6h 10m
> Remaining Estimate: 0h
>
> Implement the parts required for iHS2 -> LLAP daemons communication:
> * protobuf message schema and endpoints
> * Hive configuration
> * for use cases:
> ** dropping db
> ** dropping table
> ** dropping partition from a table
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22821) Add necessary endpoints for proactive cache eviction
[
https://issues.apache.org/jira/browse/HIVE-22821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086353#comment-17086353
]
Hive QA commented on HIVE-22821:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 2m
8s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
52s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 2m
19s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
37s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
35s{color} | {color:blue} common in master has 63 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
32s{color} | {color:blue} llap-common in master has 90 extant Findbugs
warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
26s{color} | {color:blue} llap-client in master has 27 extant Findbugs
warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m
54s{color} | {color:blue} ql in master has 1528 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
45s{color} | {color:blue} llap-server in master has 89 extant Findbugs
warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
57s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
31s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 2m
46s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 2m
24s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 2m
24s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
40s{color} | {color:red} ql: The patch generated 3 new + 2 unchanged - 0 fixed
= 5 total (was 2) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
15s{color} | {color:red} llap-server: The patch generated 2 new + 54 unchanged
- 0 fixed = 56 total (was 54) {color} |
| {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m
0s{color} | {color:red} The patch has 17 line(s) that end in whitespace. Use
git apply --whitespace=fix <>. Refer
https://git-scm.com/docs/git-apply {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 0m
39s{color} | {color:red} llap-common generated 8 new + 90 unchanged - 0 fixed =
98 total (was 90) {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
56s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
16s{color} | {color:red} The patch generated 2 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 40m 46s{color} |
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| FindBugs | module:llap-common |
| |
org.apache.hadoop.hive.llap.daemon.rpc.LlapDaemonProtocolProtos$EvictEntityRequestProto.PARSER
isn't final but should be At LlapDaemonProtocolProtos.java:be At
LlapDaemonProtocolProtos.java:[line 22695] |
| | Class
org.apache.hadoop.hive.llap.daemon.rpc.LlapDaemonProtocolProtos$EvictEntityRequestProto
defines non-transient non-serializable instance field unknownFields In
LlapDaemonProtocolProtos.java:instance field unknownFields In
LlapDaemonProtocolProtos.java |
| |
org.apache.hadoop.hive.llap.daemon.rpc.LlapDaemonProtocolProtos$EvictEntityResponseProto.PARSER
isn't final but should be At LlapDaemonProtocolProtos.java:be At
LlapDaemonProtocolProtos.java:[line 24450] |
| | Class
org.apache.hadoop.hive.llap.daemon.rpc.LlapDaemonProtocolProtos$EvictEntityResponseProto
defines non-transient non-serializable instance field unknownFields In
LlapDaemonProtocolProtos.java:instance field unknownFields In
LlapDaemonProtocolProtos.java |
| | Useless control flow in
[jira] [Updated] (HIVE-23219) Add test cleanup for TestHCatLoaderEncryption and TestSessionManagerMetrics
[ https://issues.apache.org/jira/browse/HIVE-23219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] RuiChen updated HIVE-23219: --- Attachment: HIVE-23219.2.patch Status: Patch Available (was: Open) Rebase master to update code base. > Add test cleanup for TestHCatLoaderEncryption and TestSessionManagerMetrics > --- > > Key: HIVE-23219 > URL: https://issues.apache.org/jira/browse/HIVE-23219 > Project: Hive > Issue Type: Bug >Reporter: RuiChen >Assignee: RuiChen >Priority: Minor > Attachments: HIVE-23219.2.patch, HIVE-23219.patch > > > 1.Test cases in TestHCatLoaderEncryption apply wrong test.jks in > hive/ql/target path, it casue tests failing when we run some ql tests, > then run TestHCatLoaderEncryption in local, fix it using TEST_DATA_DIR. > 2.Add tearDown method to clean up static metrics instance, to avoid > impacting each other between test cases in one class. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23219) Add test cleanup for TestHCatLoaderEncryption and TestSessionManagerMetrics
[ https://issues.apache.org/jira/browse/HIVE-23219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] RuiChen updated HIVE-23219: --- Status: Open (was: Patch Available) > Add test cleanup for TestHCatLoaderEncryption and TestSessionManagerMetrics > --- > > Key: HIVE-23219 > URL: https://issues.apache.org/jira/browse/HIVE-23219 > Project: Hive > Issue Type: Bug >Reporter: RuiChen >Assignee: RuiChen >Priority: Minor > Attachments: HIVE-23219.patch > > > 1.Test cases in TestHCatLoaderEncryption apply wrong test.jks in > hive/ql/target path, it casue tests failing when we run some ql tests, > then run TestHCatLoaderEncryption in local, fix it using TEST_DATA_DIR. > 2.Add tearDown method to clean up static metrics instance, to avoid > impacting each other between test cases in one class. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23196) Reduce number of delete calls to NN during Context::clear
[
https://issues.apache.org/jira/browse/HIVE-23196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086338#comment-17086338
]
Hive QA commented on HIVE-23196:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000284/HIVE-23196.2.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 17131 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/21738/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/21738/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-21738/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13000284 - PreCommit-HIVE-Build
> Reduce number of delete calls to NN during Context::clear
> -
>
> Key: HIVE-23196
> URL: https://issues.apache.org/jira/browse/HIVE-23196
> Project: Hive
> Issue Type: Improvement
>Reporter: Rajesh Balamohan
>Assignee: Attila Magyar
>Priority: Major
> Attachments: HIVE-23196.1.patch, HIVE-23196.2.patch
>
>
> {{Context::clear()}} ends up deleting same directories (or its subdirs)
> multiple times. It would be good to reduce the number of delete calls to NN
> for latency sensitive queries. This also has an impact on concurrent queries.
> {noformat}
> 2020-04-14T04:22:28,703 DEBUG [7c6a6b09-ab37-4bc8-93a5-5da6fb154899
> HiveServer2-Handler-Pool: Thread-378] ql.Context: Deleting result dir:
> hdfs://nn1:8020/tmp/hive/xyz/7c6a6b09-ab37-4bc8-93a5-5da6fb154899/hive_2020-04-14_04-22-24_335_8573832618972595103-13/-mr-1
> 2020-04-14T04:22:28,721 DEBUG [7c6a6b09-ab37-4bc8-93a5-5da6fb154899
> HiveServer2-Handler-Pool: Thread-378] ql.Context: Deleting scratch dir:
> hdfs://nn1:8020/tmp/hive/xyz/7c6a6b09-ab37-4bc8-93a5-5da6fb154899/hive_2020-04-14_04-22-24_335_8573832618972595103-13
> 2020-04-14T04:22:28,737 DEBUG [7c6a6b09-ab37-4bc8-93a5-5da6fb154899
> HiveServer2-Handler-Pool: Thread-378] ql.Context: Deleting scratch dir:
> hdfs://nn1:8020/tmp/hive/xyz/7c6a6b09-ab37-4bc8-93a5-5da6fb154899/hive_2020-04-14_04-22-24_335_8573832618972595103-13/-mr-1/.hive-staging_hive_2020-04-14_04-22-24_335_8573832618972595103-13{noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-23195) set hive.cluster.delegation.token.gc-interval to 15 minutes instead of an hour
[ https://issues.apache.org/jira/browse/HIVE-23195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Zhang updated HIVE-23195: - Attachment: HIVE-23195.2.patch > set hive.cluster.delegation.token.gc-interval to 15 minutes instead of an hour > -- > > Key: HIVE-23195 > URL: https://issues.apache.org/jira/browse/HIVE-23195 > Project: Hive > Issue Type: Bug > Components: Hive >Reporter: Richard Zhang >Assignee: Richard Zhang >Priority: Major > Attachments: HIVE-23195.1.patch, HIVE-23195.2.patch > > > the config "hive.cluster.delegation.token.gc-interval" is set as long > duration, 1 hour. This created some issues in a heavy loaded cluster in which > the tokens may not be cleaned up fast enough and the cleaner thread may fail > to clean the tokens. This may cause issues like eating too much space or LLAP > startup failures, or slow system startup. > If this hive.cluster.delegation.token.gc-interval” is reduced from 1 hour to > a relatively shorter period such as 15 mins, then the zookeeper tokens will > be cleaned more timely and mitigate these issues. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23196) Reduce number of delete calls to NN during Context::clear
[
https://issues.apache.org/jira/browse/HIVE-23196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086326#comment-17086326
]
Hive QA commented on HIVE-23196:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 10m
47s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
5s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
44s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m
1s{color} | {color:blue} ql in master has 1528 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
58s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
31s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
6s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
6s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
45s{color} | {color:red} ql: The patch generated 4 new + 55 unchanged - 1 fixed
= 59 total (was 56) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
14s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
59s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
16s{color} | {color:red} The patch generated 2 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 27m 6s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-21738/dev-support/hive-personality.sh
|
| git revision | master / 15ebf9e |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.1 |
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21738/yetus/diff-checkstyle-ql.txt
|
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21738/yetus/patch-asflicense-problems.txt
|
| modules | C: ql U: ql |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21738/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Reduce number of delete calls to NN during Context::clear
> -
>
> Key: HIVE-23196
> URL: https://issues.apache.org/jira/browse/HIVE-23196
> Project: Hive
> Issue Type: Improvement
>Reporter: Rajesh Balamohan
>Assignee: Attila Magyar
>Priority: Major
> Attachments: HIVE-23196.1.patch, HIVE-23196.2.patch
>
>
> {{Context::clear()}} ends up deleting same directories (or its subdirs)
> multiple times. It would be good to reduce the number of delete calls to NN
> for latency sensitive queries. This also has an impact on concurrent queries.
> {noformat}
> 2020-04-14T04:22:28,703 DEBUG [7c6a6b09-ab37-4bc8-93a5-5da6fb154899
> HiveServer2-Handler-Pool: Thread-378] ql.Context: Deleting result dir:
> hdfs://nn1:8020/tmp/hive/xyz/7c6a6b09-ab37-4bc8-93a5-5da6fb154899/hive_2020-04-14_04-22-24_335_8573832618972595103-13/-mr-1
> 2020-04-14T04:22:28,721 DEBUG [7c6a6b09-ab37-4bc8-93a5-5da6fb154899
> HiveServer2-Handler-Pool: Thread-378] ql.Context: Deleting scratch dir:
> hdfs://nn1:8020/tmp/hive/xyz/7c6a6b09-ab37-4bc8-93a5-5da6fb154899/hive_2020-04-14_04-22-24_335_8573832618972595103-13
> 2020-04-14T04:22:28,737 DEBUG [7c6a6b09-ab37-4bc8-93a5-5da6fb154899
> HiveServer2-Handler-Pool: Thread-378] ql.Context: Deleting scratch dir:
>
