[
https://issues.apache.org/jira/browse/HBASE-19848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350222#comment-16350222
]
Hadoop QA commented on HBASE-19848:
-----------------------------------
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
10s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red} 0m
0s{color} | {color:red} The patch doesn't appear to include any new or modified
tests. Please justify why no new tests are needed for this patch. Also please
list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 3m
52s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
50s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} scaladoc {color} | {color:green} 0m
27s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
52s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} scalac {color} | {color:green} 0m
52s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} scaladoc {color} | {color:green} 0m
28s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 4m
21s{color} | {color:green} hbase-spark in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
9s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 11m 27s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hbase:eee3b01 |
| JIRA Issue | HBASE-19848 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12908972/HBASE-19848-V3.patch |
| Optional Tests | asflicense scalac scaladoc unit compile |
| uname | Linux c6ceb0be5c72 4.4.0-43-generic #63-Ubuntu SMP Wed Oct 12
13:48:03 UTC 2016 x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/component/dev-support/hbase-personality.sh
|
| git revision | master / 2f4d0b94bc |
| maven | version: Apache Maven 3.5.2
(138edd61fd100ec658bfa2d307c43b76940a5d7d; 2017-10-18T07:58:13Z) |
| Test Results |
https://builds.apache.org/job/PreCommit-HBASE-Build/11361/testReport/ |
| Max. process+thread count | 1036 (vs. ulimit of 10000) |
| modules | C: hbase-spark U: hbase-spark |
| Console output |
https://builds.apache.org/job/PreCommit-HBASE-Build/11361/console |
| Powered by | Apache Yetus 0.7.0 http://yetus.apache.org |
This message was automatically generated.
> Zookeeper thread leaks in hbase-spark bulkLoad method
> -----------------------------------------------------
>
> Key: HBASE-19848
> URL: https://issues.apache.org/jira/browse/HBASE-19848
> Project: HBase
> Issue Type: Bug
> Components: spark, Zookeeper
> Affects Versions: 1.2.0
> Environment: hbase-spark-1.2.0-cdh5.12.1 version
> spark 1.6
> Reporter: Key Hutu
> Assignee: Key Hutu
> Priority: Major
> Labels: performance
> Fix For: 1.2.0
>
> Attachments: HBASE-19848-V2.patch, HBASE-19848-V3.patch,
> HBaseContext.patch, HBaseContext.scala
>
> Original Estimate: 72h
> Remaining Estimate: 72h
>
> In hbase-spark project, HBaseContext provides bulkload methond for loading
> spark rdd data to hbase easily.But when i using it frequently， the program
> will throw "cannot create native thread" exception.
> using pstack command in spark driver process , the thread num is increasing
> using jstack, named "main-SendThread" and "main-EventThread" thread so many
> It seems like that , connection created before bulkload ,but close method
> uninvoked at last
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
