[jira] [Created] (YARN-2143) Merge common killContainer logic of Fair/Capacity scheduler into AbstractYarnScheduler

[Wangda Tan (JIRA)]

Wangda Tan created YARN-2143:


 Summary: Merge common killContainer logic of Fair/Capacity 
scheduler into AbstractYarnScheduler
 Key: YARN-2143
 URL: https://issues.apache.org/jira/browse/YARN-2143
 Project: Hadoop YARN
  Issue Type: Task
  Components: resourcemanager, scheduler
Reporter: Wangda Tan


Currently, CapacityScheduler has killContainer API inherited from 
PreemptableResourceScheduler, and FairScheduler uses warnOrKillContainer to do 
container preemption. We'd better to merge common code to kill container into 
AbstractYarnScheduler.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Hadoop-Yarn-trunk - Build # 579 - Still Failing

[Apache Jenkins Server]

See https://builds.apache.org/job/Hadoop-Yarn-trunk/579/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 16179 lines...]

Failed tests: 
  TestRMAdminCLI.testHelp:307->testError:366 null

Tests in error: 
  TestRMAdminCLI.testTransitionToActive:180 » UnsupportedOperation

Tests run: 127, Failures: 1, Errors: 1, Skipped: 0

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] hadoop-yarn ... SUCCESS [4.235s]
[INFO] hadoop-yarn-api ... SUCCESS [3:24.637s]
[INFO] hadoop-yarn-common  SUCCESS [2:22.398s]
[INFO] hadoop-yarn-server  SUCCESS [0.081s]
[INFO] hadoop-yarn-server-common . SUCCESS [38.331s]
[INFO] hadoop-yarn-server-nodemanager  SUCCESS [4:49.673s]
[INFO] hadoop-yarn-server-web-proxy .. SUCCESS [22.711s]
[INFO] hadoop-yarn-server-applicationhistoryservice .. SUCCESS [1:27.234s]
[INFO] hadoop-yarn-server-resourcemanager  SUCCESS [22:38.577s]
[INFO] hadoop-yarn-server-tests .. SUCCESS [1:22.228s]
[INFO] hadoop-yarn-client  FAILURE [8:16.478s]
[INFO] hadoop-yarn-applications .. SKIPPED
[INFO] hadoop-yarn-applications-distributedshell . SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher  SKIPPED
[INFO] hadoop-yarn-site .. SKIPPED
[INFO] hadoop-yarn-project ... SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 45:29.054s
[INFO] Finished at: Tue Jun 10 11:21:51 UTC 2014
[INFO] Final Memory: 62M/619M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.16:test (default-test) on 
project hadoop-yarn-client: There are test failures.
[ERROR] 
[ERROR] Please refer to 
/home/jenkins/jenkins-slave/workspace/Hadoop-Yarn-trunk/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/target/surefire-reports
 for the individual test results.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-yarn-client
Build step 'Execute shell' marked build as failure
Archiving artifacts
Updating YARN-2030
Updating HADOOP-9099
Updating HDFS-6399
Updating HDFS-6460
Updating HDFS-6257
Updating HADOOP-10664
Sending e-mails to: yarn-dev@hadoop.apache.org
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
No tests ran.

Build failed in Jenkins: Hadoop-Yarn-trunk #579

[Apache Jenkins Server]

See 

Changes:

[jianhe] YARN-2030. Augmented RMStateStore with state machine. Contributed by 
Binglin Chang

[wang] HDFS-6460. Ignore stale and decommissioned nodes in 
NetworkTopology#sortByDistance. Contributed by Yongjun Zhang.

[jianhe] Augmented RMStateStore with state machine. Contributed by Binglin 
Chang.

[atm] Moving CHANGES.txt entry for HADOOP-9099 to the correct section.

[atm] HADOOP-10664. TestNetUtils.testNormalizeHostName fails. Contributed by 
Aaron T. Myers.

[wang] HDFS-6399. Add note about setfacl in HDFS permissions guide. Contributed 
by Chris Nauroth.

[cmccabe] HDFS-6257. TestCacheDirectives#testExceedsCapacity fails occasionally 
(cmccabe)

--
[...truncated 15986 lines...]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (depcheck) @ 
hadoop-yarn-server-resourcemanager ---
[INFO] 
[INFO] --- maven-checkstyle-plugin:2.6:checkstyle (default-cli) @ 
hadoop-yarn-server-resourcemanager ---
[INFO] 
[INFO] There are 12265 checkstyle errors.
[WARNING] Unable to locate Source XRef to link to - DISABLED
[INFO] 
[INFO] --- findbugs-maven-plugin:2.3.2:findbugs (default-cli) @ 
hadoop-yarn-server-resourcemanager ---
[INFO] ** FindBugsMojo execute ***
[INFO] canGenerate is true
[INFO] ** FindBugsMojo executeFindbugs ***
[INFO] Temp File is 

[INFO] Fork Value is true
[INFO] xmlOutput is true
[INFO] 
[INFO] 
[INFO] Building hadoop-yarn-server-tests 3.0.0-SNAPSHOT
[INFO] 
[WARNING] The POM for org.eclipse.m2e:lifecycle-mapping:jar:1.0.0 is missing, 
no dependency information available
[WARNING] Failed to retrieve plugin descriptor for 
org.eclipse.m2e:lifecycle-mapping:1.0.0: Plugin 
org.eclipse.m2e:lifecycle-mapping:1.0.0 or one of its dependencies could not be 
resolved: Failed to read artifact descriptor for 
org.eclipse.m2e:lifecycle-mapping:jar:1.0.0
[INFO] 
[INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ 
hadoop-yarn-server-tests ---
[INFO] Deleting 

[INFO] 
[INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ 
hadoop-yarn-server-tests ---
[INFO] Executing tasks

main:
[mkdir] Created dir: 

[INFO] Executed tasks
[INFO] 
[INFO] --- maven-resources-plugin:2.2:resources (default-resources) @ 
hadoop-yarn-server-tests ---
[INFO] Using default encoding to copy filtered resources.
[INFO] 
[INFO] --- maven-compiler-plugin:2.5.1:compile (default-compile) @ 
hadoop-yarn-server-tests ---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-resources-plugin:2.2:testResources (default-testResources) @ 
hadoop-yarn-server-tests ---
[INFO] Using default encoding to copy filtered resources.
[INFO] 
[INFO] --- maven-compiler-plugin:2.5.1:testCompile (default-testCompile) @ 
hadoop-yarn-server-tests ---
[INFO] Compiling 5 source files to 

[INFO] 
[INFO] --- maven-jar-plugin:2.3.1:test-jar (default) @ hadoop-yarn-server-tests 
---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-surefire-plugin:2.16:test (default-test) @ 
hadoop-yarn-server-tests ---
[INFO] Surefire report directory: 


---
 T E S T S
---

---
 T E S T S
---
Running org.apache.hadoop.yarn.server.TestRMNMSecretKeys
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.91 sec - in 
org.apache.hadoop.yarn.server.TestRMNMSecretKeys
Running org.apache.hadoop.yarn.server.TestMiniYARNClusterForHA
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.03 sec - in 
org.apache.hadoop.yarn.server.TestMiniYARNClusterForHA
Running org.apache.hadoop.yarn.server.TestContainerManagerSecurity
Tests run: 2, Failures: 0, Errors: 0, Skipped:

Re: hadoop-2.5 - June end?

[Sandy Ryza]

That sounds reasonable to me.

-Sandy


On Mon, Jun 9, 2014 at 9:39 AM, Arun C Murthy  wrote:

> Folks,
>
>  As you can see from the Roadmap wiki, it looks like several items are
> still a bit away from being ready.
>
>  I think rather than wait for them, it will be useful to create an
> intermediate release (2.5) this month - I think ATS security is pretty
> close, so we can ship that. I'm thinking of creating hadoop-2.5 by end of
> the month, with a branch a couple of weeks prior.
>
>  Thoughts?
>
> thanks,
> Arun
>
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>

Re: hadoop-2.5 - June end?

[Suresh Srinivas]

We should also include extended attributes feature for HDFS from HDFS-2006
for release 2.5.


On Mon, Jun 9, 2014 at 9:39 AM, Arun C Murthy  wrote:

> Folks,
>
>  As you can see from the Roadmap wiki, it looks like several items are
> still a bit away from being ready.
>
>  I think rather than wait for them, it will be useful to create an
> intermediate release (2.5) this month - I think ATS security is pretty
> close, so we can ship that. I'm thinking of creating hadoop-2.5 by end of
> the month, with a branch a couple of weeks prior.
>
>  Thoughts?
>
> thanks,
> Arun
>
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>



-- 
http://hortonworks.com/download/

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Success: YARN-1424 PreCommit Build #3950

[Apache Jenkins Server]

Jira: https://issues.apache.org/jira/browse/YARN-1424
Build: https://builds.apache.org/job/PreCommit-YARN-Build/3950/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 3035 lines...]


{color:green}+1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12649605/YARN1424-04.patch
  against trunk revision .

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 2 new 
or modified test files.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javadoc{color}.  There were no new javadoc warning messages.

{color:green}+1 eclipse:eclipse{color}.  The patch built with 
eclipse:eclipse.

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 1.3.9) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 core tests{color}.  The patch passed unit tests in 
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api 
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager.

{color:green}+1 contrib tests{color}.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-YARN-Build/3950//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/3950//console

This message is automatically generated.


==
==
Adding comment to Jira.
==
==


Comment added.
905fdfc2e742f5f31d9d54201279ab5c32577be6 logged out


==
==
Finished build.
==
==


Archiving artifacts
Sending artifact delta relative to PreCommit-YARN-Build #3947
Archived 22 artifacts
Archive block size is 32768
Received 230 blocks and 867940 bytes
Compression is 89.7%
Took 0.69 sec
Description set: YARN-1424
Recording test results
Email was triggered for: Success
Sending email for trigger: Success



###
## FAILED TESTS (if any) 
##
All tests passed

Re: hadoop-2.5 - June end?

[Ravi Prakash]

Does this also mean that there won't be a 2.4.1 Apache release?



On Tuesday, June 10, 2014 9:45 AM, Suresh Srinivas  
wrote:
 


We should also include extended attributes feature for HDFS from HDFS-2006
for release 2.5.


On Mon, Jun 9, 2014 at 9:39 AM, Arun C Murthy  wrote:

> Folks,
>
>  As you can see from the Roadmap wiki, it looks like several items are
> still a bit away from being ready.
>
>  I think rather than wait for them, it will be useful to create an
> intermediate release (2.5) this month - I think ATS security is pretty
> close, so we can ship that. I'm thinking of creating hadoop-2.5 by end of
> the month, with a branch a couple of weeks prior.
>
>  Thoughts?
>
> thanks,
> Arun
>
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>



-- 
http://hortonworks.com/download/


-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Success: YARN-1339 PreCommit Build #3951

[Apache Jenkins Server]

Jira: https://issues.apache.org/jira/browse/YARN-1339
Build: https://builds.apache.org/job/PreCommit-YARN-Build/3951/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 3026 lines...]


{color:green}+1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12649673/YARN-1339v6.patch
  against trunk revision .

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 3 new 
or modified test files.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javadoc{color}.  There were no new javadoc warning messages.

{color:green}+1 eclipse:eclipse{color}.  The patch built with 
eclipse:eclipse.

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 1.3.9) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 core tests{color}.  The patch passed unit tests in 
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager.

{color:green}+1 contrib tests{color}.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-YARN-Build/3951//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/3951//console

This message is automatically generated.


==
==
Adding comment to Jira.
==
==


Comment added.
814909f58bd15b380a7c893c8afe221007d6ca88 logged out


==
==
Finished build.
==
==


Archiving artifacts
Sending artifact delta relative to PreCommit-YARN-Build #3950
Archived 17 artifacts
Archive block size is 32768
Received 215 blocks and 1053837 bytes
Compression is 87.0%
Took 2.4 sec
Description set: YARN-1339
Recording test results
Email was triggered for: Success
Sending email for trigger: Success



###
## FAILED TESTS (if any) 
##
All tests passed

[jira] [Resolved] (YARN-1202) Verify RM HA works in secure clusters

[Vinod Kumar Vavilapalli (JIRA)]

 [ 
https://issues.apache.org/jira/browse/YARN-1202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vinod Kumar Vavilapalli resolved YARN-1202.
---

  Resolution: Won't Fix
Assignee: (was: Wing Yew Poon)
Target Version/s:   (was: )

The community has done enough work to validate RM fail-over in secure clusters. 
Closing this place-holder as Won't Fix.

> Verify RM HA works in secure clusters
> -
>
> Key: YARN-1202
> URL: https://issues.apache.org/jira/browse/YARN-1202
> Project: Hadoop YARN
>  Issue Type: Sub-task
>  Components: resourcemanager
>Reporter: Karthik Kambatla
>
> We should verify RM HA works in secure clusters, and fix any issues that we 
> come across.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

[jira] [Created] (YARN-2144) Add logs when preemption occurs

[Tassapol Athiapinya (JIRA)]

Tassapol Athiapinya created YARN-2144:
-

 Summary: Add logs when preemption occurs
 Key: YARN-2144
 URL: https://issues.apache.org/jira/browse/YARN-2144
 Project: Hadoop YARN
  Issue Type: Improvement
  Components: capacityscheduler
Affects Versions: 2.5.0
Reporter: Tassapol Athiapinya


There should be easy-to-read logs when preemption does occur. 
1. For debugging purpose, RM should log this.
2. For administrative purpose, RM webpage should have a page to show recent 
preemption events.

RM logs should have following properties:
* Logs are retrievable when an application is still running and often flushed.
* Can distinguish between AM container preemption and task container preemption 
with container ID shown.
* Should be INFO level log.




--
This message was sent by Atlassian JIRA
(v6.2#6252)

Re: hadoop-2.5 - June end?

[Arun C Murthy]

No, I'm currently in the middle of the 2.4.1 RC. Watch this space.

thanks,
Arun

On Jun 10, 2014, at 11:46 AM, Ravi Prakash  wrote:

> Does this also mean that there won't be a 2.4.1 Apache release?
> 
> 
> 
> On Tuesday, June 10, 2014 9:45 AM, Suresh Srinivas  
> wrote:
> 
> 
> 
> We should also include extended attributes feature for HDFS from HDFS-2006
> for release 2.5.
> 
> 
> On Mon, Jun 9, 2014 at 9:39 AM, Arun C Murthy  wrote:
> 
>> Folks,
>> 
>>   As you can see from the Roadmap wiki, it looks like several items are
>> still a bit away from being ready.
>> 
>>   I think rather than wait for them, it will be useful to create an
>> intermediate release (2.5) this month - I think ATS security is pretty
>> close, so we can ship that. I'm thinking of creating hadoop-2.5 by end of
>> the month, with a branch a couple of weeks prior.
>> 
>>   Thoughts?
>> 
>> thanks,
>> Arun
>> 
>> 
>> --
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity to
>> which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>> 
> 
> 
> 
> -- 
> http://hortonworks.com/download/
> 
> 
> -- 
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to 
> which it is addressed and may contain information that is confidential, 
> privileged and exempt from disclosure under applicable law. If the reader 
> of this message is not the intended recipient, you are hereby notified that 
> any printing, copying, dissemination, distribution, disclosure or 
> forwarding of this communication is strictly prohibited. If you have 
> received this communication in error, please contact the sender immediately 
> and delete it from your system. Thank You.

--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/



-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Failed: YARN-1514 PreCommit Build #3952

[Apache Jenkins Server]

Jira: https://issues.apache.org/jira/browse/YARN-1514
Build: https://builds.apache.org/job/PreCommit-YARN-Build/3952/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 3090 lines...]
{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12649700/YARN-1514.1.patch
  against trunk revision .

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 3 new 
or modified test files.

  {color:red}-1 javac{color}.  The applied patch generated 1279 javac 
compiler warnings (more than the trunk's current 1276 warnings).

{color:green}+1 javadoc{color}.  There were no new javadoc warning messages.

{color:green}+1 eclipse:eclipse{color}.  The patch built with 
eclipse:eclipse.

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 1.3.9) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 core tests{color}.  The patch passed unit tests in 
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager.

{color:green}+1 contrib tests{color}.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-YARN-Build/3952//testReport/
Javac warnings: 
https://builds.apache.org/job/PreCommit-YARN-Build/3952//artifact/trunk/patchprocess/diffJavacWarnings.txt
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/3952//console

This message is automatically generated.


==
==
Adding comment to Jira.
==
==


Comment added.
97fcec94aa43be2c256f386eae11cc7b11a1364c logged out


==
==
Finished build.
==
==


Build step 'Execute shell' marked build as failure
Archiving artifacts
Sending artifact delta relative to PreCommit-YARN-Build #3951
Archived 18 artifacts
Archive block size is 32768
Received 210 blocks and 1227061 bytes
Compression is 84.9%
Took 1.2 sec
[description-setter] Could not determine description.
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
All tests passed

Re: hadoop-2.5 - June end?

[Tsuyoshi OZAWA]

IMHO, it's useful to release 2.5 as intermediate release. The working
items which are not ready for 2.5 will be target for 2.6, right?

Thanks,
- Tsuyoshi

On Tue, Jun 10, 2014 at 5:03 PM,   wrote:
> Arun,
>
>  Any possibility of getting HDFS-6376 committed and backported into 2.5?
>
> Dave Marion
>
> -Original Message-
> From: Arun C Murthy [mailto:a...@hortonworks.com]
> Sent: Monday, June 09, 2014 12:40 PM
> To: common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org;
> yarn-dev@hadoop.apache.org; mapreduce-...@hadoop.apache.org
> Subject: hadoop-2.5 - June end?
>
> Folks,
>
>  As you can see from the Roadmap wiki, it looks like several items are still
> a bit away from being ready.
>
>  I think rather than wait for them, it will be useful to create an
> intermediate release (2.5) this month - I think ATS security is pretty
> close, so we can ship that. I'm thinking of creating hadoop-2.5 by end of
> the month, with a branch a couple of weeks prior.
>
>  Thoughts?
>
> thanks,
> Arun
>
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader of
> this message is not the intended recipient, you are hereby notified that any
> printing, copying, dissemination, distribution, disclosure or forwarding of
> this communication is strictly prohibited. If you have received this
> communication in error, please contact the sender immediately and delete it
> from your system. Thank You.
>



-- 
- Tsuyoshi

Success: YARN-1514 PreCommit Build #3953

[Apache Jenkins Server]

Jira: https://issues.apache.org/jira/browse/YARN-1514
Build: https://builds.apache.org/job/PreCommit-YARN-Build/3953/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 3018 lines...]


{color:green}+1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12649713/YARN-1514.2.patch
  against trunk revision .

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 3 new 
or modified test files.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javadoc{color}.  There were no new javadoc warning messages.

{color:green}+1 eclipse:eclipse{color}.  The patch built with 
eclipse:eclipse.

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 1.3.9) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 core tests{color}.  The patch passed unit tests in 
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager.

{color:green}+1 contrib tests{color}.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-YARN-Build/3953//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/3953//console

This message is automatically generated.


==
==
Adding comment to Jira.
==
==


Comment added.
4821c04e36a3f7c1f09dcdf8662e9a018fa3d621 logged out


==
==
Finished build.
==
==


Archiving artifacts
Sending artifact delta relative to PreCommit-YARN-Build #3951
Archived 17 artifacts
Archive block size is 32768
Received 212 blocks and 1164038 bytes
Compression is 85.6%
Took 2.6 sec
Description set: YARN-1514
Recording test results
Email was triggered for: Success
Sending email for trigger: Success



###
## FAILED TESTS (if any) 
##
All tests passed

Failed: YARN-2125 PreCommit Build #3954

[Apache Jenkins Server]

Jira: https://issues.apache.org/jira/browse/YARN-2125
Build: https://builds.apache.org/job/PreCommit-YARN-Build/3954/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 3126 lines...]
  http://issues.apache.org/jira/secure/attachment/12649720/YARN-2125.patch
  against trunk revision .

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:red}-1 tests included{color}.  The patch doesn't appear to include 
any new or modified tests.
Please justify why no new tests are needed for this 
patch.
Also please list what manual steps were performed to 
verify this patch.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javadoc{color}.  There were no new javadoc warning messages.

{color:green}+1 eclipse:eclipse{color}.  The patch built with 
eclipse:eclipse.

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 1.3.9) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 core tests{color}.  The patch passed unit tests in 
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager.

{color:green}+1 contrib tests{color}.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-YARN-Build/3954//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/3954//console

This message is automatically generated.


==
==
Adding comment to Jira.
==
==


Comment added.
8cbd4d6049615724d5404e6382ae8ddadb6bd003 logged out


==
==
Finished build.
==
==


Build step 'Execute shell' marked build as failure
Archiving artifacts
Sending artifact delta relative to PreCommit-YARN-Build #3953
Archived 17 artifacts
Archive block size is 32768
Received 40 blocks and 6778977 bytes
Compression is 16.2%
Took 3.1 sec
[description-setter] Could not determine description.
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
All tests passed

Success: YARN-2124 PreCommit Build #3955

[Apache Jenkins Server]

Jira: https://issues.apache.org/jira/browse/YARN-2124
Build: https://builds.apache.org/job/PreCommit-YARN-Build/3955/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 3127 lines...]


{color:green}+1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12649717/YARN-2124.patch
  against trunk revision .

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 2 new 
or modified test files.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javadoc{color}.  There were no new javadoc warning messages.

{color:green}+1 eclipse:eclipse{color}.  The patch built with 
eclipse:eclipse.

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 1.3.9) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 core tests{color}.  The patch passed unit tests in 
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager.

{color:green}+1 contrib tests{color}.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-YARN-Build/3955//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/3955//console

This message is automatically generated.


==
==
Adding comment to Jira.
==
==


Comment added.
32bdebb4009d4f76974fd7c79c9ca907f7f0c263 logged out


==
==
Finished build.
==
==


Archiving artifacts
Sending artifact delta relative to PreCommit-YARN-Build #3953
Archived 17 artifacts
Archive block size is 32768
Received 43 blocks and 6696844 bytes
Compression is 17.4%
Took 2.3 sec
Description set: YARN-2124
Recording test results
Email was triggered for: Success
Sending email for trigger: Success



###
## FAILED TESTS (if any) 
##
All tests passed