Re: [DISCUSS] Official Docker Image at release time

2016-07-20 Thread Tsuyoshi Ozawa
Forwarding this discussion to Klaus.

- Tsuyoshi

On Tue, Jul 19, 2016 at 4:46 PM, Tsuyoshi Ozawa  wrote:
> Hi developers,
>
> Klaus mentioned the availability of an official docker image of Apache
> Hadoop. Is it time that we start to distribute an official docker
> image at release time?
>
> http://mail-archives.apache.org/mod_mbox/hadoop-user/201607.mbox/%3CSG2PR04MB162977CFE150444FA022510FB6370%40SG2PR04MB1629.apcprd04.prod.outlook.com%3E
>
> Thoughts?
>
> Thanks,
> - Tsuyoshi

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Resolved] (HADOOP-13383) Update release notes for 3.0.0-alpha1

2016-07-20 Thread Andrew Wang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-13383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Wang resolved HADOOP-13383.
--
   Resolution: Fixed
Fix Version/s: 3.0.0-alpha1

Thanks for the reviews Akira and Sangjin, committed to trunk and 
branch-3.0.0-alpha1.

> Update release notes for 3.0.0-alpha1
> -
>
> Key: HADOOP-13383
> URL: https://issues.apache.org/jira/browse/HADOOP-13383
> Project: Hadoop Common
>  Issue Type: Improvement
>  Components: documentation
>Affects Versions: 3.0.0-alpha1
>Reporter: Andrew Wang
>Assignee: Andrew Wang
>Priority: Blocker
> Fix For: 3.0.0-alpha1
>
> Attachments: HADOOP-13383.001.patch, HADOOP-13383.002.patch, 
> HADOOP-13383.003.patch, HADOOP-13383.004.patch
>
>
> Per the release instructions (https://wiki.apache.org/hadoop/HowToRelease), 
> we need to update hadoop-project/src/site/markdown/index.md.vm to reflect the 
> right versions, new features and big improvements.
> I can put together some notes for HADOOP and HDFS, depending on others for 
> YARN and MR.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



Re: [DISCUSS] 2.6.x line releases

2016-07-20 Thread Akira AJISAKA

Hi Sangjin,

I'm thinking it's time for 2.6.5 release. Now there are 51 fixed issues 
in 2.6.5 and the number is more than 2.6.4 (47).


> How long do we maintain this line? What would be a sensible EOL policy?

Ideally 5 years, because most of our customers in Japan are using Hadoop 
cluster without upgrading for about 5 years. However, it's probably 
impossible for us to achieve the long term maintenance in the community 
because the maintenance cost is too high. Therefore, my answer is 
"longer is better".


By the way, I'm thinking we can reduce the maintenance cost by selecting 
which branch to maintenance for a long time. An example is Ubuntu LTS. 
Ubuntu Server LTS is maintained for 5 years but the other releases are not.


Regards,
Akira

On 7/20/16 12:45, Sean Busbey wrote:

The HBase community would like more 2.6.z releases.

On Wed, Jul 20, 2016 at 2:00 PM, Ravi Prakash  wrote:

We for one are not using 2.6.*

On Tue, Jul 19, 2016 at 1:21 PM, Sangjin Lee  wrote:


It's been a while since we had a release on the 2.6.x line. Is it time to
get ready for a 2.6.5 release? Are folks using and relying on releases on
2.6.x? If there is enough interest, I could take that on. Let me know.

I also want to gauge the community's interest in maintaining the 2.6.x
line. How long do we maintain this line? What would be a sensible EOL
policy? Note that as the main code lines start diverging (java version,
features, etc.), the cost of maintaining multiple release lines does go up.
I'd love to hear your thoughts.

Regards,
Sangjin








-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



Re: [DISCUSS] 2.6.x line releases

2016-07-20 Thread Sean Busbey
The HBase community would like more 2.6.z releases.

On Wed, Jul 20, 2016 at 2:00 PM, Ravi Prakash  wrote:
> We for one are not using 2.6.*
>
> On Tue, Jul 19, 2016 at 1:21 PM, Sangjin Lee  wrote:
>
>> It's been a while since we had a release on the 2.6.x line. Is it time to
>> get ready for a 2.6.5 release? Are folks using and relying on releases on
>> 2.6.x? If there is enough interest, I could take that on. Let me know.
>>
>> I also want to gauge the community's interest in maintaining the 2.6.x
>> line. How long do we maintain this line? What would be a sensible EOL
>> policy? Note that as the main code lines start diverging (java version,
>> features, etc.), the cost of maintaining multiple release lines does go up.
>> I'd love to hear your thoughts.
>>
>> Regards,
>> Sangjin
>>



-- 
busbey

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



Re: Apache MSDN Offer is Back

2016-07-20 Thread Chris Nauroth
That definitely was possible under the old deal.  You could go through the MSDN 
site and download an iso for various versions of Windows and run it under 
VirtualBox.  The MSDN site also would furnish a license key that you could use 
to activate the machine.

I haven't yet gone through this new process to see if anything has changed in 
the benefits.

--Chris Nauroth

From: Ravi Prakash >
Date: Wednesday, July 20, 2016 at 12:04 PM
To: Chris Nauroth >
Cc: "common-dev@hadoop.apache.org" 
>, 
"hdfs-...@hadoop.apache.org" 
>, 
"yarn-...@hadoop.apache.org" 
>, 
"mapreduce-...@hadoop.apache.org" 
>
Subject: Re: Apache MSDN Offer is Back

Thanks Chris!

I did avail of the offer a few months ago, and wasn't able to figure out if a 
windows license was also available. I want to run windows inside a virtual 
machine on my Linux laptop, for the rare cases that there are patches that may 
affect that. Any clue if that is possible?

Thanks
Ravi

On Tue, Jul 19, 2016 at 4:09 PM, Chris Nauroth 
> wrote:
A few months ago, we learned that the offer for ASF committers to get an MSDN 
license had gone away.  I'm happy to report that as of a few weeks ago, that 
offer is back in place.  For more details, committers can check out 
https://svn.apache.org/repos/private/committers and read 
donated-licenses/msdn.txt.

--Chris Nauroth



Re: Apache MSDN Offer is Back

2016-07-20 Thread Ravi Prakash
Thanks Chris!

I did avail of the offer a few months ago, and wasn't able to figure out if
a windows license was also available. I want to run windows inside a
virtual machine on my Linux laptop, for the rare cases that there are
patches that may affect that. Any clue if that is possible?

Thanks
Ravi

On Tue, Jul 19, 2016 at 4:09 PM, Chris Nauroth 
wrote:

> A few months ago, we learned that the offer for ASF committers to get an
> MSDN license had gone away.  I'm happy to report that as of a few weeks
> ago, that offer is back in place.  For more details, committers can check
> out https://svn.apache.org/repos/private/committers and read
> donated-licenses/msdn.txt.
>
> --Chris Nauroth
>


Re: [DISCUSS] 2.6.x line releases

2016-07-20 Thread Ravi Prakash
We for one are not using 2.6.*

On Tue, Jul 19, 2016 at 1:21 PM, Sangjin Lee  wrote:

> It's been a while since we had a release on the 2.6.x line. Is it time to
> get ready for a 2.6.5 release? Are folks using and relying on releases on
> 2.6.x? If there is enough interest, I could take that on. Let me know.
>
> I also want to gauge the community's interest in maintaining the 2.6.x
> line. How long do we maintain this line? What would be a sensible EOL
> policy? Note that as the main code lines start diverging (java version,
> features, etc.), the cost of maintaining multiple release lines does go up.
> I'd love to hear your thoughts.
>
> Regards,
> Sangjin
>


[jira] [Resolved] (HADOOP-12588) Fix intermittent test failure of TestGangliaMetrics

2016-07-20 Thread Vinod Kumar Vavilapalli (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-12588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vinod Kumar Vavilapalli resolved HADOOP-12588.
--
Resolution: Fixed

I'm about to release 2.7.3, so this can't be in open state unless the original 
patch gets reverted. Instead, let's open a new JIRA for more fixes.

> Fix intermittent test failure of TestGangliaMetrics
> ---
>
> Key: HADOOP-12588
> URL: https://issues.apache.org/jira/browse/HADOOP-12588
> Project: Hadoop Common
>  Issue Type: Bug
>Reporter: Tsuyoshi Ozawa
>Assignee: Masatake Iwasaki
> Fix For: 2.8.0, 2.7.3
>
> Attachments: HADOOP-12588.001.patch, HADOOP-12588.addendum.02.patch, 
> HADOOP-12588.addendum.03.patch, HADOOP-12588.addendum.patch
>
>
> Jenkins found this test failure on HADOOP-11149.
> {quote}
> Tests run: 2, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 0.773 sec <<< 
> FAILURE! - in org.apache.hadoop.metrics2.impl.TestGangliaMetrics
> testGangliaMetrics2(org.apache.hadoop.metrics2.impl.TestGangliaMetrics)  Time 
> elapsed: 0.39 sec  <<< FAILURE!
> java.lang.AssertionError: Missing metrics: test.s1rec.Xxx
>   at org.junit.Assert.fail(Assert.java:88)
>   at org.junit.Assert.assertTrue(Assert.java:41)
>   at 
> org.apache.hadoop.metrics2.impl.TestGangliaMetrics.checkMetrics(TestGangliaMetrics.java:159)
>   at 
> org.apache.hadoop.metrics2.impl.TestGangliaMetrics.testGangliaMetrics2(TestGangliaMetrics.java:137)
> {quote}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Created] (HADOOP-13393) [Azure Data Lake] Correction needed in fs.defaultFS support in documentation

2016-07-20 Thread Vishwajeet Dusane (JIRA)
Vishwajeet Dusane created HADOOP-13393:
--

 Summary: [Azure Data Lake] Correction needed in fs.defaultFS 
support in documentation
 Key: HADOOP-13393
 URL: https://issues.apache.org/jira/browse/HADOOP-13393
 Project: Hadoop Common
  Issue Type: Bug
  Components: fs/azure
Reporter: Vishwajeet Dusane


Azure data lake does not support fs.defaultFS pointing to adls storage as of 
today.So documentation to point fs.defaultFS configuration is confusing to 
customer integrating adls configuration in there storage.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Created] (HADOOP-13392) [Azure Data Lake] OAuth2 configuration should be default set to true when AdlFileSystem is configured.

2016-07-20 Thread Vishwajeet Dusane (JIRA)
Vishwajeet Dusane created HADOOP-13392:
--

 Summary: [Azure Data Lake] OAuth2 configuration should be default 
set to true when AdlFileSystem is configured. 
 Key: HADOOP-13392
 URL: https://issues.apache.org/jira/browse/HADOOP-13392
 Project: Hadoop Common
  Issue Type: Bug
  Components: fs/azure
Reporter: Vishwajeet Dusane


OAuth2 configuration is optional in case of WebHdfsFileSystem configuration. 
However OAuth2 configuration should be default set to true when AdlFileSystem 
is configured. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2016-07-20 Thread Apache Jenkins Server
For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/100/

[Jul 19, 2016 10:33:28 AM] (varunsaxena) YARN-4996. Make 
TestNMReconnect.testCompareRMNodeAfterReconnect()
[Jul 19, 2016 2:17:58 PM] (junping_du) YARN-5213. Fix a bug in LogCLIHelpers 
which cause
[Jul 19, 2016 5:43:19 PM] (Arun Suresh) Revert "YARN=5181. ClusterNodeTracker: 
add method to get list of nodes
[Jul 19, 2016 5:43:37 PM] (Arun Suresh) YARN-5181. ClusterNodeTracker: add 
method to get list of nodes matching
[Jul 19, 2016 8:49:24 PM] (aajisaka) HDFS-10603. Fix flaky tests in
[Jul 19, 2016 9:46:07 PM] (aajisaka) HDFS-10647. Add a link to HDFS disk 
balancer document in site.xml.
[Jul 19, 2016 10:13:01 PM] (aajisaka) HDFS-10620. StringBuilder created and 
appended even if logging is
[Jul 19, 2016 11:05:48 PM] (aajisaka) HADOOP-12991. Conflicting default ports 
in DelegateToFileSystem.
[Jul 20, 2016 3:15:37 AM] (sjlee) MAPREDUCE-6365. Refactor 
JobResourceUploader#uploadFilesInternal (Chris
[Jul 20, 2016 6:03:58 AM] (Arun Suresh) YARN-5350. Distributed Scheduling: 
Ensure sort order of allocatable




-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org