Re: Don't want to receive the mails again

[Sandy Ryza]

Hi WangYu and Debashish,

To unsubscribe from these mailing lists, send something to -
unsubscr...@hadoop.apache.org.

-Sandy


On Mon, Jun 23, 2014 at 7:23 PM, Maity, Debashish <
debashish.ma...@softwareag.com> wrote:

> Yes please do not send me communication again.
>
>
> -Original Message-
> From: WangYu [mailto:wangyu0...@gmail.com]
> Sent: Tuesday, June 24, 2014 7:52 AM
> To: common-dev@hadoop.apache.org
> Cc: yarn-...@hadoop.apache.org
> Subject: Don't want to receive the mails again
>
> Please don't send me the communication any more.
>

Re: Plans of moving towards JDK7 in trunk

[Vinod Kumar Vavilapalli]

Hey all,

This one started as an innocuous thread of enabling JDK7 on trunk and now it 
seems like (haven't still finished reading the entire thing, and I started a 
while ago) it has become a full blown proposal on 2.x, 3.x and 4.x releases. 
Some of us haven't been tracking this (at least me and a few others who 
indicated offline as such) assuming this is only about letting Jenkins run 
JDK7, but it has the potential to impact all future work.

I propose we fork this thread into a new one which clarifies the topic clearly 
for others to follow too.

Thanks,
+Vinod

On Jun 23, 2014, at 1:53 PM, sanjay Radia  wrote:

> 
> On Jun 21, 2014, at 8:01 AM, Andrew Wang  wrote:
> 
>> This is why I'd like to keep my original proposal on the table: keep going
>> with branch-2 in the near term, while working towards a JDK8-based Hadoop 3
>> by April next year. It doesn't need to be a big bang release either. I'd be
>> delighted if we could rolling upgrade from one to the other. I just didn't
>> want to rule out the inclusion of some very compelling feature outright.
>> Trust me though, I'd be the first person to ask about compatibility if such
>> a feature does come up.
> 
> 
> Given your above statement  on compatibility (such as rolling upgrades),  it 
> should be fine for the JDK8-based-Hadoop-release to not be 3.0 and instead 
> merely be 2.x? Or do you have any incompatible changes to Hadoop protocol or 
> APIs in mind during the same time period?
> 
> sanjay
> -- 
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to 
> which it is addressed and may contain information that is confidential, 
> privileged and exempt from disclosure under applicable law. If the reader 
> of this message is not the intended recipient, you are hereby notified that 
> any printing, copying, dissemination, distribution, disclosure or 
> forwarding of this communication is strictly prohibited. If you have 
> received this communication in error, please contact the sender immediately 
> and delete it from your system. Thank You.


-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.


signature.asc
Description: Message signed with OpenPGP using GPGMail

[jira] [Resolved] (HADOOP-10742) Problems building with -Pnative on FreeBSD 10

[Chris Nauroth (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HADOOP-10742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Chris Nauroth resolved HADOOP-10742.


Resolution: Duplicate

Hello, [~pfg].  There is an uncommitted patch for this issue on YARN-1327, so 
I'm resolving this as duplicate.

> Problems building with -Pnative on FreeBSD 10
> -
>
> Key: HADOOP-10742
> URL: https://issues.apache.org/jira/browse/HADOOP-10742
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: build
>Affects Versions: 2.4.0
> Environment: $ uname -a
> FreeBSD kakumen 10.0-STABLE FreeBSD 10.0-STABLE #4 r267707: Sat Jun 21 
> 19:40:06 COT 2014 pfg@kakumen:/usr/obj/usr/src/sys/GENERIC  amd64
> $ cc --version
> FreeBSD clang version 3.4.1 (tags/RELEASE_34/dot1-final 208032) 20140512
> Target: x86_64-unknown-freebsd10.0
> Thread model: posix
> $ javac -version
> javac 1.6.0_32
>Reporter: Pedro Giffuni
>
>[mkdir] Created dir: 
> /usr/ports/devel/hadoop2/work/hadoop-2.4.0-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/native/target
>  [exec] -- The C compiler identification is Clang 3.4.1
>  [exec] -- The CXX compiler identification is Clang 3.4.1
>  [exec] -- Check for working C compiler: /usr/bin/cc
>  [exec] -- Check for working C compiler: /usr/bin/cc -- works
>  [exec] -- Detecting C compiler ABI info
>  [exec] -- Detecting C compiler ABI info - done
>  [exec] -- Check for working CXX compiler: /usr/bin/CC
>  [exec] -- Check for working CXX compiler: /usr/bin/CC -- works
>  [exec] -- Detecting CXX compiler ABI info
>  [exec] -- Detecting CXX compiler ABI info - done
>  [exec] -- Found JNI: /usr/local/openjdk6/jre/lib/amd64/libjawt.so  
>  [exec] -- Configuring done
>  [exec] -- Generating done
>  [exec] -- Build files have been written to: 
> /usr/ports/devel/hadoop2/work/hadoop-2.4.0-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/native
> ...
>  [exec] 
> /usr/ports/devel/hadoop2/work/hadoop-2.4.0-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.c:501:33:
>  error: use of undeclared identifier 'LOGIN_NAME_MAX'
>  [exec]   if (strncmp(*users, user, LOGIN_NAME_MAX) == 0) {
>  [exec] ^
>  [exec] 
> /usr/ports/devel/hadoop2/work/hadoop-2.4.0-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.c:842:25:
>  warning: implicit declaration of function 'basename' is invalid in C99 
> [-Wimplicit-function-declaration]
>  [exec]primary_app_dir, 
> basename(nmPrivate_credentials_file_copy));
>  [exec] ^
>  [exec] 
> /usr/ports/devel/hadoop2/work/hadoop-2.4.0-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.c:1221:15:
>  warning: using the result of an assignment as a condition without 
> parentheses [-Wparentheses]
>  [exec] while (ep = readdir(dp)) {
>  [exec]~~~^
>  [exec] 
> /usr/ports/devel/hadoop2/work/hadoop-2.4.0-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.c:1221:15:
>  note: place parentheses around the assignment to silence this warning
>  [exec] while (ep = readdir(dp)) {
>  [exec]   ^
>  [exec](   )
>  [exec] 
> /usr/ports/devel/hadoop2/work/hadoop-2.4.0-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.c:1221:15:
>  note: use '==' to turn this assignment into an equality comparison
>  [exec] while (ep = readdir(dp)) {
>  [exec]   ^
>  [exec]   ==
>  [exec] 
> /usr/ports/devel/hadoop2/work/hadoop-2.4.0-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.c:1250:48:
>  error: too many arguments to function call, expected 4, have 5
>  [exec] if (mount("none", mount_path, "cgroup", 0, controller) == 0) {
>  [exec] ~  ^~
>  [exec] /usr/include/sys/mount.h:929:1: note: 'mount' declared here
>  [exec] int mount(const char *, const char *, int, void *);
>  [exec] ^
>  [exec] 2 warnings and 2 errors generated.
>  [exec] *** Error code 1
>  [exec] 
>  [exec] St

Re: HADOOP-10742 - Using containers on non-linux ?

[Chris Nauroth]

We also have an uncommitted patch for getting the native code to build on
FreeBSD:

https://issues.apache.org/jira/browse/YARN-1327

If that patch works for you, then you might want to code review it, comment
on the issue, and then seek help from a committer to put it in the
repository.  I can help if needed.

Chris Nauroth
Hortonworks
http://hortonworks.com/



On Mon, Jun 23, 2014 at 8:38 PM, Vinod Kumar Vavilapalli  wrote:

> You can completely avoid building the native bits by skipping the *native* 
> flag
> to your build.
>
> +Vinod
>
> On Jun 23, 2014, at 5:24 PM, Pedro Giffuni  wrote:
>
> Hello;
>
> I was trying to build Hadoop 2.4.0 on FreeBSD 10 and while the Java stuff
> went fine, I got stuck in file:
>
> [exec]
> /usr/ports/devel/hadoop2/work/hadoop-2.4.0-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.c:1250:48:
> error: too many arguments to function call, expected 4, have 5
> [exec] if (mount("none", mount_path, "cgroup", 0, controller) ==
> 0) {
> [exec] ~ ^~
> [exec] /usr/include/sys/mount.h:929:1: note: 'mount' declared here
> [exec] int mount(const char *, const char *, int, void *);
> [exec] ^
> [exec] 2 warnings and 2 errors generated.
> [exec] *** Error code 1
> [exec]
> [exec] Stop.
> [exec] make[2]: stopped in
> /usr/ports/devel/hadoop2/work/hadoop-2.4.0-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/native
> [exec] *** Error code 1
> [exec]
> [exec] Stop.
> ...
>
> I don't know well the code, and I have never used linux but I would assume
> by the name that mount_cgroup() is meant to be linux dependent?
>
> Container Groups are, of course, not available on FreeBSD but perhaps they
> could be replaced by resource limits[1]. In any case, it would seem like
> the code should avoid attempting to build linux-specific features on
> non-linux.
>
> Regards,
>
> Pedro.
>
>
> [1]
>
> http://www.freebsd.org/doc/en_US.ISO8859-1/books/handbook/security-resourcelimits.html
>
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Re: hadoop-2.5 - June end?

[Vinod Kumar Vavilapalli]

I started reviewing YARN-1492 and synced up offline with Sangjin and Chris who 
are leading this. I proposed that we should get the reviews and commits going 
as they go and then mark the feature alpha, beta or stable depending on how far 
we are ahead with the feature and how it aligns with the release in progress.

+Vinod

On Jun 23, 2014, at 2:30 PM, Sangjin Lee  wrote:

> It would be great if we can consider the shared cache (YARN-1492) as part
> of 2.5. It obviously will depend on the reviews from folks, but the feature
> itself should be reasonably solid.
> 
> Thanks,
> Sangjin
> 
> 
> On Mon, Jun 23, 2014 at 2:24 PM, Arun C Murthy  wrote:
> 
>> Thanks Karthik!
>> 
>> I've updated https://wiki.apache.org/hadoop/Roadmap with features which
>> are very close to completion. Let's see if that makes sense and if we get
>> any further feedback.
>> 
>> Arun
>> 
>> On Jun 23, 2014, at 2:09 PM, Karthik Kambatla  wrote:
>> 
>>> I can pick up the RM duties for 2.5. If I run into any HDFS doubts, I
>> might
>>> need some help from someone more familiar with HDFS.
>>> 
>>> 
>>> On Mon, Jun 23, 2014 at 12:07 PM, Arun C Murthy 
>> wrote:
>>> 
 Folks,
 
 I'd appreciate some help here. Due to family reasons (all good ones),
 I'll be away for a couple of weeks. Can someone else pick up the RM
>> duties
 for hadoop-2.5? Maybe Andrew since he's expressed interest in the past?
>> I
 will pick up the thread again for hadoop-2.6, but I don't want to block
 hadoop-2.5 due to my non-availability.
 
 thanks,
 Arun
 
 On Jun 9, 2014, at 9:39 AM, Arun C Murthy  wrote:
 
> Folks,
> 
> As you can see from the Roadmap wiki, it looks like several items are
 still a bit away from being ready.
> 
> I think rather than wait for them, it will be useful to create an
 intermediate release (2.5) this month - I think ATS security is pretty
 close, so we can ship that. I'm thinking of creating hadoop-2.5 by end
>> of
 the month, with a branch a couple of weeks prior.
> 
> Thoughts?
> 
> thanks,
> Arun
> 
 
 
 
 --
 CONFIDENTIALITY NOTICE
 NOTICE: This message is intended for the use of the individual or
>> entity to
 which it is addressed and may contain information that is confidential,
 privileged and exempt from disclosure under applicable law. If the
>> reader
 of this message is not the intended recipient, you are hereby notified
>> that
 any printing, copying, dissemination, distribution, disclosure or
 forwarding of this communication is strictly prohibited. If you have
 received this communication in error, please contact the sender
>> immediately
 and delete it from your system. Thank You.
 
>> 
>> --
>> Arun C. Murthy
>> Hortonworks Inc.
>> http://hortonworks.com/hdp/
>> 
>> 
>> 
>> --
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity to
>> which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>> 


-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.


signature.asc
Description: Message signed with OpenPGP using GPGMail

Re: hadoop-2.5 - June end?

[Vinod Kumar Vavilapalli]

Tx Jian, updated the wiki.

+Vinod

On Jun 23, 2014, at 3:13 PM, Jian He  wrote:

> Just found the roadmap includes a wrong jira link for "RM Webservices
> YARN-1731", it should be YARN-1695
> .
> 
> Jian
> 
> 
> On Mon, Jun 23, 2014 at 2:51 PM, Karthik Kambatla 
> wrote:
> 
>> While YARN-1492 would greatly benefit performance, I think it might be a
>> little too ambitious at this point to include it in 2.5 without delaying
>> it.
>> 
>> As I mentioned before and from my offline conversation with Arun, we might
>> want to release 2.6 end of July and that might be a better vehicle for
>> YARN-1492.
>> 
>> 
>> On Mon, Jun 23, 2014 at 2:30 PM, Sangjin Lee  wrote:
>> 
>>> It would be great if we can consider the shared cache (YARN-1492) as part
>>> of 2.5. It obviously will depend on the reviews from folks, but the
>> feature
>>> itself should be reasonably solid.
>>> 
>>> Thanks,
>>> Sangjin
>>> 
>>> 
>>> On Mon, Jun 23, 2014 at 2:24 PM, Arun C Murthy 
>>> wrote:
>>> 
 Thanks Karthik!
 
 I've updated https://wiki.apache.org/hadoop/Roadmap with features
>> which
 are very close to completion. Let's see if that makes sense and if we
>> get
 any further feedback.
 
 Arun
 
 On Jun 23, 2014, at 2:09 PM, Karthik Kambatla 
>>> wrote:
 
> I can pick up the RM duties for 2.5. If I run into any HDFS doubts, I
 might
> need some help from someone more familiar with HDFS.
> 
> 
> On Mon, Jun 23, 2014 at 12:07 PM, Arun C Murthy >> 
 wrote:
> 
>> Folks,
>> 
>> I'd appreciate some help here. Due to family reasons (all good
>> ones),
>> I'll be away for a couple of weeks. Can someone else pick up the RM
 duties
>> for hadoop-2.5? Maybe Andrew since he's expressed interest in the
>>> past?
 I
>> will pick up the thread again for hadoop-2.6, but I don't want to
>>> block
>> hadoop-2.5 due to my non-availability.
>> 
>> thanks,
>> Arun
>> 
>> On Jun 9, 2014, at 9:39 AM, Arun C Murthy 
>>> wrote:
>> 
>>> Folks,
>>> 
>>> As you can see from the Roadmap wiki, it looks like several items
>> are
>> still a bit away from being ready.
>>> 
>>> I think rather than wait for them, it will be useful to create an
>> intermediate release (2.5) this month - I think ATS security is
>> pretty
>> close, so we can ship that. I'm thinking of creating hadoop-2.5 by
>> end
 of
>> the month, with a branch a couple of weeks prior.
>>> 
>>> Thoughts?
>>> 
>>> thanks,
>>> Arun
>>> 
>> 
>> 
>> 
>> --
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or
 entity to
>> which it is addressed and may contain information that is
>>> confidential,
>> privileged and exempt from disclosure under applicable law. If the
 reader
>> of this message is not the intended recipient, you are hereby
>> notified
 that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender
 immediately
>> and delete it from your system. Thank You.
>> 
 
 --
 Arun C. Murthy
 Hortonworks Inc.
 http://hortonworks.com/hdp/
 
 
 
 --
 CONFIDENTIALITY NOTICE
 NOTICE: This message is intended for the use of the individual or
>> entity
>>> to
 which it is addressed and may contain information that is confidential,
 privileged and exempt from disclosure under applicable law. If the
>> reader
 of this message is not the intended recipient, you are hereby notified
>>> that
 any printing, copying, dissemination, distribution, disclosure or
 forwarding of this communication is strictly prohibited. If you have
 received this communication in error, please contact the sender
>>> immediately
 and delete it from your system. Thank You.
 
>>> 
>> 
> 
> -- 
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to 
> which it is addressed and may contain information that is confidential, 
> privileged and exempt from disclosure under applicable law. If the reader 
> of this message is not the intended recipient, you are hereby notified that 
> any printing, copying, dissemination, distribution, disclosure or 
> forwarding of this communication is strictly prohibited. If you have 
> received this communication in error, please contact the sender immediately 
> and delete it from your system. Thank You.


-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended r

Re: HADOOP-10742 - Using containers on non-linux ?

[Vinod Kumar Vavilapalli]

You can completely avoid building the native bits by skipping the native flag 
to your build.

+Vinod

On Jun 23, 2014, at 5:24 PM, Pedro Giffuni  wrote:

> Hello;
> 
> I was trying to build Hadoop 2.4.0 on FreeBSD 10 and while the Java stuff 
> went fine, I got stuck in file:
> 
> [exec] 
> /usr/ports/devel/hadoop2/work/hadoop-2.4.0-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.c:1250:48:
>  error: too many arguments to function call, expected 4, have 5
> [exec] if (mount("none", mount_path, "cgroup", 0, controller) == 0) {
> [exec] ~ ^~
> [exec] /usr/include/sys/mount.h:929:1: note: 'mount' declared here
> [exec] int mount(const char *, const char *, int, void *);
> [exec] ^
> [exec] 2 warnings and 2 errors generated.
> [exec] *** Error code 1
> [exec]
> [exec] Stop.
> [exec] make[2]: stopped in 
> /usr/ports/devel/hadoop2/work/hadoop-2.4.0-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/native
> [exec] *** Error code 1
> [exec]
> [exec] Stop.
> ...
> 
> I don't know well the code, and I have never used linux but I would assume by 
> the name that mount_cgroup() is meant to be linux dependent?
> 
> Container Groups are, of course, not available on FreeBSD but perhaps they 
> could be replaced by resource limits[1]. In any case, it would seem like the 
> code should avoid attempting to build linux-specific features on non-linux.
> 
> Regards,
> 
> Pedro.
> 
> 
> [1]
> http://www.freebsd.org/doc/en_US.ISO8859-1/books/handbook/security-resourcelimits.html


-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.


signature.asc
Description: Message signed with OpenPGP using GPGMail

Re: [VOTE] Release Apache Hadoop 0.23.11

[Zhijie Shen]

+1 (non-binding)

built it from source and ram some MR examples successfully.


On Mon, Jun 23, 2014 at 11:59 PM, Mit Desai 
wrote:

> +1 (non-binding)
>
> Tested on: Fedora17
> -Successful build from src
> -Verified Signature
> -Deployed source to my single node cluster and ran couple of sample MR jobs
>
>
> -Mit Desai
>
>
>
>
>
> On 6/19/14, 10:14 AM, "Thomas Graves" 
> wrote:
>
> >Hey Everyone,
> >
> >There have been various bug fixes that have went into
> >branch-0.23 since the 0.23.10 release.  We think its time to do a 0.23.11.
> >
> >This is also the last planned release off of branch-0.23 we plan on doing.
> >
> >The RC is available at:
> >http://people.apache.org/~tgraves/hadoop-0.23.11-candidate-0/
> >
> >
> >The RC Tag in svn is here:
> >http://svn.apache.org/viewvc/hadoop/common/tags/release-0.23.11-rc0/
> >
> >The maven artifacts are available via repository.apache.org.
> >
> >Please try the release and vote; the vote will run for the usual 7 days
> >til June 26th.
> >
> >I am +1 (binding).
> >
> >thanks,
> >Tom Graves
> >
> >
> >
> >
>
>


-- 
Zhijie Shen
Hortonworks Inc.
http://hortonworks.com/

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

RE: Don't want to receive the mails again

[Maity, Debashish]

Yes please do not send me communication again.


-Original Message-
From: WangYu [mailto:wangyu0...@gmail.com] 
Sent: Tuesday, June 24, 2014 7:52 AM
To: common-dev@hadoop.apache.org
Cc: yarn-...@hadoop.apache.org
Subject: Don't want to receive the mails again

Please don't send me the communication any more.

Don't want to receive the mails again

[WangYu]

Please don’t send me the communication any more.

Re: hadoop-2.5 - June end?

[Akira AJISAKA]

Extended attributes (HDFS-2006) is already merged to branch-2,
so I'll update the Roadmap wiki to change it from 2.6 to 2.5.
Please correct me if I am wrong.

Thanks,
Akira

(2014/06/23 16:28), Tsuyoshi OZAWA wrote:

IMHO, I'd like to +1 to include YARN-1492 and work-preserving restart
in 2.6. I believe they are good improvement, but they are
work-in-progress and it takes a bit time to be done.

Thanks,
- Tsuyoshi

On Tue, Jun 24, 2014 at 7:13 AM, Jian He  wrote:

Just found the roadmap includes a wrong jira link for "RM Webservices
YARN-1731", it should be YARN-1695
.

Jian


On Mon, Jun 23, 2014 at 2:51 PM, Karthik Kambatla 
wrote:


While YARN-1492 would greatly benefit performance, I think it might be a
little too ambitious at this point to include it in 2.5 without delaying
it.

As I mentioned before and from my offline conversation with Arun, we might
want to release 2.6 end of July and that might be a better vehicle for
YARN-1492.


On Mon, Jun 23, 2014 at 2:30 PM, Sangjin Lee  wrote:


It would be great if we can consider the shared cache (YARN-1492) as part
of 2.5. It obviously will depend on the reviews from folks, but the

feature

itself should be reasonably solid.

Thanks,
Sangjin


On Mon, Jun 23, 2014 at 2:24 PM, Arun C Murthy 
wrote:


Thanks Karthik!

I've updated https://wiki.apache.org/hadoop/Roadmap with features

which

are very close to completion. Let's see if that makes sense and if we

get

any further feedback.

Arun

On Jun 23, 2014, at 2:09 PM, Karthik Kambatla 

wrote:



I can pick up the RM duties for 2.5. If I run into any HDFS doubts, I

might

need some help from someone more familiar with HDFS.


On Mon, Jun 23, 2014 at 12:07 PM, Arun C Murthy 


wrote:



Folks,

I'd appreciate some help here. Due to family reasons (all good

ones),

I'll be away for a couple of weeks. Can someone else pick up the RM

duties

for hadoop-2.5? Maybe Andrew since he's expressed interest in the

past?

I

will pick up the thread again for hadoop-2.6, but I don't want to

block

hadoop-2.5 due to my non-availability.

thanks,
Arun

On Jun 9, 2014, at 9:39 AM, Arun C Murthy 

wrote:



Folks,

As you can see from the Roadmap wiki, it looks like several items

are

still a bit away from being ready.


I think rather than wait for them, it will be useful to create an

intermediate release (2.5) this month - I think ATS security is

pretty

close, so we can ship that. I'm thinking of creating hadoop-2.5 by

end

of

the month, with a branch a couple of weeks prior.


Thoughts?

thanks,
Arun





--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or

entity to

which it is addressed and may contain information that is

confidential,

privileged and exempt from disclosure under applicable law. If the

reader

of this message is not the intended recipient, you are hereby

notified

that

any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender

immediately

and delete it from your system. Thank You.



--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/hdp/



--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or

entity

to

which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the

reader

of this message is not the intended recipient, you are hereby notified

that

any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender

immediately

and delete it from your system. Thank You.







--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.

[jira] [Created] (HADOOP-10743) Problem building hadoop -2.4.0 on FreeBSD 10 (without -Pnative)

[Pedro Giffuni (JIRA)]

Pedro Giffuni created HADOOP-10743:
--

 Summary: Problem building hadoop -2.4.0 on FreeBSD 10 (without 
-Pnative)
 Key: HADOOP-10743
 URL: https://issues.apache.org/jira/browse/HADOOP-10743
 Project: Hadoop Common
  Issue Type: Bug
  Components: build
Affects Versions: 2.4.0
 Environment: $ uname -a
FreeBSD kakumen 10.0-STABLE FreeBSD 10.0-STABLE #4 r267707: Sat Jun 21 19:40:06 
COT 2014 pfg@kakumen:/usr/obj/usr/src/sys/GENERIC  amd64
$ javac -version 
javac 1.6.0_32
$
Reporter: Pedro Giffuni


mapreduce-client-core fails to compile with java 1.6 on FreeBSD 10.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

HADOOP-10742 - Using containers on non-linux ?

[Pedro Giffuni]

Hello;

I was trying to build Hadoop 2.4.0 on FreeBSD 10 and while the Java 
stuff went fine, I got stuck in file:


 [exec] 
/usr/ports/devel/hadoop2/work/hadoop-2.4.0-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.c:1250:48: 
error: too many arguments to function call, expected 4, have 5
 [exec] if (mount("none", mount_path, "cgroup", 0, controller) 
== 0) {

 [exec] ~ ^~
 [exec] /usr/include/sys/mount.h:929:1: note: 'mount' declared here
 [exec] int mount(const char *, const char *, int, void *);
 [exec] ^
 [exec] 2 warnings and 2 errors generated.
 [exec] *** Error code 1
 [exec]
 [exec] Stop.
 [exec] make[2]: stopped in 
/usr/ports/devel/hadoop2/work/hadoop-2.4.0-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/native

 [exec] *** Error code 1
 [exec]
 [exec] Stop.
...

I don't know well the code, and I have never used linux but I would 
assume by the name that mount_cgroup() is meant to be linux dependent?


Container Groups are, of course, not available on FreeBSD but perhaps 
they could be replaced by resource limits[1]. In any case, it would seem 
like the code should avoid attempting to build linux-specific features 
on non-linux.


Regards,

Pedro.


[1]
http://www.freebsd.org/doc/en_US.ISO8859-1/books/handbook/security-resourcelimits.html

[jira] [Created] (HADOOP-10742) Problems building on FreeBSD 10

[Pedro Giffuni (JIRA)]

Pedro Giffuni created HADOOP-10742:
--

 Summary: Problems building on FreeBSD 10
 Key: HADOOP-10742
 URL: https://issues.apache.org/jira/browse/HADOOP-10742
 Project: Hadoop Common
  Issue Type: Bug
  Components: build
Affects Versions: 2.4.0
 Environment: $ uname -a
FreeBSD kakumen 10.0-STABLE FreeBSD 10.0-STABLE #4 r267707: Sat Jun 21 19:40:06 
COT 2014 pfg@kakumen:/usr/obj/usr/src/sys/GENERIC  amd64
$ cc --version
FreeBSD clang version 3.4.1 (tags/RELEASE_34/dot1-final 208032) 20140512
Target: x86_64-unknown-freebsd10.0
Thread model: posix
$ javac -version
javac 1.6.0_32

Reporter: Pedro Giffuni


   [mkdir] Created dir: 
/usr/ports/devel/hadoop2/work/hadoop-2.4.0-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/native/target
 [exec] -- The C compiler identification is Clang 3.4.1
 [exec] -- The CXX compiler identification is Clang 3.4.1
 [exec] -- Check for working C compiler: /usr/bin/cc
 [exec] -- Check for working C compiler: /usr/bin/cc -- works
 [exec] -- Detecting C compiler ABI info
 [exec] -- Detecting C compiler ABI info - done
 [exec] -- Check for working CXX compiler: /usr/bin/CC
 [exec] -- Check for working CXX compiler: /usr/bin/CC -- works
 [exec] -- Detecting CXX compiler ABI info
 [exec] -- Detecting CXX compiler ABI info - done
 [exec] -- Found JNI: /usr/local/openjdk6/jre/lib/amd64/libjawt.so  
 [exec] -- Configuring done
 [exec] -- Generating done
 [exec] -- Build files have been written to: 
/usr/ports/devel/hadoop2/work/hadoop-2.4.0-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/native
...
 [exec] 
/usr/ports/devel/hadoop2/work/hadoop-2.4.0-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.c:501:33:
 error: use of undeclared identifier 'LOGIN_NAME_MAX'
 [exec]   if (strncmp(*users, user, LOGIN_NAME_MAX) == 0) {
 [exec] ^
 [exec] 
/usr/ports/devel/hadoop2/work/hadoop-2.4.0-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.c:842:25:
 warning: implicit declaration of function 'basename' is invalid in C99 
[-Wimplicit-function-declaration]
 [exec]primary_app_dir, 
basename(nmPrivate_credentials_file_copy));
 [exec] ^
 [exec] 
/usr/ports/devel/hadoop2/work/hadoop-2.4.0-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.c:1221:15:
 warning: using the result of an assignment as a condition without parentheses 
[-Wparentheses]
 [exec] while (ep = readdir(dp)) {
 [exec]~~~^
 [exec] 
/usr/ports/devel/hadoop2/work/hadoop-2.4.0-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.c:1221:15:
 note: place parentheses around the assignment to silence this warning
 [exec] while (ep = readdir(dp)) {
 [exec]   ^
 [exec](   )
 [exec] 
/usr/ports/devel/hadoop2/work/hadoop-2.4.0-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.c:1221:15:
 note: use '==' to turn this assignment into an equality comparison
 [exec] while (ep = readdir(dp)) {
 [exec]   ^
 [exec]   ==
 [exec] 
/usr/ports/devel/hadoop2/work/hadoop-2.4.0-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.c:1250:48:
 error: too many arguments to function call, expected 4, have 5
 [exec] if (mount("none", mount_path, "cgroup", 0, controller) == 0) {
 [exec] ~  ^~
 [exec] /usr/include/sys/mount.h:929:1: note: 'mount' declared here
 [exec] int mount(const char *, const char *, int, void *);
 [exec] ^
 [exec] 2 warnings and 2 errors generated.
 [exec] *** Error code 1
 [exec] 
 [exec] Stop.
 [exec] make[2]: stopped in 
/usr/ports/devel/hadoop2/work/hadoop-2.4.0-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/native
 [exec] *** Error code 1
 [exec] 
 [exec] Stop.
 [exec] make[1]: stopped in 
/usr/ports/devel/hadoop2/work/hadoop-2.4.0-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/native
 [exec] *** Error code 1
 [exec]

Re: hadoop-2.5 - June end?

[Tsuyoshi OZAWA]

IMHO, I'd like to +1 to include YARN-1492 and work-preserving restart
in 2.6. I believe they are good improvement, but they are
work-in-progress and it takes a bit time to be done.

Thanks,
- Tsuyoshi

On Tue, Jun 24, 2014 at 7:13 AM, Jian He  wrote:
> Just found the roadmap includes a wrong jira link for "RM Webservices
> YARN-1731", it should be YARN-1695
> .
>
> Jian
>
>
> On Mon, Jun 23, 2014 at 2:51 PM, Karthik Kambatla 
> wrote:
>
>> While YARN-1492 would greatly benefit performance, I think it might be a
>> little too ambitious at this point to include it in 2.5 without delaying
>> it.
>>
>> As I mentioned before and from my offline conversation with Arun, we might
>> want to release 2.6 end of July and that might be a better vehicle for
>> YARN-1492.
>>
>>
>> On Mon, Jun 23, 2014 at 2:30 PM, Sangjin Lee  wrote:
>>
>> > It would be great if we can consider the shared cache (YARN-1492) as part
>> > of 2.5. It obviously will depend on the reviews from folks, but the
>> feature
>> > itself should be reasonably solid.
>> >
>> > Thanks,
>> > Sangjin
>> >
>> >
>> > On Mon, Jun 23, 2014 at 2:24 PM, Arun C Murthy 
>> > wrote:
>> >
>> > > Thanks Karthik!
>> > >
>> > > I've updated https://wiki.apache.org/hadoop/Roadmap with features
>> which
>> > > are very close to completion. Let's see if that makes sense and if we
>> get
>> > > any further feedback.
>> > >
>> > > Arun
>> > >
>> > > On Jun 23, 2014, at 2:09 PM, Karthik Kambatla 
>> > wrote:
>> > >
>> > > > I can pick up the RM duties for 2.5. If I run into any HDFS doubts, I
>> > > might
>> > > > need some help from someone more familiar with HDFS.
>> > > >
>> > > >
>> > > > On Mon, Jun 23, 2014 at 12:07 PM, Arun C Murthy > >
>> > > wrote:
>> > > >
>> > > >> Folks,
>> > > >>
>> > > >> I'd appreciate some help here. Due to family reasons (all good
>> ones),
>> > > >> I'll be away for a couple of weeks. Can someone else pick up the RM
>> > > duties
>> > > >> for hadoop-2.5? Maybe Andrew since he's expressed interest in the
>> > past?
>> > > I
>> > > >> will pick up the thread again for hadoop-2.6, but I don't want to
>> > block
>> > > >> hadoop-2.5 due to my non-availability.
>> > > >>
>> > > >> thanks,
>> > > >> Arun
>> > > >>
>> > > >> On Jun 9, 2014, at 9:39 AM, Arun C Murthy 
>> > wrote:
>> > > >>
>> > > >>> Folks,
>> > > >>>
>> > > >>> As you can see from the Roadmap wiki, it looks like several items
>> are
>> > > >> still a bit away from being ready.
>> > > >>>
>> > > >>> I think rather than wait for them, it will be useful to create an
>> > > >> intermediate release (2.5) this month - I think ATS security is
>> pretty
>> > > >> close, so we can ship that. I'm thinking of creating hadoop-2.5 by
>> end
>> > > of
>> > > >> the month, with a branch a couple of weeks prior.
>> > > >>>
>> > > >>> Thoughts?
>> > > >>>
>> > > >>> thanks,
>> > > >>> Arun
>> > > >>>
>> > > >>
>> > > >>
>> > > >>
>> > > >> --
>> > > >> CONFIDENTIALITY NOTICE
>> > > >> NOTICE: This message is intended for the use of the individual or
>> > > entity to
>> > > >> which it is addressed and may contain information that is
>> > confidential,
>> > > >> privileged and exempt from disclosure under applicable law. If the
>> > > reader
>> > > >> of this message is not the intended recipient, you are hereby
>> notified
>> > > that
>> > > >> any printing, copying, dissemination, distribution, disclosure or
>> > > >> forwarding of this communication is strictly prohibited. If you have
>> > > >> received this communication in error, please contact the sender
>> > > immediately
>> > > >> and delete it from your system. Thank You.
>> > > >>
>> > >
>> > > --
>> > > Arun C. Murthy
>> > > Hortonworks Inc.
>> > > http://hortonworks.com/hdp/
>> > >
>> > >
>> > >
>> > > --
>> > > CONFIDENTIALITY NOTICE
>> > > NOTICE: This message is intended for the use of the individual or
>> entity
>> > to
>> > > which it is addressed and may contain information that is confidential,
>> > > privileged and exempt from disclosure under applicable law. If the
>> reader
>> > > of this message is not the intended recipient, you are hereby notified
>> > that
>> > > any printing, copying, dissemination, distribution, disclosure or
>> > > forwarding of this communication is strictly prohibited. If you have
>> > > received this communication in error, please contact the sender
>> > immediately
>> > > and delete it from your system. Thank You.
>> > >
>> >
>>
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contac

[jira] [Created] (HADOOP-10741) A lightweight WebHDFS client library

[Tsz Wo Nicholas Sze (JIRA)]

Tsz Wo Nicholas Sze created HADOOP-10741:


 Summary: A lightweight WebHDFS client library
 Key: HADOOP-10741
 URL: https://issues.apache.org/jira/browse/HADOOP-10741
 Project: Hadoop Common
  Issue Type: New Feature
  Components: tools
Reporter: Tsz Wo Nicholas Sze
Assignee: Mohammad Kamrul Islam


One of the motivations for creating WebHDFS is for applications connecting to 
HDFS from outside the cluster.  In order to do so, users have to either
# install Hadoop and use WebHdfsFileSsytem, or
# develop their own client using the WebHDFS REST API.

For #1, it is very difficult to manage and unnecessarily complicated for other 
applications since Hadoop is not a lightweight library.  For #2, it is not easy 
to deal with security and handle transient errors.

Therefore, we propose adding a lightweight WebHDFS client as a separated 
library which does not depend on Common and HDFS.  The client can be packaged 
as a standalone jar.  Other applications simply add the jar to their classpath 
for using it.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Re: [DISCUSS] Change by-laws on release votes: 5 days instead of 7

[Arun Murthy]

Thanks everyone. I'll start a vote tmrw if there are no objections.

Arun


On Mon, Jun 23, 2014 at 12:06 PM, Jitendra Pandey 
wrote:

> +1, sounds good!
>
>
> On Mon, Jun 23, 2014 at 12:02 PM, Andrew Wang 
> wrote:
>
> > +1 here as well, let's do a vote thread (for 7 days, maybe for the last
> > time!)
> >
> >
> > On Mon, Jun 23, 2014 at 11:46 AM, Vinod Kumar Vavilapalli <
> > vino...@apache.org> wrote:
> >
> > > This seems reasonable, +1.
> > >
> > > In case there is inactivity, we already extend dates even today, we can
> > do
> > > the same going forward.
> > >
> > > I don't see major disagreements, time to start a vote?
> > >
> > > Thanks
> > > +Vinod
> > >
> > > On Jun 20, 2014, at 10:54 PM, Arun C Murthy 
> wrote:
> > >
> > > > Folks,
> > > >
> > > > I'd like to propose we change our by-laws to reduce our voting
> periods
> > > on new releases from 7 days to 5.
> > > >
> > > > Currently, it just takes too long to turn around releases;
> particularly
> > > if we have critical security fixes etc.
> > > >
> > > > Thoughts?
> > > >
> > > > thanks,
> > > > Arun
> > > >
> > > >
> > > > --
> > > > CONFIDENTIALITY NOTICE
> > > > NOTICE: This message is intended for the use of the individual or
> > entity
> > > to
> > > > which it is addressed and may contain information that is
> confidential,
> > > > privileged and exempt from disclosure under applicable law. If the
> > reader
> > > > of this message is not the intended recipient, you are hereby
> notified
> > > that
> > > > any printing, copying, dissemination, distribution, disclosure or
> > > > forwarding of this communication is strictly prohibited. If you have
> > > > received this communication in error, please contact the sender
> > > immediately
> > > > and delete it from your system. Thank You.
> > >
> > >
> > > --
> > > CONFIDENTIALITY NOTICE
> > > NOTICE: This message is intended for the use of the individual or
> entity
> > to
> > > which it is addressed and may contain information that is confidential,
> > > privileged and exempt from disclosure under applicable law. If the
> reader
> > > of this message is not the intended recipient, you are hereby notified
> > that
> > > any printing, copying, dissemination, distribution, disclosure or
> > > forwarding of this communication is strictly prohibited. If you have
> > > received this communication in error, please contact the sender
> > immediately
> > > and delete it from your system. Thank You.
> > >
> >
>
>
>
> --
> 
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>



-- 

--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

[jira] [Created] (HADOOP-10740) Add missing shebang line for the shell scripts

[Henry Saputra (JIRA)]

Henry Saputra created HADOOP-10740:
--

 Summary: Add missing shebang line for the shell scripts
 Key: HADOOP-10740
 URL: https://issues.apache.org/jira/browse/HADOOP-10740
 Project: Hadoop Common
  Issue Type: Improvement
Reporter: Henry Saputra
Assignee: Henry Saputra
Priority: Minor


Add missing shebang with bash line for .sh files



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Re: hadoop-2.5 - June end?

[Karthik Kambatla]

While YARN-1492 would greatly benefit performance, I think it might be a
little too ambitious at this point to include it in 2.5 without delaying
it.

As I mentioned before and from my offline conversation with Arun, we might
want to release 2.6 end of July and that might be a better vehicle for
YARN-1492.


On Mon, Jun 23, 2014 at 2:30 PM, Sangjin Lee  wrote:

> It would be great if we can consider the shared cache (YARN-1492) as part
> of 2.5. It obviously will depend on the reviews from folks, but the feature
> itself should be reasonably solid.
>
> Thanks,
> Sangjin
>
>
> On Mon, Jun 23, 2014 at 2:24 PM, Arun C Murthy 
> wrote:
>
> > Thanks Karthik!
> >
> > I've updated https://wiki.apache.org/hadoop/Roadmap with features which
> > are very close to completion. Let's see if that makes sense and if we get
> > any further feedback.
> >
> > Arun
> >
> > On Jun 23, 2014, at 2:09 PM, Karthik Kambatla 
> wrote:
> >
> > > I can pick up the RM duties for 2.5. If I run into any HDFS doubts, I
> > might
> > > need some help from someone more familiar with HDFS.
> > >
> > >
> > > On Mon, Jun 23, 2014 at 12:07 PM, Arun C Murthy 
> > wrote:
> > >
> > >> Folks,
> > >>
> > >> I'd appreciate some help here. Due to family reasons (all good ones),
> > >> I'll be away for a couple of weeks. Can someone else pick up the RM
> > duties
> > >> for hadoop-2.5? Maybe Andrew since he's expressed interest in the
> past?
> > I
> > >> will pick up the thread again for hadoop-2.6, but I don't want to
> block
> > >> hadoop-2.5 due to my non-availability.
> > >>
> > >> thanks,
> > >> Arun
> > >>
> > >> On Jun 9, 2014, at 9:39 AM, Arun C Murthy 
> wrote:
> > >>
> > >>> Folks,
> > >>>
> > >>> As you can see from the Roadmap wiki, it looks like several items are
> > >> still a bit away from being ready.
> > >>>
> > >>> I think rather than wait for them, it will be useful to create an
> > >> intermediate release (2.5) this month - I think ATS security is pretty
> > >> close, so we can ship that. I'm thinking of creating hadoop-2.5 by end
> > of
> > >> the month, with a branch a couple of weeks prior.
> > >>>
> > >>> Thoughts?
> > >>>
> > >>> thanks,
> > >>> Arun
> > >>>
> > >>
> > >>
> > >>
> > >> --
> > >> CONFIDENTIALITY NOTICE
> > >> NOTICE: This message is intended for the use of the individual or
> > entity to
> > >> which it is addressed and may contain information that is
> confidential,
> > >> privileged and exempt from disclosure under applicable law. If the
> > reader
> > >> of this message is not the intended recipient, you are hereby notified
> > that
> > >> any printing, copying, dissemination, distribution, disclosure or
> > >> forwarding of this communication is strictly prohibited. If you have
> > >> received this communication in error, please contact the sender
> > immediately
> > >> and delete it from your system. Thank You.
> > >>
> >
> > --
> > Arun C. Murthy
> > Hortonworks Inc.
> > http://hortonworks.com/hdp/
> >
> >
> >
> > --
> > CONFIDENTIALITY NOTICE
> > NOTICE: This message is intended for the use of the individual or entity
> to
> > which it is addressed and may contain information that is confidential,
> > privileged and exempt from disclosure under applicable law. If the reader
> > of this message is not the intended recipient, you are hereby notified
> that
> > any printing, copying, dissemination, distribution, disclosure or
> > forwarding of this communication is strictly prohibited. If you have
> > received this communication in error, please contact the sender
> immediately
> > and delete it from your system. Thank You.
> >
>

Re: hadoop-2.5 - June end?

[Andrew Wang]

Thanks for volunteering Karthik, I can help out with anything on the HDFS
side if you need it.

Best,
Andrew


On Mon, Jun 23, 2014 at 2:30 PM, Sangjin Lee  wrote:

> It would be great if we can consider the shared cache (YARN-1492) as part
> of 2.5. It obviously will depend on the reviews from folks, but the feature
> itself should be reasonably solid.
>
> Thanks,
> Sangjin
>
>
> On Mon, Jun 23, 2014 at 2:24 PM, Arun C Murthy 
> wrote:
>
> > Thanks Karthik!
> >
> > I've updated https://wiki.apache.org/hadoop/Roadmap with features which
> > are very close to completion. Let's see if that makes sense and if we get
> > any further feedback.
> >
> > Arun
> >
> > On Jun 23, 2014, at 2:09 PM, Karthik Kambatla 
> wrote:
> >
> > > I can pick up the RM duties for 2.5. If I run into any HDFS doubts, I
> > might
> > > need some help from someone more familiar with HDFS.
> > >
> > >
> > > On Mon, Jun 23, 2014 at 12:07 PM, Arun C Murthy 
> > wrote:
> > >
> > >> Folks,
> > >>
> > >> I'd appreciate some help here. Due to family reasons (all good ones),
> > >> I'll be away for a couple of weeks. Can someone else pick up the RM
> > duties
> > >> for hadoop-2.5? Maybe Andrew since he's expressed interest in the
> past?
> > I
> > >> will pick up the thread again for hadoop-2.6, but I don't want to
> block
> > >> hadoop-2.5 due to my non-availability.
> > >>
> > >> thanks,
> > >> Arun
> > >>
> > >> On Jun 9, 2014, at 9:39 AM, Arun C Murthy 
> wrote:
> > >>
> > >>> Folks,
> > >>>
> > >>> As you can see from the Roadmap wiki, it looks like several items are
> > >> still a bit away from being ready.
> > >>>
> > >>> I think rather than wait for them, it will be useful to create an
> > >> intermediate release (2.5) this month - I think ATS security is pretty
> > >> close, so we can ship that. I'm thinking of creating hadoop-2.5 by end
> > of
> > >> the month, with a branch a couple of weeks prior.
> > >>>
> > >>> Thoughts?
> > >>>
> > >>> thanks,
> > >>> Arun
> > >>>
> > >>
> > >>
> > >>
> > >> --
> > >> CONFIDENTIALITY NOTICE
> > >> NOTICE: This message is intended for the use of the individual or
> > entity to
> > >> which it is addressed and may contain information that is
> confidential,
> > >> privileged and exempt from disclosure under applicable law. If the
> > reader
> > >> of this message is not the intended recipient, you are hereby notified
> > that
> > >> any printing, copying, dissemination, distribution, disclosure or
> > >> forwarding of this communication is strictly prohibited. If you have
> > >> received this communication in error, please contact the sender
> > immediately
> > >> and delete it from your system. Thank You.
> > >>
> >
> > --
> > Arun C. Murthy
> > Hortonworks Inc.
> > http://hortonworks.com/hdp/
> >
> >
> >
> > --
> > CONFIDENTIALITY NOTICE
> > NOTICE: This message is intended for the use of the individual or entity
> to
> > which it is addressed and may contain information that is confidential,
> > privileged and exempt from disclosure under applicable law. If the reader
> > of this message is not the intended recipient, you are hereby notified
> that
> > any printing, copying, dissemination, distribution, disclosure or
> > forwarding of this communication is strictly prohibited. If you have
> > received this communication in error, please contact the sender
> immediately
> > and delete it from your system. Thank You.
> >
>

Re: hadoop-2.5 - June end?

[Sangjin Lee]

It would be great if we can consider the shared cache (YARN-1492) as part
of 2.5. It obviously will depend on the reviews from folks, but the feature
itself should be reasonably solid.

Thanks,
Sangjin


On Mon, Jun 23, 2014 at 2:24 PM, Arun C Murthy  wrote:

> Thanks Karthik!
>
> I've updated https://wiki.apache.org/hadoop/Roadmap with features which
> are very close to completion. Let's see if that makes sense and if we get
> any further feedback.
>
> Arun
>
> On Jun 23, 2014, at 2:09 PM, Karthik Kambatla  wrote:
>
> > I can pick up the RM duties for 2.5. If I run into any HDFS doubts, I
> might
> > need some help from someone more familiar with HDFS.
> >
> >
> > On Mon, Jun 23, 2014 at 12:07 PM, Arun C Murthy 
> wrote:
> >
> >> Folks,
> >>
> >> I'd appreciate some help here. Due to family reasons (all good ones),
> >> I'll be away for a couple of weeks. Can someone else pick up the RM
> duties
> >> for hadoop-2.5? Maybe Andrew since he's expressed interest in the past?
> I
> >> will pick up the thread again for hadoop-2.6, but I don't want to block
> >> hadoop-2.5 due to my non-availability.
> >>
> >> thanks,
> >> Arun
> >>
> >> On Jun 9, 2014, at 9:39 AM, Arun C Murthy  wrote:
> >>
> >>> Folks,
> >>>
> >>> As you can see from the Roadmap wiki, it looks like several items are
> >> still a bit away from being ready.
> >>>
> >>> I think rather than wait for them, it will be useful to create an
> >> intermediate release (2.5) this month - I think ATS security is pretty
> >> close, so we can ship that. I'm thinking of creating hadoop-2.5 by end
> of
> >> the month, with a branch a couple of weeks prior.
> >>>
> >>> Thoughts?
> >>>
> >>> thanks,
> >>> Arun
> >>>
> >>
> >>
> >>
> >> --
> >> CONFIDENTIALITY NOTICE
> >> NOTICE: This message is intended for the use of the individual or
> entity to
> >> which it is addressed and may contain information that is confidential,
> >> privileged and exempt from disclosure under applicable law. If the
> reader
> >> of this message is not the intended recipient, you are hereby notified
> that
> >> any printing, copying, dissemination, distribution, disclosure or
> >> forwarding of this communication is strictly prohibited. If you have
> >> received this communication in error, please contact the sender
> immediately
> >> and delete it from your system. Thank You.
> >>
>
> --
> Arun C. Murthy
> Hortonworks Inc.
> http://hortonworks.com/hdp/
>
>
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>

Re: hadoop-2.5 - June end?

[Arun C Murthy]

Thanks Karthik!

I've updated https://wiki.apache.org/hadoop/Roadmap with features which are 
very close to completion. Let's see if that makes sense and if we get any 
further feedback.

Arun

On Jun 23, 2014, at 2:09 PM, Karthik Kambatla  wrote:

> I can pick up the RM duties for 2.5. If I run into any HDFS doubts, I might
> need some help from someone more familiar with HDFS.
> 
> 
> On Mon, Jun 23, 2014 at 12:07 PM, Arun C Murthy  wrote:
> 
>> Folks,
>> 
>> I'd appreciate some help here. Due to family reasons (all good ones),
>> I'll be away for a couple of weeks. Can someone else pick up the RM duties
>> for hadoop-2.5? Maybe Andrew since he's expressed interest in the past? I
>> will pick up the thread again for hadoop-2.6, but I don't want to block
>> hadoop-2.5 due to my non-availability.
>> 
>> thanks,
>> Arun
>> 
>> On Jun 9, 2014, at 9:39 AM, Arun C Murthy  wrote:
>> 
>>> Folks,
>>> 
>>> As you can see from the Roadmap wiki, it looks like several items are
>> still a bit away from being ready.
>>> 
>>> I think rather than wait for them, it will be useful to create an
>> intermediate release (2.5) this month - I think ATS security is pretty
>> close, so we can ship that. I'm thinking of creating hadoop-2.5 by end of
>> the month, with a branch a couple of weeks prior.
>>> 
>>> Thoughts?
>>> 
>>> thanks,
>>> Arun
>>> 
>> 
>> 
>> 
>> --
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity to
>> which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>> 

--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/hdp/



-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Re: hadoop-2.5 - June end?

[Karthik Kambatla]

I can pick up the RM duties for 2.5. If I run into any HDFS doubts, I might
need some help from someone more familiar with HDFS.


On Mon, Jun 23, 2014 at 12:07 PM, Arun C Murthy  wrote:

> Folks,
>
>  I'd appreciate some help here. Due to family reasons (all good ones),
> I'll be away for a couple of weeks. Can someone else pick up the RM duties
> for hadoop-2.5? Maybe Andrew since he's expressed interest in the past? I
> will pick up the thread again for hadoop-2.6, but I don't want to block
> hadoop-2.5 due to my non-availability.
>
> thanks,
> Arun
>
> On Jun 9, 2014, at 9:39 AM, Arun C Murthy  wrote:
>
> > Folks,
> >
> > As you can see from the Roadmap wiki, it looks like several items are
> still a bit away from being ready.
> >
> > I think rather than wait for them, it will be useful to create an
> intermediate release (2.5) this month - I think ATS security is pretty
> close, so we can ship that. I'm thinking of creating hadoop-2.5 by end of
> the month, with a branch a couple of weeks prior.
> >
> > Thoughts?
> >
> > thanks,
> > Arun
> >
>
>
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>

Re: Plans of moving towards JDK7 in trunk

[Sandy Ryza]

Andrew, correct me if I'm misunderstanding, but the incompatible change
that would require a major version bump is dropping support for JDK6.


On Mon, Jun 23, 2014 at 1:53 PM, sanjay Radia 
wrote:

>
> On Jun 21, 2014, at 8:01 AM, Andrew Wang  wrote:
>
> > This is why I'd like to keep my original proposal on the table: keep
> going
> > with branch-2 in the near term, while working towards a JDK8-based
> Hadoop 3
> > by April next year. It doesn't need to be a big bang release either. I'd
> be
> > delighted if we could rolling upgrade from one to the other. I just
> didn't
> > want to rule out the inclusion of some very compelling feature outright.
> > Trust me though, I'd be the first person to ask about compatibility if
> such
> > a feature does come up.
>
>
> Given your above statement  on compatibility (such as rolling upgrades),
>  it should be fine for the JDK8-based-Hadoop-release to not be 3.0 and
> instead merely be 2.x? Or do you have any incompatible changes to Hadoop
> protocol or APIs in mind during the same time period?
>
> sanjay
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>

Re: Plans of moving towards JDK7 in trunk

[sanjay Radia]

On Jun 21, 2014, at 8:01 AM, Andrew Wang  wrote:

> This is why I'd like to keep my original proposal on the table: keep going
> with branch-2 in the near term, while working towards a JDK8-based Hadoop 3
> by April next year. It doesn't need to be a big bang release either. I'd be
> delighted if we could rolling upgrade from one to the other. I just didn't
> want to rule out the inclusion of some very compelling feature outright.
> Trust me though, I'd be the first person to ask about compatibility if such
> a feature does come up.


Given your above statement  on compatibility (such as rolling upgrades),  it 
should be fine for the JDK8-based-Hadoop-release to not be 3.0 and instead 
merely be 2.x? Or do you have any incompatible changes to Hadoop protocol or 
APIs in mind during the same time period?

sanjay
-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Re: hadoop-2.5 - June end?

[Arun C Murthy]

Folks,

 I'd appreciate some help here. Due to family reasons (all good ones), I'll be 
away for a couple of weeks. Can someone else pick up the RM duties for 
hadoop-2.5? Maybe Andrew since he's expressed interest in the past? I will pick 
up the thread again for hadoop-2.6, but I don't want to block hadoop-2.5 due to 
my non-availability.

thanks,
Arun

On Jun 9, 2014, at 9:39 AM, Arun C Murthy  wrote:

> Folks,
> 
> As you can see from the Roadmap wiki, it looks like several items are still a 
> bit away from being ready.
> 
> I think rather than wait for them, it will be useful to create an 
> intermediate release (2.5) this month - I think ATS security is pretty close, 
> so we can ship that. I'm thinking of creating hadoop-2.5 by end of the month, 
> with a branch a couple of weeks prior.
> 
> Thoughts?
> 
> thanks,
> Arun
> 



-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Re: [DISCUSS] Change by-laws on release votes: 5 days instead of 7

[Jitendra Pandey]

+1, sounds good!


On Mon, Jun 23, 2014 at 12:02 PM, Andrew Wang 
wrote:

> +1 here as well, let's do a vote thread (for 7 days, maybe for the last
> time!)
>
>
> On Mon, Jun 23, 2014 at 11:46 AM, Vinod Kumar Vavilapalli <
> vino...@apache.org> wrote:
>
> > This seems reasonable, +1.
> >
> > In case there is inactivity, we already extend dates even today, we can
> do
> > the same going forward.
> >
> > I don't see major disagreements, time to start a vote?
> >
> > Thanks
> > +Vinod
> >
> > On Jun 20, 2014, at 10:54 PM, Arun C Murthy  wrote:
> >
> > > Folks,
> > >
> > > I'd like to propose we change our by-laws to reduce our voting periods
> > on new releases from 7 days to 5.
> > >
> > > Currently, it just takes too long to turn around releases; particularly
> > if we have critical security fixes etc.
> > >
> > > Thoughts?
> > >
> > > thanks,
> > > Arun
> > >
> > >
> > > --
> > > CONFIDENTIALITY NOTICE
> > > NOTICE: This message is intended for the use of the individual or
> entity
> > to
> > > which it is addressed and may contain information that is confidential,
> > > privileged and exempt from disclosure under applicable law. If the
> reader
> > > of this message is not the intended recipient, you are hereby notified
> > that
> > > any printing, copying, dissemination, distribution, disclosure or
> > > forwarding of this communication is strictly prohibited. If you have
> > > received this communication in error, please contact the sender
> > immediately
> > > and delete it from your system. Thank You.
> >
> >
> > --
> > CONFIDENTIALITY NOTICE
> > NOTICE: This message is intended for the use of the individual or entity
> to
> > which it is addressed and may contain information that is confidential,
> > privileged and exempt from disclosure under applicable law. If the reader
> > of this message is not the intended recipient, you are hereby notified
> that
> > any printing, copying, dissemination, distribution, disclosure or
> > forwarding of this communication is strictly prohibited. If you have
> > received this communication in error, please contact the sender
> immediately
> > and delete it from your system. Thank You.
> >
>



-- 


-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Re: [DISCUSS] Change by-laws on release votes: 5 days instead of 7

[Andrew Wang]

+1 here as well, let's do a vote thread (for 7 days, maybe for the last
time!)


On Mon, Jun 23, 2014 at 11:46 AM, Vinod Kumar Vavilapalli <
vino...@apache.org> wrote:

> This seems reasonable, +1.
>
> In case there is inactivity, we already extend dates even today, we can do
> the same going forward.
>
> I don't see major disagreements, time to start a vote?
>
> Thanks
> +Vinod
>
> On Jun 20, 2014, at 10:54 PM, Arun C Murthy  wrote:
>
> > Folks,
> >
> > I'd like to propose we change our by-laws to reduce our voting periods
> on new releases from 7 days to 5.
> >
> > Currently, it just takes too long to turn around releases; particularly
> if we have critical security fixes etc.
> >
> > Thoughts?
> >
> > thanks,
> > Arun
> >
> >
> > --
> > CONFIDENTIALITY NOTICE
> > NOTICE: This message is intended for the use of the individual or entity
> to
> > which it is addressed and may contain information that is confidential,
> > privileged and exempt from disclosure under applicable law. If the reader
> > of this message is not the intended recipient, you are hereby notified
> that
> > any printing, copying, dissemination, distribution, disclosure or
> > forwarding of this communication is strictly prohibited. If you have
> > received this communication in error, please contact the sender
> immediately
> > and delete it from your system. Thank You.
>
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>

Re: [DISCUSS] Change by-laws on release votes: 5 days instead of 7

[Vinod Kumar Vavilapalli]

This seems reasonable, +1.

In case there is inactivity, we already extend dates even today, we can do the 
same going forward.

I don't see major disagreements, time to start a vote?

Thanks
+Vinod

On Jun 20, 2014, at 10:54 PM, Arun C Murthy  wrote:

> Folks,
> 
> I'd like to propose we change our by-laws to reduce our voting periods on new 
> releases from 7 days to 5.
> 
> Currently, it just takes too long to turn around releases; particularly if we 
> have critical security fixes etc.
> 
> Thoughts?
> 
> thanks,
> Arun
> 
> 
> -- 
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to 
> which it is addressed and may contain information that is confidential, 
> privileged and exempt from disclosure under applicable law. If the reader 
> of this message is not the intended recipient, you are hereby notified that 
> any printing, copying, dissemination, distribution, disclosure or 
> forwarding of this communication is strictly prohibited. If you have 
> received this communication in error, please contact the sender immediately 
> and delete it from your system. Thank You.


-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.


signature.asc
Description: Message signed with OpenPGP using GPGMail

[jira] [Created] (HADOOP-10739) Renaming a file into a directory containing the same filename results in a confusing I/O error

[Jason Lowe (JIRA)]

Jason Lowe created HADOOP-10739:
---

 Summary: Renaming a file into a directory containing the same 
filename results in a confusing I/O error
 Key: HADOOP-10739
 URL: https://issues.apache.org/jira/browse/HADOOP-10739
 Project: Hadoop Common
  Issue Type: Bug
  Components: fs
Affects Versions: 2.4.0
Reporter: Jason Lowe


Renaming a file to another existing filename says "File
exists" but colliding with a file in a directory results in the cryptic
"Input/output error".



--
This message was sent by Atlassian JIRA
(v6.2#6252)

[jira] [Created] (HADOOP-10738) Dynamically adjust distcp configuration by adding distcp-site.xml into code base

[Siqi Li (JIRA)]

Siqi Li created HADOOP-10738:


 Summary: Dynamically adjust distcp configuration by adding 
distcp-site.xml into code base
 Key: HADOOP-10738
 URL: https://issues.apache.org/jira/browse/HADOOP-10738
 Project: Hadoop Common
  Issue Type: Bug
Reporter: Siqi Li






--
This message was sent by Atlassian JIRA
(v6.2#6252)

[jira] [Created] (HADOOP-10737) S3n silent failure on copy, data loss on rename

[Gian Merlino (JIRA)]

Gian Merlino created HADOOP-10737:
-

 Summary: S3n silent failure on copy, data loss on rename
 Key: HADOOP-10737
 URL: https://issues.apache.org/jira/browse/HADOOP-10737
 Project: Hadoop Common
  Issue Type: Bug
  Components: fs/s3
Affects Versions: 2.4.0
Reporter: Gian Merlino


Jets3tNativeFileSystemStore.copy(String, String) handles its exceptions with 
handleServiceException(String, ServiceException), which behaves like:

1) Throw FileNotFoundException if the exception's error code is NoSuchKey
2) Otherwise, throw IOException if the exception's cause is an IOException
3) Otherwise, LOG.debug a message and throw nothing

So S3 exceptions other than NoSuchKey (like RequestTimeout, ServiceUnavailable) 
are suppressed. This makes "copy" fail while still returning as if it 
succeeded. Furthermore since NativeS3FileSystem's "rename" is implemented as a 
copy followed by a delete, this means "rename" can delete the source key even 
though the copy has failed.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

[jira] [Created] (HADOOP-10736) Add key attributes to the key shell

[Mike Yoder (JIRA)]

Mike Yoder created HADOOP-10736:
---

 Summary: Add key attributes to the key shell
 Key: HADOOP-10736
 URL: https://issues.apache.org/jira/browse/HADOOP-10736
 Project: Hadoop Common
  Issue Type: Improvement
  Components: security
Affects Versions: 3.0.0
Reporter: Mike Yoder
Assignee: Mike Yoder


The recent work in HADOOP-10696 added key-value pairs to keys in the KMS.  Now 
the key shell needs to be updated to set/get these attributes.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Re: [VOTE] Release Apache Hadoop 2.4.1

[Steve Loughran]

someone's filed a JIRA on loops in Hedged Read, with tests ...

https://issues.apache.org/jira/browse/HDFS-6591


On 23 June 2014 08:58, Mit Desai  wrote:

> +1 (non-binding)
>
> Tested on: Fedora17
> -Successful build from src (including native)
> -Verified Signature
> -Deployed source to my single node cluster and ran couple of sample MR jobs
>
>
> - M!T
>
>
>
>
>
> On 6/21/14, 1:51 AM, "Arun C Murthy"  wrote:
>
> >Folks,
> >
> >I've created another release candidate (rc1) for hadoop-2.4.1 based on
> >the feedback that I would like to push out.
> >
> >The RC is available at:
> >http://people.apache.org/~acmurthy/hadoop-2.4.1-rc1
> >The RC tag in svn is here:
> >https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.4.1-rc1
> >
> >The maven artifacts are available via repository.apache.org.
> >
> >Please try the release and vote; the vote will run for the usual 7 days.
> >
> >thanks,
> >Arun
> >
> >
> >
> >--
> >Arun C. Murthy
> >Hortonworks Inc.
> >http://hortonworks.com/hdp/
> >
> >
> >
> >--
> >CONFIDENTIALITY NOTICE
> >NOTICE: This message is intended for the use of the individual or entity
> >to
> >which it is addressed and may contain information that is confidential,
> >privileged and exempt from disclosure under applicable law. If the reader
> >of this message is not the intended recipient, you are hereby notified
> >that
> >any printing, copying, dissemination, distribution, disclosure or
> >forwarding of this communication is strictly prohibited. If you have
> >received this communication in error, please contact the sender
> >immediately
> >and delete it from your system. Thank You.
>
>

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Re: [VOTE] Release Apache Hadoop 0.23.11

[Mit Desai]

+1 (non-binding)

Tested on: Fedora17
-Successful build from src
-Verified Signature
-Deployed source to my single node cluster and ran couple of sample MR jobs


-Mit Desai





On 6/19/14, 10:14 AM, "Thomas Graves" 
wrote:

>Hey Everyone,
>
>There have been various bug fixes that have went into
>branch-0.23 since the 0.23.10 release.  We think its time to do a 0.23.11.
>
>This is also the last planned release off of branch-0.23 we plan on doing.
>
>The RC is available at:
>http://people.apache.org/~tgraves/hadoop-0.23.11-candidate-0/
>
>
>The RC Tag in svn is here:
>http://svn.apache.org/viewvc/hadoop/common/tags/release-0.23.11-rc0/
>
>The maven artifacts are available via repository.apache.org.
>
>Please try the release and vote; the vote will run for the usual 7 days
>til June 26th.
>
>I am +1 (binding).
>
>thanks,
>Tom Graves
>
>
>
>

Re: [VOTE] Release Apache Hadoop 2.4.1

[Mit Desai]

+1 (non-binding)

Tested on: Fedora17
-Successful build from src (including native)
-Verified Signature
-Deployed source to my single node cluster and ran couple of sample MR jobs


- M!T





On 6/21/14, 1:51 AM, "Arun C Murthy"  wrote:

>Folks,
>
>I've created another release candidate (rc1) for hadoop-2.4.1 based on
>the feedback that I would like to push out.
>
>The RC is available at:
>http://people.apache.org/~acmurthy/hadoop-2.4.1-rc1
>The RC tag in svn is here:
>https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.4.1-rc1
>
>The maven artifacts are available via repository.apache.org.
>
>Please try the release and vote; the vote will run for the usual 7 days.
>
>thanks,
>Arun
>
>
>
>--
>Arun C. Murthy
>Hortonworks Inc.
>http://hortonworks.com/hdp/
>
>
>
>-- 
>CONFIDENTIALITY NOTICE
>NOTICE: This message is intended for the use of the individual or entity
>to 
>which it is addressed and may contain information that is confidential,
>privileged and exempt from disclosure under applicable law. If the reader
>of this message is not the intended recipient, you are hereby notified
>that 
>any printing, copying, dissemination, distribution, disclosure or
>forwarding of this communication is strictly prohibited. If you have
>received this communication in error, please contact the sender
>immediately 
>and delete it from your system. Thank You.

Re: [DISCUSS] Change by-laws on release votes: 5 days instead of 7

[Thomas Graves]

I¹d be fine with 5 days.  Any shorter and you could have issues with folks
being just out for a weekend and miss the entire vote unless we explicitly
tried to stay away from ending the vote on the weekend.


Tom



On 6/21/14, 12:54 AM, "Arun C Murthy"  wrote:

>Folks,
>
> I'd like to propose we change our by-laws to reduce our voting periods
>on new releases from 7 days to 5.
>
> Currently, it just takes too long to turn around releases; particularly
>if we have critical security fixes etc.
>
> Thoughts?
>
>thanks,
>Arun
>
>
>-- 
>CONFIDENTIALITY NOTICE
>NOTICE: This message is intended for the use of the individual or entity
>to 
>which it is addressed and may contain information that is confidential,
>privileged and exempt from disclosure under applicable law. If the reader
>of this message is not the intended recipient, you are hereby notified
>that 
>any printing, copying, dissemination, distribution, disclosure or
>forwarding of this communication is strictly prohibited. If you have
>received this communication in error, please contact the sender
>immediately 
>and delete it from your system. Thank You.