Re: 3rd Party Hadoop FileSystems failing with UnsupportedFileSystemException

YARN uses the FileContext APIs in its code, which would require your FS implementation to also provide one (inheriting the AbstractFileSystem). On Fri, Jun 21, 2013 at 6:38 AM, Stephen Watt wrote: > Hi Folks > > I'm working on the Hadoop FileSystem validation workstream > (https://wiki.apache.or

About container preemption

https://issues.apache.org/jira/browse/YARN-45 support work-preserve preemption Has the AM support container's state checkpoint now? Does the checkpoint support map, shuffle and reduce phase? -- *Sincerely,* *Zhaojie* * *

[jira] [Created] (YARN-870) Node manager is no longer required to store ContainerToken as it is required only during startContainer call.

Omkar Vinit Joshi created YARN-870: -- Summary: Node manager is no longer required to store ContainerToken as it is required only during startContainer call. Key: YARN-870 URL: https://issues.apache.org/jira/browse

Success: YARN-727 PreCommit Build #1375

Jira: https://issues.apache.org/jira/browse/YARN-727 Build: https://builds.apache.org/job/PreCommit-YARN-Build/1375/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncate

exec pi error

Hi All： thank you for help Error. As follows: [hadoop@hydra0001 mapreduce]$ hadoop jar hadoop-mapreduce-examples-2.0.0-cdh4.3.0.jar pi 10 10 Number of Maps = 10 Samples per Map = 10 13/06/20 16:06:38 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using built

3rd Party Hadoop FileSystems failing with UnsupportedFileSystemException

Hi Folks I'm working on the Hadoop FileSystem validation workstream (https://wiki.apache.org/hadoop/HCFS/Progress) over at Hadoop Common. To do that we're building a library of Hadoop FileSystem tests that will run against FileSystems configured within Hadoop 2.0. I have YARN working on HDFS an

Success: YARN-866 PreCommit Build #1374

Jira: https://issues.apache.org/jira/browse/YARN-866 Build: https://builds.apache.org/job/PreCommit-YARN-Build/1374/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncate

[jira] [Created] (YARN-869) ResourceManagerAdministrationProtocol should neither be public(yet) nor in yarn.api

Vinod Kumar Vavilapalli created YARN-869: Summary: ResourceManagerAdministrationProtocol should neither be public(yet) nor in yarn.api Key: YARN-869 URL: https://issues.apache.org/jira/browse/YARN-869

[jira] [Created] (YARN-868) YarnClient should set the service address in tokens returned by getRMDelegationToken()

Hitesh Shah created YARN-868: Summary: YarnClient should set the service address in tokens returned by getRMDelegationToken() Key: YARN-868 URL: https://issues.apache.org/jira/browse/YARN-868 Project: Had

[jira] [Resolved] (YARN-738) TestClientRMTokens is failing irregularly while running all yarn tests

[ https://issues.apache.org/jira/browse/YARN-738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omkar Vinit Joshi resolved YARN-738. Resolution: Invalid Assignee: Omkar Vinit Joshi > TestClientRMTokens is failing irr

[jira] [Created] (YARN-867) Isolation of failures in aux services

Hitesh Shah created YARN-867: Summary: Isolation of failures in aux services Key: YARN-867 URL: https://issues.apache.org/jira/browse/YARN-867 Project: Hadoop YARN Issue Type: Bug Comp

Success: YARN-851 PreCommit Build #1373

Jira: https://issues.apache.org/jira/browse/YARN-851 Build: https://builds.apache.org/job/PreCommit-YARN-Build/1373/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncate

Re: FileNotFoundExceptions with Pseudo Distributed YARN MR using the Local FileSystem

Please let us know your final results. Interesting to see YARN+MR directly working on local-file-system. Thanks, +Vinod On Jun 20, 2013, at 2:27 PM, Stephen Watt wrote: > I resolved this. The issue is that I was using relative paths (i.e "teragen > 1000 data/in-dir") as the params for TeraGen

Success: YARN-851 PreCommit Build #1372

Jira: https://issues.apache.org/jira/browse/YARN-851 Build: https://builds.apache.org/job/PreCommit-YARN-Build/1372/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncate

Success: YARN-851 PreCommit Build #1371

### [...truncated 3078 lines...] /bin/kill -9 19587 kill: No such process NOP {color:green}+1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12588943/YARN-851-20130620.patch against trunk revision . {color:green}+1 @author

Success: YARN-866 PreCommit Build #1370

Jira: https://issues.apache.org/jira/browse/YARN-866 Build: https://builds.apache.org/job/PreCommit-YARN-Build/1370/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncate

Success: YARN-827 PreCommit Build #1369

Jira: https://issues.apache.org/jira/browse/YARN-827 Build: https://builds.apache.org/job/PreCommit-YARN-Build/1369/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncate

Re: Heads up: branch-2.1-beta

I think I've shared this before, but here you go again… http://s.apache.org/hadoop-2.1.0-beta-blockers At this point, HADOOP-9421 seems like the most important. thanks, Arun On Jun 20, 2013, at 8:31 AM, Alejandro Abdelnur wrote: > Arun, > > It seems there are still a few things to iron out b

Re: FileNotFoundExceptions with Pseudo Distributed YARN MR using the Local FileSystem

I resolved this. The issue is that I was using relative paths (i.e "teragen 1000 data/in-dir") as the params for TeraGen and TeraSort. When I changed it to use absolute paths, (i.e. "teragen 1000 /data/in-dir") it works. - Original Message - From: "Stephen Watt" To: yarn-dev@hadoop.apac

[jira] [Created] (YARN-866) Add test for class ResourceWeights

Wei Yan created YARN-866: Summary: Add test for class ResourceWeights Key: YARN-866 URL: https://issues.apache.org/jira/browse/YARN-866 Project: Hadoop YARN Issue Type: Test Affects Versions: 2.1

Failed: YARN-827 PreCommit Build #1368

Jira: https://issues.apache.org/jira/browse/YARN-827 Build: https://builds.apache.org/job/PreCommit-YARN-Build/1368/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncate

Failed: YARN-851 PreCommit Build #1367

Jira: https://issues.apache.org/jira/browse/YARN-851 Build: https://builds.apache.org/job/PreCommit-YARN-Build/1367/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncate

Success: YARN-861 PreCommit Build #1366

Jira: https://issues.apache.org/jira/browse/YARN-861 Build: https://builds.apache.org/job/PreCommit-YARN-Build/1366/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncate

Success: YARN-865 PreCommit Build #1365

Jira: https://issues.apache.org/jira/browse/YARN-865 Build: https://builds.apache.org/job/PreCommit-YARN-Build/1365/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncate

Failed: YARN-862 PreCommit Build #1364

Jira: https://issues.apache.org/jira/browse/YARN-862 Build: https://builds.apache.org/job/PreCommit-YARN-Build/1364/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncate

Success: YARN-727 PreCommit Build #1363

Jira: https://issues.apache.org/jira/browse/YARN-727 Build: https://builds.apache.org/job/PreCommit-YARN-Build/1363/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncate

[jira] [Created] (YARN-864) YARN NM leaking containers

Chris Riccomini created YARN-864: Summary: YARN NM leaking containers Key: YARN-864 URL: https://issues.apache.org/jira/browse/YARN-864 Project: Hadoop YARN Issue Type: Bug Componen

FileNotFoundExceptions with Pseudo Distributed YARN MR using the Local FileSystem

Hi Folks I'm running into FileNotFoundExceptions when using using Pseudo Distributed Single Node YARN using the Local FileSystem. I'd greatly appreciate any insights/solutions. To level set, I'm using RHEL 6.2 and I've successfully setup a single node pseudo-distributed YARN on HDFS 2.0 using

[jira] [Created] (YARN-863) Crash in YARNRunner because of NULL dagClient

Bikas Saha created YARN-863: --- Summary: Crash in YARNRunner because of NULL dagClient Key: YARN-863 URL: https://issues.apache.org/jira/browse/YARN-863 Project: Hadoop YARN Issue Type: Bug

[jira] [Created] (YARN-862) ResourceManager and NodeManager versions should on node registration or error out

Robert Parker created YARN-862: -- Summary: ResourceManager and NodeManager versions should on node registration or error out Key: YARN-862 URL: https://issues.apache.org/jira/browse/YARN-862 Project: Hado

Re: Heads up: branch-2.1-beta

Arun, It seems there are still a few things to iron out before getting 2.1 out of the door. As RM for the release, would you mind sharing the current state of things and your estimate on when it could happen? Thanks. On Wed, Jun 19, 2013 at 4:29 PM, Roman Shaposhnik wrote: > On Tue, Jun 18,

[jira] [Created] (YARN-861) TestContainerManager is failing

Devaraj K created YARN-861: -- Summary: TestContainerManager is failing Key: YARN-861 URL: https://issues.apache.org/jira/browse/YARN-861 Project: Hadoop YARN Issue Type: Bug Reporter: Dev

Hadoop-Yarn-trunk - Build # 246 - Still Failing

See https://builds.apache.org/job/Hadoop-Yarn-trunk/246/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 12199 lines...] Results : Failed tests: testContainer

Build failed in Jenkins: Hadoop-Yarn-trunk #246

See Changes: [szetszwo] HDFS-4908. Reduce snapshot inode memory usage. [szetszwo] HDFS-4914. Use DFSClient.Conf instead of Configuration. [vinodkv] YARN-854. Fixing YARN bugs that are failing applications in secure environment. Cont

Success: YARN-853 PreCommit Build #1362

Jira: https://issues.apache.org/jira/browse/YARN-853 Build: https://builds.apache.org/job/PreCommit-YARN-Build/1362/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncate

Re: In memory shuffle phase

*import* *org**.apache.tez.dag.api.records*.DAGProtos.DAGPlan; why this import errors in tez trunk ? 2013/6/14 Arun C Murthy > https://issues.apache.org/jira/browse/TEZ-65 > > Arun > > On Jun 12, 2013, at 12:28 AM, 牛兆捷 wrote: > > > Is there any design document about tez? > > > > 2013/6/12 Arun C

[jira] [Created] (YARN-860) JobHistory UI shows -ve times for reducer

Bikas Saha created YARN-860: --- Summary: JobHistory UI shows -ve times for reducer Key: YARN-860 URL: https://issues.apache.org/jira/browse/YARN-860 Project: Hadoop YARN Issue Type: Bug Affects V

Failed: YARN-853 PreCommit Build #1361

Jira: https://issues.apache.org/jira/browse/YARN-853 Build: https://builds.apache.org/job/PreCommit-YARN-Build/1361/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncate

Re: Problems of runing with yarn-2.0.X

I think it may occur at the reduce phase. Too many shuffle fetch at the same time? 2013/6/20 Arun C Murthy > Where are seeing the error? In the tasks? Or, during job submission? > > On Jun 19, 2013, at 8:43 PM, Li Shengmei wrote: > > > Hi, all > > > > I am doing some experiments with ya

Re: Problems of runing with yarn-2.0.X

Where are seeing the error? In the tasks? Or, during job submission? On Jun 19, 2013, at 8:43 PM, Li Shengmei wrote: > Hi, all > > I am doing some experiments with yarn-2.0.x. I found some problems > as follows, can anyone give suggestion? > > > > 1. I set up hadoop environment