Re: Hadoop on Mesos: FATAL mapred.MesosScheduler: Failed to initialize the TaskScheduler

[tommy xiao]

Traiano,

i am not also use it anymore, so i just share with you.

2017-07-31 2:27 GMT+08:00 Traiano Welcome :

> Hi Tommy
>
> On Sun, Jul 30, 2017 at 9:37 PM, tommy xiao  wrote:
>
>> why not use Myriad?
>>
>> https://cwiki.apache.org/confluence/display/MYRIAD/Myriad+Home
>>
>
>
> I'm in doubt about the future of this project. I'm told it's likely to be
> discontinued soon due to the lack of contributors.
> In any case - have you perhaps seen a successful deployment of this ?
>
>
>
>
>
>>
>>
>>
>> 2017-07-23 17:27 GMT+08:00 Traiano Welcome :
>>
>>>
>>> Hi List!
>>>
>>> I'm working on configuring hadoop to use the mesos scheduler, using the
>>> procedure outlined in "Apache Mesos Essentials" here:
>>>
>>> https://pastebin.com/y1ERJZqq
>>>
>>> Currently I've a 3 node mesos cluster, with an HDFS namenode
>>> communicating successfully with two HDFS data nodes. However, when I try to
>>> start up the jobtracker it fails with the following error:
>>>
>>> 17/07/22 18:44:38 FATAL mapred.MesosScheduler: Failed to initialize the
>>> TaskScheduler
>>> java.lang.ClassNotFoundException:  org.apache.hadoop.mapred.JobQu
>>> eueTaskScheduler
>>>
>>> Some more context around the error:
>>>
>>>  17/07/22 18:44:38 INFO mapred.CompletedJobStatusStore: Completed job
>>> store is inactive
>>>  17/07/22 18:44:38 FATAL mapred.MesosScheduler: Failed to initialize the
>>> TaskScheduler
>>>  java.lang.ClassNotFoundException:  org.apache.hadoop.mapred.JobQu
>>> eueTaskScheduler
>>>
>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:359)
>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:348)
>>> at java.security.AccessController.doPrivileged(Native Method)
>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:347)
>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:312)
>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
>>> at java.lang.Class.forName0(Native Method)
>>> at java.lang.Class.forName(Class.java:195)
>>> at   org.apache.hadoop.mapred.MesosScheduler.start(MesosScheduler
>>> .java:160)
>>> atorg.apache.hadoop.mapred.JobTracker.offerService(JobTracker.
>>> java:2186)
>>> at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4548)
>>> 17/07/22 18:44:38 INFO mapred.JobTracker: SHUTDOWN_MSG:
>>>
>>> Is there some way I could debug this further to trace the root cause of
>>> this error?
>>>
>>> Here is a full paste of the debug output when starting up the jobtracker:
>>>
>>>  https://pastebin.com/a61wN4vQ
>>>
>>>
>>>
>>
>>
>> --
>> Deshi Xiao
>> Twitter: xds2000
>> E-mail: xiaods(AT)gmail.com
>>
>
>


-- 
Deshi Xiao
Twitter: xds2000
E-mail: xiaods(AT)gmail.com

Re: Hadoop on Mesos: FATAL mapred.MesosScheduler: Failed to initialize the TaskScheduler

[Traiano Welcome]

Hi Tommy

On Sun, Jul 30, 2017 at 9:37 PM, tommy xiao  wrote:

> why not use Myriad?
>
> https://cwiki.apache.org/confluence/display/MYRIAD/Myriad+Home
>


I'm in doubt about the future of this project. I'm told it's likely to be
discontinued soon due to the lack of contributors.
In any case - have you perhaps seen a successful deployment of this ?





>
>
>
> 2017-07-23 17:27 GMT+08:00 Traiano Welcome :
>
>>
>> Hi List!
>>
>> I'm working on configuring hadoop to use the mesos scheduler, using the
>> procedure outlined in "Apache Mesos Essentials" here:
>>
>> https://pastebin.com/y1ERJZqq
>>
>> Currently I've a 3 node mesos cluster, with an HDFS namenode
>> communicating successfully with two HDFS data nodes. However, when I try to
>> start up the jobtracker it fails with the following error:
>>
>> 17/07/22 18:44:38 FATAL mapred.MesosScheduler: Failed to initialize the
>> TaskScheduler
>> java.lang.ClassNotFoundException:  org.apache.hadoop.mapred.JobQu
>> eueTaskScheduler
>>
>> Some more context around the error:
>>
>>  17/07/22 18:44:38 INFO mapred.CompletedJobStatusStore: Completed job
>> store is inactive
>>  17/07/22 18:44:38 FATAL mapred.MesosScheduler: Failed to initialize the
>> TaskScheduler
>>  java.lang.ClassNotFoundException:  org.apache.hadoop.mapred.JobQu
>> eueTaskScheduler
>>
>> at java.net.URLClassLoader$1.run(URLClassLoader.java:359)
>> at java.net.URLClassLoader$1.run(URLClassLoader.java:348)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at java.net.URLClassLoader.findClass(URLClassLoader.java:347)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:312)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
>> at java.lang.Class.forName0(Native Method)
>> at java.lang.Class.forName(Class.java:195)
>> at   org.apache.hadoop.mapred.MesosScheduler.start(MesosScheduler
>> .java:160)
>> atorg.apache.hadoop.mapred.JobTracker.offerService(JobTracker.
>> java:2186)
>> at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4548)
>> 17/07/22 18:44:38 INFO mapred.JobTracker: SHUTDOWN_MSG:
>>
>> Is there some way I could debug this further to trace the root cause of
>> this error?
>>
>> Here is a full paste of the debug output when starting up the jobtracker:
>>
>>  https://pastebin.com/a61wN4vQ
>>
>>
>>
>
>
> --
> Deshi Xiao
> Twitter: xds2000
> E-mail: xiaods(AT)gmail.com
>

Re: Hadoop on Mesos: FATAL mapred.MesosScheduler: Failed to initialize the TaskScheduler

[tommy xiao]

why not use Myriad?

https://cwiki.apache.org/confluence/display/MYRIAD/Myriad+Home


2017-07-23 17:27 GMT+08:00 Traiano Welcome :

>
> Hi List!
>
> I'm working on configuring hadoop to use the mesos scheduler, using the
> procedure outlined in "Apache Mesos Essentials" here:
>
> https://pastebin.com/y1ERJZqq
>
> Currently I've a 3 node mesos cluster, with an HDFS namenode communicating
> successfully with two HDFS data nodes. However, when I try to start up the
> jobtracker it fails with the following error:
>
> 17/07/22 18:44:38 FATAL mapred.MesosScheduler: Failed to initialize the
> TaskScheduler
> java.lang.ClassNotFoundException:  org.apache.hadoop.mapred.
> JobQueueTaskScheduler
>
> Some more context around the error:
>
>  17/07/22 18:44:38 INFO mapred.CompletedJobStatusStore: Completed job
> store is inactive
>  17/07/22 18:44:38 FATAL mapred.MesosScheduler: Failed to initialize the
> TaskScheduler
>  java.lang.ClassNotFoundException:  org.apache.hadoop.mapred.
> JobQueueTaskScheduler
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:359)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:348)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:347)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:312)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
> at java.lang.Class.forName0(Native Method)
> at java.lang.Class.forName(Class.java:195)
> at   org.apache.hadoop.mapred.MesosScheduler.start(
> MesosScheduler.java:160)
> atorg.apache.hadoop.mapred.JobTracker.offerService(
> JobTracker.java:2186)
> at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4548)
> 17/07/22 18:44:38 INFO mapred.JobTracker: SHUTDOWN_MSG:
>
> Is there some way I could debug this further to trace the root cause of
> this error?
>
> Here is a full paste of the debug output when starting up the jobtracker:
>
>  https://pastebin.com/a61wN4vQ
>
>
>


-- 
Deshi Xiao
Twitter: xds2000
E-mail: xiaods(AT)gmail.com