Hi Daniel Well said
Regards Vineel On Tue, Jul 14, 2015, 6:11 AM Daniel Darabos < daniel.dara...@lynxanalytics.com> wrote: > Hi Shahid, > To be honest I think this question is better suited for Stack Overflow > than for a PhD thesis. > > On Tue, Jul 14, 2015 at 7:42 AM, shahid ashraf <sha...@trialx.com> wrote: > >> hi >> >> I have a 10 node cluster i loaded the data onto hdfs, so the no. of >> partitions i get is 9. I am running a spark application , it gets stuck on >> one of tasks, looking at the UI it seems application is not using all nodes >> to do calculations. attached is the screen shot of tasks, it seems tasks >> are put on each node more then once. looking at tasks 8 tasks get completed >> under 7-8 minutes and one task takes around 30 minutes so causing the delay >> in results. >> >> >> On Tue, Jul 14, 2015 at 10:48 AM, Shashidhar Rao < >> raoshashidhar...@gmail.com> wrote: >> >>> Hi, >>> >>> I am doing my PHD thesis on large scale machine learning e.g Online >>> learning, batch and mini batch learning. >>> >>> Could somebody help me with ideas especially in the context of Spark and >>> to the above learning methods. >>> >>> Some ideas like improvement to existing algorithms, implementing new >>> features especially the above learning methods and algorithms that have not >>> been implemented etc. >>> >>> If somebody could help me with some ideas it would really accelerate my >>> work. >>> >>> Plus few ideas on research papers regarding Spark or Mahout. >>> >>> Thanks in advance. >>> >>> Regards >>> >> >> >> >> -- >> with Regards >> Shahid Ashraf >> >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >> For additional commands, e-mail: user-h...@spark.apache.org >> > >
