Thanks Niranda, this doc is useful. On Fri, Aug 14, 2015 at 10:36 AM, Niranda Perera <nira...@wso2.com> wrote:
> From what I know, OneToOneDependancy come into play when spark tries to > create the RDD dependency tree. > > Just thought of sharing that. this would be a good resource [1] :-) > > [1] > https://databricks-training.s3.amazonaws.com/slides/advanced-spark-training.pdf > > On Thu, Aug 13, 2015 at 12:09 AM, Nirmal Fernando <nir...@wso2.com> wrote: > >> What is *org.apache.spark.OneToOneDependency ? Is it something you use?* >> >> On Wed, Aug 12, 2015 at 11:30 PM, Madawa Soysa <madawa...@cse.mrt.ac.lk> >> wrote: >> >>> Hi, >>> >>> I created a model summary in order to show the model data in the >>> analysis.jag page. >>> But when refreshing the page after building the model I get the >>> following error. >>> >>> org.wso2.carbon.ml.core.exceptions.MLAnalysisHandlerException: An error >>> has occurred while extracting all the models of analysis id: 13 >>> at >>> org.wso2.carbon.ml.core.impl.MLAnalysisHandler.getAllModelsOfAnalysis(MLAnalysisHandler.java:245) >>> at >>> org.wso2.carbon.ml.rest.api.AnalysisApiV10.getAllModelsOfAnalysis(AnalysisApiV10.java:517) >>> Caused by: >>> org.wso2.carbon.ml.database.exceptions.DatabaseHandlerException: An error >>> has occurred while extracting all the models of analysis id: 13 >>> at >>> org.wso2.carbon.ml.database.internal.MLDatabaseService.getAllModels(MLDatabaseService.java:1797) >>> at >>> org.wso2.carbon.ml.core.impl.MLAnalysisHandler.getAllModelsOfAnalysis(MLAnalysisHandler.java:243) >>> ... 52 more >>> >>> *Caused by: java.lang.ClassNotFoundException: >>> org.apache.spark.OneToOneDependency cannot be found by >>> org.scala-lang.scala-library_2.10.4.v20140209-180020-VFINAL-b66a3965* >>> at >>> org.wso2.carbon.ml.database.util.MLDBUtil.getModelSummaryFromInputStream(MLDBUtil.java:54) >>> at >>> org.wso2.carbon.ml.database.internal.MLDatabaseService.getAllModels(MLDatabaseService.java:1790) >>> ... 53 more >>> >>> I guess there is an error in persistence of the model summary object, >>> what should be the cause for this error? [1] >>> <https://github.com/madawas/carbon-ml/commit/987c799231dad2bab6f4046df7acc672d0564f22> >>> contains >>> the commit which I introduced the model summary. >>> >>> [1] - >>> https://github.com/madawas/carbon-ml/commit/987c799231dad2bab6f4046df7acc672d0564f22 >>> >>> -- >>> >>> *_________________________________**Madawa Soysa* >>> >>> Undergraduate, >>> >>> Department of Computer Science and Engineering, >>> >>> University of Moratuwa. >>> >>> >>> Mobile: +94 71 461 6050 <%2B94%2075%20812%200726> | Email: >>> madawa...@cse.mrt.ac.lk >>> LinkedIn <http://lk.linkedin.com/in/madawasoysa> | Twitter >>> <https://twitter.com/madawa_rc> | Tumblr <http://madawas.tumblr.com/> >>> >> >> >> >> -- >> >> Thanks & regards, >> Nirmal >> >> Team Lead - WSO2 Machine Learner >> Associate Technical Lead - Data Technologies Team, WSO2 Inc. >> Mobile: +94715779733 >> Blog: http://nirmalfdo.blogspot.com/ >> >> >> >> _______________________________________________ >> Dev mailing list >> Dev@wso2.org >> http://wso2.org/cgi-bin/mailman/listinfo/dev >> >> > > > -- > *Niranda Perera* > Software Engineer, WSO2 Inc. > Mobile: +94-71-554-8430 > Twitter: @n1r44 <https://twitter.com/N1R44> > https://pythagoreanscript.wordpress.com/ > -- Thanks & regards, Nirmal Team Lead - WSO2 Machine Learner Associate Technical Lead - Data Technologies Team, WSO2 Inc. Mobile: +94715779733 Blog: http://nirmalfdo.blogspot.com/
_______________________________________________ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
