Hi Niranda / Inosh, Thanks a lot for the quick call and reply. Yes issue seems to be fixed now. Did not appear for a while.
-Roshan On Fri, Dec 11, 2015 at 12:47 AM, Niranda Perera <nira...@wso2.com> wrote: > Hi Roshan, > > This happens when you have a malformed HA cluster. When you put the master > count as 2, the spark cluster would not get initiated until there are 2 > members in the analytics cluster. when the count as 2 and there is a task > scheduled already, you may come across this issue, until the 2nd node is up > and running. You should see that after sometime, the exception gets > resolved., and that is when the analytics cluster is at a workable state. > > But I agree, an NPE is not acceptable here and this has been already fixed > in 3.0.1 [1] > > as per the query modification, yes, the query gets modified to handle > multi tenancy in the spark runtime. > > hope this resolves your issues. > > rgds > > [1] https://wso2.org/jira/browse/DAS-329 > > On Fri, Dec 11, 2015 at 11:40 AM, Roshan Wijesena <ros...@wso2.com> wrote: > >> I reproduced the error. If we set carbon.spark.master.count value to 2 >> this error will occur. Any solution available in this case? >> >> >> On Thu, Dec 10, 2015 at 9:05 PM, Roshan Wijesena <ros...@wso2.com> wrote: >> >>> After I enabled the debug, it looks like below >>> >>> [2015-12-10 22:03:00,001] INFO >>> {org.wso2.carbon.analytics.spark.core.AnalyticsTask} - Executing the >>> schedule task for: httpd_log_analytics for tenant id: -1234 >>> [2015-12-10 22:03:00,013] DEBUG >>> {org.wso2.carbon.analytics.spark.core.internal.SparkAnalyticsExecutor} - >>> Executing : CREATE TEMPORARY TABLE X1234_HttpLogTable USING >>> org.wso2.carbon.analytics.spark.core.sources.AnalyticsRelationProvider >>> OPTIONS (tableName "ORG_WSO2_SAMPLE_HTTPD_LOGS" , tenantId "-1234") >>> [2015-12-10 22:03:00,013] ERROR >>> {org.wso2.carbon.ntask.core.impl.TaskQuartzJobAdapter} - Error in >>> executing task: null >>> java.lang.NullPointerException >>> at >>> org.wso2.carbon.analytics.spark.core.internal.SparkAnalyticsExecutor.executeQueryLocal(SparkAnalyticsExecutor.java:710) >>> at >>> org.wso2.carbon.analytics.spark.core.internal.SparkAnalyticsExecutor.executeQuery(SparkAnalyticsExecutor.java:692) >>> at >>> org.wso2.carbon.analytics.spark.core.CarbonAnalyticsProcessorService.executeQuery(CarbonAnalyticsProcessorService.java:199) >>> at >>> org.wso2.carbon.analytics.spark.core.CarbonAnalyticsProcessorService.executeScript(CarbonAnalyticsProcessorService.java:149) >>> at >>> org.wso2.carbon.analytics.spark.core.AnalyticsTask.execute(AnalyticsTask.java:57) >>> at >>> org.wso2.carbon.ntask.core.impl.TaskQuartzJobAdapter.execute(TaskQuartzJobAdapter.java:67) >>> at org.quartz.core.JobRunShell.run(JobRunShell.java:213) >>> at >>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) >>> at java.util.concurrent.FutureTask.run(FutureTask.java:266) >>> at >>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) >>> at >>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) >>> at java.lang.Thread.run(Thread.java:745) >>> >>> does that query got modified? >>> >>> CREATE TEMPORARY TABLE X1234_HttpLogTable USING >>> org.wso2.carbon.analytics.spark.core.sources.AnalyticsRelationProvider >>> OPTIONS (tableName "ORG_WSO2_SAMPLE_HTTPD_LOGS" , tenantId "-1234") >>> >>> >>> >>> >>> >>> >>> On Thu, Dec 10, 2015 at 6:53 PM, Roshan Wijesena <ros...@wso2.com> >>> wrote: >>> >>>> Hi DAS teaam, >>>> >>>> I am getting below null pointer exception while trying to execute a >>>> scheduled task. What I simply did was created a two node HA cluster and >>>> tried to run this example[1]. It has a scheduled task. However, this error >>>> can not be observed in a single node fresh pack. >>>> >>>> The error is, >>>> >>>> [2015-12-10 19:32:00,573] INFO >>>> {org.wso2.carbon.analytics.spark.core.AnalyticsTask} - Executing the >>>> schedule task for: httpd_log_analytics for tenant id: -1234 >>>> [2015-12-10 19:32:21,899] INFO >>>> {org.wso2.carbon.event.processor.manager.core.internal.CarbonEventManagementService} >>>> - Starting polling event receivers >>>> [2015-12-10 19:32:32,096] ERROR >>>> {org.wso2.carbon.ntask.core.impl.TaskQuartzJobAdapter} - Error in >>>> executing task: null >>>> java.lang.NullPointerException >>>> at >>>> org.wso2.carbon.analytics.spark.core.internal.SparkAnalyticsExecutor.executeQueryLocal(SparkAnalyticsExecutor.java:710) >>>> at >>>> org.wso2.carbon.analytics.spark.core.internal.SparkAnalyticsExecutor.executeQuery(SparkAnalyticsExecutor.java:692) >>>> at >>>> org.wso2.carbon.analytics.spark.core.CarbonAnalyticsProcessorService.executeQuery(CarbonAnalyticsProcessorService.java:199) >>>> at >>>> org.wso2.carbon.analytics.spark.core.CarbonAnalyticsProcessorService.executeScript(CarbonAnalyticsProcessorService.java:149) >>>> at >>>> org.wso2.carbon.analytics.spark.core.AnalyticsTask.execute(AnalyticsTask.java:57) >>>> at >>>> org.wso2.carbon.ntask.core.impl.TaskQuartzJobAdapter.execute(TaskQuartzJobAdapter.java:67) >>>> at org.quartz.core.JobRunShell.run(JobRunShell.java:213) >>>> at >>>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) >>>> at java.util.concurrent.FutureTask.run(FutureTask.java:266) >>>> at >>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) >>>> at >>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) >>>> at java.lang.Thread.run(Thread.java:745) >>>> >>>> >>>> [1] https://docs.wso2.com/display/DAS300/Analyzing+HTTPD+Logs >>>> >>>> -- >>>> Roshan Wijesena. >>>> Senior Software Engineer-WSO2 Inc. >>>> Mobile: *+94719154640 <%2B94719154640>* >>>> Email: ros...@wso2.com >>>> *WSO2, Inc. :** wso2.com <http://wso2.com/>* >>>> lean.enterprise.middleware. >>>> >>> >>> >>> >>> -- >>> Roshan Wijesena. >>> Senior Software Engineer-WSO2 Inc. >>> Mobile: *+94719154640 <%2B94719154640>* >>> Email: ros...@wso2.com >>> *WSO2, Inc. :** wso2.com <http://wso2.com/>* >>> lean.enterprise.middleware. >>> >> >> >> >> -- >> Roshan Wijesena. >> Senior Software Engineer-WSO2 Inc. >> Mobile: *+94719154640 <%2B94719154640>* >> Email: ros...@wso2.com >> *WSO2, Inc. :** wso2.com <http://wso2.com/>* >> lean.enterprise.middleware. >> > > > > -- > *Niranda Perera* > Software Engineer, WSO2 Inc. > Mobile: +94-71-554-8430 > Twitter: @n1r44 <https://twitter.com/N1R44> > https://pythagoreanscript.wordpress.com/ > -- Roshan Wijesena. Senior Software Engineer-WSO2 Inc. Mobile: *+94719154640* Email: ros...@wso2.com *WSO2, Inc. :** wso2.com <http://wso2.com/>* lean.enterprise.middleware.
_______________________________________________ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
