On Mon, May 19, 2014 at 10:32 AM, Kishanthan Thangarajah < kishant...@wso2.com> wrote:
> Yes, we observed a similar error on ELB, when there was a cache cleanup on > an IS node. Is the issue here is coming from one of the IS node or from ELB? > Just checked the ELB logs and yes issue is there.. Error occurs in ELB and one IS node. > > > On Mon, May 19, 2014 at 10:30 AM, Pradeep Fernando <prad...@wso2.com>wrote: > >> So i had a discussion with kishanthan. We saw the same issue sometime >> back. The exception was in ELB side. >> >> >> On Mon, May 19, 2014 at 10:22 AM, Pavithra Madurangi >> <pavit...@wso2.com>wrote: >> >>> No didn't observe this in single node..Anyway most of the testing were >>> done in cluster.. So I'm not sure whether this is reproducible in single >>> node... >>> >>> Thanks, >>> Pavithra >>> >>> >>> On Mon, May 19, 2014 at 10:18 AM, Afkham Azeez <az...@wso2.com> wrote: >>> >>>> So this happens when there is more than one node only, or are you >>>> seeing it with even a single node? >>>> >>>> >>>> On Mon, May 19, 2014 at 10:08 AM, Pavithra Madurangi <pavit...@wso2.com >>>> > wrote: >>>> >>>>> Yes this was reproduced in a homogeneous cluster. I'll again check >>>>> this with today's pack as well. >>>>> >>>>> Regards, >>>>> Pavithra >>>>> >>>>> >>>>> On Mon, May 19, 2014 at 7:10 AM, Prabath Siriwardena <prab...@wso2.com >>>>> > wrote: >>>>> >>>>>> Yes its a homogeneous cluster.. Asela is looking into the issue... >>>>>> >>>>>> Thanks & regards, >>>>>> -Prabath >>>>>> >>>>>> >>>>>> On Mon, May 19, 2014 at 5:52 AM, Pradeep Fernando >>>>>> <prad...@wso2.com>wrote: >>>>>> >>>>>>> I think this is a homogeneous cluster... if not, then it is the >>>>>>> root cause. I remember sometime ago, chamath and kishanthan working on a >>>>>>> similar kind of issue. >>>>>>> >>>>>>> >>>>>>> On Mon, May 19, 2014 at 1:09 AM, Afkham Azeez <az...@wso2.com>wrote: >>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> On Mon, May 19, 2014 at 1:05 AM, Prabath Siriwardena < >>>>>>>> prab...@wso2.com> wrote: >>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> On Mon, May 19, 2014 at 12:59 AM, Afkham Azeez <az...@wso2.com>wrote: >>>>>>>>> >>>>>>>>>> That could be one reason, and another way this can happen is this >>>>>>>>>> cache entry getting replicated on to another node that cannot see >>>>>>>>>> this >>>>>>>>>> class, and the first time it tries to access the entry is when it >>>>>>>>>> tries to >>>>>>>>>> do a cleanup, and at that point, tries to load the class, and then >>>>>>>>>> this >>>>>>>>>> failure happens. >>>>>>>>>> >>>>>>>>> >>>>>>>>> If this is the case.. do we have a solution for it..? >>>>>>>>> >>>>>>>> >>>>>>>> All nodes in a single cluster should be homogenous; which means, >>>>>>>> all nodes should see the same bundles/classes. Then this error will >>>>>>>> never >>>>>>>> happen. >>>>>>>> >>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> On Mon, May 19, 2014 at 12:55 AM, Pradeep Fernando < >>>>>>>>>> prad...@wso2.com> wrote: >>>>>>>>>> >>>>>>>>>>> The class, >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> org.wso2.carbon.identity.provisioning.cache.ProvisioningEntityCacheKey >>>>>>>>>>> >>>>>>>>>>> properly exported ? i know its a dumb question. just checking... >>>>>>>>>>> :) >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> On Mon, May 19, 2014 at 12:43 AM, Prabath Siriwardena < >>>>>>>>>>> prab...@wso2.com> wrote: >>>>>>>>>>> >>>>>>>>>>>> Appreciate a lot any clue on this...? >>>>>>>>>>>> >>>>>>>>>>>> https://wso2.org/jira/browse/IDENTITY-2454 >>>>>>>>>>>> >>>>>>>>>>>> - Error occurred while running CacheCleanupTask >>>>>>>>>>>> com.hazelcast.nio.serialization.HazelcastSerializationException: >>>>>>>>>>>> java.lang.ClassNotFoundException: >>>>>>>>>>>> org.wso2.carbon.identity.provisioning.cache.ProvisioningEntityCacheKey >>>>>>>>>>>> at >>>>>>>>>>>> com.hazelcast.nio.serialization.DefaultSerializers$ObjectSerializer.read(DefaultSerializers.java:190) >>>>>>>>>>>> at >>>>>>>>>>>> com.hazelcast.nio.serialization.StreamSerializerAdapter.read(StreamSerializerAdapter.java:59) >>>>>>>>>>>> >>>>>>>>>>>> -- >>>>>>>>>>>> Thanks & Regards, >>>>>>>>>>>> Prabath >>>>>>>>>>>> >>>>>>>>>>>> -- >>>>>>>>>>>> Thanks & Regards, >>>>>>>>>>>> Prabath >>>>>>>>>>>> >>>>>>>>>>>> Twitter : @prabath >>>>>>>>>>>> LinkedIn : http://www.linkedin.com/in/prabathsiriwardena >>>>>>>>>>>> >>>>>>>>>>>> Mobile : +94 71 809 6732 >>>>>>>>>>>> >>>>>>>>>>>> http://blog.facilelogin.com >>>>>>>>>>>> http://blog.api-security.org >>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> -- >>>>>>>>>>> *Pradeep Fernando* >>>>>>>>>>> Associate Technical Lead;WSO2 Inc.; http://wso2.com >>>>>>>>>>> >>>>>>>>>>> blog: http://pradeepfernando.blogspot.com >>>>>>>>>>> m: +94776603662 >>>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> -- >>>>>>>>>> *Afkham Azeez* >>>>>>>>>> Director of Architecture; WSO2, Inc.; http://wso2.com >>>>>>>>>> Member; Apache Software Foundation; http://www.apache.org/ >>>>>>>>>> * <http://www.apache.org/>* >>>>>>>>>> *email: **az...@wso2.com* <az...@wso2.com> >>>>>>>>>> * cell: +94 77 3320919 <%2B94%2077%203320919> blog: * >>>>>>>>>> *http://blog.afkham.org* <http://blog.afkham.org> >>>>>>>>>> *twitter: >>>>>>>>>> **http://twitter.com/afkham_azeez*<http://twitter.com/afkham_azeez> >>>>>>>>>> * linked-in: **http://lk.linkedin.com/in/afkhamazeez >>>>>>>>>> <http://lk.linkedin.com/in/afkhamazeez>* >>>>>>>>>> >>>>>>>>>> *Lean . Enterprise . Middleware* >>>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> -- >>>>>>>>> Thanks & Regards, >>>>>>>>> Prabath >>>>>>>>> >>>>>>>>> Twitter : @prabath >>>>>>>>> LinkedIn : http://www.linkedin.com/in/prabathsiriwardena >>>>>>>>> >>>>>>>>> Mobile : +94 71 809 6732 >>>>>>>>> >>>>>>>>> http://blog.facilelogin.com >>>>>>>>> http://blog.api-security.org >>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>>>> *Afkham Azeez* >>>>>>>> Director of Architecture; WSO2, Inc.; http://wso2.com >>>>>>>> Member; Apache Software Foundation; http://www.apache.org/ >>>>>>>> * <http://www.apache.org/>* >>>>>>>> *email: **az...@wso2.com* <az...@wso2.com> >>>>>>>> * cell: +94 77 3320919 <%2B94%2077%203320919> blog: * >>>>>>>> *http://blog.afkham.org* <http://blog.afkham.org> >>>>>>>> *twitter: >>>>>>>> **http://twitter.com/afkham_azeez*<http://twitter.com/afkham_azeez> >>>>>>>> * linked-in: **http://lk.linkedin.com/in/afkhamazeez >>>>>>>> <http://lk.linkedin.com/in/afkhamazeez>* >>>>>>>> >>>>>>>> *Lean . Enterprise . Middleware* >>>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> *Pradeep Fernando* >>>>>>> Associate Technical Lead;WSO2 Inc.; http://wso2.com >>>>>>> >>>>>>> blog: http://pradeepfernando.blogspot.com >>>>>>> m: +94776603662 >>>>>>> >>>>>>> _______________________________________________ >>>>>>> Dev mailing list >>>>>>> Dev@wso2.org >>>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>>>>> >>>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> Thanks & Regards, >>>>>> Prabath >>>>>> >>>>>> Twitter : @prabath >>>>>> LinkedIn : http://www.linkedin.com/in/prabathsiriwardena >>>>>> >>>>>> Mobile : +94 71 809 6732 >>>>>> >>>>>> http://blog.facilelogin.com >>>>>> http://blog.api-security.org >>>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> *Pavithra Madurangi* >>>>> Associate Technical Lead - QA. >>>>> WSO2 Inc.: http://wso2.com/ >>>>> Mobile: +94777207357 >>>>> >>>> >>>> >>>> >>>> -- >>>> *Afkham Azeez* >>>> Director of Architecture; WSO2, Inc.; http://wso2.com >>>> Member; Apache Software Foundation; http://www.apache.org/ >>>> * <http://www.apache.org/>* >>>> *email: **az...@wso2.com* <az...@wso2.com> >>>> * cell: +94 77 3320919 <%2B94%2077%203320919> blog: * >>>> *http://blog.afkham.org* <http://blog.afkham.org> >>>> *twitter: >>>> **http://twitter.com/afkham_azeez*<http://twitter.com/afkham_azeez> >>>> * linked-in: **http://lk.linkedin.com/in/afkhamazeez >>>> <http://lk.linkedin.com/in/afkhamazeez>* >>>> >>>> *Lean . Enterprise . Middleware* >>>> >>> >>> >>> >>> -- >>> *Pavithra Madurangi* >>> Associate Technical Lead - QA. >>> WSO2 Inc.: http://wso2.com/ >>> Mobile: +94777207357 >>> >> >> >> >> -- >> *Pradeep Fernando* >> Associate Technical Lead;WSO2 Inc.; http://wso2.com >> >> blog: http://pradeepfernando.blogspot.com >> m: +94776603662 >> >> _______________________________________________ >> Dev mailing list >> Dev@wso2.org >> http://wso2.org/cgi-bin/mailman/listinfo/dev >> >> > > > -- > *Kishanthan Thangarajah* > Senior Software Engineer, > Platform Technologies Team, > WSO2, Inc. > lean.enterprise.middleware > > Mobile - +94773426635 > Blog - *http://kishanthan.wordpress.com <http://kishanthan.wordpress.com>* > Twitter - *http://twitter.com/kishanthan <http://twitter.com/kishanthan>* > -- *Pavithra Madurangi* Associate Technical Lead - QA. WSO2 Inc.: http://wso2.com/ Mobile: +94777207357
_______________________________________________ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
