Re: [Dev] Caching implementation performance improvement

[Senaka Fernando]

Hi Azeez,

Looks really good in terms of performance.

Thanks,
Senaka.


On Thu, Aug 8, 2013 at 9:25 AM, Danushka Fernando wrote:

> Thats what my question was about. Thanks Azeez.
>
> Thanks & Regards
> Danushka Fernando
> Software Engineer
> WSO2 inc. http://wso2.com/
> Mobile : +94716332729
>
>
> On Wed, Aug 7, 2013 at 5:28 PM, Afkham Azeez  wrote:
>
>>
>>
>>
>> On Wed, Aug 7, 2013 at 2:59 PM, Danushka Fernando wrote:
>>
>>> Hi,
>>> Just wondering about the update mechanism. What happens when original
>>> value or L2 cache value get updated?
>>>
>>
>> I think the question is, if the L2 (distributed) cache got updated from
>> another node, how does it get reflected in the L1 caches of the other
>> nodes. We register an entry listener for the L2 cache, and whenever there
>> is a change, this gets triggered, and updates the L1 caches as well.
>>
>>
>>>
>>> Thanks & Regards
>>> Danushka Fernando
>>> Software Engineer
>>> WSO2 inc. http://wso2.com/
>>> Mobile : +94716332729
>>>
>>>
>>> On Wed, Aug 7, 2013 at 2:02 PM, Afkham Azeez  wrote:
>>>
  [image: Inline image 1]


 On Wed, Aug 7, 2013 at 11:31 AM, Afkham Azeez  wrote:

> While running certain scenarios during testing of the Carbon 4.2.0
> packs, we saw certain performance issues when distributed Hazelcast
> HashMaps are used as the backing data structure. To overcome this, I have
> introduced the concept of an L1 local cache. It is a write through cache,
> where items stored in it will also get written to the distributed data
> structure. When there is a L1 cache miss, we will check in the L2
> distributed cache to see whether the value is there.
>
> I am seeing significant performance improvement in the tenant creation
> scenario after this improvement.
>
> --
> *Afkham Azeez*
> Director of Architecture; WSO2, Inc.; http://wso2.com
> Member; Apache Software Foundation; http://www.apache.org/
> * **
> email: **az...@wso2.com* * cell: +94 77 3320919
> blog: **http://blog.afkham.org* *
> twitter: 
> **http://twitter.com/afkham_azeez*
> *
> linked-in: **http://lk.linkedin.com/in/afkhamazeez*
> *
> *
> *Lean . Enterprise . Middleware*
>



 --
 *Afkham Azeez*
 Director of Architecture; WSO2, Inc.; http://wso2.com
 Member; Apache Software Foundation; http://www.apache.org/
 * **
 email: **az...@wso2.com* * cell: +94 77 3320919
 blog: **http://blog.afkham.org* *
 twitter: 
 **http://twitter.com/afkham_azeez*
 *
 linked-in: **http://lk.linkedin.com/in/afkhamazeez*
 *
 *
 *Lean . Enterprise . Middleware*

 ___
 Dev mailing list
 Dev@wso2.org
 http://wso2.org/cgi-bin/mailman/listinfo/dev


>>>
>>
>>
>> --
>> *Afkham Azeez*
>> Director of Architecture; WSO2, Inc.; http://wso2.com
>> Member; Apache Software Foundation; http://www.apache.org/
>> * **
>> email: **az...@wso2.com* * cell: +94 77 3320919
>> blog: **http://blog.afkham.org* *
>> twitter: **http://twitter.com/afkham_azeez*
>> *
>> linked-in: **http://lk.linkedin.com/in/afkhamazeez*
>> *
>> *
>> *Lean . Enterprise . Middleware*
>>
>
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>
>


-- 
* 
*
*
*
*Senaka Fernando*
Senior Technical Lead; WSO2 Inc.; http://wso2.com*
Member; Apache Software Foundation; http://apache.org

E-mail: senaka AT wso2.com
**P: +1 408 754 7388; ext: 51736*; *M: +94 77 322 1818
Linked-In: http://linkedin.com/in/senakafernando

*Lean . Enterprise . Middleware
<>___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Caching implementation performance improvement

[Danushka Fernando]

Thats what my question was about. Thanks Azeez.

Thanks & Regards
Danushka Fernando
Software Engineer
WSO2 inc. http://wso2.com/
Mobile : +94716332729


On Wed, Aug 7, 2013 at 5:28 PM, Afkham Azeez  wrote:

>
>
>
> On Wed, Aug 7, 2013 at 2:59 PM, Danushka Fernando wrote:
>
>> Hi,
>> Just wondering about the update mechanism. What happens when original
>> value or L2 cache value get updated?
>>
>
> I think the question is, if the L2 (distributed) cache got updated from
> another node, how does it get reflected in the L1 caches of the other
> nodes. We register an entry listener for the L2 cache, and whenever there
> is a change, this gets triggered, and updates the L1 caches as well.
>
>
>>
>> Thanks & Regards
>> Danushka Fernando
>> Software Engineer
>> WSO2 inc. http://wso2.com/
>> Mobile : +94716332729
>>
>>
>> On Wed, Aug 7, 2013 at 2:02 PM, Afkham Azeez  wrote:
>>
>>>  [image: Inline image 1]
>>>
>>>
>>> On Wed, Aug 7, 2013 at 11:31 AM, Afkham Azeez  wrote:
>>>
 While running certain scenarios during testing of the Carbon 4.2.0
 packs, we saw certain performance issues when distributed Hazelcast
 HashMaps are used as the backing data structure. To overcome this, I have
 introduced the concept of an L1 local cache. It is a write through cache,
 where items stored in it will also get written to the distributed data
 structure. When there is a L1 cache miss, we will check in the L2
 distributed cache to see whether the value is there.

 I am seeing significant performance improvement in the tenant creation
 scenario after this improvement.

 --
 *Afkham Azeez*
 Director of Architecture; WSO2, Inc.; http://wso2.com
 Member; Apache Software Foundation; http://www.apache.org/
 * **
 email: **az...@wso2.com* * cell: +94 77 3320919
 blog: **http://blog.afkham.org* *
 twitter: 
 **http://twitter.com/afkham_azeez*
 *
 linked-in: **http://lk.linkedin.com/in/afkhamazeez*
 *
 *
 *Lean . Enterprise . Middleware*

>>>
>>>
>>>
>>> --
>>> *Afkham Azeez*
>>> Director of Architecture; WSO2, Inc.; http://wso2.com
>>> Member; Apache Software Foundation; http://www.apache.org/
>>> * **
>>> email: **az...@wso2.com* * cell: +94 77 3320919
>>> blog: **http://blog.afkham.org* *
>>> twitter: **http://twitter.com/afkham_azeez*
>>> *
>>> linked-in: **http://lk.linkedin.com/in/afkhamazeez*
>>> *
>>> *
>>> *Lean . Enterprise . Middleware*
>>>
>>> ___
>>> Dev mailing list
>>> Dev@wso2.org
>>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>>
>>>
>>
>
>
> --
> *Afkham Azeez*
> Director of Architecture; WSO2, Inc.; http://wso2.com
> Member; Apache Software Foundation; http://www.apache.org/
> * **
> email: **az...@wso2.com* * cell: +94 77 3320919
> blog: **http://blog.afkham.org* *
> twitter: **http://twitter.com/afkham_azeez*
> *
> linked-in: **http://lk.linkedin.com/in/afkhamazeez*
> *
> *
> *Lean . Enterprise . Middleware*
>
<>___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Caching implementation performance improvement

[Afkham Azeez]

On Wed, Aug 7, 2013 at 2:59 PM, Danushka Fernando wrote:

> Hi,
> Just wondering about the update mechanism. What happens when original
> value or L2 cache value get updated?
>

I think the question is, if the L2 (distributed) cache got updated from
another node, how does it get reflected in the L1 caches of the other
nodes. We register an entry listener for the L2 cache, and whenever there
is a change, this gets triggered, and updates the L1 caches as well.


>
> Thanks & Regards
> Danushka Fernando
> Software Engineer
> WSO2 inc. http://wso2.com/
> Mobile : +94716332729
>
>
> On Wed, Aug 7, 2013 at 2:02 PM, Afkham Azeez  wrote:
>
>>  [image: Inline image 1]
>>
>>
>> On Wed, Aug 7, 2013 at 11:31 AM, Afkham Azeez  wrote:
>>
>>> While running certain scenarios during testing of the Carbon 4.2.0
>>> packs, we saw certain performance issues when distributed Hazelcast
>>> HashMaps are used as the backing data structure. To overcome this, I have
>>> introduced the concept of an L1 local cache. It is a write through cache,
>>> where items stored in it will also get written to the distributed data
>>> structure. When there is a L1 cache miss, we will check in the L2
>>> distributed cache to see whether the value is there.
>>>
>>> I am seeing significant performance improvement in the tenant creation
>>> scenario after this improvement.
>>>
>>> --
>>> *Afkham Azeez*
>>> Director of Architecture; WSO2, Inc.; http://wso2.com
>>> Member; Apache Software Foundation; http://www.apache.org/
>>> * **
>>> email: **az...@wso2.com* * cell: +94 77 3320919
>>> blog: **http://blog.afkham.org* *
>>> twitter: **http://twitter.com/afkham_azeez*
>>> *
>>> linked-in: **http://lk.linkedin.com/in/afkhamazeez*
>>> *
>>> *
>>> *Lean . Enterprise . Middleware*
>>>
>>
>>
>>
>> --
>> *Afkham Azeez*
>> Director of Architecture; WSO2, Inc.; http://wso2.com
>> Member; Apache Software Foundation; http://www.apache.org/
>> * **
>> email: **az...@wso2.com* * cell: +94 77 3320919
>> blog: **http://blog.afkham.org* *
>> twitter: **http://twitter.com/afkham_azeez*
>> *
>> linked-in: **http://lk.linkedin.com/in/afkhamazeez*
>> *
>> *
>> *Lean . Enterprise . Middleware*
>>
>> ___
>> Dev mailing list
>> Dev@wso2.org
>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>
>>
>


-- 
*Afkham Azeez*
Director of Architecture; WSO2, Inc.; http://wso2.com
Member; Apache Software Foundation; http://www.apache.org/
* **
email: **az...@wso2.com* * cell: +94 77 3320919
blog: **http://blog.afkham.org* *
twitter: **http://twitter.com/afkham_azeez*
*
linked-in: **http://lk.linkedin.com/in/afkhamazeez*
*
*
*Lean . Enterprise . Middleware*
<>___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Caching implementation performance improvement

[Danushka Fernando]

Hi,
Just wondering about the update mechanism. What happens when original value
or L2 cache value get updated?

Thanks & Regards
Danushka Fernando
Software Engineer
WSO2 inc. http://wso2.com/
Mobile : +94716332729


On Wed, Aug 7, 2013 at 2:02 PM, Afkham Azeez  wrote:

> [image: Inline image 1]
>
>
> On Wed, Aug 7, 2013 at 11:31 AM, Afkham Azeez  wrote:
>
>> While running certain scenarios during testing of the Carbon 4.2.0 packs,
>> we saw certain performance issues when distributed Hazelcast HashMaps are
>> used as the backing data structure. To overcome this, I have introduced the
>> concept of an L1 local cache. It is a write through cache, where items
>> stored in it will also get written to the distributed data structure. When
>> there is a L1 cache miss, we will check in the L2 distributed cache to see
>> whether the value is there.
>>
>> I am seeing significant performance improvement in the tenant creation
>> scenario after this improvement.
>>
>> --
>> *Afkham Azeez*
>> Director of Architecture; WSO2, Inc.; http://wso2.com
>> Member; Apache Software Foundation; http://www.apache.org/
>> * **
>> email: **az...@wso2.com* * cell: +94 77 3320919
>> blog: **http://blog.afkham.org* *
>> twitter: **http://twitter.com/afkham_azeez*
>> *
>> linked-in: **http://lk.linkedin.com/in/afkhamazeez*
>> *
>> *
>> *Lean . Enterprise . Middleware*
>>
>
>
>
> --
> *Afkham Azeez*
> Director of Architecture; WSO2, Inc.; http://wso2.com
> Member; Apache Software Foundation; http://www.apache.org/
> * **
> email: **az...@wso2.com* * cell: +94 77 3320919
> blog: **http://blog.afkham.org* *
> twitter: **http://twitter.com/afkham_azeez*
> *
> linked-in: **http://lk.linkedin.com/in/afkhamazeez*
> *
> *
> *Lean . Enterprise . Middleware*
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>
>
<>___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Caching implementation performance improvement

[Afkham Azeez]

[image: Inline image 1]


On Wed, Aug 7, 2013 at 11:31 AM, Afkham Azeez  wrote:

> While running certain scenarios during testing of the Carbon 4.2.0 packs,
> we saw certain performance issues when distributed Hazelcast HashMaps are
> used as the backing data structure. To overcome this, I have introduced the
> concept of an L1 local cache. It is a write through cache, where items
> stored in it will also get written to the distributed data structure. When
> there is a L1 cache miss, we will check in the L2 distributed cache to see
> whether the value is there.
>
> I am seeing significant performance improvement in the tenant creation
> scenario after this improvement.
>
> --
> *Afkham Azeez*
> Director of Architecture; WSO2, Inc.; http://wso2.com
> Member; Apache Software Foundation; http://www.apache.org/
> * **
> email: **az...@wso2.com* * cell: +94 77 3320919
> blog: **http://blog.afkham.org* *
> twitter: **http://twitter.com/afkham_azeez*
> *
> linked-in: **http://lk.linkedin.com/in/afkhamazeez*
> *
> *
> *Lean . Enterprise . Middleware*
>



-- 
*Afkham Azeez*
Director of Architecture; WSO2, Inc.; http://wso2.com
Member; Apache Software Foundation; http://www.apache.org/
* **
email: **az...@wso2.com* * cell: +94 77 3320919
blog: **http://blog.afkham.org* *
twitter: **http://twitter.com/afkham_azeez*
*
linked-in: **http://lk.linkedin.com/in/afkhamazeez*
*
*
*Lean . Enterprise . Middleware*
<>___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Caching implementation performance improvement

[Afkham Azeez]

Yes, only CacheImpl class has changed. No API changes.


On Wed, Aug 7, 2013 at 11:53 AM, Pulasthi Supun  wrote:

> Hi,
>
> Great :), This is automatically handled by the
> caching implementation right? no need for any changes in higher levels.
>
>
> Regards,
> Pulasthi
>
>
> On Wed, Aug 7, 2013 at 11:39 AM, Afkham Azeez  wrote:
>
>> The attached profile screenshot shows the significant improvement
>>
>>
>> On Wed, Aug 7, 2013 at 11:31 AM, Afkham Azeez  wrote:
>>
>>> While running certain scenarios during testing of the Carbon 4.2.0
>>> packs, we saw certain performance issues when distributed Hazelcast
>>> HashMaps are used as the backing data structure. To overcome this, I have
>>> introduced the concept of an L1 local cache. It is a write through cache,
>>> where items stored in it will also get written to the distributed data
>>> structure. When there is a L1 cache miss, we will check in the L2
>>> distributed cache to see whether the value is there.
>>>
>>> I am seeing significant performance improvement in the tenant creation
>>> scenario after this improvement.
>>>
>>> --
>>> *Afkham Azeez*
>>> Director of Architecture; WSO2, Inc.; http://wso2.com
>>> Member; Apache Software Foundation; http://www.apache.org/
>>> * **
>>> email: **az...@wso2.com* * cell: +94 77 3320919
>>> blog: **http://blog.afkham.org* *
>>> twitter: **http://twitter.com/afkham_azeez*
>>> *
>>> linked-in: **http://lk.linkedin.com/in/afkhamazeez*
>>> *
>>> *
>>> *Lean . Enterprise . Middleware*
>>>
>>
>>
>>
>> --
>> *Afkham Azeez*
>> Director of Architecture; WSO2, Inc.; http://wso2.com
>> Member; Apache Software Foundation; http://www.apache.org/
>> * **
>> email: **az...@wso2.com* * cell: +94 77 3320919
>> blog: **http://blog.afkham.org* *
>> twitter: **http://twitter.com/afkham_azeez*
>> *
>> linked-in: **http://lk.linkedin.com/in/afkhamazeez*
>> *
>> *
>> *Lean . Enterprise . Middleware*
>>
>> ___
>> Dev mailing list
>> Dev@wso2.org
>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>
>>
>
>
> --
> --
> Pulasthi Supun
> Software Engineer; WSO2 Inc.; http://wso2.com,
> Email: pulas...@wso2.com
> Mobile: +94 (71) 9258281
> Blog : http://pulasthisupun.blogspot.com/
> Git hub profile: https://github.com/pulasthi
>



-- 
*Afkham Azeez*
Director of Architecture; WSO2, Inc.; http://wso2.com
Member; Apache Software Foundation; http://www.apache.org/
* **
email: **az...@wso2.com* * cell: +94 77 3320919
blog: **http://blog.afkham.org* *
twitter: **http://twitter.com/afkham_azeez*
*
linked-in: **http://lk.linkedin.com/in/afkhamazeez*
*
*
*Lean . Enterprise . Middleware*
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Caching implementation performance improvement

[Pulasthi Supun]

Hi,

Great :), This is automatically handled by the
caching implementation right? no need for any changes in higher levels.


Regards,
Pulasthi


On Wed, Aug 7, 2013 at 11:39 AM, Afkham Azeez  wrote:

> The attached profile screenshot shows the significant improvement
>
>
> On Wed, Aug 7, 2013 at 11:31 AM, Afkham Azeez  wrote:
>
>> While running certain scenarios during testing of the Carbon 4.2.0 packs,
>> we saw certain performance issues when distributed Hazelcast HashMaps are
>> used as the backing data structure. To overcome this, I have introduced the
>> concept of an L1 local cache. It is a write through cache, where items
>> stored in it will also get written to the distributed data structure. When
>> there is a L1 cache miss, we will check in the L2 distributed cache to see
>> whether the value is there.
>>
>> I am seeing significant performance improvement in the tenant creation
>> scenario after this improvement.
>>
>> --
>> *Afkham Azeez*
>> Director of Architecture; WSO2, Inc.; http://wso2.com
>> Member; Apache Software Foundation; http://www.apache.org/
>> * **
>> email: **az...@wso2.com* * cell: +94 77 3320919
>> blog: **http://blog.afkham.org* *
>> twitter: **http://twitter.com/afkham_azeez*
>> *
>> linked-in: **http://lk.linkedin.com/in/afkhamazeez*
>> *
>> *
>> *Lean . Enterprise . Middleware*
>>
>
>
>
> --
> *Afkham Azeez*
> Director of Architecture; WSO2, Inc.; http://wso2.com
> Member; Apache Software Foundation; http://www.apache.org/
> * **
> email: **az...@wso2.com* * cell: +94 77 3320919
> blog: **http://blog.afkham.org* *
> twitter: **http://twitter.com/afkham_azeez*
> *
> linked-in: **http://lk.linkedin.com/in/afkhamazeez*
> *
> *
> *Lean . Enterprise . Middleware*
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>
>


-- 
--
Pulasthi Supun
Software Engineer; WSO2 Inc.; http://wso2.com,
Email: pulas...@wso2.com
Mobile: +94 (71) 9258281
Blog : http://pulasthisupun.blogspot.com/
Git hub profile: https://github.com/pulasthi
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

[Dev] Caching implementation performance improvement

[Afkham Azeez]

While running certain scenarios during testing of the Carbon 4.2.0 packs,
we saw certain performance issues when distributed Hazelcast HashMaps are
used as the backing data structure. To overcome this, I have introduced the
concept of an L1 local cache. It is a write through cache, where items
stored in it will also get written to the distributed data structure. When
there is a L1 cache miss, we will check in the L2 distributed cache to see
whether the value is there.

I am seeing significant performance improvement in the tenant creation
scenario after this improvement.

-- 
*Afkham Azeez*
Director of Architecture; WSO2, Inc.; http://wso2.com
Member; Apache Software Foundation; http://www.apache.org/
* **
email: **az...@wso2.com* * cell: +94 77 3320919
blog: **http://blog.afkham.org* *
twitter: **http://twitter.com/afkham_azeez*
*
linked-in: **http://lk.linkedin.com/in/afkhamazeez*
*
*
*Lean . Enterprise . Middleware*
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev