Re: [infinispan-dev] infinispan 5.2.0.Beta3

2012-10-29 Thread Galder Zamarreño
I think we need to get Sanne's POV on that. I had a brief look into it and the 
fix looks good, but not sure if there are better ways to fix it.

On Oct 26, 2012, at 7:42 PM, Ales Justin ales.jus...@gmail.com wrote:

 What about today's ISPN-2448?
 
 On Oct 26, 2012, at 7:38 PM, Mircea Markus mircea.mar...@jboss.com wrote:
 
 The fix for lock leaks[1] - blocker - hasn't been integrated yet as it needs 
 more testing (Manik) and more time to review (Dan).
 Manik suggested testing should be ready by Mon, so I'll cut the release then.
 This would also allow time to finish integrating other stuff in the PR 
 queue, in particular Vladimir's Map/Reduce cancelation(Mircea) [2]
 
 [1] ISPN-2381 Locks are removed even if not successfully unlocked
 [2] ISPN-1042 - Enable distributed and Map/Reduce task 
 interruption/cancellation
 
 
 On 25 Oct 2012, at 17:37, Mircea Markus wrote:
 Hi,
 
 We have a lot of pull requests pending. Until Beta3 is released, can we 
 please focus on these and slow down the development for now.
 I've grouped them as follows. Please feel free to shuffle them around/ ask 
 for more feedback if you think appropriate, but please take ownership of 
 them and make sure they get integrated.
 
 Dan: 
 ISPN-2373 State transfer does not end because some segments are erroneously 
 reported as unreceived 
 Lookup optimisation in TransactionTable.getLocalTransaction and cleanup in 
 BaseRpcInterceptor hierarchy
 ISPN-2381 Locks are removed even if not successfully unlocked
 
 Adrian:
 ISPN-2318 Reimplement a Topology-Aware Consistent Hash
 
 Galder:
 ISPN-2429 Cache restart still doesn't work properly for query-enabled caches
 JBQA-6819 - Added the ant script which merges and generates jacoco code 
 coverage report file.
 ISPN-2412 Allow specifying container and cache when connecting via CLI
 
 Tristan:
 [5.1.x] ISPN-2414 Fixes to reduce memory consumption of local caches
 ISPN-2414 Fixes to reduce memory consumption of local caches
 
 Mircea:
 ISPN-2440 JGroupsTransport.invokeRemotely throws SuspectExceptions even ...
 Fix DummyInMemoryCacheStoreConfigurationBuilder#read()
 ISPN-2371 The global component registry fails to start components
 ISPN-2443 - tests are added for reproducing/verifying the issue.
 ISPN-2386 - Test reproducing/verifying the issue with ClassCastingException 
 in case of CacheLoader usage (with storeAsBinary conf).
 ISPN-1042 - Enable distributed and Map/Reduce task interruption/cancellation
 
 Vladimir:
 ISPN-2409 - Reproduction/verification case for NotSerializableException 
 occurence.
 
 Cheers,
 -- 
 Mircea Markus
 Infinispan lead (www.infinispan.org)
 
 
 
 
 
 Cheers,
 -- 
 Mircea Markus
 Infinispan lead (www.infinispan.org)
 
 
 
 
 ___
 infinispan-dev mailing list
 infinispan-dev@lists.jboss.org
 https://lists.jboss.org/mailman/listinfo/infinispan-dev
 
 ___
 infinispan-dev mailing list
 infinispan-dev@lists.jboss.org
 https://lists.jboss.org/mailman/listinfo/infinispan-dev


--
Galder Zamarreño
gal...@redhat.com
twitter.com/galderz

Project Lead, Escalante
http://escalante.io

Engineer, Infinispan
http://infinispan.org


___
infinispan-dev mailing list
infinispan-dev@lists.jboss.org
https://lists.jboss.org/mailman/listinfo/infinispan-dev


Re: [infinispan-dev] Testsuite: hanging TestNG, CDI proken

2012-10-29 Thread Anna Manukyan
Hi Sanne,

sorry for my interfering in - I was lately working on CDI testsuite - 
evaluating the coverage, etc. and actually on my local environment as well as 
on Jenkins, the CDI integration tests are passing properly.

I've run the tests several times, but I hadn't got the test hangouts as you 
have mentioned and all tests are passing on my side without failures.

I've tried also the testsuite execution with TestNG version 6.7 and it is fine 
as well.

I just thought, maybe there is something wrong with your testsuite setup or 
environment (just thoughts)?

Best regards,
Anna.

- Original Message -
From: Sanne Grinovero sa...@infinispan.org
To: infinispan -Dev List infinispan-dev@lists.jboss.org
Sent: Sunday, October 28, 2012 11:12:32 AM
Subject: [infinispan-dev] Testsuite: hanging TestNG, CDI proken

Hello all,

besides having regular failures, I also experienced occasional hangs
while running the testsuite; in some cases I found the following stack
which suggests a TestNG bug:

pool-3-thread-14 prio=10 tid=0x7f0d84632000 nid=0x1ce5 runnable
[0x7f0d58a36000]
   java.lang.Thread.State: RUNNABLE
at java.util.HashMap.put(HashMap.java:374)
at org.testng.SuiteRunner.runTest(SuiteRunner.java:320)
at org.testng.SuiteRunner.access$000(SuiteRunner.java:34)
at org.testng.SuiteRunner$SuiteWorker.run(SuiteRunner.java:351)
at 
org.testng.internal.thread.ThreadUtil$CountDownLatchedRunnable.run(ThreadUtil.java:147)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)

Even when taking multiple dumps that thread is still in the same loop,
and having a single CPU stuck at 100% I'm guessing the HashMap was
being used in some unsafe way regarding concurrency; we're using the
first minor version of TestNG which ever supported parallel testsuite
invocations so that might not be very solid.

Not sure why, but upgrading TestNG from 5.14.10 to 6.7 seems to
resolve the problem.

Now I wish I could send a pull request, but even skipping just the
core testsuite (which always fails for me even in non-parallel mode)
many other modules are broken both with and without my patches, so I'm
dropping my experiments as I won't send any pull requests if the tests
can't back my changes up.

As an example the CDI integration is:

Tests run: 247, Failures: 102, Errors: 0, Skipped: 143

...which means 2 tests are fine.

Cheers,
Sanne
___
infinispan-dev mailing list
infinispan-dev@lists.jboss.org
https://lists.jboss.org/mailman/listinfo/infinispan-dev
___
infinispan-dev mailing list
infinispan-dev@lists.jboss.org
https://lists.jboss.org/mailman/listinfo/infinispan-dev


Re: [infinispan-dev] Testsuite: hanging TestNG, CDI proken

2012-10-29 Thread Galder Zamarreño

On Oct 29, 2012, at 8:59 AM, Anna Manukyan amanu...@redhat.com wrote:

 Hi Sanne,
 
 sorry for my interfering in - I was lately working on CDI testsuite - 
 evaluating the coverage, etc. and actually on my local environment as well as 
 on Jenkins, the CDI integration tests are passing properly.
 
 I've run the tests several times, but I hadn't got the test hangouts as you 
 have mentioned and all tests are passing on my side without failures.
 
 I've tried also the testsuite execution with TestNG version 6.7 and it is 
 fine as well.
 
 I just thought, maybe there is something wrong with your testsuite setup or 
 environment (just thoughts)?

We've seen CDI testsuite fail massively at points due to some bug in TestNG, 
and although I cannot find the exact email right now, I thought long term the 
idea was to move to JUnit.

Example: 
https://infinispan.ci.cloudbees.com/job/Infinispan-master-JDK6-tcp/867/#showFailuresLink

@Sanne, if you see tests failing (apart from the massive CDI failure thing, if 
it looks like the failures in the link above), create a JIRA and assign it to 
the right person. The problem is disabling the tests which is a bit tedious if 
you're doing per JIRA, but you could batch them up.

 
 Best regards,
 Anna.
 
 - Original Message -
 From: Sanne Grinovero sa...@infinispan.org
 To: infinispan -Dev List infinispan-dev@lists.jboss.org
 Sent: Sunday, October 28, 2012 11:12:32 AM
 Subject: [infinispan-dev] Testsuite: hanging TestNG, CDI proken
 
 Hello all,
 
 besides having regular failures, I also experienced occasional hangs
 while running the testsuite; in some cases I found the following stack
 which suggests a TestNG bug:
 
 pool-3-thread-14 prio=10 tid=0x7f0d84632000 nid=0x1ce5 runnable
 [0x7f0d58a36000]
   java.lang.Thread.State: RUNNABLE
   at java.util.HashMap.put(HashMap.java:374)
   at org.testng.SuiteRunner.runTest(SuiteRunner.java:320)
   at org.testng.SuiteRunner.access$000(SuiteRunner.java:34)
   at org.testng.SuiteRunner$SuiteWorker.run(SuiteRunner.java:351)
   at 
 org.testng.internal.thread.ThreadUtil$CountDownLatchedRunnable.run(ThreadUtil.java:147)
   at 
 java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
   at 
 java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
   at java.lang.Thread.run(Thread.java:662)
 
 Even when taking multiple dumps that thread is still in the same loop,
 and having a single CPU stuck at 100% I'm guessing the HashMap was
 being used in some unsafe way regarding concurrency; we're using the
 first minor version of TestNG which ever supported parallel testsuite
 invocations so that might not be very solid.
 
 Not sure why, but upgrading TestNG from 5.14.10 to 6.7 seems to
 resolve the problem.
 
 Now I wish I could send a pull request, but even skipping just the
 core testsuite (which always fails for me even in non-parallel mode)
 many other modules are broken both with and without my patches, so I'm
 dropping my experiments as I won't send any pull requests if the tests
 can't back my changes up.
 
 As an example the CDI integration is:
 
 Tests run: 247, Failures: 102, Errors: 0, Skipped: 143
 
 ...which means 2 tests are fine.
 
 Cheers,
 Sanne
 ___
 infinispan-dev mailing list
 infinispan-dev@lists.jboss.org
 https://lists.jboss.org/mailman/listinfo/infinispan-dev
 ___
 infinispan-dev mailing list
 infinispan-dev@lists.jboss.org
 https://lists.jboss.org/mailman/listinfo/infinispan-dev


--
Galder Zamarreño
gal...@redhat.com
twitter.com/galderz

Project Lead, Escalante
http://escalante.io

Engineer, Infinispan
http://infinispan.org


___
infinispan-dev mailing list
infinispan-dev@lists.jboss.org
https://lists.jboss.org/mailman/listinfo/infinispan-dev


[infinispan-dev] iOS client lib

2012-10-29 Thread Matthias Wessendorf
HEllo,

For a WebSocket demo, I created the following iOS lib (basically a
port of the infinispan-ws.js file)
https://github.com/matzew/infinispan-ios. I was wondering if there is
interest in moving that project over to the umbrella infinispan repo
at github.

Thx,
Matthias

-- 
Matthias Wessendorf

blog: http://matthiaswessendorf.wordpress.com/
sessions: http://www.slideshare.net/mwessendorf
twitter: http://twitter.com/mwessendorf
___
infinispan-dev mailing list
infinispan-dev@lists.jboss.org
https://lists.jboss.org/mailman/listinfo/infinispan-dev


Re: [infinispan-dev] Testsuite: hanging TestNG, CDI proken

2012-10-29 Thread Anna Manukyan
Yes, I have encountered the same failures as well, but this was before I've 
updated the TestNG jar version from 5.14.6 to 5.14.10 in pom.xml for 
cdi/extension module. 
In pom.xml for cdi/extension module there is separate TestNG dependency 
declared with it's own version which is non-inherited from parent's pom.xml.

version.testng.arquillian5.14.6/version.testng.arquillian 

The last build on master was done on 4th of October which is before my upgrade 
to 5.14.10 done of 15th of October. 

Would it be possible to run the build on master one more time, to see whether 
the update fixed the issue?

- Original Message -
From: Galder Zamarreño gal...@redhat.com
To: infinispan -Dev List infinispan-dev@lists.jboss.org
Cc: Sanne Grinovero sgrin...@redhat.com
Sent: Monday, October 29, 2012 10:10:23 AM
Subject: Re: [infinispan-dev] Testsuite: hanging TestNG, CDI proken


On Oct 29, 2012, at 8:59 AM, Anna Manukyan amanu...@redhat.com wrote:

 Hi Sanne,
 
 sorry for my interfering in - I was lately working on CDI testsuite - 
 evaluating the coverage, etc. and actually on my local environment as well as 
 on Jenkins, the CDI integration tests are passing properly.
 
 I've run the tests several times, but I hadn't got the test hangouts as you 
 have mentioned and all tests are passing on my side without failures.
 
 I've tried also the testsuite execution with TestNG version 6.7 and it is 
 fine as well.
 
 I just thought, maybe there is something wrong with your testsuite setup or 
 environment (just thoughts)?

We've seen CDI testsuite fail massively at points due to some bug in TestNG, 
and although I cannot find the exact email right now, I thought long term the 
idea was to move to JUnit.

Example: 
https://infinispan.ci.cloudbees.com/job/Infinispan-master-JDK6-tcp/867/#showFailuresLink

@Sanne, if you see tests failing (apart from the massive CDI failure thing, if 
it looks like the failures in the link above), create a JIRA and assign it to 
the right person. The problem is disabling the tests which is a bit tedious if 
you're doing per JIRA, but you could batch them up.

 
 Best regards,
 Anna.
 
 - Original Message -
 From: Sanne Grinovero sa...@infinispan.org
 To: infinispan -Dev List infinispan-dev@lists.jboss.org
 Sent: Sunday, October 28, 2012 11:12:32 AM
 Subject: [infinispan-dev] Testsuite: hanging TestNG, CDI proken
 
 Hello all,
 
 besides having regular failures, I also experienced occasional hangs
 while running the testsuite; in some cases I found the following stack
 which suggests a TestNG bug:
 
 pool-3-thread-14 prio=10 tid=0x7f0d84632000 nid=0x1ce5 runnable
 [0x7f0d58a36000]
   java.lang.Thread.State: RUNNABLE
   at java.util.HashMap.put(HashMap.java:374)
   at org.testng.SuiteRunner.runTest(SuiteRunner.java:320)
   at org.testng.SuiteRunner.access$000(SuiteRunner.java:34)
   at org.testng.SuiteRunner$SuiteWorker.run(SuiteRunner.java:351)
   at 
 org.testng.internal.thread.ThreadUtil$CountDownLatchedRunnable.run(ThreadUtil.java:147)
   at 
 java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
   at 
 java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
   at java.lang.Thread.run(Thread.java:662)
 
 Even when taking multiple dumps that thread is still in the same loop,
 and having a single CPU stuck at 100% I'm guessing the HashMap was
 being used in some unsafe way regarding concurrency; we're using the
 first minor version of TestNG which ever supported parallel testsuite
 invocations so that might not be very solid.
 
 Not sure why, but upgrading TestNG from 5.14.10 to 6.7 seems to
 resolve the problem.
 
 Now I wish I could send a pull request, but even skipping just the
 core testsuite (which always fails for me even in non-parallel mode)
 many other modules are broken both with and without my patches, so I'm
 dropping my experiments as I won't send any pull requests if the tests
 can't back my changes up.
 
 As an example the CDI integration is:
 
 Tests run: 247, Failures: 102, Errors: 0, Skipped: 143
 
 ...which means 2 tests are fine.
 
 Cheers,
 Sanne
 ___
 infinispan-dev mailing list
 infinispan-dev@lists.jboss.org
 https://lists.jboss.org/mailman/listinfo/infinispan-dev
 ___
 infinispan-dev mailing list
 infinispan-dev@lists.jboss.org
 https://lists.jboss.org/mailman/listinfo/infinispan-dev


--
Galder Zamarreño
gal...@redhat.com
twitter.com/galderz

Project Lead, Escalante
http://escalante.io

Engineer, Infinispan
http://infinispan.org


___
infinispan-dev mailing list
infinispan-dev@lists.jboss.org
https://lists.jboss.org/mailman/listinfo/infinispan-dev

___
infinispan-dev mailing list
infinispan-dev@lists.jboss.org
https://lists.jboss.org/mailman/listinfo/infinispan-dev

Re: [infinispan-dev] broken lazy query iteration

2012-10-29 Thread Emmanuel Bernard
Correct, the DocumentExtractor contract expects the absolute index. It
looks like a bug in how ISPN's Query module use it.

Emmanuel

On Fri 2012-10-26 16:09, Ales Justin wrote:
 After searching for the needed in haystack, I finally found the problem.
 (not to mention complete lack of tests for this *basic* feature ...)
 
 The problem is with queries with offset when you iterate over them -- offset 
 is never taken into account.
 
 There are two possible fixes -- as I see them.
 
 1) In HS:
 
 DocumentExtractorImpl::extract takes into account firstIndex
 
   public EntityInfo extract(int scoreDocIndex) throws IOException {
   int docId = queryHits.docId( firstIndex + scoreDocIndex );
   Document document = extractDocument( fistIndex + scoreDocIndex 
 );
 
 2) LazyIterator in Infinispan-Query applies the offset:
 
protected EntityInfo loadEntityInfo(int index) {
   try {
  return extractor.extract(extractor.getFirstIndex() + index);
 
 ---
 
 Since those methods are exposed in DocumentExtractor,
 I would guess they were meant for external code to use them,
 instead of putting this logic into extractor itself.
 
 So, I'll go ahead and provide a patch for (2).
 
 -Ales
 
___
infinispan-dev mailing list
infinispan-dev@lists.jboss.org
https://lists.jboss.org/mailman/listinfo/infinispan-dev


Re: [infinispan-dev] Testsuite: hanging TestNG, CDI proken

2012-10-29 Thread Mircea Markus

On 29 Oct 2012, at 09:10, Galder Zamarreño wrote:

 
 On Oct 29, 2012, at 8:59 AM, Anna Manukyan amanu...@redhat.com wrote:
 
 Hi Sanne,
 
 sorry for my interfering in - I was lately working on CDI testsuite - 
 evaluating the coverage, etc. and actually on my local environment as well 
 as on Jenkins, the CDI integration tests are passing properly.
 
 I've run the tests several times, but I hadn't got the test hangouts as you 
 have mentioned and all tests are passing on my side without failures.
 
 I've tried also the testsuite execution with TestNG version 6.7 and it is 
 fine as well.
 
 I just thought, maybe there is something wrong with your testsuite setup or 
 environment (just thoughts)?
 
 We've seen CDI testsuite fail massively at points due to some bug in TestNG, 
 and although I cannot find the exact email right now, I thought long term the 
 idea was to move to JUnit.
Switching to JUnit won't happen very soon unfortunately, so upgrading TestNG 
should still be done that we won't have this kind of issues. 
I'll take a look at upgrading TestNG  - now that we have Jenkins up and running 
(thanks Galder!).

 
 Example: 
 https://infinispan.ci.cloudbees.com/job/Infinispan-master-JDK6-tcp/867/#showFailuresLink
 
 @Sanne, if you see tests failing (apart from the massive CDI failure thing, 
 if it looks like the failures in the link above), create a JIRA and assign it 
 to the right person. The problem is disabling the tests which is a bit 
 tedious if you're doing per JIRA, but you could batch them up.


Cheers,
-- 
Mircea Markus
Infinispan lead (www.infinispan.org)




___
infinispan-dev mailing list
infinispan-dev@lists.jboss.org
https://lists.jboss.org/mailman/listinfo/infinispan-dev

Re: [infinispan-dev] broken lazy query iteration

2012-10-29 Thread Ales Justin
What's the design decision behind this?

As DE has all the info, it could easily hide the offset (and max) into impl 
details.

-Ales

On Oct 29, 2012, at 11:14 AM, Emmanuel Bernard emman...@hibernate.org wrote:

 Correct, the DocumentExtractor contract expects the absolute index. It
 looks like a bug in how ISPN's Query module use it.
 
 Emmanuel
 
 On Fri 2012-10-26 16:09, Ales Justin wrote:
 After searching for the needed in haystack, I finally found the problem.
 (not to mention complete lack of tests for this *basic* feature ...)
 
 The problem is with queries with offset when you iterate over them -- offset 
 is never taken into account.
 
 There are two possible fixes -- as I see them.
 
 1) In HS:
 
 DocumentExtractorImpl::extract takes into account firstIndex
 
  public EntityInfo extract(int scoreDocIndex) throws IOException {
  int docId = queryHits.docId( firstIndex + scoreDocIndex );
  Document document = extractDocument( fistIndex + scoreDocIndex 
 );
 
 2) LazyIterator in Infinispan-Query applies the offset:
 
   protected EntityInfo loadEntityInfo(int index) {
  try {
 return extractor.extract(extractor.getFirstIndex() + index);
 
 ---
 
 Since those methods are exposed in DocumentExtractor,
 I would guess they were meant for external code to use them,
 instead of putting this logic into extractor itself.
 
 So, I'll go ahead and provide a patch for (2).
 
 -Ales
 


___
infinispan-dev mailing list
infinispan-dev@lists.jboss.org
https://lists.jboss.org/mailman/listinfo/infinispan-dev


Re: [infinispan-dev] Testsuite: hanging TestNG, CDI proken

2012-10-29 Thread Sanne Grinovero
On 29 October 2012 08:59, Anna Manukyan amanu...@redhat.com wrote:
 Hi Sanne,

 sorry for my interfering in - I was lately working on CDI testsuite - 
 evaluating the coverage, etc. and actually on my local environment as well as 
 on Jenkins, the CDI integration tests are passing properly.

Hi Anna,
I wouldn't call that interfering, it's exactly the kind of feedback I
was looking for. I just checked master again, and it still failed for
me.
This is the stack I have in all tests, in case it helps:

java.lang.NullPointerException
at 
org.jboss.arquillian.testng.Arquillian.arquillianAfterClass(Arquillian.java:82)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at 
org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:74)
at 
org.testng.internal.Invoker.invokeConfigurationMethod(Invoker.java:525)
at org.testng.internal.Invoker.invokeConfigurations(Invoker.java:202)
at org.testng.internal.Invoker.invokeConfigurations(Invoker.java:130)
at 
org.testng.internal.TestMethodWorker.invokeAfterClassMethods(TestMethodWorker.java:222)
at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:112)
at org.testng.TestRunner.runWorkers(TestRunner.java:1147)
at org.testng.TestRunner.privateRun(TestRunner.java:749)
at org.testng.TestRunner.run(TestRunner.java:600)
at org.testng.SuiteRunner.runTest(SuiteRunner.java:317)
at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:312)
at org.testng.SuiteRunner.privateRun(SuiteRunner.java:274)
at org.testng.SuiteRunner.run(SuiteRunner.java:223)
at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52)
at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86)
at org.testng.TestNG.runSuitesSequentially(TestNG.java:1039)
at org.testng.TestNG.runSuitesLocally(TestNG.java:964)
at org.testng.TestNG.run(TestNG.java:900)
at 
org.apache.maven.surefire.testng.TestNGExecutor.run(TestNGExecutor.java:77)


Anyway, whatever the state of CDI that looks like a separate problem;
I can't run the core testsuite reliably with this version of TestNG;
from Vladimir's comment I guess we can't upgrade easily
so I'm opening ISPN-2450.

Cheers,
Sanne



 I've run the tests several times, but I hadn't got the test hangouts as you 
 have mentioned and all tests are passing on my side without failures.

 I've tried also the testsuite execution with TestNG version 6.7 and it is 
 fine as well.

 I just thought, maybe there is something wrong with your testsuite setup or 
 environment (just thoughts)?

 Best regards,
 Anna.

 - Original Message -
 From: Sanne Grinovero sa...@infinispan.org
 To: infinispan -Dev List infinispan-dev@lists.jboss.org
 Sent: Sunday, October 28, 2012 11:12:32 AM
 Subject: [infinispan-dev] Testsuite: hanging TestNG, CDI proken

 Hello all,

 besides having regular failures, I also experienced occasional hangs
 while running the testsuite; in some cases I found the following stack
 which suggests a TestNG bug:

 pool-3-thread-14 prio=10 tid=0x7f0d84632000 nid=0x1ce5 runnable
 [0x7f0d58a36000]
java.lang.Thread.State: RUNNABLE
 at java.util.HashMap.put(HashMap.java:374)
 at org.testng.SuiteRunner.runTest(SuiteRunner.java:320)
 at org.testng.SuiteRunner.access$000(SuiteRunner.java:34)
 at org.testng.SuiteRunner$SuiteWorker.run(SuiteRunner.java:351)
 at 
 org.testng.internal.thread.ThreadUtil$CountDownLatchedRunnable.run(ThreadUtil.java:147)
 at 
 java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
 at 
 java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
 at java.lang.Thread.run(Thread.java:662)

 Even when taking multiple dumps that thread is still in the same loop,
 and having a single CPU stuck at 100% I'm guessing the HashMap was
 being used in some unsafe way regarding concurrency; we're using the
 first minor version of TestNG which ever supported parallel testsuite
 invocations so that might not be very solid.

 Not sure why, but upgrading TestNG from 5.14.10 to 6.7 seems to
 resolve the problem.

 Now I wish I could send a pull request, but even skipping just the
 core testsuite (which always fails for me even in non-parallel mode)
 many other modules are broken both with and without my patches, so I'm
 dropping my experiments as I won't send any pull requests if the tests
 can't back my changes up.

 As an example the CDI integration is:

 Tests run: 247, Failures: 102, Errors: 0, Skipped: 143

 ...which means 2 tests are fine.

 Cheers,
 Sanne
 

Re: [infinispan-dev] Testsuite: hanging TestNG, CDI proken

2012-10-29 Thread Manik Surtani
For what it's worth, I just created a branch with:

* TestNG 6.7 as a dependency in parent/pom.xml (so all modules use this)
* Updated cdi/extension/pom.xml to use ${version.testng} rather than 
${version.testng.arquillian} - so it too now uses TestNG 6.7.

Ran tests.

Results from tests in cdi/extension:

Results :

Tests run: 60, Failures: 0, Errors: 0, Skipped: 0

Anyone want a pull req? ;)

- M

On 29 Oct 2012, at 16:06, Sanne Grinovero sa...@infinispan.org wrote:

 On 29 October 2012 08:59, Anna Manukyan amanu...@redhat.com wrote:
 Hi Sanne,
 
 sorry for my interfering in - I was lately working on CDI testsuite - 
 evaluating the coverage, etc. and actually on my local environment as well 
 as on Jenkins, the CDI integration tests are passing properly.
 
 Hi Anna,
 I wouldn't call that interfering, it's exactly the kind of feedback I
 was looking for. I just checked master again, and it still failed for
 me.
 This is the stack I have in all tests, in case it helps:
 
 java.lang.NullPointerException
   at 
 org.jboss.arquillian.testng.Arquillian.arquillianAfterClass(Arquillian.java:82)
   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   at 
 sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
   at 
 sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
   at java.lang.reflect.Method.invoke(Method.java:597)
   at 
 org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:74)
   at 
 org.testng.internal.Invoker.invokeConfigurationMethod(Invoker.java:525)
   at org.testng.internal.Invoker.invokeConfigurations(Invoker.java:202)
   at org.testng.internal.Invoker.invokeConfigurations(Invoker.java:130)
   at 
 org.testng.internal.TestMethodWorker.invokeAfterClassMethods(TestMethodWorker.java:222)
   at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:112)
   at org.testng.TestRunner.runWorkers(TestRunner.java:1147)
   at org.testng.TestRunner.privateRun(TestRunner.java:749)
   at org.testng.TestRunner.run(TestRunner.java:600)
   at org.testng.SuiteRunner.runTest(SuiteRunner.java:317)
   at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:312)
   at org.testng.SuiteRunner.privateRun(SuiteRunner.java:274)
   at org.testng.SuiteRunner.run(SuiteRunner.java:223)
   at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52)
   at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86)
   at org.testng.TestNG.runSuitesSequentially(TestNG.java:1039)
   at org.testng.TestNG.runSuitesLocally(TestNG.java:964)
   at org.testng.TestNG.run(TestNG.java:900)
   at 
 org.apache.maven.surefire.testng.TestNGExecutor.run(TestNGExecutor.java:77)
 
 
 Anyway, whatever the state of CDI that looks like a separate problem;
 I can't run the core testsuite reliably with this version of TestNG;
 from Vladimir's comment I guess we can't upgrade easily
 so I'm opening ISPN-2450.
 
 Cheers,
 Sanne
 
 
 
 I've run the tests several times, but I hadn't got the test hangouts as you 
 have mentioned and all tests are passing on my side without failures.
 
 I've tried also the testsuite execution with TestNG version 6.7 and it is 
 fine as well.
 
 I just thought, maybe there is something wrong with your testsuite setup or 
 environment (just thoughts)?
 
 Best regards,
 Anna.
 
 - Original Message -
 From: Sanne Grinovero sa...@infinispan.org
 To: infinispan -Dev List infinispan-dev@lists.jboss.org
 Sent: Sunday, October 28, 2012 11:12:32 AM
 Subject: [infinispan-dev] Testsuite: hanging TestNG, CDI proken
 
 Hello all,
 
 besides having regular failures, I also experienced occasional hangs
 while running the testsuite; in some cases I found the following stack
 which suggests a TestNG bug:
 
 pool-3-thread-14 prio=10 tid=0x7f0d84632000 nid=0x1ce5 runnable
 [0x7f0d58a36000]
   java.lang.Thread.State: RUNNABLE
at java.util.HashMap.put(HashMap.java:374)
at org.testng.SuiteRunner.runTest(SuiteRunner.java:320)
at org.testng.SuiteRunner.access$000(SuiteRunner.java:34)
at org.testng.SuiteRunner$SuiteWorker.run(SuiteRunner.java:351)
at 
 org.testng.internal.thread.ThreadUtil$CountDownLatchedRunnable.run(ThreadUtil.java:147)
at 
 java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at 
 java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
 
 Even when taking multiple dumps that thread is still in the same loop,
 and having a single CPU stuck at 100% I'm guessing the HashMap was
 being used in some unsafe way regarding concurrency; we're using the
 first minor version of TestNG which ever supported parallel testsuite
 invocations so that might not be very solid.
 
 Not sure why, but upgrading TestNG from 5.14.10 to 6.7 seems to
 resolve the 

Re: [infinispan-dev] Testsuite: hanging TestNG, CDI proken

2012-10-29 Thread Tristan Tarrant
I have further changes to the CDI pom, so please issue your PR first :)

Tristan

On 10/29/2012 04:25 PM, Manik Surtani wrote:
 For what it's worth, I just created a branch with:

 * TestNG 6.7 as a dependency in parent/pom.xml (so all modules use this)
 * Updated cdi/extension/pom.xml to use ${version.testng} rather than 
 ${version.testng.arquillian} - so it too now uses TestNG 6.7.

 Ran tests.

 Results from tests in cdi/extension:

 Results :

 Tests run: 60, Failures: 0, Errors: 0, Skipped: 0

 Anyone want a pull req? ;)

 - M

 On 29 Oct 2012, at 16:06, Sanne Grinovero sa...@infinispan.org wrote:

 On 29 October 2012 08:59, Anna Manukyan amanu...@redhat.com wrote:
 Hi Sanne,

 sorry for my interfering in - I was lately working on CDI testsuite - 
 evaluating the coverage, etc. and actually on my local environment as well 
 as on Jenkins, the CDI integration tests are passing properly.
 Hi Anna,
 I wouldn't call that interfering, it's exactly the kind of feedback I
 was looking for. I just checked master again, and it still failed for
 me.
 This is the stack I have in all tests, in case it helps:

 java.lang.NullPointerException
  at 
 org.jboss.arquillian.testng.Arquillian.arquillianAfterClass(Arquillian.java:82)
  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  at 
 sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
  at 
 sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
  at java.lang.reflect.Method.invoke(Method.java:597)
  at 
 org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:74)
  at 
 org.testng.internal.Invoker.invokeConfigurationMethod(Invoker.java:525)
  at org.testng.internal.Invoker.invokeConfigurations(Invoker.java:202)
  at org.testng.internal.Invoker.invokeConfigurations(Invoker.java:130)
  at 
 org.testng.internal.TestMethodWorker.invokeAfterClassMethods(TestMethodWorker.java:222)
  at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:112)
  at org.testng.TestRunner.runWorkers(TestRunner.java:1147)
  at org.testng.TestRunner.privateRun(TestRunner.java:749)
  at org.testng.TestRunner.run(TestRunner.java:600)
  at org.testng.SuiteRunner.runTest(SuiteRunner.java:317)
  at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:312)
  at org.testng.SuiteRunner.privateRun(SuiteRunner.java:274)
  at org.testng.SuiteRunner.run(SuiteRunner.java:223)
  at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52)
  at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86)
  at org.testng.TestNG.runSuitesSequentially(TestNG.java:1039)
  at org.testng.TestNG.runSuitesLocally(TestNG.java:964)
  at org.testng.TestNG.run(TestNG.java:900)
  at 
 org.apache.maven.surefire.testng.TestNGExecutor.run(TestNGExecutor.java:77)


 Anyway, whatever the state of CDI that looks like a separate problem;
 I can't run the core testsuite reliably with this version of TestNG;
 from Vladimir's comment I guess we can't upgrade easily
 so I'm opening ISPN-2450.

 Cheers,
 Sanne


 I've run the tests several times, but I hadn't got the test hangouts as you 
 have mentioned and all tests are passing on my side without failures.

 I've tried also the testsuite execution with TestNG version 6.7 and it is 
 fine as well.

 I just thought, maybe there is something wrong with your testsuite setup or 
 environment (just thoughts)?

 Best regards,
 Anna.

 - Original Message -
 From: Sanne Grinovero sa...@infinispan.org
 To: infinispan -Dev List infinispan-dev@lists.jboss.org
 Sent: Sunday, October 28, 2012 11:12:32 AM
 Subject: [infinispan-dev] Testsuite: hanging TestNG, CDI proken

 Hello all,

 besides having regular failures, I also experienced occasional hangs
 while running the testsuite; in some cases I found the following stack
 which suggests a TestNG bug:

 pool-3-thread-14 prio=10 tid=0x7f0d84632000 nid=0x1ce5 runnable
 [0x7f0d58a36000]
java.lang.Thread.State: RUNNABLE
 at java.util.HashMap.put(HashMap.java:374)
 at org.testng.SuiteRunner.runTest(SuiteRunner.java:320)
 at org.testng.SuiteRunner.access$000(SuiteRunner.java:34)
 at org.testng.SuiteRunner$SuiteWorker.run(SuiteRunner.java:351)
 at 
 org.testng.internal.thread.ThreadUtil$CountDownLatchedRunnable.run(ThreadUtil.java:147)
 at 
 java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
 at 
 java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
 at java.lang.Thread.run(Thread.java:662)

 Even when taking multiple dumps that thread is still in the same loop,
 and having a single CPU stuck at 100% I'm guessing the HashMap was
 being used in some unsafe way regarding concurrency; we're using the
 first minor version of TestNG which ever supported parallel testsuite
 invocations so that might 

Re: [infinispan-dev] broken lazy query iteration

2012-10-29 Thread Emmanuel Bernard
Made sense to me at the time. Still does for what it's worth.
Plus the code using DocumentExtractor sill has to compute and deal with
first and max anyways.

Emmanuel

On Mon 2012-10-29 14:09, Ales Justin wrote:
 What's the design decision behind this?
 
 As DE has all the info, it could easily hide the offset (and max) into impl 
 details.
 
 -Ales
 
 On Oct 29, 2012, at 11:14 AM, Emmanuel Bernard emman...@hibernate.org wrote:
 
  Correct, the DocumentExtractor contract expects the absolute index. It
  looks like a bug in how ISPN's Query module use it.
  
  Emmanuel
  
  On Fri 2012-10-26 16:09, Ales Justin wrote:
  After searching for the needed in haystack, I finally found the problem.
  (not to mention complete lack of tests for this *basic* feature ...)
  
  The problem is with queries with offset when you iterate over them -- 
  offset is never taken into account.
  
  There are two possible fixes -- as I see them.
  
  1) In HS:
  
  DocumentExtractorImpl::extract takes into account firstIndex
  
 public EntityInfo extract(int scoreDocIndex) throws IOException {
 int docId = queryHits.docId( firstIndex + scoreDocIndex );
 Document document = extractDocument( fistIndex + scoreDocIndex 
  );
  
  2) LazyIterator in Infinispan-Query applies the offset:
  
protected EntityInfo loadEntityInfo(int index) {
   try {
  return extractor.extract(extractor.getFirstIndex() + index);
  
  ---
  
  Since those methods are exposed in DocumentExtractor,
  I would guess they were meant for external code to use them,
  instead of putting this logic into extractor itself.
  
  So, I'll go ahead and provide a patch for (2).
  
  -Ales
  
 
___
infinispan-dev mailing list
infinispan-dev@lists.jboss.org
https://lists.jboss.org/mailman/listinfo/infinispan-dev


Re: [infinispan-dev] Testsuite: hanging TestNG, CDI proken

2012-10-29 Thread Mircea Markus

On 29 Oct 2012, at 15:25, Manik Surtani wrote:

 For what it's worth, I just created a branch with:
 
 * TestNG 6.7 as a dependency in parent/pom.xml (so all modules use this)
 * Updated cdi/extension/pom.xml to use ${version.testng} rather than 
 ${version.testng.arquillian} - so it too now uses TestNG 6.7.
 
 Ran tests.
 
 Results from tests in cdi/extension:
 
 Results :
 
 Tests run: 60, Failures: 0, Errors: 0, Skipped: 0
 
 Anyone want a pull req? ;)
 

I do :)
 - M
 
 On 29 Oct 2012, at 16:06, Sanne Grinovero sa...@infinispan.org wrote:
 
 On 29 October 2012 08:59, Anna Manukyan amanu...@redhat.com wrote:
 Hi Sanne,
 
 sorry for my interfering in - I was lately working on CDI testsuite - 
 evaluating the coverage, etc. and actually on my local environment as well 
 as on Jenkins, the CDI integration tests are passing properly.
 
 Hi Anna,
 I wouldn't call that interfering, it's exactly the kind of feedback I
 was looking for. I just checked master again, and it still failed for
 me.
 This is the stack I have in all tests, in case it helps:
 
 java.lang.NullPointerException
  at 
 org.jboss.arquillian.testng.Arquillian.arquillianAfterClass(Arquillian.java:82)
  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  at 
 sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
  at 
 sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
  at java.lang.reflect.Method.invoke(Method.java:597)
  at 
 org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:74)
  at 
 org.testng.internal.Invoker.invokeConfigurationMethod(Invoker.java:525)
  at org.testng.internal.Invoker.invokeConfigurations(Invoker.java:202)
  at org.testng.internal.Invoker.invokeConfigurations(Invoker.java:130)
  at 
 org.testng.internal.TestMethodWorker.invokeAfterClassMethods(TestMethodWorker.java:222)
  at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:112)
  at org.testng.TestRunner.runWorkers(TestRunner.java:1147)
  at org.testng.TestRunner.privateRun(TestRunner.java:749)
  at org.testng.TestRunner.run(TestRunner.java:600)
  at org.testng.SuiteRunner.runTest(SuiteRunner.java:317)
  at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:312)
  at org.testng.SuiteRunner.privateRun(SuiteRunner.java:274)
  at org.testng.SuiteRunner.run(SuiteRunner.java:223)
  at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52)
  at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86)
  at org.testng.TestNG.runSuitesSequentially(TestNG.java:1039)
  at org.testng.TestNG.runSuitesLocally(TestNG.java:964)
  at org.testng.TestNG.run(TestNG.java:900)
  at 
 org.apache.maven.surefire.testng.TestNGExecutor.run(TestNGExecutor.java:77)
 
 
 Anyway, whatever the state of CDI that looks like a separate problem;
 I can't run the core testsuite reliably with this version of TestNG;
 from Vladimir's comment I guess we can't upgrade easily
 so I'm opening ISPN-2450.
 
 Cheers,
 Sanne
 
 
 
 I've run the tests several times, but I hadn't got the test hangouts as you 
 have mentioned and all tests are passing on my side without failures.
 
 I've tried also the testsuite execution with TestNG version 6.7 and it is 
 fine as well.
 
 I just thought, maybe there is something wrong with your testsuite setup or 
 environment (just thoughts)?
 
 Best regards,
 Anna.
 
 - Original Message -
 From: Sanne Grinovero sa...@infinispan.org
 To: infinispan -Dev List infinispan-dev@lists.jboss.org
 Sent: Sunday, October 28, 2012 11:12:32 AM
 Subject: [infinispan-dev] Testsuite: hanging TestNG, CDI proken
 
 Hello all,
 
 besides having regular failures, I also experienced occasional hangs
 while running the testsuite; in some cases I found the following stack
 which suggests a TestNG bug:
 
 pool-3-thread-14 prio=10 tid=0x7f0d84632000 nid=0x1ce5 runnable
 [0x7f0d58a36000]
  java.lang.Thread.State: RUNNABLE
   at java.util.HashMap.put(HashMap.java:374)
   at org.testng.SuiteRunner.runTest(SuiteRunner.java:320)
   at org.testng.SuiteRunner.access$000(SuiteRunner.java:34)
   at org.testng.SuiteRunner$SuiteWorker.run(SuiteRunner.java:351)
   at 
 org.testng.internal.thread.ThreadUtil$CountDownLatchedRunnable.run(ThreadUtil.java:147)
   at 
 java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
   at 
 java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
   at java.lang.Thread.run(Thread.java:662)
 
 Even when taking multiple dumps that thread is still in the same loop,
 and having a single CPU stuck at 100% I'm guessing the HashMap was
 being used in some unsafe way regarding concurrency; we're using the
 first minor version of TestNG which ever supported parallel testsuite
 invocations so that might not be very solid.
 
 Not sure why, but upgrading TestNG from 

[infinispan-dev] cce on invocation context

2012-10-29 Thread Ales Justin
I'm constantly seeing this CCE while running CapeDwarf cluster tests:

(running 5.2.Beta2 with my iterator offset patch)

17:43:10,175 ERROR [org.infinispan.interceptors.InvocationContextInterceptor] 
(OOB-18,null) ISPN000136: Execution error: java.lang.ClassCastException: 
org.infinispan.context.impl.NonTxInvocationContext cannot be cast to 
org.infinispan.context.impl.TxInvocationContext
at 
org.infinispan.interceptors.locking.PessimisticLockingInterceptor.visitPutKeyValueCommand(PessimisticLockingInterceptor.java:114)
at 
org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:77)
at 
org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118)
at 
org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:132)
at 
org.infinispan.commands.AbstractVisitor.visitPutKeyValueCommand(AbstractVisitor.java:63)
at 
org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:77)
at 
org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118)
at 
org.infinispan.interceptors.TxInterceptor.enlistWriteAndInvokeNext(TxInterceptor.java:212)
at 
org.infinispan.interceptors.TxInterceptor.visitPutKeyValueCommand(TxInterceptor.java:150)
at 
org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:77)
at 
org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118)
at 
org.infinispan.statetransfer.StateTransferInterceptor.handleTopologyAffectedCommand(StateTransferInterceptor.java:207)
at 
org.infinispan.statetransfer.StateTransferInterceptor.handleWriteCommand(StateTransferInterceptor.java:191)
at 
org.infinispan.statetransfer.StateTransferInterceptor.visitPutKeyValueCommand(StateTransferInterceptor.java:136)
at 
org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:77)
at 
org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118)
at 
org.infinispan.interceptors.CacheMgmtInterceptor.visitPutKeyValueCommand(CacheMgmtInterceptor.java:127)
at 
org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:77)
at 
org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118)
at 
org.infinispan.interceptors.InvocationContextInterceptor.handleAll(InvocationContextInterceptor.java:129)
at 
org.infinispan.interceptors.InvocationContextInterceptor.handleDefault(InvocationContextInterceptor.java:93)
at 
org.infinispan.commands.AbstractVisitor.visitPutKeyValueCommand(AbstractVisitor.java:63)
at 
org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:77)
at 
org.infinispan.interceptors.InterceptorChain.invoke(InterceptorChain.java:347)
at 
org.infinispan.statetransfer.StateConsumerImpl.doApplyState(StateConsumerImpl.java:306)
at 
org.infinispan.statetransfer.StateConsumerImpl.applyState(StateConsumerImpl.java:264)
at 
org.infinispan.statetransfer.StateResponseCommand.perform(StateResponseCommand.java:86)
at 
org.infinispan.remoting.InboundInvocationHandlerImpl.handleInternal(InboundInvocationHandlerImpl.java:95)
at 
org.infinispan.remoting.InboundInvocationHandlerImpl.handleWithWaitForBlocks(InboundInvocationHandlerImpl.java:110)
at 
org.infinispan.remoting.InboundInvocationHandlerImpl.handle(InboundInvocationHandlerImpl.java:82)
at 
org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.executeCommandFromLocalCluster(CommandAwareRpcDispatcher.java:244)
at 
org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.handle(CommandAwareRpcDispatcher.java:217)
at 
org.jgroups.blocks.RequestCorrelator.handleRequest(RequestCorrelator.java:483)
at 
org.jgroups.blocks.RequestCorrelator.receiveMessage(RequestCorrelator.java:390)
at 
org.jgroups.blocks.RequestCorrelator.receive(RequestCorrelator.java:248)
at 
org.jgroups.blocks.MessageDispatcher$ProtocolAdapter.up(MessageDispatcher.java:604)
at org.jgroups.blocks.mux.MuxUpHandler.up(MuxUpHandler.java:130)
at org.jgroups.JChannel.up(JChannel.java:670)
at org.jgroups.stack.ProtocolStack.up(ProtocolStack.java:1020)
at org.jgroups.protocols.RSVP.up(RSVP.java:172)
at org.jgroups.protocols.FRAG2.up(FRAG2.java:181)
at org.jgroups.protocols.FlowControl.up(FlowControl.java:418)
at org.jgroups.protocols.FlowControl.up(FlowControl.java:400)
at org.jgroups.protocols.pbcast.GMS.up(GMS.java:896)
at org.jgroups.protocols.pbcast.STABLE.up(STABLE.java:244)
at 

Re: [infinispan-dev] Testsuite: hanging TestNG, CDI proken

2012-10-29 Thread Manik Surtani
Ok, I've hijacked http://issues.jboss.org/browse/ISPN-2450 and have issued 
https://github.com/infinispan/infinispan/pull/1434

The pull request is for master.  I think it should be applied to branch 5.1.x 
as well, but I'll let one of you guys test it on 5.1.x first - I have a flight 
to catch.  :)

- M

On 29 Oct 2012, at 16:51, Mircea Markus mircea.mar...@jboss.com wrote:

 
 On 29 Oct 2012, at 15:25, Manik Surtani wrote:
 
 For what it's worth, I just created a branch with:
 
 * TestNG 6.7 as a dependency in parent/pom.xml (so all modules use this)
 * Updated cdi/extension/pom.xml to use ${version.testng} rather than 
 ${version.testng.arquillian} - so it too now uses TestNG 6.7.
 
 Ran tests.
 
 Results from tests in cdi/extension:
 
 Results :
 
 Tests run: 60, Failures: 0, Errors: 0, Skipped: 0
 
 Anyone want a pull req? ;)
 
 
 I do :)
 - M
 
 On 29 Oct 2012, at 16:06, Sanne Grinovero sa...@infinispan.org wrote:
 
 On 29 October 2012 08:59, Anna Manukyan amanu...@redhat.com wrote:
 Hi Sanne,
 
 sorry for my interfering in - I was lately working on CDI testsuite - 
 evaluating the coverage, etc. and actually on my local environment as well 
 as on Jenkins, the CDI integration tests are passing properly.
 
 Hi Anna,
 I wouldn't call that interfering, it's exactly the kind of feedback I
 was looking for. I just checked master again, and it still failed for
 me.
 This is the stack I have in all tests, in case it helps:
 
 java.lang.NullPointerException
 at 
 org.jboss.arquillian.testng.Arquillian.arquillianAfterClass(Arquillian.java:82)
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at 
 sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
 at 
 sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
 at java.lang.reflect.Method.invoke(Method.java:597)
 at 
 org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:74)
 at 
 org.testng.internal.Invoker.invokeConfigurationMethod(Invoker.java:525)
 at org.testng.internal.Invoker.invokeConfigurations(Invoker.java:202)
 at org.testng.internal.Invoker.invokeConfigurations(Invoker.java:130)
 at 
 org.testng.internal.TestMethodWorker.invokeAfterClassMethods(TestMethodWorker.java:222)
 at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:112)
 at org.testng.TestRunner.runWorkers(TestRunner.java:1147)
 at org.testng.TestRunner.privateRun(TestRunner.java:749)
 at org.testng.TestRunner.run(TestRunner.java:600)
 at org.testng.SuiteRunner.runTest(SuiteRunner.java:317)
 at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:312)
 at org.testng.SuiteRunner.privateRun(SuiteRunner.java:274)
 at org.testng.SuiteRunner.run(SuiteRunner.java:223)
 at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52)
 at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86)
 at org.testng.TestNG.runSuitesSequentially(TestNG.java:1039)
 at org.testng.TestNG.runSuitesLocally(TestNG.java:964)
 at org.testng.TestNG.run(TestNG.java:900)
 at 
 org.apache.maven.surefire.testng.TestNGExecutor.run(TestNGExecutor.java:77)
 
 
 Anyway, whatever the state of CDI that looks like a separate problem;
 I can't run the core testsuite reliably with this version of TestNG;
 from Vladimir's comment I guess we can't upgrade easily
 so I'm opening ISPN-2450.
 
 Cheers,
 Sanne
 
 
 
 I've run the tests several times, but I hadn't got the test hangouts as 
 you have mentioned and all tests are passing on my side without failures.
 
 I've tried also the testsuite execution with TestNG version 6.7 and it is 
 fine as well.
 
 I just thought, maybe there is something wrong with your testsuite setup 
 or environment (just thoughts)?
 
 Best regards,
 Anna.
 
 - Original Message -
 From: Sanne Grinovero sa...@infinispan.org
 To: infinispan -Dev List infinispan-dev@lists.jboss.org
 Sent: Sunday, October 28, 2012 11:12:32 AM
 Subject: [infinispan-dev] Testsuite: hanging TestNG, CDI proken
 
 Hello all,
 
 besides having regular failures, I also experienced occasional hangs
 while running the testsuite; in some cases I found the following stack
 which suggests a TestNG bug:
 
 pool-3-thread-14 prio=10 tid=0x7f0d84632000 nid=0x1ce5 runnable
 [0x7f0d58a36000]
  java.lang.Thread.State: RUNNABLE
   at java.util.HashMap.put(HashMap.java:374)
   at org.testng.SuiteRunner.runTest(SuiteRunner.java:320)
   at org.testng.SuiteRunner.access$000(SuiteRunner.java:34)
   at org.testng.SuiteRunner$SuiteWorker.run(SuiteRunner.java:351)
   at 
 org.testng.internal.thread.ThreadUtil$CountDownLatchedRunnable.run(ThreadUtil.java:147)
   at 
 java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
   at 
 java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
   at java.lang.Thread.run(Thread.java:662)
 
 Even 

Re: [infinispan-dev] cce on invocation context

2012-10-29 Thread Dan Berindei
Ales, I think you're seeing https://issues.jboss.org/browse/ISPN-2408


On Mon, Oct 29, 2012 at 6:44 PM, Ales Justin ales.jus...@gmail.com wrote:

 I'm constantly seeing this CCE while running CapeDwarf cluster tests:

 (running 5.2.Beta2 with my iterator offset patch)

 17:43:10,175 ERROR
 [org.infinispan.interceptors.InvocationContextInterceptor] (OOB-18,null)
 ISPN000136: Execution error: java.lang.ClassCastException:
 org.infinispan.context.impl.NonTxInvocationContext cannot be cast to
 org.infinispan.context.impl.TxInvocationContext
 at
 org.infinispan.interceptors.locking.PessimisticLockingInterceptor.visitPutKeyValueCommand(PessimisticLockingInterceptor.java:114)
 at
 org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:77)
 at
 org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118)
 at
 org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:132)
 at
 org.infinispan.commands.AbstractVisitor.visitPutKeyValueCommand(AbstractVisitor.java:63)
 at
 org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:77)
 at
 org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118)
 at
 org.infinispan.interceptors.TxInterceptor.enlistWriteAndInvokeNext(TxInterceptor.java:212)
 at
 org.infinispan.interceptors.TxInterceptor.visitPutKeyValueCommand(TxInterceptor.java:150)
 at
 org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:77)
 at
 org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118)
 at
 org.infinispan.statetransfer.StateTransferInterceptor.handleTopologyAffectedCommand(StateTransferInterceptor.java:207)
 at
 org.infinispan.statetransfer.StateTransferInterceptor.handleWriteCommand(StateTransferInterceptor.java:191)
 at
 org.infinispan.statetransfer.StateTransferInterceptor.visitPutKeyValueCommand(StateTransferInterceptor.java:136)
 at
 org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:77)
 at
 org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118)
 at
 org.infinispan.interceptors.CacheMgmtInterceptor.visitPutKeyValueCommand(CacheMgmtInterceptor.java:127)
 at
 org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:77)
 at
 org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118)
 at
 org.infinispan.interceptors.InvocationContextInterceptor.handleAll(InvocationContextInterceptor.java:129)
 at
 org.infinispan.interceptors.InvocationContextInterceptor.handleDefault(InvocationContextInterceptor.java:93)
 at
 org.infinispan.commands.AbstractVisitor.visitPutKeyValueCommand(AbstractVisitor.java:63)
 at
 org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:77)
 at
 org.infinispan.interceptors.InterceptorChain.invoke(InterceptorChain.java:347)
 at
 org.infinispan.statetransfer.StateConsumerImpl.doApplyState(StateConsumerImpl.java:306)
 at
 org.infinispan.statetransfer.StateConsumerImpl.applyState(StateConsumerImpl.java:264)
 at
 org.infinispan.statetransfer.StateResponseCommand.perform(StateResponseCommand.java:86)
 at
 org.infinispan.remoting.InboundInvocationHandlerImpl.handleInternal(InboundInvocationHandlerImpl.java:95)
 at
 org.infinispan.remoting.InboundInvocationHandlerImpl.handleWithWaitForBlocks(InboundInvocationHandlerImpl.java:110)
 at
 org.infinispan.remoting.InboundInvocationHandlerImpl.handle(InboundInvocationHandlerImpl.java:82)
 at
 org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.executeCommandFromLocalCluster(CommandAwareRpcDispatcher.java:244)
 at
 org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.handle(CommandAwareRpcDispatcher.java:217)
 at
 org.jgroups.blocks.RequestCorrelator.handleRequest(RequestCorrelator.java:483)
 at
 org.jgroups.blocks.RequestCorrelator.receiveMessage(RequestCorrelator.java:390)
 at
 org.jgroups.blocks.RequestCorrelator.receive(RequestCorrelator.java:248)
 at
 org.jgroups.blocks.MessageDispatcher$ProtocolAdapter.up(MessageDispatcher.java:604)
 at org.jgroups.blocks.mux.MuxUpHandler.up(MuxUpHandler.java:130)
 at org.jgroups.JChannel.up(JChannel.java:670)
 at org.jgroups.stack.ProtocolStack.up(ProtocolStack.java:1020)
 at org.jgroups.protocols.RSVP.up(RSVP.java:172)
 at org.jgroups.protocols.FRAG2.up(FRAG2.java:181)
 at org.jgroups.protocols.FlowControl.up(FlowControl.java:418)
 at org.jgroups.protocols.FlowControl.up(FlowControl.java:400)
 

Re: [infinispan-dev] Testsuite: hanging TestNG, CDI proken

2012-10-29 Thread Dan Berindei
On Mon, Oct 29, 2012 at 5:06 PM, Sanne Grinovero sa...@infinispan.orgwrote:

 On 29 October 2012 08:59, Anna Manukyan amanu...@redhat.com wrote:
  Hi Sanne,
 
  sorry for my interfering in - I was lately working on CDI testsuite -
 evaluating the coverage, etc. and actually on my local environment as well
 as on Jenkins, the CDI integration tests are passing properly.

 Hi Anna,
 I wouldn't call that interfering, it's exactly the kind of feedback I
 was looking for. I just checked master again, and it still failed for
 me.
 This is the stack I have in all tests, in case it helps:

 java.lang.NullPointerException
 at
 org.jboss.arquillian.testng.Arquillian.arquillianAfterClass(Arquillian.java:82)
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at
 sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
 at
 sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
 at java.lang.reflect.Method.invoke(Method.java:597)
 at
 org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:74)
 at
 org.testng.internal.Invoker.invokeConfigurationMethod(Invoker.java:525)
 at
 org.testng.internal.Invoker.invokeConfigurations(Invoker.java:202)
 at
 org.testng.internal.Invoker.invokeConfigurations(Invoker.java:130)
 at
 org.testng.internal.TestMethodWorker.invokeAfterClassMethods(TestMethodWorker.java:222)
 at
 org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:112)
 at org.testng.TestRunner.runWorkers(TestRunner.java:1147)
 at org.testng.TestRunner.privateRun(TestRunner.java:749)
 at org.testng.TestRunner.run(TestRunner.java:600)
 at org.testng.SuiteRunner.runTest(SuiteRunner.java:317)
 at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:312)
 at org.testng.SuiteRunner.privateRun(SuiteRunner.java:274)
 at org.testng.SuiteRunner.run(SuiteRunner.java:223)
 at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52)
 at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86)
 at org.testng.TestNG.runSuitesSequentially(TestNG.java:1039)
 at org.testng.TestNG.runSuitesLocally(TestNG.java:964)
 at org.testng.TestNG.run(TestNG.java:900)
 at
 org.apache.maven.surefire.testng.TestNGExecutor.run(TestNGExecutor.java:77)


This is https://issues.jboss.org/browse/ARQ-553

Of course, we do specify parallel=none in the CDI pom.xml, but because of a
bug in Maven or Surefire, TestNG sometime runs with the parent
configuration (parallel=tests).

If you can reproduce it reliably on your machine maybe you can debug Maven
and file a bug with them... I was supposed to fix the CDI suite but I never
reproduced it on my machine.




 Anyway, whatever the state of CDI that looks like a separate problem;
 I can't run the core testsuite reliably with this version of TestNG;
 from Vladimir's comment I guess we can't upgrade easily
 so I'm opening ISPN-2450.

 Cheers,
 Sanne


 
  I've run the tests several times, but I hadn't got the test hangouts as
 you have mentioned and all tests are passing on my side without failures.
 
  I've tried also the testsuite execution with TestNG version 6.7 and it
 is fine as well.
 
  I just thought, maybe there is something wrong with your testsuite setup
 or environment (just thoughts)?
 
  Best regards,
  Anna.
 
  - Original Message -
  From: Sanne Grinovero sa...@infinispan.org
  To: infinispan -Dev List infinispan-dev@lists.jboss.org
  Sent: Sunday, October 28, 2012 11:12:32 AM
  Subject: [infinispan-dev] Testsuite: hanging TestNG, CDI proken
 
  Hello all,
 
  besides having regular failures, I also experienced occasional hangs
  while running the testsuite; in some cases I found the following stack
  which suggests a TestNG bug:
 
  pool-3-thread-14 prio=10 tid=0x7f0d84632000 nid=0x1ce5 runnable
  [0x7f0d58a36000]
 java.lang.Thread.State: RUNNABLE
  at java.util.HashMap.put(HashMap.java:374)
  at org.testng.SuiteRunner.runTest(SuiteRunner.java:320)
  at org.testng.SuiteRunner.access$000(SuiteRunner.java:34)
  at org.testng.SuiteRunner$SuiteWorker.run(SuiteRunner.java:351)
  at
 org.testng.internal.thread.ThreadUtil$CountDownLatchedRunnable.run(ThreadUtil.java:147)
  at
 java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
  at
 java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
  at java.lang.Thread.run(Thread.java:662)
 
  Even when taking multiple dumps that thread is still in the same loop,
  and having a single CPU stuck at 100% I'm guessing the HashMap was
  being used in some unsafe way regarding concurrency; we're using the
  first minor version of TestNG which ever supported parallel testsuite
  invocations so that might not be very solid.
 
  Not 

Re: [infinispan-dev] Testsuite: hanging TestNG, CDI proken

2012-10-29 Thread Mircea Markus

On 29 Oct 2012, at 17:12, Manik Surtani wrote:

 Ok, I've hijacked http://issues.jboss.org/browse/ISPN-2450 and have issued 
 https://github.com/infinispan/infinispan/pull/1434
 
 The pull request is for master.  I think it should be applied to branch 5.1.x 
 as well, but I'll let one of you guys test it on 5.1.x first - I have a 
 flight to catch.  :)

It's in - thanks! :-)

Cheers,
-- 
Mircea Markus
Infinispan lead (www.infinispan.org)




___
infinispan-dev mailing list
infinispan-dev@lists.jboss.org
https://lists.jboss.org/mailman/listinfo/infinispan-dev

Re: [infinispan-dev] Transaction table cleanup

2012-10-29 Thread Manik Surtani

On 19 Oct 2012, at 17:40, Mircea Markus mircea.mar...@jboss.com wrote:

 
 On 19 Oct 2012, at 07:41, Vladimir Blagojevic wrote:
 
 On 12-10-19 4:15 AM, Manik Surtani wrote:
 
 You're right actually, the temporary cache created is transactional. it is 
 built in the CreateCacheCommand and relies on the DummyTransactionManager, 
 might be better to use batching perhaps? Or even not require for this cache 
 to be transactional?
 
 Yes, we should keep such internal caches as simple as possible.
 
 Mircea/Manik, it could be batch I believe. If you recall Mircea, you and I 
 talked about how to effectively move data across cluster deadlock free - we 
 even agreed we should blog post about it :-) 
 https://issues.jboss.org/browse/ISPN-2156
 
 Mircea/Manik could I get some advice and code review for 
 MapReduceManagerImpl#combine?
 Thanks Vladimir. The only change to make is CreateCacheCommand.create, 
 configure the cache to be batchable[1]. Then in the 
 MapReduceManagerImpl#combine, don't use the TransactionManager.beggin/commit 
 but the batch API.

Is this in?  Have we redone M/R not to rely on transactions and instead to use 
batching yet?  Vladimir?

- M

 
 [1] https://docs.jboss.org/author/display/ISPN/Batching 
 
 
 Thanks guys,
 Vladimir
 ___
 infinispan-dev mailing list
 infinispan-dev@lists.jboss.org
 https://lists.jboss.org/mailman/listinfo/infinispan-dev
 
 Cheers,
 -- 
 Mircea Markus
 Infinispan lead (www.infinispan.org)
 
 
 
 
 ___
 infinispan-dev mailing list
 infinispan-dev@lists.jboss.org
 https://lists.jboss.org/mailman/listinfo/infinispan-dev

--
Manik Surtani
ma...@jboss.org
twitter.com/maniksurtani

Platform Architect, JBoss Data Grid
http://red.ht/data-grid

___
infinispan-dev mailing list
infinispan-dev@lists.jboss.org
https://lists.jboss.org/mailman/listinfo/infinispan-dev