[jira] [Commented] (IGNITE-2938) IgfsBackupsDualAsyncSelfTest.testAppendParentMissing and IgfsBackupsDualAsyncSelfTest.testAppendParentMissingPartially fail sometimes on master

2016-06-10 Thread Ivan Veselovsky (JIRA)

[ 
https://issues.apache.org/jira/browse/IGNITE-2938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15325099#comment-15325099
 ] 

Ivan Veselovsky commented on IGNITE-2938:
-

https://github.com/apache/ignite/pull/793

> IgfsBackupsDualAsyncSelfTest.testAppendParentMissing and 
> IgfsBackupsDualAsyncSelfTest.testAppendParentMissingPartially fail sometimes 
> on master
> ---
>
> Key: IGNITE-2938
> URL: https://issues.apache.org/jira/browse/IGNITE-2938
> Project: Ignite
>  Issue Type: Test
>  Components: IGFS
>Affects Versions: 1.5.0.final
>Reporter: Ivan Veselovsky
>Assignee: Ivan Veselovsky
> Fix For: 1.7
>
>
> Tests 
>   IgfsBackupsDualAsyncSelfTest.testAppendParentMissing
>   IgfsBackupsDualAsyncSelfTest.testAppendParentMissingPartially   
> fail from time to time on master -- need to investigate. 
> It looks like that started to happen after fix  
> https://issues.apache.org/jira/browse/IGNITE-1631 .
> The failure happens with probability ~1/50 :
> {code}
> [18:14:50,772][INFO ][main][root] >>> Starting test: 
> IgfsBackupsDualAsyncSelfTest#testAppendParentMissingPartially <<<
> [18:14:50,792][ERROR][main][root] Test failed.
> java.io.IOException: Inconsistent file's data block (incorrectly written?) 
> [path=/dir/subdir/file, blockIdx=0, blockSize=128, expectedBlockSize=256, 
> fileBlockSize=524288, fileLen=256]
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsInputStreamImpl.block(IgfsInputStreamImpl.java:485)
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsInputStreamImpl.blockFragmentizerSafe(IgfsInputStreamImpl.java:399)
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsInputStreamImpl.readFromStore(IgfsInputStreamImpl.java:373)
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsInputStreamImpl.readFully(IgfsInputStreamImpl.java:222)
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsInputStreamImpl.readFully(IgfsInputStreamImpl.java:216)
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsAbstractSelfTest.checkFileContent(IgfsAbstractSelfTest.java:2999)
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsAbstractSelfTest.checkFile(IgfsAbstractSelfTest.java:2969)
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsDualAbstractSelfTest.testAppendParentMissingPartially(IgfsDualAbstractSelfTest.java:1364)
>   at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:606)
>   at junit.framework.TestCase.runTest(TestCase.java:176)
>   at 
> org.apache.ignite.testframework.junits.GridAbstractTest.runTestInternal(GridAbstractTest.java:1759)
>   at 
> org.apache.ignite.testframework.junits.GridAbstractTest.access$000(GridAbstractTest.java:118)
>   at 
> org.apache.ignite.testframework.junits.GridAbstractTest$4.run(GridAbstractTest.java:1697)
>   at java.lang.Thread.run(Thread.java:745)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (IGNITE-3293) AWS bootstrap scripts patch for Ignite-Cassandra

2016-06-10 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/IGNITE-3293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15325090#comment-15325090
 ] 

ASF GitHub Bot commented on IGNITE-3293:


GitHub user irudyak opened a pull request:

https://github.com/apache/ignite/pull/794

IGNITE-3293 AWS bootstrap scripts patch for Ignite-Cassandra



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/irudyak/ignite ignite-3293

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/ignite/pull/794.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #794


commit a725b5f16d9b6fb4363432710cb87d420b2c8a88
Author: Igor 
Date:   2016-06-10T00:03:09Z

fix for ignite-3293

commit 7ba18f937fcd4d54ba156397d893731588a04f4e
Author: Igor 
Date:   2016-06-10T04:04:21Z

shell scripts to recreate Cassandra artifacts on each load tests execution




> AWS bootstrap scripts patch for Ignite-Cassandra 
> -
>
> Key: IGNITE-3293
> URL: https://issues.apache.org/jira/browse/IGNITE-3293
> Project: Ignite
>  Issue Type: Bug
>  Components: cache
>Affects Versions: 1.6, 1.7
>Reporter: Igor Rudyak
>Assignee: Igor Rudyak
>
> New version of AWS bootstrap script having:
> 1) Gaglia monitoring
> 2) Allows to manually trigger tests execution multiple times on the same 
> ifstastructure



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (IGNITE-1789) Data Snapshots for Ignite caches

2016-06-10 Thread Dmitriy Setrakyan (JIRA)

[ 
https://issues.apache.org/jira/browse/IGNITE-1789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15324894#comment-15324894
 ] 

Dmitriy Setrakyan commented on IGNITE-1789:
---

Michael, why do you need 2 identical data sets in memory? What you are asking 
for can be done with a simple iteration through one cache and putting data into 
another. However, you would have to make sure that when changing keys, the 
key-affinity remains the same, so it stays on the same node. Please see 
{{AffinityKeyMapped}} and {{AffinityKeyMapper}} interfaces to control affinity 
mapping.

> Data Snapshots for Ignite caches
> 
>
> Key: IGNITE-1789
> URL: https://issues.apache.org/jira/browse/IGNITE-1789
> Project: Ignite
>  Issue Type: New Feature
>  Components: cache
>Reporter: Raúl Kripalani
>Assignee: Saikat Maitra
>
> There was a discussion in the dev forum about Data Snapshots in Ignite as a 
> way to obtain a consistent and "frozen" view of one or multiple caches in 
> order to execute a set of SQL queries, distributed closures, map reduce, etc. 
> without having to worry about data slippage (or moving data).
> The discussion is here: 
> http://apache-ignite-developers.2346864.n4.nabble.com/Data-Snapshots-in-Ignite-td4183.html
>  and we still need to mature the idea, but several users chimed in and 
> considered it interesting.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (IGNITE-3272) Memory consumption in ContinuousQueryHandler

2016-06-10 Thread Nikolay Tikhonov (JIRA)

[ 
https://issues.apache.org/jira/browse/IGNITE-3272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15324757#comment-15324757
 ] 

Nikolay Tikhonov commented on IGNITE-3272:
--

Implemented that in backup queue don't saved key and value for filtered events.

> Memory consumption in ContinuousQueryHandler
> 
>
> Key: IGNITE-3272
> URL: https://issues.apache.org/jira/browse/IGNITE-3272
> Project: Ignite
>  Issue Type: Bug
>  Components: cache
>Affects Versions: 1.6
>Reporter: Nikolay Tikhonov
>Assignee: Nikolay Tikhonov
> Attachments: IgniteCacheContinuousQueryBackupQueueTest.java
>
>
> On backup nodes events put in queue with value and key. For filtered events 
> need to store only update counter and partition. In attached test which 
> should pass with -Xmx2g -Xms2g



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (IGNITE-2680) Terminating running SQL queries

2016-06-10 Thread Alexei Scherbakov (JIRA)

[ 
https://issues.apache.org/jira/browse/IGNITE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15324739#comment-15324739
 ] 

Alexei Scherbakov commented on IGNITE-2680:
---

Manual and initiator failure cancellation is working, tests are passing locally.
Need to add tests for SqlFieldQuery.timeout() query property and schedule TC 
run.

> Terminating running SQL queries
> ---
>
> Key: IGNITE-2680
> URL: https://issues.apache.org/jira/browse/IGNITE-2680
> Project: Ignite
>  Issue Type: Bug
>Affects Versions: 1.5.0.final
>Reporter: Denis Magda
>Assignee: Alexei Scherbakov
>  Labels: important
>
> If to start a long running SQL query over a huge cache will millions of 
> entries there should be a way terminate it. Even if {{QueryCursor}} is closed 
> the query won't be cancelled consuming available resources.
> There should be a way to close a query having using an object that is related 
> to it. Seems that ideally we can use {{QueryCursor.close()}} method for that;



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (IGNITE-3014) Optimize GridDhtPartitionTopologyImpl#localPartition()

2016-06-10 Thread Ilya Lantukh (JIRA)

[ 
https://issues.apache.org/jira/browse/IGNITE-3014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15324599#comment-15324599
 ] 

Ilya Lantukh commented on IGNITE-3014:
--

[~sboikov],

I've implemented changes you suggested and re-tested this branch. Please review 
again.

> Optimize GridDhtPartitionTopologyImpl#localPartition()
> --
>
> Key: IGNITE-3014
> URL: https://issues.apache.org/jira/browse/IGNITE-3014
> Project: Ignite
>  Issue Type: Improvement
>Reporter: Ilya Lantukh
>Assignee: Ilya Lantukh
>  Labels: performance
>
> This method is called at least once for every cache operation on each node.
> It was partially optimized in 
> https://issues.apache.org/jira/browse/IGNITE-2948.
> It seems that we can reduce time spent in that method even further by 
> removing excessive RW locks and using volatile read/write instead.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Assigned] (IGNITE-3014) Optimize GridDhtPartitionTopologyImpl#localPartition()

2016-06-10 Thread Ilya Lantukh (JIRA)

 [ 
https://issues.apache.org/jira/browse/IGNITE-3014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ilya Lantukh reassigned IGNITE-3014:


Assignee: Semen Boikov  (was: Ilya Lantukh)

> Optimize GridDhtPartitionTopologyImpl#localPartition()
> --
>
> Key: IGNITE-3014
> URL: https://issues.apache.org/jira/browse/IGNITE-3014
> Project: Ignite
>  Issue Type: Improvement
>Reporter: Ilya Lantukh
>Assignee: Semen Boikov
>  Labels: performance
>
> This method is called at least once for every cache operation on each node.
> It was partially optimized in 
> https://issues.apache.org/jira/browse/IGNITE-2948.
> It seems that we can reduce time spent in that method even further by 
> removing excessive RW locks and using volatile read/write instead.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Assigned] (IGNITE-1952) Visorcmd: add a command for reset (clear) of metrics

2016-06-10 Thread Saikat Maitra (JIRA)

 [ 
https://issues.apache.org/jira/browse/IGNITE-1952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Saikat Maitra reassigned IGNITE-1952:
-

Assignee: Saikat Maitra

> Visorcmd: add a command for reset (clear) of metrics
> 
>
> Key: IGNITE-1952
> URL: https://issues.apache.org/jira/browse/IGNITE-1952
> Project: Ignite
>  Issue Type: Task
>  Components: UI
>Affects Versions: ignite-1.4, 1.5.0.final
>Reporter: Sergey Kozlov
>Assignee: Saikat Maitra
>Priority: Minor
>
> There is no command to reset metrics data for a cache. But it is useful to 
> interactively reset metrics values for during a troubleshooting



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Assigned] (IGNITE-1110) REST API: create/delete cache

2016-06-10 Thread Saikat Maitra (JIRA)

 [ 
https://issues.apache.org/jira/browse/IGNITE-1110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Saikat Maitra reassigned IGNITE-1110:
-

Assignee: Saikat Maitra

> REST API: create/delete cache
> -
>
> Key: IGNITE-1110
> URL: https://issues.apache.org/jira/browse/IGNITE-1110
> Project: Ignite
>  Issue Type: Task
>Affects Versions: sprint-8
>Reporter: Sergey Kozlov
>Assignee: Saikat Maitra
>Priority: Minor
>
> Apache Ignite supports dynamic caches so REST API could be extended by 
> following commands:
>  - get or create cache (start cache)
>  - destroy cache (stop cache)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Assigned] (IGNITE-2741) Ignite as Spring Session data store

2016-06-10 Thread Saikat Maitra (JIRA)

 [ 
https://issues.apache.org/jira/browse/IGNITE-2741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Saikat Maitra reassigned IGNITE-2741:
-

Assignee: Saikat Maitra

> Ignite as Spring Session data store
> ---
>
> Key: IGNITE-2741
> URL: https://issues.apache.org/jira/browse/IGNITE-2741
> Project: Ignite
>  Issue Type: New Feature
>Reporter: Roman Shtykh
>Assignee: Saikat Maitra
>  Labels: web
>
> On Spring Session: 
> http://docs.spring.io/spring-session/docs/current/reference/html5/#
> How to contribute the integration: 
> http://docs.spring.io/spring-session/docs/current/reference/html5/#community-contributing
> _From 1.1.0 Gemfire and Hazelcast are supported and can be used for 
> reference, if needed._



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Assigned] (IGNITE-2345) Implement JPA-based store session listener

2016-06-10 Thread Saikat Maitra (JIRA)

 [ 
https://issues.apache.org/jira/browse/IGNITE-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Saikat Maitra reassigned IGNITE-2345:
-

Assignee: Saikat Maitra

> Implement JPA-based store session listener
> --
>
> Key: IGNITE-2345
> URL: https://issues.apache.org/jira/browse/IGNITE-2345
> Project: Ignite
>  Issue Type: Improvement
>  Components: cache
>Reporter: Valentin Kulichenko
>Assignee: Saikat Maitra
> Fix For: 1.7
>
>
> We already have JDBC, Spring and Hibernate-based listeners, but it would be 
> useful to have JPA-based implementation as well.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Assigned] (IGNITE-1789) Data Snapshots for Ignite caches

2016-06-10 Thread Saikat Maitra (JIRA)

 [ 
https://issues.apache.org/jira/browse/IGNITE-1789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Saikat Maitra reassigned IGNITE-1789:
-

Assignee: Saikat Maitra

> Data Snapshots for Ignite caches
> 
>
> Key: IGNITE-1789
> URL: https://issues.apache.org/jira/browse/IGNITE-1789
> Project: Ignite
>  Issue Type: New Feature
>  Components: cache
>Reporter: Raúl Kripalani
>Assignee: Saikat Maitra
>
> There was a discussion in the dev forum about Data Snapshots in Ignite as a 
> way to obtain a consistent and "frozen" view of one or multiple caches in 
> order to execute a set of SQL queries, distributed closures, map reduce, etc. 
> without having to worry about data slippage (or moving data).
> The discussion is here: 
> http://apache-ignite-developers.2346864.n4.nabble.com/Data-Snapshots-in-Ignite-td4183.html
>  and we still need to mature the idea, but several users chimed in and 
> considered it interesting.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Assigned] (IGNITE-3227) IgniteCache: add method to calculate size per partition

2016-06-10 Thread Saikat Maitra (JIRA)

 [ 
https://issues.apache.org/jira/browse/IGNITE-3227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Saikat Maitra reassigned IGNITE-3227:
-

Assignee: Saikat Maitra

> IgniteCache: add method to calculate size per partition
> ---
>
> Key: IGNITE-3227
> URL: https://issues.apache.org/jira/browse/IGNITE-3227
> Project: Ignite
>  Issue Type: Improvement
>Reporter: Denis Magda
>Assignee: Saikat Maitra
>  Labels: community, important
>
> It makes sense to add size calculation per partition. Actually the following 
> methods should be added to the {{IgniteCache}} API.
> {code}
> public int size(int partition, CachePeekMode... peekModes) throws 
> CacheException;
> public int localSize(int partition, CachePeekMode... peekModes);
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (IGNITE-3302) .NET: Inject resources into user ILogger

2016-06-10 Thread Pavel Tupitsyn (JIRA)
Pavel Tupitsyn created IGNITE-3302:
--

 Summary: .NET: Inject resources into user ILogger
 Key: IGNITE-3302
 URL: https://issues.apache.org/jira/browse/IGNITE-3302
 Project: Ignite
  Issue Type: Sub-task
  Components: platforms
Affects Versions: 1.7
Reporter: Pavel Tupitsyn
Assignee: Pavel Tupitsyn
 Fix For: 1.7






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (IGNITE-2616) NonHeap memory usage metrics don't work as expected.

2016-06-10 Thread Vladislav Pyatkov (JIRA)

[ 
https://issues.apache.org/jira/browse/IGNITE-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15324532#comment-15324532
 ] 

Vladislav Pyatkov commented on IGNITE-2616:
---

[~dmagda] I corrected all the comments.
And the node metrics is working correctly now.

> NonHeap memory usage metrics don't work as expected.
> 
>
> Key: IGNITE-2616
> URL: https://issues.apache.org/jira/browse/IGNITE-2616
> Project: Ignite
>  Issue Type: Bug
>  Components: general
>Affects Versions: 1.5.0.final
>Reporter: Vladimir Ershov
>Assignee: Vladislav Pyatkov
>Priority: Minor
> Attachments: ClusterMetricsOnCacheSelfTest.java
>
>   Original Estimate: 48h
>  Remaining Estimate: 48h
>
> This simple code:
> {noformat}
> public static void main(String ... args) {
> MemoryMXBean mxBean = ManagementFactory.getMemoryMXBean();
> System.out.println(mxBean.getNonHeapMemoryUsage());
> GridUnsafeMemory uMem = new GridUnsafeMemory(1024L * 1024 * 1024 * 
> 3); //3GB
> System.out.println(mxBean.getNonHeapMemoryUsage());
> uMem.allocate(1024 * 1024 * 1024, true, false);
> System.out.println(mxBean.getNonHeapMemoryUsage());
> uMem.allocate(1024 * 1024 * 1024, true, true);
> System.out.println(mxBean.getNonHeapMemoryUsage());
> }
> {noformat}
> shows: 
> {noformat}
> init = 2555904(2496K) used = 4783352(4671K) committed = 8060928(7872K) max = 
> -1(-1K)
> init = 2555904(2496K) used = 5018704(4901K) committed = 8060928(7872K) max = 
> -1(-1K)
> init = 2555904(2496K) used = 5018960(4901K) committed = 8060928(7872K) max = 
> -1(-1K)
> init = 2555904(2496K) used = 5018960(4901K) committed = 8060928(7872K) max = 
> -1(-1K)
> {noformat}
> which means: offHeap metrics are incorrect. The  problem is: Apache Ignite 
> uses that MemoryMXBean  for collecting metrics, thus Apache Ignite offHeap 
> metrics are incorrect too. We should find the way to fix this, if there are 
> any.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Issue Comment Deleted] (IGNITE-3151) Using IgniteCountDownLatch sometimes drives to dead lock.

2016-06-10 Thread Vladislav Pyatkov (JIRA)

 [ 
https://issues.apache.org/jira/browse/IGNITE-3151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vladislav Pyatkov updated IGNITE-3151:
--
Comment: was deleted

(was: [~dmagda] I corrected all the comments.)

> Using IgniteCountDownLatch sometimes drives to dead lock.
> -
>
> Key: IGNITE-3151
> URL: https://issues.apache.org/jira/browse/IGNITE-3151
> Project: Ignite
>  Issue Type: Bug
>Reporter: Vladislav Pyatkov
>Assignee: Vladislav Pyatkov
> Attachments: igniteBugShot.zip
>
>
> Run several serve node (recoment use count of CPU - 1).
> Wait update topology.
> Run client
> After some iteration exception will thrown (In my case it take place after 
> around 10K iteration).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (IGNITE-3151) Using IgniteCountDownLatch sometimes drives to dead lock.

2016-06-10 Thread Vladislav Pyatkov (JIRA)

[ 
https://issues.apache.org/jira/browse/IGNITE-3151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15324528#comment-15324528
 ] 

Vladislav Pyatkov commented on IGNITE-3151:
---

[~dmagda] I corrected all the comments.

> Using IgniteCountDownLatch sometimes drives to dead lock.
> -
>
> Key: IGNITE-3151
> URL: https://issues.apache.org/jira/browse/IGNITE-3151
> Project: Ignite
>  Issue Type: Bug
>Reporter: Vladislav Pyatkov
>Assignee: Vladislav Pyatkov
> Attachments: igniteBugShot.zip
>
>
> Run several serve node (recoment use count of CPU - 1).
> Wait update topology.
> Run client
> After some iteration exception will thrown (In my case it take place after 
> around 10K iteration).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (IGNITE-3301) .NET: Logging extension methods

2016-06-10 Thread Pavel Tupitsyn (JIRA)
Pavel Tupitsyn created IGNITE-3301:
--

 Summary: .NET: Logging extension methods
 Key: IGNITE-3301
 URL: https://issues.apache.org/jira/browse/IGNITE-3301
 Project: Ignite
  Issue Type: Sub-task
  Components: platforms
Affects Versions: 1.7
Reporter: Pavel Tupitsyn
Assignee: Pavel Tupitsyn
 Fix For: 1.7


* Trace, Debug, Info, Warn, Error overloads
* GetLogger(category)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (IGNITE-3301) .NET: Logging extension methods

2016-06-10 Thread Pavel Tupitsyn (JIRA)

 [ 
https://issues.apache.org/jira/browse/IGNITE-3301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pavel Tupitsyn closed IGNITE-3301.
--

> .NET: Logging extension methods
> ---
>
> Key: IGNITE-3301
> URL: https://issues.apache.org/jira/browse/IGNITE-3301
> Project: Ignite
>  Issue Type: Sub-task
>  Components: platforms
>Affects Versions: 1.7
>Reporter: Pavel Tupitsyn
>Assignee: Pavel Tupitsyn
> Fix For: 1.7
>
>
> * Trace, Debug, Info, Warn, Error overloads
> * GetLogger(category)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (IGNITE-3301) .NET: Logging extension methods

2016-06-10 Thread Pavel Tupitsyn (JIRA)

 [ 
https://issues.apache.org/jira/browse/IGNITE-3301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pavel Tupitsyn resolved IGNITE-3301.

Resolution: Done

> .NET: Logging extension methods
> ---
>
> Key: IGNITE-3301
> URL: https://issues.apache.org/jira/browse/IGNITE-3301
> Project: Ignite
>  Issue Type: Sub-task
>  Components: platforms
>Affects Versions: 1.7
>Reporter: Pavel Tupitsyn
>Assignee: Pavel Tupitsyn
> Fix For: 1.7
>
>
> * Trace, Debug, Info, Warn, Error overloads
> * GetLogger(category)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (IGNITE-3283) .NET Windows Event Log logger

2016-06-10 Thread Pavel Tupitsyn (JIRA)

 [ 
https://issues.apache.org/jira/browse/IGNITE-3283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pavel Tupitsyn closed IGNITE-3283.
--

> .NET Windows Event Log logger
> -
>
> Key: IGNITE-3283
> URL: https://issues.apache.org/jira/browse/IGNITE-3283
> Project: Ignite
>  Issue Type: Sub-task
>  Components: platforms
>Affects Versions: 1.7
>Reporter: Pavel Tupitsyn
>Assignee: Pavel Tupitsyn
> Fix For: 1.7
>
>
> Provide an optional Event Log logger



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (IGNITE-3283) .NET Windows Event Log logger

2016-06-10 Thread Pavel Tupitsyn (JIRA)

 [ 
https://issues.apache.org/jira/browse/IGNITE-3283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pavel Tupitsyn resolved IGNITE-3283.

Resolution: Won't Fix

NLog and Log4net can write to EventLog. No need to reinvent this.

> .NET Windows Event Log logger
> -
>
> Key: IGNITE-3283
> URL: https://issues.apache.org/jira/browse/IGNITE-3283
> Project: Ignite
>  Issue Type: Sub-task
>  Components: platforms
>Affects Versions: 1.7
>Reporter: Pavel Tupitsyn
>Assignee: Pavel Tupitsyn
> Fix For: 1.7
>
>
> Provide an optional Event Log logger



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (IGNITE-3300) ArrayIndexOutOfBoundsException: -1 during capitalization benchmark running

2016-06-10 Thread Ksenia Rybakova (JIRA)
Ksenia Rybakova created IGNITE-3300:
---

 Summary: ArrayIndexOutOfBoundsException: -1 during capitalization 
benchmark running
 Key: IGNITE-3300
 URL: https://issues.apache.org/jira/browse/IGNITE-3300
 Project: Ignite
  Issue Type: Bug
  Components: general
Affects Versions: 1.7
Reporter: Ksenia Rybakova


Test config:
1 client, 16 servers
warmup 60
duration 1h
preload 5M
operations: capitalization benchmark
backups count 1

After ~30 min after start the following errors occur at the driver:
{noformat}
[08:42:51,367][ERROR][sys-#5%null%][GridTaskWorker] Failed to obtain remote job 
result policy for result from ComputeTask.result(..) method (will fail the 
whole task): GridJobResultImpl [job=C4V2 
[r=o.a.i.yardstick.cache.load.IgniteCapitalizationBenchmark$ScanQueryBroadcastClosure@41013d64],
 sib=GridJobSiblingImpl 
[sesId=bfb21563551-a8d91d06-89bd-41a5-8b4f-6a02416dfc63, 
jobId=51c21563551-a8d91d06-89bd-41a5-8b4f-6a02416dfc63, 
nodeId=79226bcc-651f-4af7-8d39-fd4019b7708c, isJobDone=false], 
jobCtx=GridJobContextImpl 
[jobId=51c21563551-a8d91d06-89bd-41a5-8b4f-6a02416dfc63, timeoutObj=null, 
attrs={}], node=TcpDiscoveryNode [id=79226bcc-651f-4af7-8d39-fd4019b7708c, 
addrs=[10.20.0.216, 127.0.0.1], sockAddrs=[fosters-216/10.20.0.216:47501, 
/10.20.0.216:47501, /127.0.0.1:47501], discPort=47501, order=5, intOrder=5, 
lastExchangeTime=1465485122287, loc=false, ver=1.7.0#20160603-sha1:82573436, 
isClient=false], ex=class o.a.i.compute.ComputeUserUndeclaredException: Failed 
to execute job due to unexpected runtime exception 
[jobId=51c21563551-a8d91d06-89bd-41a5-8b4f-6a02416dfc63, ses=GridJobSessionImpl 
[ses=GridTaskSessionImpl 
[taskName=o.a.i.yardstick.cache.load.IgniteCapitalizationBenchmark$ScanQueryBroadcastClosure,
 dep=LocalDeployment [super=GridDeployment [ts=1465485111989, depMode=SHARED, 
clsLdr=sun.misc.Launcher$AppClassLoader@6da264f1, 
clsLdrId=cee28b53551-79226bcc-651f-4af7-8d39-fd4019b7708c, userVer=0, loc=true, 
sampleClsName=java.lang.String, pendingUndeploy=false, undeployed=false, 
usage=0]], 
taskClsName=o.a.i.yardstick.cache.load.IgniteCapitalizationBenchmark$ScanQueryBroadcastClosure,
 sesId=bfb21563551-a8d91d06-89bd-41a5-8b4f-6a02416dfc63, 
startTime=1465486810898, endTime=9223372036854775807, 
taskNodeId=a8d91d06-89bd-41a5-8b4f-6a02416dfc63, 
clsLdr=sun.misc.Launcher$AppClassLoader@6da264f1, closed=false, cpSpi=null, 
failSpi=null, loadSpi=null, usage=1, fullSup=false, 
subjId=a8d91d06-89bd-41a5-8b4f-6a02416dfc63, mapFut=IgniteFuture 
[orig=GridFutureAdapter [resFlag=0, res=null, startTime=1465486811180, 
endTime=0, ignoreInterrupts=false, state=INIT]]], 
jobId=51c21563551-a8d91d06-89bd-41a5-8b4f-6a02416dfc63]], hasRes=true, 
isCancelled=false, isOccupied=true]
class org.apache.ignite.IgniteException: Remote job threw user exception 
(override or implement ComputeTask.result(..) method if you would like to have 
automatic failover for this exception).
at 
org.apache.ignite.compute.ComputeTaskAdapter.result(ComputeTaskAdapter.java:101)
at 
org.apache.ignite.internal.processors.task.GridTaskWorker$3.apply(GridTaskWorker.java:912)
at 
org.apache.ignite.internal.processors.task.GridTaskWorker$3.apply(GridTaskWorker.java:905)
at 
org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils.java:6491)
at 
org.apache.ignite.internal.processors.task.GridTaskWorker.result(GridTaskWorker.java:905)
at 
org.apache.ignite.internal.processors.task.GridTaskWorker.onResponse(GridTaskWorker.java:801)
at 
org.apache.ignite.internal.processors.task.GridTaskProcessor.processJobExecuteResponse(GridTaskProcessor.java:995)
at 
org.apache.ignite.internal.processors.task.GridTaskProcessor$JobMessageListener.onMessage(GridTaskProcessor.java:1220)
at 
org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1219)
at 
org.apache.ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:847)
at 
org.apache.ignite.internal.managers.communication.GridIoManager.access$1700(GridIoManager.java:105)
at 
org.apache.ignite.internal.managers.communication.GridIoManager$5.run(GridIoManager.java:810)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: class org.apache.ignite.compute.ComputeUserUndeclaredException: 
Failed to execute job due to unexpected runtime exception 
[jobId=51c21563551-a8d91d06-89bd-41a5-8b4f-6a02416dfc63, ses=GridJobSessionImpl 
[ses=GridTaskSessionImpl 
[taskName=org.apache.ignite.yardstick.cache.load.IgniteCapitalizationBenchmark$ScanQueryBroadcastClosure,
 dep=LocalDeployment [super=GridDeployment [ts=14

[jira] [Created] (IGNITE-3299) Cache remove can be lost in ATOMIC cache with OFFHEAP_TIERED memory mode

2016-06-10 Thread Semen Boikov (JIRA)
Semen Boikov created IGNITE-3299:


 Summary: Cache remove can be lost in ATOMIC cache with 
OFFHEAP_TIERED memory mode
 Key: IGNITE-3299
 URL: https://issues.apache.org/jira/browse/IGNITE-3299
 Project: Ignite
  Issue Type: Bug
  Components: cache
Reporter: Semen Boikov
Assignee: Semen Boikov
Priority: Critical
 Fix For: 1.7


Added test reproducing issue (IgniteCacheConcurrentPutGetRemove).

1. There is an issue with 'deferredDelete' implementation - entry marked as 
'deleted' can be evicted from cache, after this information about remove is 
lost (note: this can be reproduced not only in OFFHEAP_TIERED, but also in 
ONHEAP_TIERED mode with eviction policy, also this can also cause lost update 
in transactional cache on changing topology).

2. Looks like condition for removing from offheap in 
GridCacheMapEntry.innerUpdate is not correct:
{noformat}
if (op != GridCacheOperation.UPDATE && cctx.offheapTiered() && 
hasValPtr) {
boolean rmv = cctx.swap().removeOffheap(key);
{noformat}

It is possible that value was put in offheap, but 'hasValPtr' is false.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (IGNITE-3298) Action "Export all" does not work on SQL page

2016-06-10 Thread Alexey Kuznetsov (JIRA)

 [ 
https://issues.apache.org/jira/browse/IGNITE-3298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alexey Kuznetsov updated IGNITE-3298:
-
Summary: Action "Export all" does not work on SQL page  (was: Do not work 
"Export all" on SQL page)

> Action "Export all" does not work on SQL page
> -
>
> Key: IGNITE-3298
> URL: https://issues.apache.org/jira/browse/IGNITE-3298
> Project: Ignite
>  Issue Type: Sub-task
>  Components: wizards
>Affects Versions: 1.7
>Reporter: Vasiliy Sisko
> Fix For: 1.7
>
>
> Log is empty.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (IGNITE-3298) Do not work "Export all" on SQL page

2016-06-10 Thread Vasiliy Sisko (JIRA)
Vasiliy Sisko created IGNITE-3298:
-

 Summary: Do not work "Export all" on SQL page
 Key: IGNITE-3298
 URL: https://issues.apache.org/jira/browse/IGNITE-3298
 Project: Ignite
  Issue Type: Sub-task
  Components: wizards
Affects Versions: 1.7
Reporter: Vasiliy Sisko






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (IGNITE-3298) Do not work "Export all" on SQL page

2016-06-10 Thread Vasiliy Sisko (JIRA)

 [ 
https://issues.apache.org/jira/browse/IGNITE-3298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vasiliy Sisko updated IGNITE-3298:
--
Description: Log is empty.

> Do not work "Export all" on SQL page
> 
>
> Key: IGNITE-3298
> URL: https://issues.apache.org/jira/browse/IGNITE-3298
> Project: Ignite
>  Issue Type: Sub-task
>  Components: wizards
>Affects Versions: 1.7
>Reporter: Vasiliy Sisko
> Fix For: 1.7
>
>
> Log is empty.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (IGNITE-3297) Pipe chart is empty in special case.

2016-06-10 Thread Vasiliy Sisko (JIRA)
Vasiliy Sisko created IGNITE-3297:
-

 Summary: Pipe chart is empty in special case.
 Key: IGNITE-3297
 URL: https://issues.apache.org/jira/browse/IGNITE-3297
 Project: Ignite
  Issue Type: Sub-task
  Components: wizards
Affects Versions: 1.7
Reporter: Vasiliy Sisko


# Execute query where column A and B have the same values in all rows.
# Build Pipe chart where A and B columns set as X and Y columns. 
Showed legend for chart but chart area is empty.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (IGNITE-3152) Client node's addresses are registered in IP finder

2016-06-10 Thread Anton Vinogradov (JIRA)

[ 
https://issues.apache.org/jira/browse/IGNITE-3152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15324164#comment-15324164
 ] 

Anton Vinogradov commented on IGNITE-3152:
--

I've updated test to ensure it works.

> Client node's addresses are registered in IP finder
> ---
>
> Key: IGNITE-3152
> URL: https://issues.apache.org/jira/browse/IGNITE-3152
> Project: Ignite
>  Issue Type: Bug
>  Components: general
>Affects Versions: 1.5.0.final
>Reporter: Valentin Kulichenko
>Assignee: Anton Vinogradov
>  Labels: important
> Fix For: 1.7
>
> Attachments: Test.java
>
>
> Currently client node register its addresses in IP finder and never 
> deregisters them. Also looks like coordinator address is also not removed.
> The simple test that shows this behavior is attached.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (IGNITE-3238) Javadoc Warning due to cassandra libs usage

2016-06-10 Thread Anton Vinogradov (JIRA)

 [ 
https://issues.apache.org/jira/browse/IGNITE-3238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Anton Vinogradov closed IGNITE-3238.


Master fixed.

> Javadoc Warning due to cassandra libs usage
> ---
>
> Key: IGNITE-3238
> URL: https://issues.apache.org/jira/browse/IGNITE-3238
> Project: Ignite
>  Issue Type: Bug
>Affects Versions: 1.6
>Reporter: Anton Vinogradov
>Assignee: Igor Rudyak
>Priority: Critical
> Fix For: 1.7
>
>
> I found following at Ignite 1.6 build log:
> {code} [WARNING] Javadoc Warnings
>  [WARNING] warning: 
> /home/teamcity/.m2/repository/org/apache/cassandra/cassandra-all/3.3/cassandra-all-3.3.jar(org/apache/cassandra/service/CassandraDaemon.class):
>  major version 52 is newer than 51, the highest major version supported by 
> this compiler.
>  [WARNING] It is recommended that the compiler be upgraded.{code} 
> seems this warning related to 
> https://issues.apache.org/jira/browse/IGNITE-1371. 
> Command to gain this is:
> {code} mvn clean package -DskipTests{code} 
> also you can use this TeamCity task: 
> http://149.202.210.143:8111/viewType.html?buildTypeId=IgniteTests_RatJavadoc
> Need to fix it without using JDK 8.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (IGNITE-2969) Optimistic transactions support in deadlock detection

2016-06-10 Thread Andrey Gura (JIRA)

[ 
https://issues.apache.org/jira/browse/IGNITE-2969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15324141#comment-15324141
 ] 

Andrey Gura commented on IGNITE-2969:
-

Tests fixed. Please review.

> Optimistic transactions support in deadlock detection
> -
>
> Key: IGNITE-2969
> URL: https://issues.apache.org/jira/browse/IGNITE-2969
> Project: Ignite
>  Issue Type: Improvement
>  Components: cache
>Reporter: Andrey Gura
>Assignee: Andrey Gura
> Fix For: 1.7
>
>
> Deadlock detection doesn't support optimistic transactions now. It should be 
> implemented.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (IGNITE-3296) Validation fail in special case

2016-06-10 Thread Vasiliy Sisko (JIRA)
Vasiliy Sisko created IGNITE-3296:
-

 Summary: Validation fail in special case
 Key: IGNITE-3296
 URL: https://issues.apache.org/jira/browse/IGNITE-3296
 Project: Ignite
  Issue Type: Sub-task
  Components: wizards
Affects Versions: 1.7
Reporter: Vasiliy Sisko
Assignee: Dmitriyff


# Enable some section that have disabled fields.
# Input in field invalid value.
# Disable section and try to save.
- Validation show invalid message for disabled field.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (IGNITE-3238) Javadoc Warning due to cassandra libs usage

2016-06-10 Thread Anton Vinogradov (JIRA)

 [ 
https://issues.apache.org/jira/browse/IGNITE-3238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Anton Vinogradov resolved IGNITE-3238.
--
Resolution: Fixed

Merged to master.

> Javadoc Warning due to cassandra libs usage
> ---
>
> Key: IGNITE-3238
> URL: https://issues.apache.org/jira/browse/IGNITE-3238
> Project: Ignite
>  Issue Type: Bug
>Affects Versions: 1.6
>Reporter: Anton Vinogradov
>Assignee: Igor Rudyak
>Priority: Critical
> Fix For: 1.7
>
>
> I found following at Ignite 1.6 build log:
> {code} [WARNING] Javadoc Warnings
>  [WARNING] warning: 
> /home/teamcity/.m2/repository/org/apache/cassandra/cassandra-all/3.3/cassandra-all-3.3.jar(org/apache/cassandra/service/CassandraDaemon.class):
>  major version 52 is newer than 51, the highest major version supported by 
> this compiler.
>  [WARNING] It is recommended that the compiler be upgraded.{code} 
> seems this warning related to 
> https://issues.apache.org/jira/browse/IGNITE-1371. 
> Command to gain this is:
> {code} mvn clean package -DskipTests{code} 
> also you can use this TeamCity task: 
> http://149.202.210.143:8111/viewType.html?buildTypeId=IgniteTests_RatJavadoc
> Need to fix it without using JDK 8.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (IGNITE-3216) Need to deduplicate addresses registered in the IP finder

2016-06-10 Thread Anton Vinogradov (JIRA)

[ 
https://issues.apache.org/jira/browse/IGNITE-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15324109#comment-15324109
 ] 

Anton Vinogradov commented on IGNITE-3216:
--

TeamCity passed.

> Need to deduplicate addresses registered in the IP finder
> -
>
> Key: IGNITE-3216
> URL: https://issues.apache.org/jira/browse/IGNITE-3216
> Project: Ignite
>  Issue Type: Bug
>  Components: general
>Affects Versions: 1.6
>Reporter: Valentin Kulichenko
>Assignee: Anton Vinogradov
> Fix For: 1.7
>
>
> {{IgniteUtils.toSocketAddresses(...)}} method can produce the collection with 
> duplicated addresses in some cases (e.g., if one of hostnames is provided as 
> an IP). We should deduplicate the list before returning it (most likely we 
> should simply use {{Set}} instead).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (IGNITE-3151) Using IgniteCountDownLatch sometimes drives to dead lock.

2016-06-10 Thread Denis Magda (JIRA)

[ 
https://issues.apache.org/jira/browse/IGNITE-3151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15324103#comment-15324103
 ] 

Denis Magda commented on IGNITE-3151:
-

[~v.pyatkov] Please see my review notes in the pull-request.

Aslo I would add the same test but when a half of the nodes are client nodes. 
Client nodes receive update notifications a bit later and we must be sure that 
your fix didn't break anything.

> Using IgniteCountDownLatch sometimes drives to dead lock.
> -
>
> Key: IGNITE-3151
> URL: https://issues.apache.org/jira/browse/IGNITE-3151
> Project: Ignite
>  Issue Type: Bug
>Reporter: Vladislav Pyatkov
>Assignee: Vladislav Pyatkov
> Attachments: igniteBugShot.zip
>
>
> Run several serve node (recoment use count of CPU - 1).
> Wait update topology.
> Run client
> After some iteration exception will thrown (In my case it take place after 
> around 10K iteration).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (IGNITE-3238) Javadoc Warning due to cassandra libs usage

2016-06-10 Thread Anton Vinogradov (JIRA)

[ 
https://issues.apache.org/jira/browse/IGNITE-3238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15324099#comment-15324099
 ] 

Anton Vinogradov commented on IGNITE-3238:
--

Igor, Thanks for branch recreation. 
I closed pull request I've made before and created new.
Now I see only changes related to this task.

TeamCity Task should be checked is specified at Issue description.
I checked it at your branch: 
http://149.202.210.143:8111/viewLog.html?buildId=261612&tab=buildResultsDiv&buildTypeId=IgniteTests_RatJavadoc
And it works instead of original master branch: 
http://149.202.210.143:8111/viewLog.html?buildId=260834&tab=buildResultsDiv&buildTypeId=IgniteTests_RatJavadoc
Thanks for your contribution, that's really important fix, I'll merge your 
changes.

> Javadoc Warning due to cassandra libs usage
> ---
>
> Key: IGNITE-3238
> URL: https://issues.apache.org/jira/browse/IGNITE-3238
> Project: Ignite
>  Issue Type: Bug
>Affects Versions: 1.6
>Reporter: Anton Vinogradov
>Assignee: Igor Rudyak
>Priority: Critical
> Fix For: 1.7
>
>
> I found following at Ignite 1.6 build log:
> {code} [WARNING] Javadoc Warnings
>  [WARNING] warning: 
> /home/teamcity/.m2/repository/org/apache/cassandra/cassandra-all/3.3/cassandra-all-3.3.jar(org/apache/cassandra/service/CassandraDaemon.class):
>  major version 52 is newer than 51, the highest major version supported by 
> this compiler.
>  [WARNING] It is recommended that the compiler be upgraded.{code} 
> seems this warning related to 
> https://issues.apache.org/jira/browse/IGNITE-1371. 
> Command to gain this is:
> {code} mvn clean package -DskipTests{code} 
> also you can use this TeamCity task: 
> http://149.202.210.143:8111/viewType.html?buildTypeId=IgniteTests_RatJavadoc
> Need to fix it without using JDK 8.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (IGNITE-1631) IGFS: append fails to create a new file in DUAL modes

2016-06-10 Thread Vladimir Ozerov (JIRA)

 [ 
https://issues.apache.org/jira/browse/IGNITE-1631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vladimir Ozerov updated IGNITE-1631:

Fix Version/s: (was: 1.6)
   1.7

> IGFS: append fails to create a new file in DUAL modes
> -
>
> Key: IGNITE-1631
> URL: https://issues.apache.org/jira/browse/IGNITE-1631
> Project: Ignite
>  Issue Type: Bug
>  Components: hadoop
>Affects Versions: ignite-1.4
>Reporter: Ivan Veselovsky
>Assignee: Ivan Veselovsky
>  Labels: community
> Fix For: 1.7
>
>
> An attempt to create a new file using IGFS#append() method with "create" flag 
> being 'true' constantly fails with the below exception.
> Fix that and cover with tests.
> Caused by: class org.apache.ignite.IgniteCheckedException: Failed to append 
> to the file due to secondary file system exception: /dir/subdir/file2
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsMetaManager$6.onFailure(IgfsMetaManager.java:2332)
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsMetaManager$6.onFailure(IgfsMetaManager.java:2284)
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsMetaManager.synchronizeAndExecute(IgfsMetaManager.java:3065)
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsMetaManager.synchronizeAndExecute(IgfsMetaManager.java:2860)
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsMetaManager.appendDual(IgfsMetaManager.java:2337)
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsImpl$16.call(IgfsImpl.java:1119)
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsImpl$16.call(IgfsImpl.java:1104)
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsImpl.safeOp(IgfsImpl.java:2014)
>   ... 11 more
> Caused by: class org.apache.ignite.IgniteCheckedException: Failed to create 
> path locally due to secondary file system exception: /dir
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsMetaManager.synchronize(IgfsMetaManager.java:2814)
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsMetaManager.synchronizeAndExecute(IgfsMetaManager.java:3018)
>   ... 16 more



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (IGNITE-1631) IGFS: append fails to create a new file in DUAL modes

2016-06-10 Thread Vladimir Ozerov (JIRA)

[ 
https://issues.apache.org/jira/browse/IGNITE-1631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15324059#comment-15324059
 ] 

Vladimir Ozerov commented on IGNITE-1631:
-

Test still fails.

> IGFS: append fails to create a new file in DUAL modes
> -
>
> Key: IGNITE-1631
> URL: https://issues.apache.org/jira/browse/IGNITE-1631
> Project: Ignite
>  Issue Type: Bug
>  Components: hadoop
>Affects Versions: ignite-1.4
>Reporter: Ivan Veselovsky
>Assignee: Vladimir Ozerov
>  Labels: community
> Fix For: 1.7
>
>
> An attempt to create a new file using IGFS#append() method with "create" flag 
> being 'true' constantly fails with the below exception.
> Fix that and cover with tests.
> Caused by: class org.apache.ignite.IgniteCheckedException: Failed to append 
> to the file due to secondary file system exception: /dir/subdir/file2
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsMetaManager$6.onFailure(IgfsMetaManager.java:2332)
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsMetaManager$6.onFailure(IgfsMetaManager.java:2284)
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsMetaManager.synchronizeAndExecute(IgfsMetaManager.java:3065)
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsMetaManager.synchronizeAndExecute(IgfsMetaManager.java:2860)
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsMetaManager.appendDual(IgfsMetaManager.java:2337)
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsImpl$16.call(IgfsImpl.java:1119)
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsImpl$16.call(IgfsImpl.java:1104)
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsImpl.safeOp(IgfsImpl.java:2014)
>   ... 11 more
> Caused by: class org.apache.ignite.IgniteCheckedException: Failed to create 
> path locally due to secondary file system exception: /dir
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsMetaManager.synchronize(IgfsMetaManager.java:2814)
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsMetaManager.synchronizeAndExecute(IgfsMetaManager.java:3018)
>   ... 16 more



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (IGNITE-1631) IGFS: append fails to create a new file in DUAL modes

2016-06-10 Thread Vladimir Ozerov (JIRA)

 [ 
https://issues.apache.org/jira/browse/IGNITE-1631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vladimir Ozerov updated IGNITE-1631:

Assignee: Ivan Veselovsky  (was: Vladimir Ozerov)

> IGFS: append fails to create a new file in DUAL modes
> -
>
> Key: IGNITE-1631
> URL: https://issues.apache.org/jira/browse/IGNITE-1631
> Project: Ignite
>  Issue Type: Bug
>  Components: hadoop
>Affects Versions: ignite-1.4
>Reporter: Ivan Veselovsky
>Assignee: Ivan Veselovsky
>  Labels: community
> Fix For: 1.7
>
>
> An attempt to create a new file using IGFS#append() method with "create" flag 
> being 'true' constantly fails with the below exception.
> Fix that and cover with tests.
> Caused by: class org.apache.ignite.IgniteCheckedException: Failed to append 
> to the file due to secondary file system exception: /dir/subdir/file2
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsMetaManager$6.onFailure(IgfsMetaManager.java:2332)
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsMetaManager$6.onFailure(IgfsMetaManager.java:2284)
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsMetaManager.synchronizeAndExecute(IgfsMetaManager.java:3065)
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsMetaManager.synchronizeAndExecute(IgfsMetaManager.java:2860)
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsMetaManager.appendDual(IgfsMetaManager.java:2337)
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsImpl$16.call(IgfsImpl.java:1119)
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsImpl$16.call(IgfsImpl.java:1104)
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsImpl.safeOp(IgfsImpl.java:2014)
>   ... 11 more
> Caused by: class org.apache.ignite.IgniteCheckedException: Failed to create 
> path locally due to secondary file system exception: /dir
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsMetaManager.synchronize(IgfsMetaManager.java:2814)
>   at 
> org.apache.ignite.internal.processors.igfs.IgfsMetaManager.synchronizeAndExecute(IgfsMetaManager.java:3018)
>   ... 16 more



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (IGNITE-3294) IGFS: Merge create routine for PRIMARY and DUAL modes.

2016-06-10 Thread Vladimir Ozerov (JIRA)

 [ 
https://issues.apache.org/jira/browse/IGNITE-3294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vladimir Ozerov updated IGNITE-3294:

Summary: IGFS: Merge create routine for PRIMARY and DUAL modes.  (was: 
IGFS: Request multiple path IDs in a single request during sync step.)

> IGFS: Merge create routine for PRIMARY and DUAL modes.
> --
>
> Key: IGNITE-3294
> URL: https://issues.apache.org/jira/browse/IGNITE-3294
> Project: Ignite
>  Issue Type: Sub-task
>  Components: IGFS
>Affects Versions: 1.6
>Reporter: Vladimir Ozerov
>Assignee: Vladimir Ozerov
> Fix For: 1.7
>
>
> Currently during secondary file system synchronization we request multiple 
> paths in a separate "idsForPaths()" requests.
> Instead, it is better to get all required IDs in a single request.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (IGNITE-3287) IGFS: Do not synchronize file system during deletes.

2016-06-10 Thread Vladimir Ozerov (JIRA)

 [ 
https://issues.apache.org/jira/browse/IGNITE-3287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vladimir Ozerov closed IGNITE-3287.
---

> IGFS: Do not synchronize file system during deletes.
> 
>
> Key: IGNITE-3287
> URL: https://issues.apache.org/jira/browse/IGNITE-3287
> Project: Ignite
>  Issue Type: Sub-task
>  Components: IGFS
>Affects Versions: 1.6
>Reporter: Vladimir Ozerov
>Assignee: Vladimir Ozerov
>Priority: Critical
> Fix For: 1.7
>
>
> There is no need to synchronize IGFS with secondary file system when 
> performing removes. Instead, we should simply call the secondary file system 
> and exit form within a transaction, and exit.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (IGNITE-3287) IGFS: Do not synchronize file system during deletes.

2016-06-10 Thread Vladimir Ozerov (JIRA)

 [ 
https://issues.apache.org/jira/browse/IGNITE-3287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vladimir Ozerov resolved IGNITE-3287.
-
Resolution: Fixed

> IGFS: Do not synchronize file system during deletes.
> 
>
> Key: IGNITE-3287
> URL: https://issues.apache.org/jira/browse/IGNITE-3287
> Project: Ignite
>  Issue Type: Sub-task
>  Components: IGFS
>Affects Versions: 1.6
>Reporter: Vladimir Ozerov
>Assignee: Vladimir Ozerov
>Priority: Critical
> Fix For: 1.7
>
>
> There is no need to synchronize IGFS with secondary file system when 
> performing removes. Instead, we should simply call the secondary file system 
> and exit form within a transaction, and exit.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (IGNITE-2616) NonHeap memory usage metrics don't work as expected.

2016-06-10 Thread Denis Magda (JIRA)

[ 
https://issues.apache.org/jira/browse/IGNITE-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15324055#comment-15324055
 ] 

Denis Magda commented on IGNITE-2616:
-

[~v.pyatkov], reviewed. Please see my comments in the pull request.

In short the issue hasn't been fixed for node metrics. The fix is only for the 
cluster metrics. Please fix it for the node metrics instead and cluster metrics 
will work in a correct way automatically after that.

> NonHeap memory usage metrics don't work as expected.
> 
>
> Key: IGNITE-2616
> URL: https://issues.apache.org/jira/browse/IGNITE-2616
> Project: Ignite
>  Issue Type: Bug
>  Components: general
>Affects Versions: 1.5.0.final
>Reporter: Vladimir Ershov
>Assignee: Vladislav Pyatkov
>Priority: Minor
> Attachments: ClusterMetricsOnCacheSelfTest.java
>
>   Original Estimate: 48h
>  Remaining Estimate: 48h
>
> This simple code:
> {noformat}
> public static void main(String ... args) {
> MemoryMXBean mxBean = ManagementFactory.getMemoryMXBean();
> System.out.println(mxBean.getNonHeapMemoryUsage());
> GridUnsafeMemory uMem = new GridUnsafeMemory(1024L * 1024 * 1024 * 
> 3); //3GB
> System.out.println(mxBean.getNonHeapMemoryUsage());
> uMem.allocate(1024 * 1024 * 1024, true, false);
> System.out.println(mxBean.getNonHeapMemoryUsage());
> uMem.allocate(1024 * 1024 * 1024, true, true);
> System.out.println(mxBean.getNonHeapMemoryUsage());
> }
> {noformat}
> shows: 
> {noformat}
> init = 2555904(2496K) used = 4783352(4671K) committed = 8060928(7872K) max = 
> -1(-1K)
> init = 2555904(2496K) used = 5018704(4901K) committed = 8060928(7872K) max = 
> -1(-1K)
> init = 2555904(2496K) used = 5018960(4901K) committed = 8060928(7872K) max = 
> -1(-1K)
> init = 2555904(2496K) used = 5018960(4901K) committed = 8060928(7872K) max = 
> -1(-1K)
> {noformat}
> which means: offHeap metrics are incorrect. The  problem is: Apache Ignite 
> uses that MemoryMXBean  for collecting metrics, thus Apache Ignite offHeap 
> metrics are incorrect too. We should find the way to fix this, if there are 
> any.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (IGNITE-3294) IGFS: Request multiple path IDs in a single request during sync step.

2016-06-10 Thread Vladimir Ozerov (JIRA)

 [ 
https://issues.apache.org/jira/browse/IGNITE-3294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vladimir Ozerov updated IGNITE-3294:

Description: 
Currently during secondary file system synchronization we request multiple 
paths in a separate "idsForPaths()" requests.

Instead, it is better to get all required IDs in a single request.

  was:
Currently during secondary file system synchronization we request multiple 
paths in a separate "idsForPaths()" requests.

Instead, it is better to get all required IDs in a single request. Moreover, we 
can re-use already requested IDs.


> IGFS: Request multiple path IDs in a single request during sync step.
> -
>
> Key: IGNITE-3294
> URL: https://issues.apache.org/jira/browse/IGNITE-3294
> Project: Ignite
>  Issue Type: Sub-task
>  Components: IGFS
>Affects Versions: 1.6
>Reporter: Vladimir Ozerov
>Assignee: Vladimir Ozerov
> Fix For: 1.7
>
>
> Currently during secondary file system synchronization we request multiple 
> paths in a separate "idsForPaths()" requests.
> Instead, it is better to get all required IDs in a single request.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (IGNITE-3295) IGFS: Introduce file ID cache (HashMap) to minimize cache calls.

2016-06-10 Thread Vladimir Ozerov (JIRA)
Vladimir Ozerov created IGNITE-3295:
---

 Summary: IGFS: Introduce file ID cache (HashMap) to minimize cache 
calls.
 Key: IGNITE-3295
 URL: https://issues.apache.org/jira/browse/IGNITE-3295
 Project: Ignite
  Issue Type: Sub-task
  Components: IGFS
Affects Versions: 1.6
Reporter: Vladimir Ozerov
Assignee: Vladimir Ozerov
 Fix For: 1.7






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (IGNITE-3294) IGFS: Request multiple path IDs in a single request during sync step.

2016-06-10 Thread Vladimir Ozerov (JIRA)

 [ 
https://issues.apache.org/jira/browse/IGNITE-3294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vladimir Ozerov updated IGNITE-3294:

Issue Type: Sub-task  (was: Task)
Parent: IGNITE-3245

> IGFS: Request multiple path IDs in a single request during sync step.
> -
>
> Key: IGNITE-3294
> URL: https://issues.apache.org/jira/browse/IGNITE-3294
> Project: Ignite
>  Issue Type: Sub-task
>  Components: IGFS
>Affects Versions: 1.6
>Reporter: Vladimir Ozerov
>Assignee: Vladimir Ozerov
> Fix For: 1.7
>
>
> Currently during secondary file system synchronization we request multiple 
> paths in a separate "idsForPaths()" requests.
> Instead, it is better to get all required IDs in a single request. Moreover, 
> we can re-use already requested IDs.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (IGNITE-3294) IGFS: Request multiple path IDs in a single request during sync step.

2016-06-10 Thread Vladimir Ozerov (JIRA)
Vladimir Ozerov created IGNITE-3294:
---

 Summary: IGFS: Request multiple path IDs in a single request 
during sync step.
 Key: IGNITE-3294
 URL: https://issues.apache.org/jira/browse/IGNITE-3294
 Project: Ignite
  Issue Type: Task
  Components: IGFS
Affects Versions: 1.6
Reporter: Vladimir Ozerov
Assignee: Vladimir Ozerov
 Fix For: 1.7


Currently during secondary file system synchronization we request multiple 
paths in a separate "idsForPaths()" requests.

Instead, it is better to get all required IDs in a single request. Moreover, we 
can re-use already requested IDs.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)