[jira] [Commented] (IGNITE-3875) Create separate thread pool for data streamer.

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/IGNITE-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15782537#comment-15782537
 ] 

ASF GitHub Bot commented on IGNITE-3875:


Github user devozerov closed the pull request at:

https://github.com/apache/ignite/pull/1383


> Create separate thread pool for data streamer.
> --
>
> Key: IGNITE-3875
> URL: https://issues.apache.org/jira/browse/IGNITE-3875
> Project: Ignite
>  Issue Type: Task
>  Components: streaming
>Affects Versions: 1.7
>Reporter: Vladimir Ozerov
>Assignee: Vladimir Ozerov
> Fix For: 2.0
>
>
> Currently data streamer requests are submitted to PUBLIC pool. Because of 
> this it is not safe to run streamer from compute tasks which is very 
> inconvenient.
> We should create separate thread pool for streamer and route streamer jobs to 
> it. Compatibility must be preserved.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (IGNITE-3875) Create separate thread pool for data streamer.

[Vladimir Ozerov (JIRA)]

[ 
https://issues.apache.org/jira/browse/IGNITE-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15778196#comment-15778196
 ] 

Vladimir Ozerov commented on IGNITE-3875:
-

Merged with {{ignite-2.0}}, reviewed, performed minor fixes and 
simplifications. Now waiting for tests results. New PR is #1383.

> Create separate thread pool for data streamer.
> --
>
> Key: IGNITE-3875
> URL: https://issues.apache.org/jira/browse/IGNITE-3875
> Project: Ignite
>  Issue Type: Task
>  Components: streaming
>Affects Versions: 1.7
>Reporter: Vladimir Ozerov
>Assignee: Vladimir Ozerov
> Fix For: 2.0
>
>
> Currently data streamer requests are submitted to PUBLIC pool. Because of 
> this it is not safe to run streamer from compute tasks which is very 
> inconvenient.
> We should create separate thread pool for streamer and route streamer jobs to 
> it. Compatibility must be preserved.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (IGNITE-3875) Create separate thread pool for data streamer.

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/IGNITE-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15778193#comment-15778193
 ] 

ASF GitHub Bot commented on IGNITE-3875:


GitHub user devozerov opened a pull request:

https://github.com/apache/ignite/pull/1383

IGNITE-3875



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/gridgain/apache-ignite ignite-3875

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/ignite/pull/1383.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1383


commit 9b25a643ac97b2a832179d669397d552d2a3
Author: AMRepo 
Date:   2016-10-19T16:05:19Z

Implemented

commit 0862db26623db5bde0c744f4b3536a10fd7b3e52
Author: AMRepo 
Date:   2016-10-19T16:05:19Z

Implemented

commit f9304121945f07b3785d07518e435bc964233f2f
Author: AMRepo 
Date:   2016-10-19T18:46:33Z

Minors

commit c17ff0e716cdbaf759e0f34bbbf7834b87198d0a
Author: AMRepo 
Date:   2016-10-19T18:55:50Z

Merge remote-tracking branch 'origin/ignite-3875' into ignite-3875

# Conflicts:
#   
modules/core/src/main/java/org/apache/ignite/internal/processors/datastreamer/DataStreamProcessor.java

commit c8f78c3e4a69fb001c8995bb1f9c204da7415403
Author: Andrey V. Mashenkov 
Date:   2016-10-20T10:12:21Z

Merge branch 'ignite-1.6.11' into ignite-3875

commit 380a0b8a01a2ae4c606dbf67b588896ca7be435b
Author: vozerov-gridgain 
Date:   2016-10-20T11:58:55Z

Fixed receiver serialization problem.

commit 0f927608fe7b10f6c79b24b87b5eeecd46f68717
Author: vozerov-gridgain 
Date:   2016-10-20T11:59:15Z

Merge remote-tracking branch 'upstream/ignite-3875' into ignite-3875

commit 448d6f594dfb484aa471c186fec80bb0e54949d6
Author: Andrey V. Mashenkov 
Date:   2016-10-20T12:05:37Z

Fixed receiver serialization problem.

commit c893da70a9757b16b0799adc8eaa29fa1b03d06e
Author: tledkov-gridgain 
Date:   2016-12-21T11:54:33Z

IGNITE-4399: IGFS: Merged IgfsSecondaryFileSystem and 
IgfsSecondaryFileSystemV2 interfaces. This closes #1346.

commit c5882a85f4e3a1f61723ac54fd92f087684df6da
Author: devozerov 
Date:   2016-12-26T11:15:42Z

Merge branch 'master' into ignite-2.0

commit 248eaa710b11982831f71ed6733d125a5bae6871
Author: devozerov 
Date:   2016-12-26T11:21:50Z

Merge branch 'ignite-2.0' into ignite-3875

# Conflicts:
#   modules/core/src/main/java/org/apache/ignite/internal/IgnitionEx.java
#   
modules/core/src/main/java/org/apache/ignite/internal/managers/communication/GridIoManager.java
#   
modules/core/src/main/java/org/apache/ignite/internal/managers/communication/GridIoPolicy.java
#   
modules/core/src/main/java/org/apache/ignite/internal/processors/datastreamer/DataStreamProcessor.java
#   
modules/core/src/main/java/org/apache/ignite/internal/processors/datastreamer/DataStreamerImpl.java
#   
modules/core/src/test/java/org/apache/ignite/testframework/junits/GridTestKernalContext.java

commit 1d0a10c8a48de51e122821e2c3b47b0fff83ac7f
Author: devozerov 
Date:   2016-12-26T11:23:41Z

Fixes after merge.

commit 1883359d5ddc8deaddebb35b30e135ad18333070
Author: devozerov 
Date:   2016-12-26T11:23:51Z

Fixes after merge.

commit 13e514e99a715ce8a276c7fd1aa12f384a727015
Author: devozerov 
Date:   2016-12-26T11:31:45Z

Fixes after review.

commit 34aef7c17a59b9fdcc3df70382cb84dca1577a4b
Author: devozerov 
Date:   2016-12-26T11:39:58Z

Minors.

commit b39ae48535ed5ca1ec0bab7b8d64d6b1fe5d3715
Author: devozerov 
Date:   2016-12-26T11:42:07Z

Minors.

commit 87f103f92aeda9939e536b878f281b57aa1c31f2
Author: devozerov 
Date:   2016-12-26T11:44:02Z

Minors.

commit af5e0482d767bd79fa152c486d991628d928827c
Author: devozerov 
Date:   2016-12-26T11:47:26Z

Minors.




> Create separate thread pool for data streamer.
> --
>
> Key: IGNITE-3875
> URL: https://issues.apache.org/jira/browse/IGNITE-3875
> Project: Ignite
>  Issue Type: Task
>  Components: streaming
>Affects Versions: 1.7
>Reporter: Vladimir Ozerov
>Assignee: Vladimir Ozerov
> Fix For: 2.0
>
>
> Currently data streamer requests are submitted to PUBLIC pool. Because of 
> this it is not safe to run streamer from compute tasks which is 

[jira] [Commented] (IGNITE-3875) Create separate thread pool for data streamer.

[Vladimir Ozerov (JIRA)]

[ 
https://issues.apache.org/jira/browse/IGNITE-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15641856#comment-15641856
 ] 

Vladimir Ozerov commented on IGNITE-3875:
-

Moved to 2.0 because of very complex compatibility logic changes.

> Create separate thread pool for data streamer.
> --
>
> Key: IGNITE-3875
> URL: https://issues.apache.org/jira/browse/IGNITE-3875
> Project: Ignite
>  Issue Type: Task
>  Components: streaming
>Affects Versions: 1.7
>Reporter: Vladimir Ozerov
>Assignee: Vladimir Ozerov
> Fix For: 2.0
>
>
> Currently data streamer requests are submitted to PUBLIC pool. Because of 
> this it is not safe to run streamer from compute tasks which is very 
> inconvenient.
> We should create separate thread pool for streamer and route streamer jobs to 
> it. Compatibility must be preserved.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (IGNITE-3875) Create separate thread pool for data streamer.

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/IGNITE-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15589162#comment-15589162
 ] 

ASF GitHub Bot commented on IGNITE-3875:


GitHub user AMashenkov opened a pull request:

https://github.com/apache/ignite/pull/1173

IGNITE-3875 Create separate thread pool for data streamer.

Implemented

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/gridgain/apache-ignite ignite-3875

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/ignite/pull/1173.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1173


commit 2f78346e0e3d6a1cb9483b66144175c826a1ff5f
Author: sboikov 
Date:   2016-07-01T09:16:56Z

ignite-1088 Implemented store for multi jvm tests
(cherry picked from commit f91b699)

commit ade57eaf5b77f779642be424d8cdf858a327ce2d
Author: sboikov 
Date:   2016-07-05T04:43:51Z

ignite-1088 Implemented store for multi jvm tests (fixed NPE)
(cherry picked from commit d31a476)

commit d2198a1df0e5c907434ec1a465eb118823723439
Author: sboikov 
Date:   2016-07-04T18:08:24Z

ignite-1089 Fixed tests for multi jvm mode. This closes #846.
(cherry picked from commit bf57413)

commit a648e88c14295bf2c45b8e200eb5a3137997e131
Author: sboikov 
Date:   2016-07-15T13:26:00Z

ignite-1089 Fixed tests for multi jvm mode. This closes #846.
(cherry picked from commit bf57413)

commit 8d6273780bdb63397dfddaf7b7c1e65a8b717e8d
Author: sboikov 
Date:   2016-07-15T13:40:31Z

Added more info in assert message.

commit 4f97444c1e6ac29648dd96bc93f878e1d2c3e784
Author: Denis Magda 
Date:   2016-07-18T12:21:46Z

IGNITE-3455: Entry placed on C++ side is not found on Java side
(cherry picked from commit 84e83c9)

commit e1195296ddc883c0a980f64bf0d80c26ef78b233
Author: sboikov 
Date:   2016-07-13T09:29:33Z

ignite-3392 Added test.
(cherry picked from commit a056954)

commit 46f42723ac76c025863d7a9250de3eec1eca524a
Author: sboikov 
Date:   2016-07-13T09:41:18Z

ignite-3413 Use cache node filter for continuous query registration
(cherry picked from commit 89d64e7)

commit 590dffbe47d015db36710ba7708fd7d83269329f
Author: sboikov 
Date:   2016-07-19T10:35:59Z

ignite-3465 Do not call super.toString for not-initialized BinaryObjectImpl.
(cherry picked from commit 78d7c13)

commit 279de8f7c51dc93480bf64231321c451c7c11780
Author: vozerov-gridgain 
Date:   2016-07-19T12:54:27Z

IGNITE-3416: CPP: Fixed string deserialization performance issue.

commit 1dc8bcc20d89eb4172c4b1c8f718419f059c6cc2
Author: vozerov-gridgain 
Date:   2016-07-19T12:16:21Z

IGNITE-3414: Hadoop: implemented new weight-based map-reduce planner.

commit ecc77b0180b3b16303988e1dc187b53e7b96a111
Author: vozerov-gridgain 
Date:   2016-07-19T13:09:06Z

IGNITE-3414: Hadoop: implemented new weight-based map-reduce planner.

commit 51add5049c9603a143a1a8f9233d94f92c8394da
Author: Pavel Tupitsyn 
Date:   2016-07-19T14:11:46Z

IGNITE-3511: .NET: Fixed AffinityFunctionBase.cs placement, added missing 
Package-Info.cs files.

commit 5ec99e8d987d7c966a55b8138aade6643decd5dd
Author: Valentin Kulichenko 
Date:   2016-07-19T23:01:32Z

IGNITE-3470 - Support EXPIRED events in continuous queries

commit d767e518bf7844e3dcdb3f3fdc02da5ecc1b4f54
Author: Valentin Kulichenko 
Date:   2016-07-07T07:05:16Z

Revert IGNITE-2949 due to broken compatibility

commit 7140ee9ded458e5aedd1c5a9852204337fc3
Author: Valentin Kulichenko 
Date:   2016-07-19T23:23:27Z

Revert IGNITE-2949 due to broken compatibility

commit 6b8020d3ffef55039d0afa55ed5925d9fdb914d2
Author: Sergi Vladykin 
Date:   2016-07-13T17:19:25Z

ignite-3254 - fixed
(cherry picked from commit 4d2be72)

commit 11c7e8fe53461f84924e5c29893865191f236c8c
Author: Anton Vinogradov 
Date:   2016-07-20T08:31:14Z

Documentation fix

commit 9b55658749d0e2a869bbb3614034d8aa1f0e95c1
Author: vozerov-gridgain 
Date:   2016-07-20T11:14:50Z

IGNITE-3405: IGFS: Restricted path modes interleaving, so that now only 
DUAL -> PRIMARY and DUAL -> PROXY paths are possible.

commit 6c5218f4d67c8e247f59dbe8deb58b51db2954a2
Author: vozerov-gridgain 
Date:   2016-07-20T11:15:11Z

Merge remote-tracking branch 'upstream/gridgain-7.6.2' into gridgain-7.6.2

commit 

[jira] [Commented] (IGNITE-3875) Create separate thread pool for data streamer.

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/IGNITE-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15589157#comment-15589157
 ] 

ASF GitHub Bot commented on IGNITE-3875:


Github user AMashenkov closed the pull request at:

https://github.com/apache/ignite/pull/1067


> Create separate thread pool for data streamer.
> --
>
> Key: IGNITE-3875
> URL: https://issues.apache.org/jira/browse/IGNITE-3875
> Project: Ignite
>  Issue Type: Task
>  Components: streaming
>Affects Versions: 1.7
>Reporter: Vladimir Ozerov
>Assignee: Andrew Mashenkov
> Fix For: 1.8
>
>
> Currently data streamer requests are submitted to PUBLIC pool. Because of 
> this it is not safe to run streamer from compute tasks which is very 
> inconvenient.
> We should create separate thread pool for streamer and route streamer jobs to 
> it. Compatibility must be preserved.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (IGNITE-3875) Create separate thread pool for data streamer.

[Vladimir Ozerov (JIRA)]

[ 
https://issues.apache.org/jira/browse/IGNITE-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15581586#comment-15581586
 ] 

Vladimir Ozerov commented on IGNITE-3875:
-

Ticket completed.

> Create separate thread pool for data streamer.
> --
>
> Key: IGNITE-3875
> URL: https://issues.apache.org/jira/browse/IGNITE-3875
> Project: Ignite
>  Issue Type: Task
>  Components: streaming
>Affects Versions: 1.7
>Reporter: Vladimir Ozerov
>Assignee: Vladimir Ozerov
> Fix For: 1.8
>
>
> Currently data streamer requests are submitted to PUBLIC pool. Because of 
> this it is not safe to run streamer from compute tasks which is very 
> inconvenient.
> We should create separate thread pool for streamer and route streamer jobs to 
> it. Compatibility must be preserved.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (IGNITE-3875) Create separate thread pool for data streamer.

[Andrew Mashenkov (JIRA)]

[ 
https://issues.apache.org/jira/browse/IGNITE-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15565140#comment-15565140
 ] 

Andrew Mashenkov commented on IGNITE-3875:
--

Tests added and passed successfully on TC.

> Create separate thread pool for data streamer.
> --
>
> Key: IGNITE-3875
> URL: https://issues.apache.org/jira/browse/IGNITE-3875
> Project: Ignite
>  Issue Type: Task
>  Components: streaming
>Affects Versions: 1.7
>Reporter: Vladimir Ozerov
>Assignee: Andrew Mashenkov
> Fix For: 1.8
>
>
> Currently data streamer requests are submitted to PUBLIC pool. Because of 
> this it is not safe to run streamer from compute tasks which is very 
> inconvenient.
> We should create separate thread pool for streamer and route streamer jobs to 
> it. Compatibility must be preserved.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (IGNITE-3875) Create separate thread pool for data streamer.

[Vladimir Ozerov (JIRA)]

[ 
https://issues.apache.org/jira/browse/IGNITE-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522470#comment-15522470
 ] 

Vladimir Ozerov commented on IGNITE-3875:
-

Regarding p.6 - looks like we should not use {{SynchronousQueue}}. Instead, 
normal {{LinkedBlockingQueue}} will be enough.

> Create separate thread pool for data streamer.
> --
>
> Key: IGNITE-3875
> URL: https://issues.apache.org/jira/browse/IGNITE-3875
> Project: Ignite
>  Issue Type: Task
>  Components: streaming
>Affects Versions: 1.7
>Reporter: Vladimir Ozerov
>Assignee: Andrew Mashenkov
> Fix For: 1.8
>
>
> Currently data streamer requests are submitted to PUBLIC pool. Because of 
> this it is not safe to run streamer from compute tasks which is very 
> inconvenient.
> We should create separate thread pool for streamer and route streamer jobs to 
> it. Compatibility must be preserved.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (IGNITE-3875) Create separate thread pool for data streamer.

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/IGNITE-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15493592#comment-15493592
 ] 

ASF GitHub Bot commented on IGNITE-3875:


GitHub user AMashenkov opened a pull request:

https://github.com/apache/ignite/pull/1067

IGNITE-3875: Create separate thread pool for data streamer.



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/gridgain/apache-ignite ignite-3875

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/ignite/pull/1067.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1067


commit fad73bf570760e697e20ea19c00c18bc5d6cfc6e
Author: Alexey Kuznetsov 
Date:   2016-06-14T02:37:29Z

Refactor collecting partitions in VisorCache into separate task 
VisorCachePartitionsTask.

commit 150b5c99828f701f72cabf852dfbff0dca4ea0ca
Author: sboikov 
Date:   2016-06-14T06:45:10Z

ignite-3261 Store information about AffinityKey class in metadata cache.
(cherry picked from commit 2b64e7c)

commit e90c9c8889235e780bb9f37ed0b0ca7a8d30136d
Author: sboikov 
Date:   2016-06-14T07:05:20Z

ignite-114 Load value from store for cache 'invoke'
(cherry picked from commit e10ffef)

commit e5fcebb095fc189487d1d4f267fbf2164aef7329
Author: sboikov 
Date:   2016-06-14T07:17:50Z

ignite-3038 Do not use custom discovery events to start continuous queries 
for system caches
(cherry picked from commit 7f878c5)

commit c88ce20a62e315418cac014c3419ce254c591bee
Author: sboikov 
Date:   2016-06-14T08:16:29Z

ignite-3038 Do not use custom discovery events to start continuous queries 
for system caches
(cherry picked from commit 7f878c5)

commit 3a4f587b457bd1bb86665bf51757a2aa3f986f07
Author: sboikov 
Date:   2016-06-14T08:42:52Z

Tcp discovery minor: create buffered input stream with size = socket 
receiveBufferSize.
(cherry picked from commit 54425bf)

commit 6094ee0d73f26e913dd5ff4c64d72a75e450479b
Author: Sergi Vladykin 
Date:   2016-06-05T21:14:05Z

ignite-gg-11181 - scanCount with offheap index fix

commit fda4110baf5cba8c6d32d0cdd3d7e2c8945af2e5
Author: Denis Magda 
Date:   2016-06-14T10:25:38Z

Merge branch 'gridgain-7.6.1' of https://github.com/gridgain/apache-ignite 
into gridgain-7.6.1

commit e9a33f2376733ec3c507963c6ff98e3ad0514281
Author: nikolay_tikhonov 
Date:   2016-06-14T15:17:33Z

IGNITE-3272 Fixed "Memory consumption in ContinuousQueryHandler". (cherry 
picked from commit 5f44672)

commit 84547ef2a198d639ac213ecf2f51de539b3f19d0
Author: Alexey Goncharuk 
Date:   2016-06-14T00:52:39Z

IGNITE-3305 - Fixed SYNC rebalance mode for dynamically started cache.

commit ab7fa496459d9e8560c56d0daa9c56c171dea405
Author: Sergi Vladykin 
Date:   2016-06-14T18:47:11Z

IGNITE-3273 - fixed

commit 6faa1f229bf24d5aa5dc6fc99023283639ecacfe
Author: Valentin Kulichenko 
Date:   2016-06-14T15:09:10Z

IGNITE-3215 - Added IgniteRDD.withKeepBinary method

commit 10916ed03688f820cef93866c8ea71226bba3716
Author: Valentin Kulichenko 
Date:   2016-06-15T09:19:44Z

IGNITE-3215 - Added IgniteRDD.withKeepBinary method (ScalaDoc)

commit e9546aa76be97dde30d3d4777b5770d15cc4d1fa
Author: Valentin Kulichenko 
Date:   2016-06-15T10:44:23Z

Fixed compilation

commit 5c1492872358cac78a6954796ea1e3420bf7c26e
Author: samaitra 
Date:   2016-06-15T09:58:33Z

IGNITE-2344 - WebSessionFilter doesn't support session ID renewal. Fixes 
#780.

commit dc1d08856e803ee8b689b2e5aad25c767e4c2015
Author: vozerov-gridgain 
Date:   2016-06-10T08:05:48Z

IGNITE-3287: IGFS Delete in PRIMARY/DUAL modes goes through the same path.

commit 51814fd816f1f3c4bf72c91399c03db7b1358ed1
Author: vozerov-gridgain 
Date:   2016-06-15T13:25:19Z

Merge remote-tracking branch 'upstream/gridgain-7.6.1' into gridgain-7.6.1

commit c2f8df96907e096fdeaa8d040463ff5ec1662395
Author: vozerov-gridgain 
Date:   2016-06-14T08:09:01Z

IGNITE-3294: IGFS: Improved "create" performance in DUAL mode.

commit 95513d3214dd1ea7a1a68d6f1709af004c2efccd
Author: vozerov-gridgain 
Date:   2016-06-14T08:36:33Z

IGNITE-3294: IGFS: Created separate processor optimized for entry rename.

commit e733e912cccf2c83d7e31d6f856b30fc4c663975
Author: vozerov-gridgain 
Date:   2016-06-14T14:39:44Z

IGNITE-2938: IGFS: Puts