[jira] [Resolved] (IGNITE-2342) HadoopFileSystemFactory must set correct context ClassLoader before calling FileSystem.get()

2016-01-08 Thread Vladimir Ozerov (JIRA)

 [ 
https://issues.apache.org/jira/browse/IGNITE-2342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vladimir Ozerov resolved IGNITE-2342.
-
Resolution: Fixed

> HadoopFileSystemFactory must set correct context ClassLoader before calling 
> FileSystem.get()
> 
>
> Key: IGNITE-2342
> URL: https://issues.apache.org/jira/browse/IGNITE-2342
> Project: Ignite
>  Issue Type: Task
>  Components: hadoop
>Affects Versions: ignite-1.4
>Reporter: Vladimir Ozerov
>Assignee: Vladimir Ozerov
>Priority: Critical
>  Labels: important
> Fix For: 1.6
>
>
> FileSystem.get() might delegate to ServiceLoader to get the list of file 
> system implementation. And ServiceLoader is known to be sensitive to context 
> classloader.
> We must ensure that Thread.contextClassLoader is equal to 
> Factory.getClassLoader().



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (IGNITE-2342) HadoopFileSystemFactory must set correct context ClassLoader before calling FileSystem.get()

2016-01-08 Thread Vladimir Ozerov (JIRA)

 [ 
https://issues.apache.org/jira/browse/IGNITE-2342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vladimir Ozerov closed IGNITE-2342.
---

> HadoopFileSystemFactory must set correct context ClassLoader before calling 
> FileSystem.get()
> 
>
> Key: IGNITE-2342
> URL: https://issues.apache.org/jira/browse/IGNITE-2342
> Project: Ignite
>  Issue Type: Task
>  Components: hadoop
>Affects Versions: ignite-1.4
>Reporter: Vladimir Ozerov
>Assignee: Vladimir Ozerov
>Priority: Critical
>  Labels: important
> Fix For: 1.6
>
>
> FileSystem.get() might delegate to ServiceLoader to get the list of file 
> system implementation. And ServiceLoader is known to be sensitive to context 
> classloader.
> We must ensure that Thread.contextClassLoader is equal to 
> Factory.getClassLoader().



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (IGNITE-2340) Throw sensible error from IgniteHadoopFileSystem if real file system is not IgniteHadoopIgfsSecondaryFileSystem

2016-01-08 Thread Vladimir Ozerov (JIRA)

 [ 
https://issues.apache.org/jira/browse/IGNITE-2340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vladimir Ozerov resolved IGNITE-2340.
-
Resolution: Fixed

> Throw sensible error from IgniteHadoopFileSystem if real file system is not 
> IgniteHadoopIgfsSecondaryFileSystem
> ---
>
> Key: IGNITE-2340
> URL: https://issues.apache.org/jira/browse/IGNITE-2340
> Project: Ignite
>  Issue Type: Task
>  Components: hadoop
>Affects Versions: ignite-1.4
>Reporter: Vladimir Ozerov
>Assignee: Vladimir Ozerov
>  Labels: important
> Fix For: 1.6
>
>
> Consider the following scenario:
> 1) User configures some custom secondary file system;
> 2) Some paths are set to PROXY mode (e.g. default modes);
> 3) User instantiates IgniteHadoopFileSystem somewhere else. 
> Result:
> IgniteHadoopFileSystem notices PROXY paths and tries to get FileSystem 
> factory from handshake request, but it is null. As a result, NPE is thrown a 
> moment later.
> Proposed fix:
> If factory is null. we must throw an exception and advise user to set 
> IgniteHadoopIgfsSecondaryFileSystem as secondary file system.in IGFS 
> configuration.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (IGNITE-2341) Improve warnings about BinaryMarshaller switched to "optimized" mode

2016-01-08 Thread Vladimir Ozerov (JIRA)

 [ 
https://issues.apache.org/jira/browse/IGNITE-2341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vladimir Ozerov closed IGNITE-2341.
---

> Improve warnings about BinaryMarshaller switched to "optimized" mode
> 
>
> Key: IGNITE-2341
> URL: https://issues.apache.org/jira/browse/IGNITE-2341
> Project: Ignite
>  Issue Type: Task
>  Components: general
>Affects Versions: ignite-1.4
>Reporter: Vladimir Ozerov
>Assignee: Vladimir Ozerov
> Fix For: 1.6
>
>
> Some classes implement Externalizable interface and hence cannot be written 
> with binary marshaller. In this case a warning is printed:
> {code}
> Class "o.a.i.i.processors.hadoop.jobtracker.HadoopJobMetadata" cannot be 
> written in binary format because it either implements Externalizable 
> interface or have writeObject/readObject methods. Please ensure that all 
> nodes have this class in classpath. To enable binary serialization either 
> implement Binarylizable interface or set explicit serializer using 
> BinaryTypeConfiguration.setSerializer() method.
> {code}
> 1) We need to make it more sensible: we must clearly note that these classes 
> will be deserialized on the server.
> 2) These warnings should not be printed for "o.a.i" classes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (IGNITE-2340) Throw sensible error from IgniteHadoopFileSystem if real file system is not IgniteHadoopIgfsSecondaryFileSystem

2016-01-08 Thread Vladimir Ozerov (JIRA)

 [ 
https://issues.apache.org/jira/browse/IGNITE-2340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vladimir Ozerov closed IGNITE-2340.
---

> Throw sensible error from IgniteHadoopFileSystem if real file system is not 
> IgniteHadoopIgfsSecondaryFileSystem
> ---
>
> Key: IGNITE-2340
> URL: https://issues.apache.org/jira/browse/IGNITE-2340
> Project: Ignite
>  Issue Type: Task
>  Components: hadoop
>Affects Versions: ignite-1.4
>Reporter: Vladimir Ozerov
>Assignee: Vladimir Ozerov
>  Labels: important
> Fix For: 1.6
>
>
> Consider the following scenario:
> 1) User configures some custom secondary file system;
> 2) Some paths are set to PROXY mode (e.g. default modes);
> 3) User instantiates IgniteHadoopFileSystem somewhere else. 
> Result:
> IgniteHadoopFileSystem notices PROXY paths and tries to get FileSystem 
> factory from handshake request, but it is null. As a result, NPE is thrown a 
> moment later.
> Proposed fix:
> If factory is null. we must throw an exception and advise user to set 
> IgniteHadoopIgfsSecondaryFileSystem as secondary file system.in IGFS 
> configuration.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (IGNITE-2341) Improve warnings about BinaryMarshaller switched to "optimized" mode

2016-01-08 Thread Vladimir Ozerov (JIRA)

 [ 
https://issues.apache.org/jira/browse/IGNITE-2341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vladimir Ozerov resolved IGNITE-2341.
-
Resolution: Fixed

> Improve warnings about BinaryMarshaller switched to "optimized" mode
> 
>
> Key: IGNITE-2341
> URL: https://issues.apache.org/jira/browse/IGNITE-2341
> Project: Ignite
>  Issue Type: Task
>  Components: general
>Affects Versions: ignite-1.4
>Reporter: Vladimir Ozerov
>Assignee: Vladimir Ozerov
> Fix For: 1.6
>
>
> Some classes implement Externalizable interface and hence cannot be written 
> with binary marshaller. In this case a warning is printed:
> {code}
> Class "o.a.i.i.processors.hadoop.jobtracker.HadoopJobMetadata" cannot be 
> written in binary format because it either implements Externalizable 
> interface or have writeObject/readObject methods. Please ensure that all 
> nodes have this class in classpath. To enable binary serialization either 
> implement Binarylizable interface or set explicit serializer using 
> BinaryTypeConfiguration.setSerializer() method.
> {code}
> 1) We need to make it more sensible: we must clearly note that these classes 
> will be deserialized on the server.
> 2) These warnings should not be printed for "o.a.i" classes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (IGNITE-1371) Key-Value store (like Cassandra) as CacheStore

2016-01-08 Thread Igor Rudyak (JIRA)

[ 
https://issues.apache.org/jira/browse/IGNITE-1371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15088934#comment-15088934
 ] 

Igor Rudyak commented on IGNITE-1371:
-

Alexey,

I finished with items 4-5 and pushed everything into ignite-1371 branch. 

The only thing which wasn't refactored is the logic related to Serializers. I 
am not sure that fully understood your approach with Binary Marshaller. Are you 
suggesting just to use OptimizedMarshaller to serialize objects to BLOB? How 
about restrictions of Binary Marshaller 
(https://apacheignite.readme.io/docs/binary-marshaller)? How about forward and 
backward compatibility of Binary Marshaller serialization (which is for example 
supported by Kryo)? By the way, one of the useful features of Serializers 
approach - it could be used to secure sensitive data. Thus all the sensitive 
data from in-memory Ignite cache will be persisted into Cassandra in encrypted 
form. For this purpose you just need to implement your custom Serializer which 
implements data encryption/decryption.


> Key-Value store (like Cassandra) as CacheStore
> --
>
> Key: IGNITE-1371
> URL: https://issues.apache.org/jira/browse/IGNITE-1371
> Project: Ignite
>  Issue Type: New Feature
>  Components: cache
>Affects Versions: ignite-1.4
>Reporter: Alexandre Boudnik
>Assignee: Igor Rudyak
> Attachments: master_02b59e4_ignite-1371.patch
>
>   Original Estimate: 504h
>  Remaining Estimate: 504h
>
> It will provide ability to map particular cache holding POJOs to Cassandra 
> table. Later it would be generalized to support eventually any any Key-Value 
> store.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (IGNITE-2202) Local server query result doesn't include versions in entries

2016-01-08 Thread Denis Magda (JIRA)

[ 
https://issues.apache.org/jira/browse/IGNITE-2202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15088966#comment-15088966
 ] 

Denis Magda commented on IGNITE-2202:
-

Implemented the logic discussed above for {{ScanQueries}}. Need to support the 
rest of queries.

> Local server query result doesn't include versions in entries
> -
>
> Key: IGNITE-2202
> URL: https://issues.apache.org/jira/browse/IGNITE-2202
> Project: Ignite
>  Issue Type: Bug
>  Components: cache
>Reporter: Valentin Kulichenko
>Assignee: Denis Magda
>Priority: Critical
>  Labels: important
> Fix For: 1.6
>
> Attachments: QueryTest2.java
>
>
> Cache entries returned as query results don't contain versions even if the 
> query is local.
> Test attached.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (IGNITE-2343) IGFS: MapReduce task sent by Hunk/Splunk fails with NPE

2016-01-08 Thread Denis Magda (JIRA)
Denis Magda created IGNITE-2343:
---

 Summary: IGFS: MapReduce task sent by Hunk/Splunk fails with NPE
 Key: IGNITE-2343
 URL: https://issues.apache.org/jira/browse/IGNITE-2343
 Project: Ignite
  Issue Type: Bug
  Components: IGFS
Affects Versions: ignite-1.4
Reporter: Denis Magda
Assignee: Vladimir Ozerov
 Fix For: 1.6


A MR task being sent by Hunk [1] fails with NPE

{noformat}
[10:31:58,250][ERROR][Hadoop-task-fd3ff783-d952-4147-8e5b-8e3080b91ddb_1-MAP-50-
 0-#271%null%][HadoopRunnableTask] Task execution failed.
class org.apache.ignite.IgniteCheckedException: class 
org.apache.ignite.IgniteCh eckedException: null
at org.apache.ignite.internal.processors.hadoop.v2.HadoopV2MapTask.run0( 
HadoopV2MapTask.java:105)
at org.apache.ignite.internal.processors.hadoop.v2.HadoopV2Task.run(Hado 
opV2Task.java:54)
at org.apache.ignite.internal.processors.hadoop.v2.HadoopV2TaskContext.r 
un(HadoopV2TaskContext.java:249)
at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopRunna 
bleTask.runTask(HadoopRunnableTask.java:201)
at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopRunna 
bleTask.call0(HadoopRunnableTask.java:144)
at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopRunna 
bleTask$1.call(HadoopRunnableTask.java:116)
at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopRunna 
bleTask$1.call(HadoopRunnableTask.java:114)
at org.apache.ignite.internal.processors.hadoop.v2.HadoopV2TaskContext$1 
.run(HadoopV2TaskContext.java:550)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInforma 
tion.java:1657)
at org.apache.ignite.internal.processors.hadoop.v2.HadoopV2TaskContext.r 
unAsJobOwner(HadoopV2TaskContext.java:548)
at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopRunna 
bleTask.call(HadoopRunnableTask.java:114)
at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopRunna 
bleTask.call(HadoopRunnableTask.java:46)
at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopExecu 
torService$2.body(HadoopExecutorService.java:186)
at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java :110)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NullPointerException
at com.splunk.mr.SplunkSearchMapper.runImpl(SplunkSearchMapper.java:308)
at com.splunk.mr.SplunkBaseMapper.run(SplunkBaseMapper.java:169)
at org.apache.ignite.internal.processors.hadoop.v2.HadoopV2MapTask.run0( 
HadoopV2MapTask.java:87)
... 16 more
at org.apache.ignite.internal.processors.hadoop.HadoopUtils.transformExc 
eption(HadoopUtils.java:290)
at org.apache.ignite.internal.processors.hadoop.v2.HadoopV2TaskContext.r 
un(HadoopV2TaskContext.java:255)
at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopRunna 
bleTask.runTask(HadoopRunnableTask.java:201)
at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopRunna 
bleTask.call0(HadoopRunnableTask.java:144)
at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopRunna 
bleTask$1.call(HadoopRunnableTask.java:116)
at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopRunna 
bleTask$1.call(HadoopRunnableTask.java:114)
at org.apache.ignite.internal.processors.hadoop.v2.HadoopV2TaskContext$1 
.run(HadoopV2TaskContext.java:550)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInforma 
tion.java:1657)
at org.apache.ignite.internal.processors.hadoop.v2.HadoopV2TaskContext.r 
unAsJobOwner(HadoopV2TaskContext.java:548)
at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopRunna 
bleTask.call(HadoopRunnableTask.java:114)
at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopRunna 
bleTask.call(HadoopRunnableTask.java:46)
at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopExecu 
torService$2.body(HadoopExecutorService.java:186)
at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java :110)
at java.lang.Thread.run(Thread.java:745)
{noformat}



[1] http://www.splunk.com/en_us/products/hunk.html



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (IGNITE-2344) WebSessionFilter doesn't support session ID renewal

2016-01-08 Thread Denis Magda (JIRA)
Denis Magda created IGNITE-2344:
---

 Summary: WebSessionFilter doesn't support session ID renewal
 Key: IGNITE-2344
 URL: https://issues.apache.org/jira/browse/IGNITE-2344
 Project: Ignite
  Issue Type: Bug
  Components: general
Affects Versions: ignite-1.4
Reporter: Denis Magda


It's quite a common scenario to update a session ID after a user successfully 
logged in preserving the session content for further usage.

Ignite's {{WebSessionFilter}} doesn't support such a use case creating a 
session from scratch.

To support this behavior we can store a special Cookie that will hold latest 
session ID. When a session is passed to {{WebSessionFilter}} and the filter 
detects that this is a fresh session it will check the Cookie in advance. If 
the Cookie exists and holds an old session ID then the filter will be able to 
get a session content from the cache using the old ID and put it back using the 
new ID.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (IGNITE-2344) WebSessionFilter doesn't support session ID renewal

2016-01-08 Thread Denis Magda (JIRA)

[ 
https://issues.apache.org/jira/browse/IGNITE-2344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089193#comment-15089193
 ] 

Denis Magda commented on IGNITE-2344:
-

The ticket was created as a result of this discussion
http://apache-ignite-users.70518.x6.nabble.com/Web-app-with-CMS-td2414.html

> WebSessionFilter doesn't support session ID renewal
> ---
>
> Key: IGNITE-2344
> URL: https://issues.apache.org/jira/browse/IGNITE-2344
> Project: Ignite
>  Issue Type: Bug
>  Components: general
>Affects Versions: ignite-1.4
>Reporter: Denis Magda
>
> It's quite a common scenario to update a session ID after a user successfully 
> logged in preserving the session content for further usage.
> Ignite's {{WebSessionFilter}} doesn't support such a use case creating a 
> session from scratch.
> To support this behavior we can store a special Cookie that will hold latest 
> session ID. When a session is passed to {{WebSessionFilter}} and the filter 
> detects that this is a fresh session it will check the Cookie in advance. If 
> the Cookie exists and holds an old session ID then the filter will be able to 
> get a session content from the cache using the old ID and put it back using 
> the new ID.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (IGNITE-2343) IGFS: MapReduce task sent by Hunk/Splunk fails with NPE

2016-01-08 Thread Denis Magda (JIRA)

[ 
https://issues.apache.org/jira/browse/IGNITE-2343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089205#comment-15089205
 ] 

Denis Magda commented on IGNITE-2343:
-

One more important thing to pay attention to while this issue will be being 
fixed.

If the node fails with the stack trace from the description it doesn't respond 
any longer and the only way to stop it is to kill forcibly using 'kill -9'.

> IGFS: MapReduce task sent by Hunk/Splunk fails with NPE
> ---
>
> Key: IGNITE-2343
> URL: https://issues.apache.org/jira/browse/IGNITE-2343
> Project: Ignite
>  Issue Type: Bug
>  Components: IGFS
>Affects Versions: ignite-1.4
>Reporter: Denis Magda
>Assignee: Vladimir Ozerov
> Fix For: 1.6
>
>
> A MR task being sent by Hunk [1] fails with NPE
> {noformat}
> [10:31:58,250][ERROR][Hadoop-task-fd3ff783-d952-4147-8e5b-8e3080b91ddb_1-MAP-50-
>  0-#271%null%][HadoopRunnableTask] Task execution failed.
> class org.apache.ignite.IgniteCheckedException: class 
> org.apache.ignite.IgniteCh eckedException: null
> at org.apache.ignite.internal.processors.hadoop.v2.HadoopV2MapTask.run0( 
> HadoopV2MapTask.java:105)
> at org.apache.ignite.internal.processors.hadoop.v2.HadoopV2Task.run(Hado 
> opV2Task.java:54)
> at org.apache.ignite.internal.processors.hadoop.v2.HadoopV2TaskContext.r 
> un(HadoopV2TaskContext.java:249)
> at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopRunna 
> bleTask.runTask(HadoopRunnableTask.java:201)
> at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopRunna 
> bleTask.call0(HadoopRunnableTask.java:144)
> at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopRunna 
> bleTask$1.call(HadoopRunnableTask.java:116)
> at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopRunna 
> bleTask$1.call(HadoopRunnableTask.java:114)
> at org.apache.ignite.internal.processors.hadoop.v2.HadoopV2TaskContext$1 
> .run(HadoopV2TaskContext.java:550)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInforma 
> tion.java:1657)
> at org.apache.ignite.internal.processors.hadoop.v2.HadoopV2TaskContext.r 
> unAsJobOwner(HadoopV2TaskContext.java:548)
> at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopRunna 
> bleTask.call(HadoopRunnableTask.java:114)
> at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopRunna 
> bleTask.call(HadoopRunnableTask.java:46)
> at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopExecu 
> torService$2.body(HadoopExecutorService.java:186)
> at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java :110)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.NullPointerException
> at com.splunk.mr.SplunkSearchMapper.runImpl(SplunkSearchMapper.java:308)
> at com.splunk.mr.SplunkBaseMapper.run(SplunkBaseMapper.java:169)
> at org.apache.ignite.internal.processors.hadoop.v2.HadoopV2MapTask.run0( 
> HadoopV2MapTask.java:87)
> ... 16 more
> at org.apache.ignite.internal.processors.hadoop.HadoopUtils.transformExc 
> eption(HadoopUtils.java:290)
> at org.apache.ignite.internal.processors.hadoop.v2.HadoopV2TaskContext.r 
> un(HadoopV2TaskContext.java:255)
> at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopRunna 
> bleTask.runTask(HadoopRunnableTask.java:201)
> at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopRunna 
> bleTask.call0(HadoopRunnableTask.java:144)
> at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopRunna 
> bleTask$1.call(HadoopRunnableTask.java:116)
> at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopRunna 
> bleTask$1.call(HadoopRunnableTask.java:114)
> at org.apache.ignite.internal.processors.hadoop.v2.HadoopV2TaskContext$1 
> .run(HadoopV2TaskContext.java:550)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInforma 
> tion.java:1657)
> at org.apache.ignite.internal.processors.hadoop.v2.HadoopV2TaskContext.r 
> unAsJobOwner(HadoopV2TaskContext.java:548)
> at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopRunna 
> bleTask.call(HadoopRunnableTask.java:114)
> at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopRunna 
> bleTask.call(HadoopRunnableTask.java:46)
> at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopExecu 
> torService$2.body(HadoopExecutorService.java:186)
> at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java :110)
> at java.lang.Thread.run(Thread.java:745)
> {noformat}
> [1] http://www.splunk.com/en_us/products

[jira] [Commented] (IGNITE-944) HTTP REST log command doesn't work

2016-01-08 Thread Denis Magda (JIRA)

[ 
https://issues.apache.org/jira/browse/IGNITE-944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089223#comment-15089223
 ] 

Denis Magda commented on IGNITE-944:


Hi Saikat, sorry for the delay. We will review your contribution in the nearest 
days.

> HTTP REST log command doesn't work
> --
>
> Key: IGNITE-944
> URL: https://issues.apache.org/jira/browse/IGNITE-944
> Project: Ignite
>  Issue Type: Bug
>  Components: general, newbie
>Affects Versions: sprint-5
>Reporter: Sergey Kozlov
>Assignee: Saikat Maitra
>
> Request http://localhost:8080/ignite?cmd=log&to=1&from=0 returns following
> {noformat}
> {"error":"Failed to find registered handler for command: 
> LOG","response":null,"sessionToken":"","successStatus":1}
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (IGNITE-429) Implement IgniteStormStreamer to stream data from Apache Storm

2016-01-08 Thread Denis Magda (JIRA)

[ 
https://issues.apache.org/jira/browse/IGNITE-429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089229#comment-15089229
 ] 

Denis Magda commented on IGNITE-429:


Roman, thanks! Someone will review the changes the next week.

> Implement IgniteStormStreamer to stream data from Apache Storm
> --
>
> Key: IGNITE-429
> URL: https://issues.apache.org/jira/browse/IGNITE-429
> Project: Ignite
>  Issue Type: Sub-task
>  Components: streaming
>Reporter: Dmitriy Setrakyan
>Assignee: Roman Shtykh
> Fix For: 1.6
>
>
> We have {{IgniteDataStreamer}} which is used to load data into Ignite under 
> high load. It was previously named {{IgniteDataLoader}}, see ticket 
> IGNITE-394.
> See [Apache Storm|https://storm.apache.org/] for more information.
> We should create {{IgniteStormStreamer}} which will consume tuples from Storm 
> and stream them into Ignite caches. 
> More details to follow, but to the least we should be able to:
> - Convert/Intercept Storm tuples to Ignite data using an optional pluggable 
> converter.
> - Specify the cache name for the Ignite cache to load data into.
> - Specify other flags available on {{IgniteDataStreamer}} class.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (IGNITE-2016) Update KafkaStreamer to fit new features introduced in Kafka 0.9

2016-01-08 Thread Denis Magda (JIRA)

[ 
https://issues.apache.org/jira/browse/IGNITE-2016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089227#comment-15089227
 ] 

Denis Magda commented on IGNITE-2016:
-

Roman, thanks! Sorry for the delay. I'll review the changes in the nearest days.

> Update KafkaStreamer to fit new features introduced in Kafka 0.9
> 
>
> Key: IGNITE-2016
> URL: https://issues.apache.org/jira/browse/IGNITE-2016
> Project: Ignite
>  Issue Type: New Feature
>  Components: streaming
>Reporter: Roman Shtykh
>Assignee: Roman Shtykh
>
> Particularly,
> - new consumer
> - Kafka Connect (Copycat)
> http://www.confluent.io/blog/apache-kafka-0.9-is-released
> This can be a a different integration task or a complete re-write of the 
> current implementation, considering the fact that Kafka Connect is a new 
> standard way for "large-scale, real-time data import and export for Kafka."



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (IGNITE-255) Jvm8 warns that MaxPermSize is ignored

2016-01-08 Thread Denis Magda (JIRA)

[ 
https://issues.apache.org/jira/browse/IGNITE-255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089232#comment-15089232
 ] 

Denis Magda commented on IGNITE-255:


Saikat, thanks for taking care of this. Someone will review the changes the 
next week.

> Jvm8 warns that MaxPermSize is ignored
> --
>
> Key: IGNITE-255
> URL: https://issues.apache.org/jira/browse/IGNITE-255
> Project: Ignite
>  Issue Type: Bug
>  Components: general
>Affects Versions: sprint-1
>Reporter: Sergey Kozlov
>Assignee: Saikat Maitra
>
> Jaba8 doesn't support MaxPermSize anymore. Either we should replace it in 
> ignite.sh by a similar option of Java8 or set it only if ignite.sh started 
> for Java7
> {noformat}
> D:\GridGain\Ignite-SP1\ignite-fabric-1.0.0-RC1-SNAPSHOT>bin\ignite.bat
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=256m; 
> support was removed in 8.0
> [15:50:16]__  
> [15:50:16]   /  _/ ___/ |/ /  _/_  __/ __/
> [15:50:16]  _/ // (_ /// /  / / / _/
> [15:50:16] /___/\___/_/|_/___/ /_/ /___/
> [15:50:16]
> [15:50:16] ver. 1.0.0-RC1-SNAPSHOT#20150214-sha1:4d01989c
> [15:50:16] 2015 Copyright(C) Apache Software Foundation
> [15:50:16]
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)