[
https://issues.apache.org/jira/browse/IGNITE-2343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15101390#comment-15101390
]
Denis Magda commented on IGNITE-2343:
-------------------------------------
MR doesn't work if tmp and the splunk user are running NOT in IGFS PRIMARY
mode.
If to put splunk user and tmp dirs on PRIMARY mode only that everything works
fine.
Attached logs and thread dumps that might be useful.
> IGFS: MapReduce task sent by Hunk/Splunk fails with NPE
> -------------------------------------------------------
>
> Key: IGNITE-2343
> URL: https://issues.apache.org/jira/browse/IGNITE-2343
> Project: Ignite
> Issue Type: Bug
> Components: IGFS
> Affects Versions: 1.5
> Reporter: Denis Magda
> Assignee: Ivan Veselovsky
> Labels: important
> Fix For: 1.6
>
>
> A MR task being sent by Hunk [1] fails with NPE
> {noformat}
> [10:31:58,250][ERROR][Hadoop-task-fd3ff783-d952-4147-8e5b-8e3080b91ddb_1-MAP-50-
> 0-#271%null%][HadoopRunnableTask] Task execution failed.
> class org.apache.ignite.IgniteCheckedException: class
> org.apache.ignite.IgniteCh eckedException: null
> at org.apache.ignite.internal.processors.hadoop.v2.HadoopV2MapTask.run0(
> HadoopV2MapTask.java:105)
> at org.apache.ignite.internal.processors.hadoop.v2.HadoopV2Task.run(Hado
> opV2Task.java:54)
> at org.apache.ignite.internal.processors.hadoop.v2.HadoopV2TaskContext.r
> un(HadoopV2TaskContext.java:249)
> at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopRunna
> bleTask.runTask(HadoopRunnableTask.java:201)
> at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopRunna
> bleTask.call0(HadoopRunnableTask.java:144)
> at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopRunna
> bleTask$1.call(HadoopRunnableTask.java:116)
> at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopRunna
> bleTask$1.call(HadoopRunnableTask.java:114)
> at org.apache.ignite.internal.processors.hadoop.v2.HadoopV2TaskContext$1
> .run(HadoopV2TaskContext.java:550)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInforma
> tion.java:1657)
> at org.apache.ignite.internal.processors.hadoop.v2.HadoopV2TaskContext.r
> unAsJobOwner(HadoopV2TaskContext.java:548)
> at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopRunna
> bleTask.call(HadoopRunnableTask.java:114)
> at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopRunna
> bleTask.call(HadoopRunnableTask.java:46)
> at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopExecu
> torService$2.body(HadoopExecutorService.java:186)
> at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java :110)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.NullPointerException
> at com.splunk.mr.SplunkSearchMapper.runImpl(SplunkSearchMapper.java:308)
> at com.splunk.mr.SplunkBaseMapper.run(SplunkBaseMapper.java:169)
> at org.apache.ignite.internal.processors.hadoop.v2.HadoopV2MapTask.run0(
> HadoopV2MapTask.java:87)
> ... 16 more
> at org.apache.ignite.internal.processors.hadoop.HadoopUtils.transformExc
> eption(HadoopUtils.java:290)
> at org.apache.ignite.internal.processors.hadoop.v2.HadoopV2TaskContext.r
> un(HadoopV2TaskContext.java:255)
> at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopRunna
> bleTask.runTask(HadoopRunnableTask.java:201)
> at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopRunna
> bleTask.call0(HadoopRunnableTask.java:144)
> at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopRunna
> bleTask$1.call(HadoopRunnableTask.java:116)
> at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopRunna
> bleTask$1.call(HadoopRunnableTask.java:114)
> at org.apache.ignite.internal.processors.hadoop.v2.HadoopV2TaskContext$1
> .run(HadoopV2TaskContext.java:550)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInforma
> tion.java:1657)
> at org.apache.ignite.internal.processors.hadoop.v2.HadoopV2TaskContext.r
> unAsJobOwner(HadoopV2TaskContext.java:548)
> at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopRunna
> bleTask.call(HadoopRunnableTask.java:114)
> at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopRunna
> bleTask.call(HadoopRunnableTask.java:46)
> at org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopExecu
> torService$2.body(HadoopExecutorService.java:186)
> at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java :110)
> at java.lang.Thread.run(Thread.java:745)
> {noformat}
> [1] http://www.splunk.com/en_us/products/hunk.html
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
