Hi, We just started exploring apache nifi for data onboarding into MapR distribution. Have configured putHDFS with yarn-site.xml from on local mapr client where cluster information is provided, configured the "Directory" with mapr fs directory to write the files, configured nifi to run as user has permission to write to mapr fs, inspie of that we are getting below error while writing the file into given file system path. I am doubting, nifi is not talking to the cluster or talking with wrong user, appreciate if you some can guide me to troubleshoot this issue or any solutions if we are doing something wrong:
Nifi workflow is very simple: GetFile is configure to read from locla file system, connected to PutHDFS with yarn-site.xml and directory information configured. 2016-06-13 15:14:36,305 INFO [Timer-Driven Process Thread-2] o.apache.nifi.processors.hadoop.PutHDFS PutHDFS[id=07abcfaa-fa8d-496b-81f0-b1b770672719] Kerberos relogin successful or ticket still valid 2016-06-13 15:14:36,324 ERROR [Timer-Driven Process Thread-2] o.apache.nifi.processors.hadoop.PutHDFS PutHDFS[id=07abcfaa-fa8d-496b-81f0-b1b770672719] Failed to write to HDFS due to java.io.IOException: /app/DataAnalyticsFramework/catalog/nifi could not be created: java.io.IOException: /app/DataAnalyticsFramework/catalog/nifi could not be created 2016-06-13 15:14:36,330 ERROR [Timer-Driven Process Thread-2] o.apache.nifi.processors.hadoop.PutHDFS java.io.IOException: /app/DataAnalyticsFramework/catalog/nifi could not be created at org.apache.nifi.processors.hadoop.PutHDFS.onTrigger(PutHDFS.java:238) ~[nifi-hdfs-processors-0.6.1.jar:0.6.1] at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27) [nifi-api-0.6.1.jar:0.6.1] at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1059) [nifi-framework-core-0.6.1.jar:0.6.1] at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:136) [nifi-framework-core-0.6.1.jar:0.6.1] at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47) [nifi-framework-core-0.6.1.jar:0.6.1] at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:123) [nifi-framework-core-0.6.1.jar:0.6.1] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [na:1.7.0_101] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304) [na:1.7.0_101] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178) [na:1.7.0_101] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) [na:1.7.0_101] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_101] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_101] at java.lang.Thread.run(Thread.java:745) [na:1.7.0_101] Appreciate any help. Thanks, Ravi Papisetti Technical Leader Services Technology Incubation Center<http://wwwin.cisco.com/CustAdv/ts/cstg/stic/> rpapi...@cisco.com<mailto:rpapi...@cisco.com> Phone: +1 512 340 3377 [stic-logo-email-blue]