Re: Kerberos installation
Hello Ravi, Were you able to solve this issue? If so, kindly request you to post the correct configurations for Kerberos enabled Ignite Installation. Thanks in Advance!!! -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Kerberos installation
Hi Evgenii, Thanks for the reply. We wanted to use ignite on top of the existing kerberized hadoop/hive deployment with out any code change(Means used HDFS as secondary file system and refer ignite specific config files while accessing hdfs and not writing any java code). In this case can you provide the needed ignite config file which has KerberosHadoopFileSystemFactory and its allowed properties?. We are not finding the enough documentation. Please reply. Regards Ravi -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Kerberos-installation-tp16200p16440.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Re: Kerberos installation
Hi, take a look for a KerberosHadoopFileSystemFactory,it can be used in kerberized hadoop env: KerberosHadoopFileSystemFactory delegate = new KerberosHadoopFileSystemFactory(); delegate.setKeyTab("foo.keytab"); delegate.setKeyTabPrincipal("foo"); delegate.setReloginInterval(0); Evgenii 2017-08-26 18:09 GMT+03:00 ravi : > Hi, > I have kerberos enabled zookeeper based hadoop HA environment. With out > ignite, I am able to access my hadoop file system with valid kerberos > ticket. > However by running the below command, I am getting below exception. Is > there anything i am missing in default-config.xml?. Can u provide some > proper documentation to make hdfs as secondary file system ( kerberos > enabled hadoop environment ) to ignite?. > > $HADOOP_HOME/bin/hdfs --config /$HADOOP_HOME/ignite_conf dfs -mkdir /tut1 > > Ignote default-config.xml:- (Hadoop as secondary file system) > > > class="org.apache.ignite.hadoop.fs.IgniteHadoopIgfsSecondaryFileSystem"> > > class="org.apache.ignite.hadoop.fs.CachingHadoopFileSystemFactory"> > value="hdfs://192.168.126.207:8020/"/> > > > > /opt/Ignite2/ignite-hadoop-2.1.0/config/hadoop/ > core-site.xml > > > > > > > > > > Stack Trace:- > > Caused by: > org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security. > AccessControlException): > SIMPLE authentication is not enabled. Available:[TOKEN, KERBEROS] > at org.apache.hadoop.ipc.Client.call(Client.java:1475) > [2017-08-26 18:50:11,731][ERROR][igfs-igfs-ipc-#63%null%][IgfsImpl] File > info operation in DUAL mode failed [path=/tut1] > class org.apache.ignite.igfs.IgfsException: Failed to get file status > [path=/tut1] > > > > > -- > View this message in context: http://apache-ignite-users. > 70518.x6.nabble.com/Kerberos-installation-tp16200p16427.html > Sent from the Apache Ignite Users mailing list archive at Nabble.com. >
Re: Kerberos installation
Hi, I have kerberos enabled zookeeper based hadoop HA environment. With out ignite, I am able to access my hadoop file system with valid kerberos ticket. However by running the below command, I am getting below exception. Is there anything i am missing in default-config.xml?. Can u provide some proper documentation to make hdfs as secondary file system ( kerberos enabled hadoop environment ) to ignite?. $HADOOP_HOME/bin/hdfs --config /$HADOOP_HOME/ignite_conf dfs -mkdir /tut1 Ignote default-config.xml:- (Hadoop as secondary file system) /opt/Ignite2/ignite-hadoop-2.1.0/config/hadoop/core-site.xml Stack Trace:- Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException): SIMPLE authentication is not enabled. Available:[TOKEN, KERBEROS] at org.apache.hadoop.ipc.Client.call(Client.java:1475) [2017-08-26 18:50:11,731][ERROR][igfs-igfs-ipc-#63%null%][IgfsImpl] File info operation in DUAL mode failed [path=/tut1] class org.apache.ignite.igfs.IgfsException: Failed to get file status [path=/tut1] -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Kerberos-installation-tp16200p16427.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Re: Kerberos installation
Have you checked this link: https://apacheignite-fs.readme.io/docs/file-system ? You need to configure IGFS for hadoop and Ignite should use Hadoop api to work with Kerberos Evgenii -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Kerberos-installation-tp16200p16204.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Kerberos installation
Hi, I'm trying to find documentation on the steps needed to ensure Ignite will work on a kerberized HDP cluster, but have not had much luck with the official docs or with Google. Can anyone advise on this please? I'm sure the steps are probably relatively simple, but we need to know specifically what they are in advance for project reasons. thanks, Gareth