Re: ClassNotFoundException when using IgniteHadoopIgfsSecondaryFileSystem

2019-04-02 Thread ilya.kasnacheev
Hello! Looks like there is some dependency problem in hadoop modules. Do you have steps to reproduce? Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: ClassNotFoundException when using IgniteHadoopIgfsSecondaryFileSystem

2019-03-10 Thread mehdi sey
hi. i want to start ignite node with a configuration name as example-igfs.xml. i have alter this configuration for using IGFS as cache layer for HDFS. but when i execute the below command for start ignite node i encounter with error: /usr/local/apache-ignite-fabric-2.6.0-bin/bin/ignite.sh /usr/loc

Re: ClassNotFoundException when using IgniteHadoopIgfsSecondaryFileSystem

2017-12-07 Thread Juan Rodríguez Hortalá
Hi Alexey, Thanks for your answers. I was finally able to fix this, I was missing some additional jars in the lib directory of the ignite installation in the worker nodes. The exception thrown was by org.apache.hadoop.conf.Configuration.getClassByName was a bit misleading because it was referring

Re: ClassNotFoundException when using IgniteHadoopIgfsSecondaryFileSystem

2017-12-07 Thread Alexey Kukushkin
I just replied you on another thread with details on what you need to do to connect to a remote IGFS cluster. You still need Ignite configuration and Ignite-Hadoop dependencies on your spark nodes to connect to r

Re: ClassNotFoundException when using IgniteHadoopIgfsSecondaryFileSystem

2017-12-06 Thread Juan Rodríguez Hortalá
Hi, Thanks for your answer. I have both libs/ignite-core and libs/ignite-hadoop/ignite-hadoop, and also the jar for the other hadoop file system, in the list of jars visible on the java.class.path section that is returned by the config command of the Ignite Visor. Is the order of the jars relevant

Re: ClassNotFoundException when using IgniteHadoopIgfsSecondaryFileSystem

2017-12-06 Thread Alexey Kukushkin
Hi, I do not see any other reasons for a "class not found" exception but the class is not on the CLASSPATH. Can you make sure "ignite-core-xxx.jar" and "ignite-hadoop-xxx.jar" are on the hadoop's CLASSPATH.

ClassNotFoundException when using IgniteHadoopIgfsSecondaryFileSystem

2017-12-05 Thread Juan Rodríguez Hortalá
Hi, I'm trying to use IgniteHadoopIgfsSecondaryFileSystem on EMR, and I have been able to make this work using HDFS in the uri. But when I use a different scheme for another file system that is working ok with `hadoop fs` and other applications, I get ``` [hadoop@ip-10-0-0-242 ~]$ hadoop fs -ls