Guys, I am running a simple example to check the latest Spark acceleration module in Ignite and am hitting some strange stuff (which musta be my configuration issue, but I can not figure out what is this).
This is how I run spark-shell in my docker container (spark-master and worker are started in the same container) % spark-shell --packages org.apache.ignite:ignite-spark:1.3.3-p2-SNAPSHOT --repositories https://repository.apache.org/content/groups/snapshots --master spark://ignite.docker:7077 then I execute this: scala> import org.apache.ignite.spark._ import org.apache.ignite.configuration._ val ic = new IgniteContext[Integer, Integer](sc, "/bigtop/spark-ignite-config.xml") 15/08/18 23:26:52 INFO XmlBeanDefinitionReader: Loading XML bean definitions from URL [file:/bigtop/spark-ignite-config.xml] 15/08/18 23:26:52 INFO GenericApplicationContext: Refreshing org.springframework.context.support.GenericApplicationContext@7f85c5d1: startup date [Tue Aug 18 2 3:26:52 UTC 2015]; root of context hierarchy 15/08/18 23:26:53 INFO IgniteKernal: >>> __________ ________________ >>> / _/ ___/ |/ / _/_ __/ __/ >>> _/ // (7 7 // / / / / _/ >>> /___/\___/_/|_/___/ /_/ /___/ >>> >>> ver. 1.3.3-p2-SNAPSHOT#20150814-sha1:9300bbc7 >>> 2015 Copyright(C) Apache Software Foundation >>> >>> Ignite documentation: http://ignite.incubator.apache.org 15/08/18 23:26:53 INFO IgniteKernal: Config URL: n/a 15/08/18 23:26:53 INFO IgniteKernal: Daemon mode: off 15/08/18 23:26:53 INFO IgniteKernal: OS: Linux 3.13.0-61-generic amd64 15/08/18 23:26:53 INFO IgniteKernal: OS user: root 15/08/18 23:26:53 INFO IgniteKernal: Language runtime: Scala ver. 2.10.4 15/08/18 23:26:53 INFO IgniteKernal: VM information: Java(TM) SE Runtime Environment 1.7.0_60-b19 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 24.60-b0 9 15/08/18 23:26:53 INFO IgniteKernal: VM total memory: 0.48GB 15/08/18 23:26:53 INFO IgniteKernal: Remote Management [restart: off, REST: on, JMX (remote: off)] 15/08/18 23:26:53 INFO IgniteKernal: IGNITE_HOME=null 15/08/18 23:26:53 INFO IgniteKernal: VM arguments: [-XX:MaxPermSize=128m, -Dscala.usejavacp=true, -Xms512m, -Xmx512m] 15/08/18 23:26:53 INFO IgniteKernal: Configured caches ['ignite-marshaller-sys-cache', 'ignite-sys-cache', 'ignite-atomics-sys-cache', 'SharedNumbers'] 15/08/18 23:26:53 INFO IgniteKernal: Non-loopback local IPs: 172.17.0.1, fe80:0:0:0:42:acff:fe11:1%4 15/08/18 23:26:53 INFO IgniteKernal: Enabled local MACs: 0242AC110001 15/08/18 23:26:53 INFO IgnitePluginProcessor: Configured plugins: 15/08/18 23:26:53 INFO IgnitePluginProcessor: ^-- None 15/08/18 23:26:53 INFO IgnitePluginProcessor: 15/08/18 23:26:53 INFO TcpCommunicationSpi: IPC shared memory server endpoint started [port=48100, tokDir=/tmp/ignite/work/ipc/shmem/9fa0e60d-8d5a-4606-9797-4dc86c683a32-10416] 15/08/18 23:26:53 INFO TcpCommunicationSpi: Successfully bound shared memory communication to TCP port [port=48100, locHost=0.0.0.0/0.0.0.0] 15/08/18 23:26:53 INFO TcpCommunicationSpi: Successfully bound to TCP port [port=47100, locHost=0.0.0.0/0.0.0.0] 15/08/18 23:26:53 WARN NoopCheckpointSpi: Checkpoints are disabled (to enable configure any GridCheckpointSpi implementation) 15/08/18 23:26:53 WARN GridCollisionManager: Collision resolution is disabled (all jobs will be activated upon arrival). 15/08/18 23:26:53 WARN NoopSwapSpaceSpi: Swap space is disabled. To enable use FileSwapSpaceSpi. 15/08/18 23:26:53 INFO IgniteKernal: Security status [authentication=off, communication encryption=off] 15/08/18 23:26:53 INFO GridTcpRestProtocol: Command protocol successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11211] 15/08/18 23:26:53 WARN TcpDiscoveryMulticastIpFinder: TcpDiscoveryMulticastIpFinder has no pre-configured addresses (it is recommended in production to specify at least one address in TcpDiscoveryMulticastIpFinder.getAddresses() configuration property) 15/08/18 23:26:53 WARN TcpDiscoverySpi: No addresses registered in the IP finder (will retry in 2000ms): TcpDiscoveryMulticastIpFinder [mcastGrp=228.1.2.4, mcastPort=47400, resWaitTime=500, addrReqAttempts=2, locAddr=null, super=TcpDiscoveryVmIpFinder [addrs=[], super=TcpDiscoveryIpFinderAdapter [shared=true]]] [23:27:03] New version is available at .... and after that the process is just hanging there without any progress. The spark-ignite-config is below <beans xmlns="http://www.springframework.org/schema/beans"; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; xsi:schemaLocation=" http://www.springframework.org/schema/beans http://www.springframework.org/schema/beans/spring-beans.xsd";> <!-- Alter configuration below as needed. --> <bean id="grid.cfg" class="org.apache.ignite.configuration.IgniteConfiguration"> <property name="cacheConfiguration"> <list> <!-- Partitioned cache example configuration (Atomic mode). --> <bean class="org.apache.ignite.configuration.CacheConfiguration"> <property name="name" value="SharedNumbers"/> <property name="affinity"> <bean class="org.apache.ignite.cache.affinity.rendezvous.RendezvousAffinityFunction"> <property name="partitions" value="32"/> </bean> </property> <property name="indexedTypes"> <array> <value>java.lang.Integer</value> <value>java.lang.Integer</value> </array> </property> </bean> </list> </property> </bean> </beans> What shall I do at this point? Thanks in advance! Cos
