RE: spark assembly jar caused "changed on src filesystem" error

2014-12-07 Thread Hu, Leo
If anybody knows the reason, please help me. thanks a lot. Thanks Best Regard LEO HU CD&SP SAP LABS CHINA From: Hu, Leo [mailto:leo.h...@sap.com] Sent: Friday, December 05, 2014 10:23 AM To: u...@spark.incubator.apache.org Subject: spark assembly jar caused "changed on src filesystem&q

spark assembly jar caused "changed on src filesystem" error

2014-12-04 Thread Hu, Leo
Hi all when I execute: /spark-1.1.1-bin-hadoop2.4/bin/spark-submit --verbose --master yarn-cluster --class spark.SimpleApp --jars /spark-1.1.1-bin-hadoop2.4/lib/spark-assembly-1.1.1-hadoop2.4.0.jar --executor-memory 1G --num-executors 2 /spark-1.1.1-bin-hadoop2.4/testfile/simple-project-1.0.ja

spark1.0.1 & hadoop2.2.0 issue

2014-07-19 Thread Hu, Leo
Hi all Have anyone encounter such problem below, and how to solve it ? any help would be appreciated. Caused by: java.lang.UnsatisfiedLinkError: org.apache.hadoop.security.JniBasedUnixGroupsMapping.anchorNative()V at org.apache.hadoop.security.JniBasedUnixGroupsMapping.anchorNative(Na

can we insert and update with spark sql

2014-07-16 Thread Hu, Leo
Hi As for spark 1.0, can we insert and update a table with SPARK SQL, and how? Thanks Best Regard