HI, I am seeing warnings like this in the logs when I run Spark jobs:
OpenJDK 64-Bit Server VM warning: You have loaded library /root/ephemeral-hdfs/lib/native/libhadoop.so.1.0.0 which might have disabled stack guard. The VM will try to fix the stack guard now. It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'. I used spark-ec2 to launch the cluster with the default AMI, Spark 1.5.2, hadoop major version 2.4. I altered the jdk to be openjdk 8 as I'd written some jobs in Java 8. The 6 workers nodes are m4.2xlarge and master is m4.large. Could this contribute to any problems running the jobs? Regards, James