Hi , I get errors like below when trying to run the spark unit tests zipPartitions(test.org.apache.spark.Java8RDDAPISuite) Time elapsed: 2.212 > sec <<< ERROR! > java.lang.IllegalStateException: failed to create a child event loop > at test.org.apache.spark.Java8RDDAPISuite.setUp(Java8RDDAPISuite.java:54) > Caused by: io.netty.channel.ChannelException: failed to open a new > selector > at test.org.apache.spark.Java8RDDAPISuite.setUp(Java8RDDAPISuite.java:54) > Caused by: java.io.IOException:* Too many open files* > at test.org.apache.spark.Java8RDDAPISuite.setUp(Java8RDDAPISuite.java:54)
I am running unit tests from version 2.2.1 with following system config > $ sysctl fs.file-max > fs.file-max = 100000 > $ ulimit -u > 65536 Command line used: > build/mvn -Phadoop-2.6 -Pyarn -Phive -Phive-thriftserver -Pkinesis-asl > -Pmesos --fail-at-end test Any pointers on this will be helpful Thanks Karuppayya
