Getting Exceptions/WARN during random runs for same dataset

Hi Everyone, Environment used: Datastax Enterprise 4.8.3 which is bundled with Spark 1.4.1 and scala 2.10.5. I am using Dataframes to query Cassandra, do processing and store the result back into Cassandra. The job is being submitted using spark-submit on a cluster of 3 nodes. While doing so I

Re: Getting Exceptions/WARN during random runs for same dataset

It's a known issue. See https://issues.apache.org/jira/browse/SPARK-10719 On Thu, Jan 28, 2016 at 5:44 PM, Khusro Siddiqui wrote: > It is happening on random executors on random nodes. Not on any specific > node everytime. > Or not happening at all > > On Thu, Jan 28, 2016 at

Getting Exceptions/WARN during random runs for same dataset

Hi Everyone, Environment used: Datastax Enterprise 4.8.3 which is bundled with Spark 1.4.1 and scala 2.10.5. I am using Dataframes to query Cassandra, do processing and store the result back into Cassandra. The job is being submitted using spark-submit on a cluster of 3 nodes. While doing so I

Re: Getting Exceptions/WARN during random runs for same dataset

It is happening on random executors on random nodes. Not on any specific node everytime. Or not happening at all On Thu, Jan 28, 2016 at 7:42 PM, Ted Yu wrote: > Did the UnsupportedOperationException's happen from the executors on all the > nodes or only one node ? > >

Re: Getting Exceptions/WARN during random runs for same dataset

Did the UnsupportedOperationException's happen from the executors on all the nodes or only one node ? Thanks On Thu, Jan 28, 2016 at 5:13 PM, Khusro Siddiqui wrote: > Hi Everyone, > > Environment used: Datastax Enterprise 4.8.3 which is bundled with Spark > 1.4.1 and scala