Re: Spark SQL 1.6.1 issue
Hi, does the version have to be the same down to the minor version, e.g.
1.6.1 and 1.6.2 will give this issue
On Thu, Aug 18, 2016 at 6:27 PM, Olivier Girardot <
o.girar...@lateral-thoughts.com> wrote:
> your executors/driver must not have the multiple versions of spark in
> classpath, it may come from the cassandra connector check the pom
> dependencies of the version you fetched and if it's compatible with your
> spark version.
>
>
>
> On Thu, Aug 18, 2016 6:05 AM, thbeh th...@thbeh.com wrote:
>
>> Running the query below I have been hitting - local class incompatible
>>
>> exception, anyone know the cause?
>>
>>
>> val rdd = csc.cassandraSql("""select *, concat('Q', d_qoy) as qoy from
>>
>> store_sales join date_dim on ss_sold_date_sk = d_date_sk join item on
>>
>> ss_item_sk =
>>
>> i_item_sk""").groupBy("i_category").pivot("qoy").agg(
>> round(sum("ss_sales_price")/100,2))
>>
>>
>> The source data is from TPCDS test data and I am running in Zeppelin.
>>
>>
>>
>> /INFO [2016-08-18 03:15:58,429] ({task-result-getter-2}
>>
>> Logging.scala[logInfo]:58) - Lost task 3.0 in stage 3.0 (TID 52) on
>> executor
>>
>> ceph5.example.my: java.io.InvalidClassException
>>
>> (org.apache.spark.sql.catalyst.expressions.Literal; local class
>>
>> incompatible: stream classdesc serialVersionUID = 3305180847846277455,
>> local
>>
>> class serialVersionUID = -4259705229845269663) [duplicate 1]
>>
>> INFO [2016-08-18 03:15:58,429] ({task-result-getter-3}
>>
>> Logging.scala[logInfo]:58) - Lost task 2.0 in stage 3.0 (TID 51) on
>> executor
>>
>> ceph5.example.my: java.io.InvalidClassException
>>
>> (org.apache.spark.sql.catalyst.expressions.Literal; local class
>>
>> incompatible: stream classdesc serialVersionUID = 3305180847846277455,
>> local
>>
>> class serialVersionUID = -4259705229845269663) [duplicate 2]
>>
>> INFO [2016-08-18 03:15:58,430] ({task-result-getter-3}
>>
>> Logging.scala[logInfo]:58) - Lost task 6.0 in stage 3.0 (TID 55) on
>> executor
>>
>> ceph5.example.my: java.io.InvalidClassException
>>
>> (org.apache.spark.sql.catalyst.expressions.Literal; local class
>>
>> incompatible: stream classdesc serialVersionUID = 3305180847846277455,
>> local
>>
>> class serialVersionUID = -4259705229845269663) [duplicate 3]/
>>
>>
>> Thanks
>>
>>
>>
>>
>> --
>>
>> View this message in context: http://apache-spark-user-list.
>> 1001560.n3.nabble.com/Spark-SQL-1-6-1-issue-tp27554.html
>>
>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>
>>
>> -
>>
>> To unsubscribe e-mail: user-unsubscr...@spark.apache.org
>>
>>
>>
>>
>
> *Olivier Girardot* | Associé
> o.girar...@lateral-thoughts.com
> +33 6 24 09 17 94
>
Re: Spark SQL 1.6.1 issue
your executors/driver must not have the multiple versions of spark in classpath,
it may come from the cassandra connector check the pom dependencies of the
version you fetched and if it's compatible with your spark version.
On Thu, Aug 18, 2016 6:05 AM, thbeh th...@thbeh.com wrote:
Running the query below I have been hitting - local class incompatible
exception, anyone know the cause?
val rdd = csc.cassandraSql("""select *, concat('Q', d_qoy) as qoy from
store_sales join date_dim on ss_sold_date_sk = d_date_sk join item on
ss_item_sk =
i_item_sk""").groupBy("i_category").pivot("qoy").agg(round(sum("ss_sales_price")/100,2))
The source data is from TPCDS test data and I am running in Zeppelin.
/INFO [2016-08-18 03:15:58,429] ({task-result-getter-2}
Logging.scala[logInfo]:58) - Lost task 3.0 in stage 3.0 (TID 52) on executor
ceph5.example.my: java.io.InvalidClassException
(org.apache.spark.sql.catalyst.expressions.Literal; local class
incompatible: stream classdesc serialVersionUID = 3305180847846277455, local
class serialVersionUID = -4259705229845269663) [duplicate 1]
INFO [2016-08-18 03:15:58,429] ({task-result-getter-3}
Logging.scala[logInfo]:58) - Lost task 2.0 in stage 3.0 (TID 51) on executor
ceph5.example.my: java.io.InvalidClassException
(org.apache.spark.sql.catalyst.expressions.Literal; local class
incompatible: stream classdesc serialVersionUID = 3305180847846277455, local
class serialVersionUID = -4259705229845269663) [duplicate 2]
INFO [2016-08-18 03:15:58,430] ({task-result-getter-3}
Logging.scala[logInfo]:58) - Lost task 6.0 in stage 3.0 (TID 55) on executor
ceph5.example.my: java.io.InvalidClassException
(org.apache.spark.sql.catalyst.expressions.Literal; local class
incompatible: stream classdesc serialVersionUID = 3305180847846277455, local
class serialVersionUID = -4259705229845269663) [duplicate 3]/
Thanks
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-SQL-1-6-1-issue-tp27554.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org
Olivier Girardot | Associé
o.girar...@lateral-thoughts.com
+33 6 24 09 17 94
Spark SQL 1.6.1 issue
Running the query below I have been hitting - local class incompatible
exception, anyone know the cause?
val rdd = csc.cassandraSql("""select *, concat('Q', d_qoy) as qoy from
store_sales join date_dim on ss_sold_date_sk = d_date_sk join item on
ss_item_sk =
i_item_sk""").groupBy("i_category").pivot("qoy").agg(round(sum("ss_sales_price")/100,2))
The source data is from TPCDS test data and I am running in Zeppelin.
/INFO [2016-08-18 03:15:58,429] ({task-result-getter-2}
Logging.scala[logInfo]:58) - Lost task 3.0 in stage 3.0 (TID 52) on executor
ceph5.example.my: java.io.InvalidClassException
(org.apache.spark.sql.catalyst.expressions.Literal; local class
incompatible: stream classdesc serialVersionUID = 3305180847846277455, local
class serialVersionUID = -4259705229845269663) [duplicate 1]
INFO [2016-08-18 03:15:58,429] ({task-result-getter-3}
Logging.scala[logInfo]:58) - Lost task 2.0 in stage 3.0 (TID 51) on executor
ceph5.example.my: java.io.InvalidClassException
(org.apache.spark.sql.catalyst.expressions.Literal; local class
incompatible: stream classdesc serialVersionUID = 3305180847846277455, local
class serialVersionUID = -4259705229845269663) [duplicate 2]
INFO [2016-08-18 03:15:58,430] ({task-result-getter-3}
Logging.scala[logInfo]:58) - Lost task 6.0 in stage 3.0 (TID 55) on executor
ceph5.example.my: java.io.InvalidClassException
(org.apache.spark.sql.catalyst.expressions.Literal; local class
incompatible: stream classdesc serialVersionUID = 3305180847846277455, local
class serialVersionUID = -4259705229845269663) [duplicate 3]/
Thanks
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-SQL-1-6-1-issue-tp27554.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org
