Re: Caused by: java.io.NotSerializableException: com.softwaremill.sttp.FollowRedirectsBackend

2018-11-30 Thread James Starks
; On Thu, Nov 29, 2018 at 9:45 AM James Starks >> wrote: >> >>> This is not problem directly caused by Spark, but it's related; thus asking >>> here. I use spark to read data from parquet and processing some http call >>> with sttp (https://github.com/s

Re: Caused by: java.io.NotSerializableException: com.softwaremill.sttp.FollowRedirectsBackend

2018-11-30 Thread chris
Starks >> wrote: >> This is not problem directly caused by Spark, but it's related; thus asking >> here. I use spark to read data from parquet and processing some http call >> with sttp (https://github.com/softwaremill/sttp). However, spark throws >> &g

Re: Caused by: java.io.NotSerializableException: com.softwaremill.sttp.FollowRedirectsBackend

2018-11-29 Thread Koert Kuipers
tp (https://github.com/softwaremill/sttp). However, spark > throws > > Caused by: java.io.NotSerializableException: > com.softwaremill.sttp.FollowRedirectsBackend > > It's understood why such exception is thrown because > FollowRedirectsBackend is not seralizable. So I

Caused by: java.io.NotSerializableException: com.softwaremill.sttp.FollowRedirectsBackend

2018-11-29 Thread James Starks
This is not problem directly caused by Spark, but it's related; thus asking here. I use spark to read data from parquet and processing some http call with sttp (https://github.com/softwaremill/sttp). However, spark throws Caused by: java.io.NotSerializableException