Re: Driver aborts on Mesos when unable to connect to one of external shuffle services

Hi Igor, Have you started the external shuffle service manually? Cheers 2018-04-12 10:48 GMT+02:00 igor.berman : > Hi, > any input regarding is it expected: > Driver starts and unable to connect to external shuffle service on one of > the nodes(no matter what is the

Re: Windows10 + pyspark + ipython + csv file loading with timestamps

Hi Esa, I'm using it like this: https://gist.github.com/tromika/1cda392242fdd66befe7970d80380216 cheers, 2017-12-16 11:04 GMT+01:00 Esa Heikkinen : > Hi > > Does anyone have any hints or example (code) how to get combination: > Windows10 + pyspark + ipython notebook +

Re: Metadata Management

Hi Vasu, https://github.com/linkedin/WhereHows might be a good fit. Cheers Tamas On 2017. Oct 19., Thu at 23:22, Vasu Gourabathina wrote: > All: > > This may be off topic for Spark, but I'm sure several of you might have > used some form of this as part of your BigData

Re: how to convert the binary from kafak to srring pleaae

Hi, You can cast it to string in a select or you can set the value.deserializer parameter for kafka. cheers, 2017-07-24 4:44 GMT+02:00 萝卜丝炒饭 <1427357...@qq.com>: > Hi all > > I want to change the binary from kafka to string. Would you like help me > please? > > val df =

Re: How best we can store streaming data on dashboards for real time user experience?

For us, after some Spark Streaming transformation, Elasticsearch + Kibana is a great combination to store and visualize data. An alternative solution that we use is Spark Streaming put some data back to Kafka and we consume it with nodejs. Cheers, Tamas 2017-03-30 9:25 GMT+02:00 Alonso Isidoro