Sent from my Verizon Wireless 4G LTE DROID
to RDDs or Dataset
in the next stage of the pipeline.
Also, I'm not sure what the custom Java mappers are doing - could you use them
as UDFs within a DataFrame?
Xinh
On Fri, Jun 24, 2016 at 11:42 AM, Martin Serrano
<mar...@attivio.com<mailto:mar...@attivio.com>> wrote:
Indeed. But
Indeed. But I'm dealing with 1.6 for now unfortunately.
On 06/24/2016 02:30 PM, Ted Yu wrote:
In Spark 2.0, Dataset and DataFrame are unified.
Would this simplify your use case ?
On Fri, Jun 24, 2016 at 7:27 AM, Martin Serrano
<mar...@attivio.com<mailto:mar...@attivio.com>> wro
Hi,
I'm exposing a custom source to the Spark environment. I have a question about
the best way to approach this problem.
I created a custom relation for my source and it creates a DataFrame. My
custom source knows the data types which are dynamic so this seemed to be the
appropriate return
