g" <user@spark.apache.org>, #MM - Heartbeat <
> mm-heartb...@capitalone.com>
> *Subject: *Re: Union of 2 streaming data frames
>
>
>
> Great! Even, *val **dfAllEvents =
> sparkSession.table("oldEvents").union(sparkSession.table("newEvents"))
>
icks.com>
Cc: "user@spark.apache.org" <user@spark.apache.org>, #MM - Heartbeat
<mm-heartb...@capitalone.com>
Subject: Re: Union of 2 streaming data frames
Great! Even, val dfAllEvents =
sparkSession.table("oldEvents").union(sparkSession.table("newEvents")) doesn’
; <jayesh.lalw...@capitalone.com>
Cc: "user@spark.apache.org" <user@spark.apache.org>, #MM - Heartbeat
<mm-heartb...@capitalone.com>
Subject: Re: Union of 2 streaming data frames
Ah, looks like you are hitting
SPARK-20441<https://issues.apache.org/jira/browse/SPAR
pache.spark.sql.execution.streaming.
> StreamExecution$$anonfun$org$apache$spark$sql$execution$
> streaming$StreamExecution$$runBatches$1.apply$mcZ$sp(
> StreamExecution.scala:244)
>
> at org.apache.spark.sql.execution.streaming.
> ProcessingTimeExecutor.execute(TriggerEx
rust <mich...@databricks.com>
Date: Friday, July 7, 2017 at 2:30 PM
To: "Lalwani, Jayesh" <jayesh.lalw...@capitalone.com>
Cc: "user@spark.apache.org" <user@spark.apache.org>
Subject: Re: Union of 2 streaming data frames
df.union(df2) should be supported when both
df.union(df2) should be supported when both DataFrames are created from a
streaming source. What error are you seeing?
On Fri, Jul 7, 2017 at 11:27 AM, Lalwani, Jayesh <
jayesh.lalw...@capitalone.com> wrote:
> In structured streaming, Is there a way to Union 2 streaming data frames?
> Are there
