Hi Yuanjian
On 5/7/19 4:55 AM, Yuanjian Li wrote:
> Hi Joe
>
> I think you met this issue: https://issues.apache.org/jira/browse/SPARK-27340
> You can check the description in Jira and PR. We also met this in our
> production env and fixed by the providing PR.
>
> The PR is still in review. cc
t; To: user@spark.apache.org <mailto:user@spark.apache.org> <
> user@spark.apache.org> <mailto:user@spark.apache.org>
> > Subject: Spark structured streaming watermarks on nested attributes
> >
> >> Hi all
> >>
> >> I'm pretty new to
ting prefixes.
> From: Joe Ammann <mailto:j...@pyx.ch>
> Reply: Joe Ammann <mailto:j...@pyx.ch>
> Date: May 6, 2019 at 6:45:13 AM
> To: user@spark.apache.org <mailto:user@spark.apache.org>
> <mailto:user@spark.apache.org>
> Subject: Spark structur
at checkpoints.
From: Joe Ammann
Reply: Joe Ammann
Date: May 6, 2019 at 6:45:13 AM
To: user@spark.apache.org
Subject: Spark structured streaming watermarks on nested attributes
Hi all
I'm pretty new to Spark and implementing my first non-trivial structured
streaming job with outer joins
Hi all
I'm pretty new to Spark and implementing my first non-trivial structured
streaming job with outer joins. My environment is a Hortonworks HDP 3.1 cluster
with Spark 2.3.2, working with Python.
I understood that I need to provide watermarks and join conditions for left
outer joins to
