Operators supported by Spark Structured Streaming

[shicheng31...@gmail.com]

Hi:
Spark Structured Streaming uses the DataFrame API. When programming, there 
are no compilation errors, but when running, it will report various unsupported 
conditions. The official website does not seem to have a document to list the 
unsupported operators. This will Inconvenient when developing. How did you 
solve this problem?



shicheng31...@gmail.com

Re: Operators supported by Spark Structured Streaming

[Jungtaek Lim]

Hi,

Unsupported operations in Structured Streaming is explained in the guide
doc.
http://spark.apache.org/docs/latest/structured-streaming-programming-guide.html#unsupported-operations

Thanks,
Jungtaek Lim (HeartSaVioR)


On Fri, Nov 29, 2019 at 2:08 PM shicheng31...@gmail.com <
shicheng31...@gmail.com> wrote:

> Hi:
> Spark Structured Streaming uses the DataFrame API. When programming,
> there are no compilation errors, but when running, it will report various
> unsupported conditions. The official website does not seem to have a
> document to list the unsupported operators. This will Inconvenient when
> developing. How did you solve this problem?
>
> --
> shicheng31...@gmail.com
>

Re: Operators supported by Spark Structured Streaming

[hahaha sc]

It is still not complete. For example, the supported operators are
different under different outputmodes. For developers, only try.

Jungtaek Lim  于2019年11月29日周五 下午1:36写道：

> Hi,
>
> Unsupported operations in Structured Streaming is explained in the guide
> doc.
>
> http://spark.apache.org/docs/latest/structured-streaming-programming-guide.html#unsupported-operations
>
> Thanks,
> Jungtaek Lim (HeartSaVioR)
>
>
> On Fri, Nov 29, 2019 at 2:08 PM shicheng31...@gmail.com <
> shicheng31...@gmail.com> wrote:
>
>> Hi:
>> Spark Structured Streaming uses the DataFrame API. When programming,
>> there are no compilation errors, but when running, it will report various
>> unsupported conditions. The official website does not seem to have a
>> document to list the unsupported operators. This will Inconvenient when
>> developing. How did you solve this problem?
>>
>> --
>> shicheng31...@gmail.com
>>
>