[
https://issues.apache.org/jira/browse/BEAM-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ismaël Mejía updated BEAM-9451:
-------------------------------
Status: Open (was: Triage Needed)
> Optimize translation of SQL/Schema-based PTransforms in Spark Structured
> Streaming runner
> -----------------------------------------------------------------------------------------
>
> Key: BEAM-9451
> URL: https://issues.apache.org/jira/browse/BEAM-9451
> Project: Beam
> Issue Type: Improvement
> Components: runner-spark
> Reporter: Ismaël Mejía
> Priority: Major
>
> Spark Structured Streaming runner supports Datasets that already have Schema
> information. This is used by Spark to optimize jobs (via Catalyst). This
> issue is to implement optimized transforms for the runner so we can benefit
> of the performance improvements internally done by Spark.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
