Ismaël Mejía created BEAM-9451:
----------------------------------
Summary: Optimize translation of SQL/Schema-based PTransforms in
Spark Structured Streaming runner
Key: BEAM-9451
URL: https://issues.apache.org/jira/browse/BEAM-9451
Project: Beam
Issue Type: Improvement
Components: runner-spark
Reporter: Ismaël Mejía
Spark Structured Streaming runner supports Datasets that already have Schema
information. This is used by Spark to optimize jobs (via Catalyst). This issue
is to implement optimized transforms for the runner so we can benefit of the
performance improvements internally done by Spark.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
