Ian Cook created SPARK-48478:
--------------------------------
Summary: Allow passing iterator of PyArrow RecordBatches to
createDataFrame()
Key: SPARK-48478
URL: https://issues.apache.org/jira/browse/SPARK-48478
Project: Spark
Issue Type: Improvement
Components: Connect, Input/Output, PySpark, SQL
Affects Versions: 3.5.1, 4.0.0
Reporter: Ian Cook
As a follow-up to SPARK-48220:
For larger data, it would be nice to be able to pass an iterator of PyArrow
RecordBatches to {{{}createDataFrame(){}}}.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
