[
https://issues.apache.org/jira/browse/FLINK-40437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18118628#comment-18118628
]
Dian Fu commented on FLINK-40437:
---------------------------------
[~fdolce] Great! Thanks for working on this.
> Add iteration and bounded retrieval to DataFrame API
> ----------------------------------------------------
>
> Key: FLINK-40437
> URL: https://issues.apache.org/jira/browse/FLINK-40437
> Project: Flink
> Issue Type: Sub-task
> Components: API / Python
> Reporter: Liu Liu
> Priority: Major
>
> Add incremental row and batch result APIs:
> {code:java}
> def iter_rows(
> self,
> *,
> include_row_kind=False,
> row_kind_field="__row_kind__",
> ) -> CloseableIterator[Dict[str, Any]]
> def iter_batches(
> self,
> *,
> batch_size=1000,
> batch_format="pandas",
> include_row_kind=False,
> row_kind_field="__row_kind__",
> ) -> CloseableIterator {code}
> Also add bounded retrieval helpers:
> {code:java}
> def take(self, n, *, timeout=None, include_row_kind=False, ...) -> List[Dict]
> def take_batch(self, n, *, timeout=None, batch_format="pandas", ...) -> Batch
> {code}
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
