[
https://issues.apache.org/jira/browse/BEAM-11324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255758#comment-17255758
]
Brian Hulette commented on BEAM-11324:
--------------------------------------
An initial implementation was finished in pr/13401. There are some follow up
items in TODOs:
{code}
# TODO(BEAM-11324): Consider verifying result is always the same
{code}
https://github.com/apache/beam/blob/7ef8bd1d13463c03a28812473e92014fc6b5a3d1/sdks/python/apache_beam/dataframe/expressions.py#L129
{code}
# TODO(BEAM-11324): This check should be stronger, it should verify that
# running partition_fn on the concatenation of dfs yields the same
# partitions.
{code}
https://github.com/apache/beam/blob/7ef8bd1d13463c03a28812473e92014fc6b5a3d1/sdks/python/apache_beam/dataframe/partitionings.py#L119)
> Additional verification in PartitioningSession
> ----------------------------------------------
>
> Key: BEAM-11324
> URL: https://issues.apache.org/jira/browse/BEAM-11324
> Project: Beam
> Issue Type: Task
> Components: sdk-py-core
> Reporter: Brian Hulette
> Assignee: Brian Hulette
> Priority: P2
> Labels: stale-assigned
> Time Spent: 50m
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
