[
https://issues.apache.org/jira/browse/HUDI-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
teeyog updated HUDI-1526:
-------------------------
Description:
Currently, if you want to set the partition of hudi, you must configure it with
the parameter hoodie.datasource.write.partitionpath.field, but the Spark
DataFrame api partitonBy does not take effect. We can automatically translate
the parameter of partitionBy into the partition field of hudi.
[https://github.com/apache/hudi/pull/2431|https://github.com/apache/hudi/pull/2431/commits/fa597aa31b5af5ceea651af32bc163911137552c]
was:
Currently, if you want to set the partition of hudi, you must configure it with
the parameter hoodie.datasource.write.partitionpath.field, but the Spark
DataFrame api partitonBy does not take effect. We can automatically translate
the parameter of partitionBy into the partition field of hudi.
https://github.com/apache/hudi/pull/2431/commits/fa597aa31b5af5ceea651af32bc163911137552c
> Translate the spark api partitionBy to
> hoodie.datasource.write.partitionpath.field
> ----------------------------------------------------------------------------------
>
> Key: HUDI-1526
> URL: https://issues.apache.org/jira/browse/HUDI-1526
> Project: Apache Hudi
> Issue Type: Improvement
> Components: Spark Integration
> Reporter: teeyog
> Priority: Major
>
> Currently, if you want to set the partition of hudi, you must configure it
> with the parameter hoodie.datasource.write.partitionpath.field, but the Spark
> DataFrame api partitonBy does not take effect. We can automatically translate
> the parameter of partitionBy into the partition field of hudi.
> [https://github.com/apache/hudi/pull/2431|https://github.com/apache/hudi/pull/2431/commits/fa597aa31b5af5ceea651af32bc163911137552c]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
