[jira] [Updated] (HUDI-1526) Translate the spark api partitionBy to hoodie.datasource.write.partitionpath.field

2021-03-15 Thread Xianghu Wang (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Xianghu Wang updated HUDI-1526:
---
Fix Version/s: 0.8.0

> Translate the spark api partitionBy to 
> hoodie.datasource.write.partitionpath.field
> --
>
> Key: HUDI-1526
> URL: https://issues.apache.org/jira/browse/HUDI-1526
> Project: Apache Hudi
>  Issue Type: Improvement
>  Components: Spark Integration
>Reporter: teeyog
>Priority: Major
>  Labels: pull-request-available
> Fix For: 0.8.0
>
>
> Currently, if you want to set the partition of hudi, you must configure it 
> with the parameter hoodie.datasource.write.partitionpath.field, but the Spark 
> DataFrame api partitonBy does not take effect. We can automatically translate 
> the parameter of partitionBy into the partition field of hudi.
> [https://github.com/apache/hudi/pull/2431|https://github.com/apache/hudi/pull/2431/commits/fa597aa31b5af5ceea651af32bc163911137552c]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (HUDI-1526) Translate the spark api partitionBy to hoodie.datasource.write.partitionpath.field

2021-01-14 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated HUDI-1526:
-
Labels: pull-request-available  (was: )

> Translate the spark api partitionBy to 
> hoodie.datasource.write.partitionpath.field
> --
>
> Key: HUDI-1526
> URL: https://issues.apache.org/jira/browse/HUDI-1526
> Project: Apache Hudi
>  Issue Type: Improvement
>  Components: Spark Integration
>Reporter: teeyog
>Priority: Major
>  Labels: pull-request-available
>
> Currently, if you want to set the partition of hudi, you must configure it 
> with the parameter hoodie.datasource.write.partitionpath.field, but the Spark 
> DataFrame api partitonBy does not take effect. We can automatically translate 
> the parameter of partitionBy into the partition field of hudi.
> [https://github.com/apache/hudi/pull/2431|https://github.com/apache/hudi/pull/2431/commits/fa597aa31b5af5ceea651af32bc163911137552c]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (HUDI-1526) Translate the spark api partitionBy to hoodie.datasource.write.partitionpath.field

2021-01-13 Thread teeyog (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

teeyog updated HUDI-1526:
-
Description: 
Currently, if you want to set the partition of hudi, you must configure it with 
the parameter hoodie.datasource.write.partitionpath.field, but the Spark 
DataFrame api partitonBy does not take effect. We can automatically translate 
the parameter of partitionBy into the partition field of hudi.

https://github.com/apache/hudi/pull/2431/commits/fa597aa31b5af5ceea651af32bc163911137552c

  was:Currently, if you want to set the partition of hudi, you must configure 
it with the parameter hoodie.datasource.write.partitionpath.field, but the 
Spark DataFrame api partitonBy does not take effect. We can automatically 
translate the parameter of partitionBy into the partition field of hudi.


> Translate the spark api partitionBy to 
> hoodie.datasource.write.partitionpath.field
> --
>
> Key: HUDI-1526
> URL: https://issues.apache.org/jira/browse/HUDI-1526
> Project: Apache Hudi
>  Issue Type: Improvement
>  Components: Spark Integration
>Reporter: teeyog
>Priority: Major
>
> Currently, if you want to set the partition of hudi, you must configure it 
> with the parameter hoodie.datasource.write.partitionpath.field, but the Spark 
> DataFrame api partitonBy does not take effect. We can automatically translate 
> the parameter of partitionBy into the partition field of hudi.
> https://github.com/apache/hudi/pull/2431/commits/fa597aa31b5af5ceea651af32bc163911137552c



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (HUDI-1526) Translate the spark api partitionBy to hoodie.datasource.write.partitionpath.field

2021-01-13 Thread teeyog (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

teeyog updated HUDI-1526:
-
Description: 
Currently, if you want to set the partition of hudi, you must configure it with 
the parameter hoodie.datasource.write.partitionpath.field, but the Spark 
DataFrame api partitonBy does not take effect. We can automatically translate 
the parameter of partitionBy into the partition field of hudi.

[https://github.com/apache/hudi/pull/2431|https://github.com/apache/hudi/pull/2431/commits/fa597aa31b5af5ceea651af32bc163911137552c]

  was:
Currently, if you want to set the partition of hudi, you must configure it with 
the parameter hoodie.datasource.write.partitionpath.field, but the Spark 
DataFrame api partitonBy does not take effect. We can automatically translate 
the parameter of partitionBy into the partition field of hudi.

https://github.com/apache/hudi/pull/2431/commits/fa597aa31b5af5ceea651af32bc163911137552c


> Translate the spark api partitionBy to 
> hoodie.datasource.write.partitionpath.field
> --
>
> Key: HUDI-1526
> URL: https://issues.apache.org/jira/browse/HUDI-1526
> Project: Apache Hudi
>  Issue Type: Improvement
>  Components: Spark Integration
>Reporter: teeyog
>Priority: Major
>
> Currently, if you want to set the partition of hudi, you must configure it 
> with the parameter hoodie.datasource.write.partitionpath.field, but the Spark 
> DataFrame api partitonBy does not take effect. We can automatically translate 
> the parameter of partitionBy into the partition field of hudi.
> [https://github.com/apache/hudi/pull/2431|https://github.com/apache/hudi/pull/2431/commits/fa597aa31b5af5ceea651af32bc163911137552c]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (HUDI-1526) Translate the spark api partitionBy to hoodie.datasource.write.partitionpath.field

2021-01-13 Thread teeyog (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

teeyog updated HUDI-1526:
-
Summary: Translate the spark api partitionBy to 
hoodie.datasource.write.partitionpath.field  (was: translate the spark api 
partitionBy to hoodie.datasource.write.partitionpath.field)

> Translate the spark api partitionBy to 
> hoodie.datasource.write.partitionpath.field
> --
>
> Key: HUDI-1526
> URL: https://issues.apache.org/jira/browse/HUDI-1526
> Project: Apache Hudi
>  Issue Type: Improvement
>  Components: Spark Integration
>Reporter: teeyog
>Priority: Major
>
> Currently, if you want to set the partition of hudi, you must configure it 
> with the parameter hoodie.datasource.write.partitionpath.field, but the Spark 
> DataFrame api partitonBy does not take effect. We can automatically translate 
> the parameter of partitionBy into the partition field of hudi.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)