[jira] [Updated] (HUDI-3555) re-use spark config for parquet timestamp format instead of having our own config

2023-10-04 Thread Prashant Wason (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-3555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Prashant Wason updated HUDI-3555:
-
Fix Version/s: 0.14.1
   (was: 0.14.0)

> re-use spark config for parquet timestamp format instead of having our own 
> config
> -
>
> Key: HUDI-3555
> URL: https://issues.apache.org/jira/browse/HUDI-3555
> Project: Apache Hudi
>  Issue Type: Improvement
>  Components: spark
>Reporter: sivabalan narayanan
>Assignee: liujinhui
>Priority: Major
>  Labels: pull-request-available
> Fix For: 0.14.1
>
>
> We have two diff configs to set the right timestamp format. 
> "hoodie.parquet.outputtimestamptype": "TIMESTAMP_MICROS",
> and spark config
> --conf spark.sql.parquet.outputTimestampType=TIMESTAMP_MICROS 
>  
> We should deprecate our own config and just rely on spark's configs. 
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (HUDI-3555) re-use spark config for parquet timestamp format instead of having our own config

2023-02-07 Thread Ethan Guo (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-3555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ethan Guo updated HUDI-3555:

Fix Version/s: 0.14.0
   (was: 0.13.0)

> re-use spark config for parquet timestamp format instead of having our own 
> config
> -
>
> Key: HUDI-3555
> URL: https://issues.apache.org/jira/browse/HUDI-3555
> Project: Apache Hudi
>  Issue Type: Improvement
>  Components: spark
>Reporter: sivabalan narayanan
>Assignee: liujinhui
>Priority: Major
>  Labels: pull-request-available
> Fix For: 0.14.0
>
>
> We have two diff configs to set the right timestamp format. 
> "hoodie.parquet.outputtimestamptype": "TIMESTAMP_MICROS",
> and spark config
> --conf spark.sql.parquet.outputTimestampType=TIMESTAMP_MICROS 
>  
> We should deprecate our own config and just rely on spark's configs. 
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (HUDI-3555) re-use spark config for parquet timestamp format instead of having our own config

2022-08-18 Thread Raymond Xu (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-3555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raymond Xu updated HUDI-3555:
-
Fix Version/s: 0.13.0
   (was: 0.12.1)

> re-use spark config for parquet timestamp format instead of having our own 
> config
> -
>
> Key: HUDI-3555
> URL: https://issues.apache.org/jira/browse/HUDI-3555
> Project: Apache Hudi
>  Issue Type: Improvement
>  Components: spark
>Reporter: sivabalan narayanan
>Assignee: liujinhui
>Priority: Major
>  Labels: pull-request-available
> Fix For: 0.13.0
>
>
> We have two diff configs to set the right timestamp format. 
> "hoodie.parquet.outputtimestamptype": "TIMESTAMP_MICROS",
> and spark config
> --conf spark.sql.parquet.outputTimestampType=TIMESTAMP_MICROS 
>  
> We should deprecate our own config and just rely on spark's configs. 
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (HUDI-3555) re-use spark config for parquet timestamp format instead of having our own config

2022-08-18 Thread sivabalan narayanan (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-3555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

sivabalan narayanan updated HUDI-3555:
--
Fix Version/s: 0.12.1
   (was: 0.13.0)

> re-use spark config for parquet timestamp format instead of having our own 
> config
> -
>
> Key: HUDI-3555
> URL: https://issues.apache.org/jira/browse/HUDI-3555
> Project: Apache Hudi
>  Issue Type: Improvement
>  Components: spark
>Reporter: sivabalan narayanan
>Assignee: liujinhui
>Priority: Major
>  Labels: pull-request-available
> Fix For: 0.12.1
>
>
> We have two diff configs to set the right timestamp format. 
> "hoodie.parquet.outputtimestamptype": "TIMESTAMP_MICROS",
> and spark config
> --conf spark.sql.parquet.outputTimestampType=TIMESTAMP_MICROS 
>  
> We should deprecate our own config and just rely on spark's configs. 
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (HUDI-3555) re-use spark config for parquet timestamp format instead of having our own config

2022-07-29 Thread Sagar Sumit (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-3555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sagar Sumit updated HUDI-3555:
--
Fix Version/s: 0.13.0
   (was: 0.12.0)

> re-use spark config for parquet timestamp format instead of having our own 
> config
> -
>
> Key: HUDI-3555
> URL: https://issues.apache.org/jira/browse/HUDI-3555
> Project: Apache Hudi
>  Issue Type: Improvement
>  Components: spark
>Reporter: sivabalan narayanan
>Assignee: liujinhui
>Priority: Major
>  Labels: pull-request-available
> Fix For: 0.13.0
>
>
> We have two diff configs to set the right timestamp format. 
> "hoodie.parquet.outputtimestamptype": "TIMESTAMP_MICROS",
> and spark config
> --conf spark.sql.parquet.outputTimestampType=TIMESTAMP_MICROS 
>  
> We should deprecate our own config and just rely on spark's configs. 
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (HUDI-3555) re-use spark config for parquet timestamp format instead of having our own config

2022-06-01 Thread Raymond Xu (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-3555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raymond Xu updated HUDI-3555:
-
Sprint: 2022/05/16  (was: 2022/05/16, 2022/05/31)

> re-use spark config for parquet timestamp format instead of having our own 
> config
> -
>
> Key: HUDI-3555
> URL: https://issues.apache.org/jira/browse/HUDI-3555
> Project: Apache Hudi
>  Issue Type: Improvement
>  Components: spark
>Reporter: sivabalan narayanan
>Assignee: liujinhui
>Priority: Major
>  Labels: pull-request-available
> Fix For: 0.12.0
>
>
> We have two diff configs to set the right timestamp format. 
> "hoodie.parquet.outputtimestamptype": "TIMESTAMP_MICROS",
> and spark config
> --conf spark.sql.parquet.outputTimestampType=TIMESTAMP_MICROS 
>  
> We should deprecate our own config and just rely on spark's configs. 
>  



--
This message was sent by Atlassian Jira
(v8.20.7#820007)


[jira] [Updated] (HUDI-3555) re-use spark config for parquet timestamp format instead of having our own config

2022-06-01 Thread Raymond Xu (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-3555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raymond Xu updated HUDI-3555:
-
Sprint: 2022/05/16, 2022/05/17  (was: 2022/05/16)

> re-use spark config for parquet timestamp format instead of having our own 
> config
> -
>
> Key: HUDI-3555
> URL: https://issues.apache.org/jira/browse/HUDI-3555
> Project: Apache Hudi
>  Issue Type: Improvement
>  Components: spark
>Reporter: sivabalan narayanan
>Assignee: liujinhui
>Priority: Major
>  Labels: pull-request-available
> Fix For: 0.12.0
>
>
> We have two diff configs to set the right timestamp format. 
> "hoodie.parquet.outputtimestamptype": "TIMESTAMP_MICROS",
> and spark config
> --conf spark.sql.parquet.outputTimestampType=TIMESTAMP_MICROS 
>  
> We should deprecate our own config and just rely on spark's configs. 
>  



--
This message was sent by Atlassian Jira
(v8.20.7#820007)


[jira] [Updated] (HUDI-3555) re-use spark config for parquet timestamp format instead of having our own config

2022-05-19 Thread liujinhui (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-3555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

liujinhui updated HUDI-3555:

Status: In Progress  (was: Open)

> re-use spark config for parquet timestamp format instead of having our own 
> config
> -
>
> Key: HUDI-3555
> URL: https://issues.apache.org/jira/browse/HUDI-3555
> Project: Apache Hudi
>  Issue Type: Improvement
>  Components: spark
>Reporter: sivabalan narayanan
>Assignee: liujinhui
>Priority: Major
>  Labels: pull-request-available
> Fix For: 0.12.0
>
>
> We have two diff configs to set the right timestamp format. 
> "hoodie.parquet.outputtimestamptype": "TIMESTAMP_MICROS",
> and spark config
> --conf spark.sql.parquet.outputTimestampType=TIMESTAMP_MICROS 
>  
> We should deprecate our own config and just rely on spark's configs. 
>  



--
This message was sent by Atlassian Jira
(v8.20.7#820007)


[jira] [Updated] (HUDI-3555) re-use spark config for parquet timestamp format instead of having our own config

2022-05-17 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-3555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated HUDI-3555:
-
Labels: pull-request-available  (was: )

> re-use spark config for parquet timestamp format instead of having our own 
> config
> -
>
> Key: HUDI-3555
> URL: https://issues.apache.org/jira/browse/HUDI-3555
> Project: Apache Hudi
>  Issue Type: Improvement
>  Components: spark
>Reporter: sivabalan narayanan
>Assignee: liujinhui
>Priority: Major
>  Labels: pull-request-available
> Fix For: 0.12.0
>
>
> We have two diff configs to set the right timestamp format. 
> "hoodie.parquet.outputtimestamptype": "TIMESTAMP_MICROS",
> and spark config
> --conf spark.sql.parquet.outputTimestampType=TIMESTAMP_MICROS 
>  
> We should deprecate our own config and just rely on spark's configs. 
>  



--
This message was sent by Atlassian Jira
(v8.20.7#820007)


[jira] [Updated] (HUDI-3555) re-use spark config for parquet timestamp format instead of having our own config

2022-05-16 Thread Raymond Xu (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-3555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raymond Xu updated HUDI-3555:
-
Fix Version/s: 0.12.0

> re-use spark config for parquet timestamp format instead of having our own 
> config
> -
>
> Key: HUDI-3555
> URL: https://issues.apache.org/jira/browse/HUDI-3555
> Project: Apache Hudi
>  Issue Type: Improvement
>  Components: spark
>Reporter: sivabalan narayanan
>Assignee: Jian Feng
>Priority: Major
> Fix For: 0.12.0
>
>
> We have two diff configs to set the right timestamp format. 
> "hoodie.parquet.outputtimestamptype": "TIMESTAMP_MICROS",
> and spark config
> --conf spark.sql.parquet.outputTimestampType=TIMESTAMP_MICROS 
>  
> We should deprecate our own config and just rely on spark's configs. 
>  



--
This message was sent by Atlassian Jira
(v8.20.7#820007)


[jira] [Updated] (HUDI-3555) re-use spark config for parquet timestamp format instead of having our own config

2022-05-15 Thread Raymond Xu (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-3555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raymond Xu updated HUDI-3555:
-
Sprint: 2022/05/16

> re-use spark config for parquet timestamp format instead of having our own 
> config
> -
>
> Key: HUDI-3555
> URL: https://issues.apache.org/jira/browse/HUDI-3555
> Project: Apache Hudi
>  Issue Type: Improvement
>  Components: spark
>Reporter: sivabalan narayanan
>Priority: Major
>
> We have two diff configs to set the right timestamp format. 
> "hoodie.parquet.outputtimestamptype": "TIMESTAMP_MICROS",
> and spark config
> --conf spark.sql.parquet.outputTimestampType=TIMESTAMP_MICROS 
>  
> We should deprecate our own config and just rely on spark's configs. 
>  



--
This message was sent by Atlassian Jira
(v8.20.7#820007)


[jira] [Updated] (HUDI-3555) re-use spark config for parquet timestamp format instead of having our own config

2022-03-21 Thread Raymond Xu (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-3555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raymond Xu updated HUDI-3555:
-
 Epic Link: HUDI-1239
Issue Type: Improvement  (was: Task)

> re-use spark config for parquet timestamp format instead of having our own 
> config
> -
>
> Key: HUDI-3555
> URL: https://issues.apache.org/jira/browse/HUDI-3555
> Project: Apache Hudi
>  Issue Type: Improvement
>  Components: spark
>Reporter: sivabalan narayanan
>Priority: Major
>
> We have two diff configs to set the right timestamp format. 
> "hoodie.parquet.outputtimestamptype": "TIMESTAMP_MICROS",
> and spark config
> --conf spark.sql.parquet.outputTimestampType=TIMESTAMP_MICROS 
>  
> We should deprecate our own config and just rely on spark's configs. 
>  



--
This message was sent by Atlassian Jira
(v8.20.1#820001)