[jira] [Updated] (HUDI-6937) CopyOnWriteInsertHandler#consume will cause clustering performance degradation

2023-10-12 Thread Danny Chen (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-6937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Danny Chen updated HUDI-6937:
-
Fix Version/s: 1.0.0
   0.14.1

> CopyOnWriteInsertHandler#consume will cause clustering performance degradation
> --
>
> Key: HUDI-6937
> URL: https://issues.apache.org/jira/browse/HUDI-6937
> Project: Apache Hudi
>  Issue Type: Improvement
>  Components: spark
>Reporter: kwang
>Priority: Major
>  Labels: pull-request-available
> Fix For: 1.0.0, 0.14.1
>
> Attachments: hudi-0.12-flamegraph.png, hudi-0.12-log.png, 
> hudi-0.14-flamegraph.png, hudi-0.14-log.png
>
>
> We upgraded Hudi from 0.12 to 0.14, and found that the offline clustering 
> performance dropped by half. We compared and analyzed this two versions of 
> flame graphs, found TypedProperties object instantiation takes too much time. 
> This will cause clustering performance degradation.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (HUDI-6937) CopyOnWriteInsertHandler#consume will cause clustering performance degradation

2023-10-12 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-6937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated HUDI-6937:
-
Labels: pull-request-available  (was: )

> CopyOnWriteInsertHandler#consume will cause clustering performance degradation
> --
>
> Key: HUDI-6937
> URL: https://issues.apache.org/jira/browse/HUDI-6937
> Project: Apache Hudi
>  Issue Type: Improvement
>  Components: spark
>Reporter: kwang
>Priority: Major
>  Labels: pull-request-available
> Attachments: hudi-0.12-flamegraph.png, hudi-0.12-log.png, 
> hudi-0.14-flamegraph.png, hudi-0.14-log.png
>
>
> We upgraded Hudi from 0.12 to 0.14, and found that the offline clustering 
> performance dropped by half. We compared and analyzed this two versions of 
> flame graphs, found TypedProperties object instantiation takes too much time. 
> This will cause clustering performance degradation.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (HUDI-6937) CopyOnWriteInsertHandler#consume will cause clustering performance degradation

2023-10-12 Thread kwang (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-6937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

kwang updated HUDI-6937:

Fix Version/s: (was: 0.14.1)

> CopyOnWriteInsertHandler#consume will cause clustering performance degradation
> --
>
> Key: HUDI-6937
> URL: https://issues.apache.org/jira/browse/HUDI-6937
> Project: Apache Hudi
>  Issue Type: Improvement
>  Components: spark
>Reporter: kwang
>Priority: Major
> Attachments: hudi-0.12-flamegraph.png, hudi-0.12-log.png, 
> hudi-0.14-flamegraph.png, hudi-0.14-log.png
>
>
> We upgraded Hudi from 0.12 to 0.14, and found that the offline clustering 
> performance dropped by half. We compared and analyzed this two versions of 
> flame graphs, found TypedProperties object instantiation takes too much time. 
> This will cause clustering performance degradation.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (HUDI-6937) CopyOnWriteInsertHandler#consume will cause clustering performance degradation

2023-10-12 Thread kwang (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-6937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

kwang updated HUDI-6937:

Description: We upgraded Hudi from 0.12 to 0.14, and found that the offline 
clustering performance dropped by half. We compared and analyzed this two 
versions of flame graphs, found TypedProperties object instantiation takes too 
much time. This will cause clustering 

> CopyOnWriteInsertHandler#consume will cause clustering performance degradation
> --
>
> Key: HUDI-6937
> URL: https://issues.apache.org/jira/browse/HUDI-6937
> Project: Apache Hudi
>  Issue Type: Improvement
>  Components: spark
>Reporter: kwang
>Priority: Major
> Fix For: 0.14.1
>
> Attachments: hudi-0.12-flamegraph.png, hudi-0.12-log.png, 
> hudi-0.14-flamegraph.png, hudi-0.14-log.png
>
>
> We upgraded Hudi from 0.12 to 0.14, and found that the offline clustering 
> performance dropped by half. We compared and analyzed this two versions of 
> flame graphs, found TypedProperties object instantiation takes too much time. 
> This will cause clustering 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (HUDI-6937) CopyOnWriteInsertHandler#consume will cause clustering performance degradation

2023-10-12 Thread kwang (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-6937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

kwang updated HUDI-6937:

Description: We upgraded Hudi from 0.12 to 0.14, and found that the offline 
clustering performance dropped by half. We compared and analyzed this two 
versions of flame graphs, found TypedProperties object instantiation takes too 
much time. This will cause clustering performance degradation.  (was: We 
upgraded Hudi from 0.12 to 0.14, and found that the offline clustering 
performance dropped by half. We compared and analyzed this two versions of 
flame graphs, found TypedProperties object instantiation takes too much time. 
This will cause clustering )

> CopyOnWriteInsertHandler#consume will cause clustering performance degradation
> --
>
> Key: HUDI-6937
> URL: https://issues.apache.org/jira/browse/HUDI-6937
> Project: Apache Hudi
>  Issue Type: Improvement
>  Components: spark
>Reporter: kwang
>Priority: Major
> Fix For: 0.14.1
>
> Attachments: hudi-0.12-flamegraph.png, hudi-0.12-log.png, 
> hudi-0.14-flamegraph.png, hudi-0.14-log.png
>
>
> We upgraded Hudi from 0.12 to 0.14, and found that the offline clustering 
> performance dropped by half. We compared and analyzed this two versions of 
> flame graphs, found TypedProperties object instantiation takes too much time. 
> This will cause clustering performance degradation.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (HUDI-6937) CopyOnWriteInsertHandler#consume will cause clustering performance degradation

2023-10-12 Thread Sagar Sumit (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-6937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sagar Sumit updated HUDI-6937:
--
Fix Version/s: 0.14.1
   (was: 0.14.0)

> CopyOnWriteInsertHandler#consume will cause clustering performance degradation
> --
>
> Key: HUDI-6937
> URL: https://issues.apache.org/jira/browse/HUDI-6937
> Project: Apache Hudi
>  Issue Type: Improvement
>  Components: spark
>Reporter: kwang
>Priority: Major
> Fix For: 0.14.1
>
> Attachments: hudi-0.12-flamegraph.png, hudi-0.12-log.png, 
> hudi-0.14-flamegraph.png, hudi-0.14-log.png
>
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (HUDI-6937) CopyOnWriteInsertHandler#consume will cause clustering performance degradation

2023-10-12 Thread kwang (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-6937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

kwang updated HUDI-6937:

Attachment: hudi-0.12-flamegraph.png
hudi-0.12-log.png
hudi-0.14-flamegraph.png
hudi-0.14-log.png

> CopyOnWriteInsertHandler#consume will cause clustering performance degradation
> --
>
> Key: HUDI-6937
> URL: https://issues.apache.org/jira/browse/HUDI-6937
> Project: Apache Hudi
>  Issue Type: Improvement
>  Components: spark
>Reporter: kwang
>Priority: Major
> Fix For: 0.14.0
>
> Attachments: hudi-0.12-flamegraph.png, hudi-0.12-log.png, 
> hudi-0.14-flamegraph.png, hudi-0.14-log.png
>
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (HUDI-6937) CopyOnWriteInsertHandler#consume will cause clustering performance degradation

2023-10-12 Thread kwang (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-6937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

kwang updated HUDI-6937:

Component/s: spark
 (was: hudi-utilities)

> CopyOnWriteInsertHandler#consume will cause clustering performance degradation
> --
>
> Key: HUDI-6937
> URL: https://issues.apache.org/jira/browse/HUDI-6937
> Project: Apache Hudi
>  Issue Type: Improvement
>  Components: spark
>Reporter: kwang
>Priority: Major
> Fix For: 0.14.0
>
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)