[GitHub] [hudi] nsivabalan commented on issue #3854: [SUPPORT] Lower performance using 0.9.0 vs 0.8.0
nsivabalan commented on issue #3854: URL: https://github.com/apache/hudi/issues/3854#issuecomment-1246010850 we made a perf fix around fixing the issue you have reported. https://github.com/apache/hudi/pull/5187 this should be available from 0.11. But in general, we also made few critical perf fixes with hudi in 0.12. So, would recommend to upgrade to latest hudi version since it also enables metadata table by default. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] nsivabalan commented on issue #3854: [SUPPORT] Lower performance using 0.9.0 vs 0.8.0
nsivabalan commented on issue #3854: URL: https://github.com/apache/hudi/issues/3854#issuecomment-974870498 Hey hi. Can you give it a try with open source across two versions. @umehrot2 : Can you chime in wrt EMR spark versions. Is there any performance patches expected for hudi 0.9.0 anytime? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] nsivabalan commented on issue #3854: [SUPPORT] Lower performance using 0.9.0 vs 0.8.0
nsivabalan commented on issue #3854: URL: https://github.com/apache/hudi/issues/3854#issuecomment-974870498 Hey hi. Can you give it a try with open source across two versions. @umehrot2 : Can you chime in wrt EMR spark versions. Is there any performance patches expected for hudi 0.9.0 anytime? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] nsivabalan commented on issue #3854: [SUPPORT] Lower performance using 0.9.0 vs 0.8.0
nsivabalan commented on issue #3854: URL: https://github.com/apache/hudi/issues/3854#issuecomment-965678397 yes, bulk insert boost is due to row writer, but not very sure on upsert operations. Are you clarify for hudi and spark versions, is it EMR's version or open source one. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org