Re: [PR] [HUDI-6878] Fix Overwrite error when ingest multiple tables [hudi]

2023-10-22 Thread via GitHub
bvaradar merged PR #9749: URL: https://github.com/apache/hudi/pull/9749 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.

Re: [PR] [HUDI-6878] Fix Overwrite error when ingest multiple tables [hudi]

2023-10-20 Thread via GitHub
stream2000 commented on PR #9749: URL: https://github.com/apache/hudi/pull/9749#issuecomment-1772205039 > This new strategy looks better to me. I see that some multiwriter tests are failing in azure. The CI is green now~ -- This is an automated message from the Apache Git Service.

Re: [PR] [HUDI-6878] Fix Overwrite error when ingest multiple tables [hudi]

2023-10-19 Thread via GitHub
hudi-bot commented on PR #9749: URL: https://github.com/apache/hudi/pull/9749#issuecomment-1772163336 ## CI report: * 149dfda8469d598e3098c418ce1e7bf99a4a177f UNKNOWN * 66ea14a95621e003cbf81773c78f0ad2147bbbf6 UNKNOWN * cbaa0122822bfeb4066737429bffefce927d63f9 Azure: [SUCCES

Re: [PR] [HUDI-6878] Fix Overwrite error when ingest multiple tables [hudi]

2023-10-19 Thread via GitHub
hudi-bot commented on PR #9749: URL: https://github.com/apache/hudi/pull/9749#issuecomment-1772023277 ## CI report: * 149dfda8469d598e3098c418ce1e7bf99a4a177f UNKNOWN * 66ea14a95621e003cbf81773c78f0ad2147bbbf6 UNKNOWN * 1597dfa2436c2789e5a5e8dbecfe4f900383c35d Azure: [FAILUR

Re: [PR] [HUDI-6878] Fix Overwrite error when ingest multiple tables [hudi]

2023-10-19 Thread via GitHub
hudi-bot commented on PR #9749: URL: https://github.com/apache/hudi/pull/9749#issuecomment-1771987757 ## CI report: * 149dfda8469d598e3098c418ce1e7bf99a4a177f UNKNOWN * 66ea14a95621e003cbf81773c78f0ad2147bbbf6 UNKNOWN * 1597dfa2436c2789e5a5e8dbecfe4f900383c35d Azure: [FAILUR

Re: [PR] [HUDI-6878] Fix Overwrite error when ingest multiple tables [hudi]

2023-10-18 Thread via GitHub
jonvex commented on PR #9749: URL: https://github.com/apache/hudi/pull/9749#issuecomment-1768638721 This new strategy looks better to me. I see that some multiwriter tests are failing in azure. -- This is an automated message from the Apache Git Service. To respond to the message, please

[PR] [HUDI-6878] Fix Overwrite error when ingest multiple tables [hudi]

2023-10-18 Thread via GitHub
stream2000 opened a new pull request, #9749: URL: https://github.com/apache/hudi/pull/9749 ### Change Logs Fix Overwrite error when ingest multiple tables. HoodieSparkSqlWriter#tableExists may be modified by multiple threads and cause some unexpected behavior. For example, we think t

Re: [PR] [HUDI-6878] Fix Overwrite error when ingest multiple tables [hudi]

2023-10-18 Thread via GitHub
stream2000 closed pull request #9749: [HUDI-6878] Fix Overwrite error when ingest multiple tables URL: https://github.com/apache/hudi/pull/9749 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

Re: [PR] [HUDI-6878] Fix Overwrite error when ingest multiple tables [hudi]

2023-10-17 Thread via GitHub
hudi-bot commented on PR #9749: URL: https://github.com/apache/hudi/pull/9749#issuecomment-1767680714 ## CI report: * 149dfda8469d598e3098c418ce1e7bf99a4a177f UNKNOWN * 66ea14a95621e003cbf81773c78f0ad2147bbbf6 UNKNOWN * 1597dfa2436c2789e5a5e8dbecfe4f900383c35d Azure: [FAILUR

Re: [PR] [HUDI-6878] Fix Overwrite error when ingest multiple tables [hudi]

2023-10-17 Thread via GitHub
hudi-bot commented on PR #9749: URL: https://github.com/apache/hudi/pull/9749#issuecomment-1767619726 ## CI report: * 149dfda8469d598e3098c418ce1e7bf99a4a177f UNKNOWN * 66ea14a95621e003cbf81773c78f0ad2147bbbf6 UNKNOWN * 918ff90b4bc079e5053fcc8a3b3f0d472d30ca1e Azure: [SUCCES

Re: [PR] [HUDI-6878] Fix Overwrite error when ingest multiple tables [hudi]

2023-10-17 Thread via GitHub
hudi-bot commented on PR #9749: URL: https://github.com/apache/hudi/pull/9749#issuecomment-1767581062 ## CI report: * 149dfda8469d598e3098c418ce1e7bf99a4a177f UNKNOWN * 66ea14a95621e003cbf81773c78f0ad2147bbbf6 UNKNOWN * 918ff90b4bc079e5053fcc8a3b3f0d472d30ca1e Azure: [SUCCES

Re: [PR] [HUDI-6878] Fix Overwrite error when ingest multiple tables [hudi]

2023-10-17 Thread via GitHub
stream2000 commented on PR #9749: URL: https://github.com/apache/hudi/pull/9749#issuecomment-1767491739 > could you write a test or provide a some sample code to trigger this issue? I'm a little unclear if this is solving a race condition or something else @jonvex We can trigger the issu

Re: [PR] [HUDI-6878] Fix Overwrite error when ingest multiple tables [hudi]

2023-10-17 Thread via GitHub
hudi-bot commented on PR #9749: URL: https://github.com/apache/hudi/pull/9749#issuecomment-1766356922 ## CI report: * 149dfda8469d598e3098c418ce1e7bf99a4a177f UNKNOWN * 66ea14a95621e003cbf81773c78f0ad2147bbbf6 UNKNOWN * 918ff90b4bc079e5053fcc8a3b3f0d472d30ca1e Azure: [SUCCES

Re: [PR] [HUDI-6878] Fix Overwrite error when ingest multiple tables [hudi]

2023-10-17 Thread via GitHub
hudi-bot commented on PR #9749: URL: https://github.com/apache/hudi/pull/9749#issuecomment-1766072360 ## CI report: * 149dfda8469d598e3098c418ce1e7bf99a4a177f UNKNOWN * 66ea14a95621e003cbf81773c78f0ad2147bbbf6 UNKNOWN * 2770efd23467ecbebe130bbca23508730ba288d2 Azure: [FAILUR

Re: [PR] [HUDI-6878] Fix Overwrite error when ingest multiple tables [hudi]

2023-10-17 Thread via GitHub
hudi-bot commented on PR #9749: URL: https://github.com/apache/hudi/pull/9749#issuecomment-1766056445 ## CI report: * 149dfda8469d598e3098c418ce1e7bf99a4a177f UNKNOWN * 66ea14a95621e003cbf81773c78f0ad2147bbbf6 UNKNOWN * 2770efd23467ecbebe130bbca23508730ba288d2 Azure: [FAILUR

Re: [PR] [HUDI-6878] Fix Overwrite error when ingest multiple tables [hudi]

2023-10-13 Thread via GitHub
hudi-bot commented on PR #9749: URL: https://github.com/apache/hudi/pull/9749#issuecomment-1761462184 ## CI report: * 149dfda8469d598e3098c418ce1e7bf99a4a177f UNKNOWN * 66ea14a95621e003cbf81773c78f0ad2147bbbf6 UNKNOWN * 2770efd23467ecbebe130bbca23508730ba288d2 Azure: [FAILUR

Re: [PR] [HUDI-6878] Fix Overwrite error when ingest multiple tables [hudi]

2023-10-13 Thread via GitHub
hudi-bot commented on PR #9749: URL: https://github.com/apache/hudi/pull/9749#issuecomment-1761300380 ## CI report: * 149dfda8469d598e3098c418ce1e7bf99a4a177f UNKNOWN * 66ea14a95621e003cbf81773c78f0ad2147bbbf6 UNKNOWN * 8a6e3249cf0e6cac04ad06f6dc628ac9714b2b1e Azure: [FAILUR

Re: [PR] [HUDI-6878] Fix Overwrite error when ingest multiple tables [hudi]

2023-10-13 Thread via GitHub
hudi-bot commented on PR #9749: URL: https://github.com/apache/hudi/pull/9749#issuecomment-1761234713 ## CI report: * 149dfda8469d598e3098c418ce1e7bf99a4a177f UNKNOWN * 66ea14a95621e003cbf81773c78f0ad2147bbbf6 UNKNOWN * 8a6e3249cf0e6cac04ad06f6dc628ac9714b2b1e Azure: [FAILUR

Re: [PR] [HUDI-6878] Fix Overwrite error when ingest multiple tables [hudi]

2023-10-13 Thread via GitHub
hudi-bot commented on PR #9749: URL: https://github.com/apache/hudi/pull/9749#issuecomment-1761148016 ## CI report: * 149dfda8469d598e3098c418ce1e7bf99a4a177f UNKNOWN * 66ea14a95621e003cbf81773c78f0ad2147bbbf6 UNKNOWN * 8a6e3249cf0e6cac04ad06f6dc628ac9714b2b1e Azure: [FAILUR

Re: [PR] [HUDI-6878] Fix Overwrite error when ingest multiple tables [hudi]

2023-10-13 Thread via GitHub
hudi-bot commented on PR #9749: URL: https://github.com/apache/hudi/pull/9749#issuecomment-1761057294 ## CI report: * 149dfda8469d598e3098c418ce1e7bf99a4a177f UNKNOWN * 90e03acde4d522b200fbf68d5e2e7330a5eee0ab Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

Re: [PR] [HUDI-6878] Fix Overwrite error when ingest multiple tables [hudi]

2023-10-13 Thread via GitHub
hudi-bot commented on PR #9749: URL: https://github.com/apache/hudi/pull/9749#issuecomment-1761045286 ## CI report: * 149dfda8469d598e3098c418ce1e7bf99a4a177f UNKNOWN * 90e03acde4d522b200fbf68d5e2e7330a5eee0ab Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

Re: [PR] [HUDI-6878] Fix Overwrite error when ingest multiple tables [hudi]

2023-10-12 Thread via GitHub
hudi-bot commented on PR #9749: URL: https://github.com/apache/hudi/pull/9749#issuecomment-1760984617 ## CI report: * 149dfda8469d598e3098c418ce1e7bf99a4a177f UNKNOWN * 90e03acde4d522b200fbf68d5e2e7330a5eee0ab Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

Re: [PR] [HUDI-6878] Fix Overwrite error when ingest multiple tables [hudi]

2023-10-12 Thread via GitHub
jonvex commented on PR #9749: URL: https://github.com/apache/hudi/pull/9749#issuecomment-1759735573 @stream2000 could you write a test or provide a some sample code to trigger this issue? I'm a little unclear if this is solving a race condition or something else -- This is an automated m

Re: [PR] [HUDI-6878] Fix Overwrite error when ingest multiple tables [hudi]

2023-10-10 Thread via GitHub
stream2000 commented on PR #9749: URL: https://github.com/apache/hudi/pull/9749#issuecomment-1754787729 @jonvex hi, could you help review this PR? Thanks~ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t