[GitHub] [hudi] andykrk commented on issue #4604: [SUPPORT] Archive functionality fails

2022-05-05 Thread GitBox
andykrk commented on issue #4604: URL: https://github.com/apache/hudi/issues/4604#issuecomment-1118619225 @nsivabalan We need to park this item temporarily. We may get some additional resources to work on that on our side after this. I will keep you posted on that. -- This is an

[GitHub] [hudi] andykrk commented on issue #4604: [SUPPORT] Archive functionality fails

2022-03-03 Thread GitBox
andykrk commented on issue #4604: URL: https://github.com/apache/hudi/issues/4604#issuecomment-1057984997 Please find the output of desc hudi_table for the table the archive was successful: +--+--+---+ |col_name |data_type

[GitHub] [hudi] andykrk commented on issue #4604: [SUPPORT] Archive functionality fails

2022-03-01 Thread GitBox
andykrk commented on issue #4604: URL: https://github.com/apache/hudi/issues/4604#issuecomment-1055478036 I have done the same with the other table and it was successful. Let me check the details of the successful one. -- This is an automated message from the Apache Git Service. To

[GitHub] [hudi] andykrk commented on issue #4604: [SUPPORT] Archive functionality fails

2022-02-22 Thread GitBox
andykrk commented on issue #4604: URL: https://github.com/apache/hudi/issues/4604#issuecomment-1047896321 I have just checked with hudi 0.9.0 and metadata disabled. Please find the error log attached

[GitHub] [hudi] andykrk commented on issue #4604: [SUPPORT] Archive functionality fails

2022-02-15 Thread GitBox
andykrk commented on issue #4604: URL: https://github.com/apache/hudi/issues/4604#issuecomment-1040046911 @nsivabalan in the meantime we have this table running with 0.9.0 in production as we are starting to use 0.9.0 wherever it's possible but still with very high archival setting (no

[GitHub] [hudi] andykrk commented on issue #4604: [SUPPORT] Archive functionality fails

2022-02-15 Thread GitBox
andykrk commented on issue #4604: URL: https://github.com/apache/hudi/issues/4604#issuecomment-1040046911 @nsivabalan in the meantime we have this table running with 0.9.0 in production as we are starting to use 0.9.0 wherever it's possible but still with very high archival setting (no

[GitHub] [hudi] andykrk commented on issue #4604: [SUPPORT] Archive functionality fails

2022-02-11 Thread GitBox
andykrk commented on issue #4604: URL: https://github.com/apache/hudi/issues/4604#issuecomment-1036096714 Hello, I will try to describe the procedure with more details. It's very close to what you have described though. Please hold on with reproduction attempt and let me try again

[GitHub] [hudi] andykrk commented on issue #4604: [SUPPORT] Archive functionality fails

2022-01-28 Thread GitBox
andykrk commented on issue #4604: URL: https://github.com/apache/hudi/issues/4604#issuecomment-1024091806 @nsivabalan I was able to reproduce the issue on the other table. Let me add some additional information to it that may help. We start with our current table that was created with

[GitHub] [hudi] andykrk commented on issue #4604: [SUPPORT] Archive functionality fails

2022-01-25 Thread GitBox
andykrk commented on issue #4604: URL: https://github.com/apache/hudi/issues/4604#issuecomment-1021132470 @nsivabalan Just additional information. I have the data in the commit that is created prior to the two I have posted here. The thing is that was the one created with our old archival

[GitHub] [hudi] andykrk commented on issue #4604: [SUPPORT] Archive functionality fails

2022-01-25 Thread GitBox
andykrk commented on issue #4604: URL: https://github.com/apache/hudi/issues/4604#issuecomment-1021132470 @nsivabalan Just additional information. I have the data in the commit that is created prior to the two I have posted here. The thing is that was the one created with our old archival

[GitHub] [hudi] andykrk commented on issue #4604: [SUPPORT] Archive functionality fails

2022-01-24 Thread GitBox
andykrk commented on issue #4604: URL: https://github.com/apache/hudi/issues/4604#issuecomment-1020263489 @nsivabalan I just rerun my load with the same data last time (we made it static) and the only commit that was added in a directory today is:

[GitHub] [hudi] andykrk commented on issue #4604: [SUPPORT] Archive functionality fails

2022-01-24 Thread GitBox
andykrk commented on issue #4604: URL: https://github.com/apache/hudi/issues/4604#issuecomment-1019951496 @nsivabalan Yes, the issue was also visible for me with 0.10.0. Thanks for the suggestion we will try to go with it. @XuQianJin-Stars Is there anything else I can provide to

[GitHub] [hudi] andykrk commented on issue #4604: [SUPPORT] Archive functionality fails

2022-01-19 Thread GitBox
andykrk commented on issue #4604: URL: https://github.com/apache/hudi/issues/4604#issuecomment-1016347338 hello @XuQianJin-Stars, please find output of desc command: ``` +--+--+---+ |col_name |data_type |comment|

[GitHub] [hudi] andykrk commented on issue #4604: [SUPPORT] Archive functionality fails

2022-01-18 Thread GitBox
andykrk commented on issue #4604: URL: https://github.com/apache/hudi/issues/4604#issuecomment-1015375826 hi XuQianJin-Stars, please let me know what if there is anything specific that can provide to help with this further -- This is an automated message from the Apache Git Service. To

[GitHub] [hudi] andykrk commented on issue #4604: [SUPPORT] Archive functionality fails

2022-01-17 Thread GitBox
andykrk commented on issue #4604: URL: https://github.com/apache/hudi/issues/4604#issuecomment-1014469030 Please find the content of the .commit file below: { "partitionToWriteStats" : { }, "compacted" : false, "extraMetadata" : { "schema" :