[GitHub] [spark] zhengruifeng commented on pull request #41933: [SPARK-44370][CONNECT] Migrate Buf remote generation alpha to remote plugins

2023-07-11 Thread via GitHub
zhengruifeng commented on PR #41933: URL: https://github.com/apache/spark/pull/41933#issuecomment-1630579815 cc @grundprinzip would you mind also taking a look? It seems that we need this PR to enable the python codegen -- This is an automated message from the Apache Git Service. To respo

[GitHub] [spark] zhengruifeng commented on pull request #41933: [SPARK-44370][CONNECT] Migrate Buf remote generation alpha to remote plugins

2023-07-11 Thread via GitHub
zhengruifeng commented on PR #41933: URL: https://github.com/apache/spark/pull/41933#issuecomment-1630402998 if we can not avoid codegen change, then i am fine to upgrade buf to latest -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] zhengruifeng commented on pull request #41933: [SPARK-44370][CONNECT] Migrate Buf remote generation alpha to remote plugins

2023-07-11 Thread via GitHub
zhengruifeng commented on PR #41933: URL: https://github.com/apache/spark/pull/41933#issuecomment-1630365221 > yeah, this failure actually started before we upgrade buf -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

[GitHub] [spark] zhengruifeng commented on pull request #41933: [SPARK-44370][CONNECT] Migrate Buf remote generation alpha to remote plugins

2023-07-11 Thread via GitHub
zhengruifeng commented on PR #41933: URL: https://github.com/apache/spark/pull/41933#issuecomment-1630344412 but i think we have pinned the version of protobuf https://github.com/apache/spark/blob/d7bc6f5c7efd9dcb1e460657447d1a9ea8f03f62/.github/workflows/build_and_test.yml#L637 -- This

[GitHub] [spark] zhengruifeng commented on pull request #41933: [SPARK-44370][CONNECT] Migrate Buf remote generation alpha to remote plugins

2023-07-11 Thread via GitHub
zhengruifeng commented on PR #41933: URL: https://github.com/apache/spark/pull/41933#issuecomment-1630326822 @Hisoka-X now the buf version is `v1.20.0`, would you mind help checking whether this migration still cause codegen changes? -- This is an automated message from the Apache Git Se

[GitHub] [spark] zhengruifeng commented on pull request #41933: [SPARK-44370][CONNECT] Migrate Buf remote generation alpha to remote plugins

2023-07-11 Thread via GitHub
zhengruifeng commented on PR #41933: URL: https://github.com/apache/spark/pull/41933#issuecomment-1630299746 > Can we try revert the version of buf 1.23.1 and only updating the `remote-plugins`? If don't need to change so much code, I think we can revert buf version before code freeze

[GitHub] [spark] zhengruifeng commented on pull request #41933: [SPARK-44370][CONNECT] Migrate Buf remote generation alpha to remote plugins

2023-07-11 Thread via GitHub
zhengruifeng commented on PR #41933: URL: https://github.com/apache/spark/pull/41933#issuecomment-1630290786 @LuciferYang @panbingkun @Hisoka-X @HyukjinKwon do you know what cause this large changes in generated codes? the upgrade to v1.23.1? or this migration? -- This is an autom