Re: [PR] [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder [spark]

2024-04-17 Thread via GitHub
github-actions[bot] commented on PR #44357: URL: https://github.com/apache/spark/pull/44357#issuecomment-2062764367 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue manageable.

Re: [PR] [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder [spark]

2024-04-17 Thread via GitHub
caicancai closed pull request #44357: [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder URL: https://github.com/apache/spark/pull/44357 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

Re: [PR] [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder [spark]

2023-12-14 Thread via GitHub
caicancai commented on PR #44357: URL: https://github.com/apache/spark/pull/44357#issuecomment-1856018097 I will add supplementary tests later, because I made the modification in 3.4 before, and I still have a question why my cli always fails. -- This is an automated message from the Apac

Re: [PR] [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder [spark]

2023-12-14 Thread via GitHub
caicancai commented on PR #44357: URL: https://github.com/apache/spark/pull/44357#issuecomment-1857434549 cc @beliefer -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

Re: [PR] [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder [spark]

2023-12-17 Thread via GitHub
caicancai commented on PR #44357: URL: https://github.com/apache/spark/pull/44357#issuecomment-1859146374 > I think this PR is incomplete. You should select a builtin JDBC dialect (e.g. H2, Postgres and so on) to push down the expression to JDBC query and add some test cases. Hello,

Re: [PR] [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder [spark]

2023-12-17 Thread via GitHub
beliefer commented on PR #44357: URL: https://github.com/apache/spark/pull/44357#issuecomment-1859566710 > Hello, thank you very much for your review. There is no mysql test in JDBCV2Suite. I can only imitate date_add and create such a test in h2. No. You can't. H2 doesn't support `da

Re: [PR] [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder [spark]

2023-12-17 Thread via GitHub
caicancai commented on PR #44357: URL: https://github.com/apache/spark/pull/44357#issuecomment-1859617257 > > Hello, thank you very much for your review. There is no mysql test in JDBCV2Suite. I can only imitate date_add and create such a test in h2. > > No. You can't. H2 doesn't supp

Re: [PR] [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder [spark]

2023-12-18 Thread via GitHub
beliefer commented on PR #44357: URL: https://github.com/apache/spark/pull/44357#issuecomment-1860153777 > Thanks for your reply, but v2.MySQLIntegrationSuite does not have related function tests (such as date_add, datediff, etc.), and may need to modify the MySQLDialect, you need me to add

Re: [PR] [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder [spark]

2023-12-18 Thread via GitHub
caicancai commented on PR #44357: URL: https://github.com/apache/spark/pull/44357#issuecomment-1862067057 > > Thanks for your reply, but v2.MySQLIntegrationSuite does not have related function tests (such as date_add, datediff, etc.), and may need to modify the MySQLDialect, you need me to

Re: [PR] [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder [spark]

2023-12-20 Thread via GitHub
beliefer commented on PR #44357: URL: https://github.com/apache/spark/pull/44357#issuecomment-1864457090 @caicancai `v2.MySQLIntegrationSuite` has own method, please refer `V2JDBCTest` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder [spark]

2024-01-01 Thread via GitHub
caicancai commented on PR #44357: URL: https://github.com/apache/spark/pull/44357#issuecomment-1873229188 Sorry, I was quite busy some time ago and didn’t have time to follow up on this PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [PR] [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder [spark]

2024-01-01 Thread via GitHub
caicancai commented on PR #44357: URL: https://github.com/apache/spark/pull/44357#issuecomment-1873230108 @beliefer Hello, Happy New Year. I found that neither date_add nor date_sub is pushed down. My pr only supports the expression date_sub. Do I need to support the push down to mysql? -

Re: [PR] [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder [spark]

2024-01-01 Thread via GitHub
beliefer commented on code in PR #44357: URL: https://github.com/apache/spark/pull/44357#discussion_r1439010177 ## connector/docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/v2/MySQLIntegrationSuite.scala: ## @@ -163,4 +164,29 @@ class MySQLIntegrationSuite exte

Re: [PR] [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder [spark]

2024-01-01 Thread via GitHub
beliefer commented on PR #44357: URL: https://github.com/apache/spark/pull/44357#issuecomment-1873295524 Please check the failure tests. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

Re: [PR] [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder [spark]

2024-01-01 Thread via GitHub
caicancai commented on PR #44357: URL: https://github.com/apache/spark/pull/44357#issuecomment-1873296989 > Please check the failure tests. ![2024-01-01 19-59-55屏幕截图](https://github.com/apache/spark/assets/77189278/994d5a12-7aa0-405b-8cd5-4c9c84e443f5) Thank you for your reply. I d

Re: [PR] [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder [spark]

2024-01-01 Thread via GitHub
caicancai commented on PR #44357: URL: https://github.com/apache/spark/pull/44357#issuecomment-1873341258 I found a bug when trying to push down date_add these date functions `date_add(date1, 1) = '2022-05-20'` will change `'2022-05-20' to 19132` before executing build(expr) ![

Re: [PR] [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder [spark]

2024-01-01 Thread via GitHub
caicancai commented on code in PR #44357: URL: https://github.com/apache/spark/pull/44357#discussion_r1439040233 ## connector/docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/v2/MySQLIntegrationSuite.scala: ## @@ -163,4 +164,29 @@ class MySQLIntegrationSuite ext

Re: [PR] [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder [spark]

2024-01-01 Thread via GitHub
caicancai commented on PR #44357: URL: https://github.com/apache/spark/pull/44357#issuecomment-1873668599 The 3.4 branch can be pushed down and also has the inputToSQL function above. I am investigating why the master reports an error. -- This is an automated message from the Apache Git S

Re: [PR] [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder [spark]

2024-01-01 Thread via GitHub
caicancai commented on PR #44357: URL: https://github.com/apache/spark/pull/44357#issuecomment-1873675855 ![image](https://github.com/apache/spark/assets/77189278/bf58bdd7-933a-4575-b1cf-f973b5e42ac2) This code adaptation will be entered in the 3.4 branch. I will check specifically w

Re: [PR] [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder [spark]

2024-01-02 Thread via GitHub
beliefer commented on PR #44357: URL: https://github.com/apache/spark/pull/44357#issuecomment-1873772219 @caicancai You can retriever the GA tests. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder [spark]

2024-01-02 Thread via GitHub
caicancai commented on PR #44357: URL: https://github.com/apache/spark/pull/44357#issuecomment-1873773507 > @caicancai You can retrigger the GA tests. I'm not sure how this works, sorry. -- This is an automated message from the Apache Git Service. To respond to the message, please l

Re: [PR] [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder [spark]

2024-01-02 Thread via GitHub
beliefer commented on PR #44357: URL: https://github.com/apache/spark/pull/44357#issuecomment-1873907460 ![屏幕快照 2024-01-02 下午7 24 58](https://github.com/apache/spark/assets/8486025/984df303-4dcd-4a9f-a404-a4802af65418) -- This is an automated message from the Apache Git Service.

Re: [PR] [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder [spark]

2024-01-02 Thread via GitHub
beliefer commented on PR #44357: URL: https://github.com/apache/spark/pull/44357#issuecomment-1873908116 ![屏幕快照 2024-01-02 下午7 24 58](https://github.com/apache/spark/assets/8486025/02edf80b-a11e-4227-855f-cbf920178be4) -- This is an automated message from the Apache Git Service. To re

Re: [PR] [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder [spark]

2024-01-02 Thread via GitHub
beliefer commented on PR #44357: URL: https://github.com/apache/spark/pull/44357#issuecomment-1873910396 ![屏幕快照 2024-01-02 下午7 24 58](https://github.com/apache/spark/assets/8486025/16e75468-7187-4062-95d5-e451ba261016) -- This is an automated message from the Apache Git Service. To re

Re: [PR] [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder [spark]

2024-01-02 Thread via GitHub
beliefer commented on PR #44357: URL: https://github.com/apache/spark/pull/44357#issuecomment-1873910933 ![屏幕快照 2024-01-02 下午7 26 05](https://github.com/apache/spark/assets/8486025/da58d55a-9992-465f-ade1-334febaa6c33) -- This is an automated message from the Apache Git Service. To re

Re: [PR] [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder [spark]

2024-01-02 Thread via GitHub
beliefer commented on PR #44357: URL: https://github.com/apache/spark/pull/44357#issuecomment-187395 ![屏幕快照 2024-01-02 下午7 28 10](https://github.com/apache/spark/assets/8486025/ac0f8772-7188-4de5-a493-d7db66b6512e) -- This is an automated message from the Apache Git Service. To re

Re: [PR] [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder [spark]

2024-01-02 Thread via GitHub
caicancai commented on PR #44357: URL: https://github.com/apache/spark/pull/44357#issuecomment-1873981248 ![2024-01-02 20-42-21屏幕截图](https://github.com/apache/spark/assets/77189278/87dbbfaa-8b47-4cec-b7e8-12ddb3cb83ef) @beliefer Thank you very much for your patient reply, but cli still se

Re: [PR] [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder [spark]

2024-01-02 Thread via GitHub
caicancai commented on PR #44357: URL: https://github.com/apache/spark/pull/44357#issuecomment-1874078036 > ![image](https://private-user-images.githubusercontent.com/77189278/293640835-bf58bdd7-933a-4575-b1cf-f973b5e42ac2.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29t

Re: [PR] [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder [spark]

2024-01-02 Thread via GitHub
caicancai commented on PR #44357: URL: https://github.com/apache/spark/pull/44357#issuecomment-1874160076 I seem to know why the cli failed because I didn't push https://github.comapache-spark-ci-image -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [PR] [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder [spark]

2024-01-04 Thread via GitHub
caicancai commented on PR #44357: URL: https://github.com/apache/spark/pull/44357#issuecomment-1878057102 @beliefer @dongjoon-hyun Can you please tell me how to pass the cli, thank you -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder [spark]

2024-01-05 Thread via GitHub
beliefer commented on PR #44357: URL: https://github.com/apache/spark/pull/44357#issuecomment-1878281644 Please rebase first. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder [spark]

2024-01-05 Thread via GitHub
caicancai commented on PR #44357: URL: https://github.com/apache/spark/pull/44357#issuecomment-1878349043 > Please rebase first. done -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

Re: [PR] [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder [spark]

2024-01-07 Thread via GitHub
caicancai commented on PR #44357: URL: https://github.com/apache/spark/pull/44357#issuecomment-1880445464 @beliefer rebase, thank you -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder [spark]

2024-01-08 Thread via GitHub
beliefer commented on PR #44357: URL: https://github.com/apache/spark/pull/44357#issuecomment-1880808012 Before you understand how the DS V2 pushdown framework, please refer https://github.com/apache/spark/commit/7148980dac987518a1d095c52fd9462d5a2cf47b -- This is an automated message fro