github-actions[bot] commented on PR #44357:
URL: https://github.com/apache/spark/pull/44357#issuecomment-2062764367
We're closing this PR because it hasn't been updated in a while. This isn't
a judgement on the merit of the PR in any way. It's just a way of keeping the
PR queue manageable.
caicancai closed pull request #44357: [SPARK-46408][SQL] Support date_sub on
V2ExpressionBuilder
URL: https://github.com/apache/spark/pull/44357
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the s
caicancai commented on PR #44357:
URL: https://github.com/apache/spark/pull/44357#issuecomment-1856018097
I will add supplementary tests later, because I made the modification in 3.4
before, and I still have a question why my cli always fails.
--
This is an automated message from the Apac
caicancai commented on PR #44357:
URL: https://github.com/apache/spark/pull/44357#issuecomment-1857434549
cc @beliefer
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To u
caicancai commented on PR #44357:
URL: https://github.com/apache/spark/pull/44357#issuecomment-1859146374
> I think this PR is incomplete. You should select a builtin JDBC dialect
(e.g. H2, Postgres and so on) to push down the expression to JDBC query and add
some test cases.
Hello,
beliefer commented on PR #44357:
URL: https://github.com/apache/spark/pull/44357#issuecomment-1859566710
> Hello, thank you very much for your review. There is no mysql test in
JDBCV2Suite. I can only imitate date_add and create such a test in h2.
No. You can't. H2 doesn't support `da
caicancai commented on PR #44357:
URL: https://github.com/apache/spark/pull/44357#issuecomment-1859617257
> > Hello, thank you very much for your review. There is no mysql test in
JDBCV2Suite. I can only imitate date_add and create such a test in h2.
>
> No. You can't. H2 doesn't supp
beliefer commented on PR #44357:
URL: https://github.com/apache/spark/pull/44357#issuecomment-1860153777
> Thanks for your reply, but v2.MySQLIntegrationSuite does not have related
function tests (such as date_add, datediff, etc.), and may need to modify the
MySQLDialect, you need me to add
caicancai commented on PR #44357:
URL: https://github.com/apache/spark/pull/44357#issuecomment-1862067057
> > Thanks for your reply, but v2.MySQLIntegrationSuite does not have
related function tests (such as date_add, datediff, etc.), and may need to
modify the MySQLDialect, you need me to
beliefer commented on PR #44357:
URL: https://github.com/apache/spark/pull/44357#issuecomment-1864457090
@caicancai `v2.MySQLIntegrationSuite` has own method, please refer
`V2JDBCTest`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
caicancai commented on PR #44357:
URL: https://github.com/apache/spark/pull/44357#issuecomment-1873229188
Sorry, I was quite busy some time ago and didn’t have time to follow up on
this PR.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log
caicancai commented on PR #44357:
URL: https://github.com/apache/spark/pull/44357#issuecomment-1873230108
@beliefer Hello, Happy New Year. I found that neither date_add nor date_sub
is pushed down. My pr only supports the expression date_sub. Do I need to
support the push down to mysql?
-
beliefer commented on code in PR #44357:
URL: https://github.com/apache/spark/pull/44357#discussion_r1439010177
##
connector/docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/v2/MySQLIntegrationSuite.scala:
##
@@ -163,4 +164,29 @@ class MySQLIntegrationSuite exte
beliefer commented on PR #44357:
URL: https://github.com/apache/spark/pull/44357#issuecomment-1873295524
Please check the failure tests.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specif
caicancai commented on PR #44357:
URL: https://github.com/apache/spark/pull/44357#issuecomment-1873296989
> Please check the failure tests.
![2024-01-01
19-59-55屏幕截图](https://github.com/apache/spark/assets/77189278/994d5a12-7aa0-405b-8cd5-4c9c84e443f5)
Thank you for your reply. I d
caicancai commented on PR #44357:
URL: https://github.com/apache/spark/pull/44357#issuecomment-1873341258
I found a bug when trying to push down date_add these date functions
`date_add(date1, 1) = '2022-05-20'` will change `'2022-05-20' to 19132`
before executing build(expr)
![
caicancai commented on code in PR #44357:
URL: https://github.com/apache/spark/pull/44357#discussion_r1439040233
##
connector/docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/v2/MySQLIntegrationSuite.scala:
##
@@ -163,4 +164,29 @@ class MySQLIntegrationSuite ext
caicancai commented on PR #44357:
URL: https://github.com/apache/spark/pull/44357#issuecomment-1873668599
The 3.4 branch can be pushed down and also has the inputToSQL function
above. I am investigating why the master reports an error.
--
This is an automated message from the Apache Git S
caicancai commented on PR #44357:
URL: https://github.com/apache/spark/pull/44357#issuecomment-1873675855
![image](https://github.com/apache/spark/assets/77189278/bf58bdd7-933a-4575-b1cf-f973b5e42ac2)
This code adaptation will be entered in the 3.4 branch. I will check
specifically w
beliefer commented on PR #44357:
URL: https://github.com/apache/spark/pull/44357#issuecomment-1873772219
@caicancai You can retriever the GA tests.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
caicancai commented on PR #44357:
URL: https://github.com/apache/spark/pull/44357#issuecomment-1873773507
> @caicancai You can retrigger the GA tests.
I'm not sure how this works, sorry.
--
This is an automated message from the Apache Git Service.
To respond to the message, please l
beliefer commented on PR #44357:
URL: https://github.com/apache/spark/pull/44357#issuecomment-1873907460
![屏幕快照 2024-01-02 下午7 24
58](https://github.com/apache/spark/assets/8486025/984df303-4dcd-4a9f-a404-a4802af65418)
--
This is an automated message from the Apache Git Service.
beliefer commented on PR #44357:
URL: https://github.com/apache/spark/pull/44357#issuecomment-1873908116
![屏幕快照 2024-01-02 下午7 24
58](https://github.com/apache/spark/assets/8486025/02edf80b-a11e-4227-855f-cbf920178be4)
--
This is an automated message from the Apache Git Service.
To re
beliefer commented on PR #44357:
URL: https://github.com/apache/spark/pull/44357#issuecomment-1873910396
![屏幕快照 2024-01-02 下午7 24
58](https://github.com/apache/spark/assets/8486025/16e75468-7187-4062-95d5-e451ba261016)
--
This is an automated message from the Apache Git Service.
To re
beliefer commented on PR #44357:
URL: https://github.com/apache/spark/pull/44357#issuecomment-1873910933
![屏幕快照 2024-01-02 下午7 26
05](https://github.com/apache/spark/assets/8486025/da58d55a-9992-465f-ade1-334febaa6c33)
--
This is an automated message from the Apache Git Service.
To re
beliefer commented on PR #44357:
URL: https://github.com/apache/spark/pull/44357#issuecomment-187395
![屏幕快照 2024-01-02 下午7 28
10](https://github.com/apache/spark/assets/8486025/ac0f8772-7188-4de5-a493-d7db66b6512e)
--
This is an automated message from the Apache Git Service.
To re
caicancai commented on PR #44357:
URL: https://github.com/apache/spark/pull/44357#issuecomment-1873981248
![2024-01-02
20-42-21屏幕截图](https://github.com/apache/spark/assets/77189278/87dbbfaa-8b47-4cec-b7e8-12ddb3cb83ef)
@beliefer Thank you very much for your patient reply, but cli still se
caicancai commented on PR #44357:
URL: https://github.com/apache/spark/pull/44357#issuecomment-1874078036
>
![image](https://private-user-images.githubusercontent.com/77189278/293640835-bf58bdd7-933a-4575-b1cf-f973b5e42ac2.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29t
caicancai commented on PR #44357:
URL: https://github.com/apache/spark/pull/44357#issuecomment-1874160076
I seem to know why the cli failed because I didn't push
https://github.comapache-spark-ci-image
--
This is an automated message from the Apache Git Service.
To respond to the message,
caicancai commented on PR #44357:
URL: https://github.com/apache/spark/pull/44357#issuecomment-1878057102
@beliefer @dongjoon-hyun Can you please tell me how to pass the cli, thank
you
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
beliefer commented on PR #44357:
URL: https://github.com/apache/spark/pull/44357#issuecomment-1878281644
Please rebase first.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
caicancai commented on PR #44357:
URL: https://github.com/apache/spark/pull/44357#issuecomment-1878349043
> Please rebase first.
done
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the sp
caicancai commented on PR #44357:
URL: https://github.com/apache/spark/pull/44357#issuecomment-1880445464
@beliefer rebase, thank you
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific
beliefer commented on PR #44357:
URL: https://github.com/apache/spark/pull/44357#issuecomment-1880808012
Before you understand how the DS V2 pushdown framework, please refer
https://github.com/apache/spark/commit/7148980dac987518a1d095c52fd9462d5a2cf47b
--
This is an automated message fro
34 matches
Mail list logo