[jira] [Commented] (SPARK-34844) JDBCRelation columnPartition function includes the first stride in the lower partition

2021-03-24 Thread Jason Yarbrough (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17308249#comment-17308249 ] Jason Yarbrough commented on SPARK-34844: - As I coded up the unit tests and checked the effect

[jira] [Commented] (SPARK-34844) JDBCRelation columnPartition function includes the first stride in the lower partition

2021-03-23 Thread Jason Yarbrough (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307500#comment-17307500 ] Jason Yarbrough commented on SPARK-34844: - The way I'm currently supplying it is by using a Map

[jira] [Commented] (SPARK-34844) JDBCRelation columnPartition function includes the first stride in the lower partition

2021-03-23 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307496#comment-17307496 ] Takeshi Yamamuro commented on SPARK-34844: -- > It depends on how much data skew you have. Yea,

[jira] [Commented] (SPARK-34844) JDBCRelation columnPartition function includes the first stride in the lower partition

2021-03-23 Thread Jason Yarbrough (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307484#comment-17307484 ] Jason Yarbrough commented on SPARK-34844: - It depends on how much data skew you have. I think

[jira] [Commented] (SPARK-34844) JDBCRelation columnPartition function includes the first stride in the lower partition

2021-03-23 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307479#comment-17307479 ] Takeshi Yamamuro commented on SPARK-34844: -- The current logic can cause any issue? I feel there