[
https://issues.apache.org/jira/browse/SPARK-34910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17775922#comment-17775922
]
Jason Yarbrough commented on SPARK-34910:
-
Hey guys,
Sorry for commenting on su
[
https://issues.apache.org/jira/browse/SPARK-34910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Yarbrough updated SPARK-34910:
Description:
Currently, the JDBCRelation columnPartition function orders the strides in
a
[
https://issues.apache.org/jira/browse/SPARK-34910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17312702#comment-17312702
]
Jason Yarbrough edited comment on SPARK-34910 at 3/31/21, 11:51 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-34910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17312749#comment-17312749
]
Jason Yarbrough commented on SPARK-34910:
-
It's not that the records/rows themse
[
https://issues.apache.org/jira/browse/SPARK-34910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17312702#comment-17312702
]
Jason Yarbrough commented on SPARK-34910:
-
Hi [~srowen], thanks for asking. The
[
https://issues.apache.org/jira/browse/SPARK-34910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Yarbrough updated SPARK-34910:
Summary: JDBC - Add an option for different stride orders (was: Add an
option for differe
Jason Yarbrough created SPARK-34910:
---
Summary: Add an option for different stride orders
Key: SPARK-34910
URL: https://issues.apache.org/jira/browse/SPARK-34910
Project: Spark
Issue Type: I
[
https://issues.apache.org/jira/browse/SPARK-34843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Yarbrough updated SPARK-34843:
Summary: JDBCRelation columnPartition function improperly determines stride
size. Upper bo
[
https://issues.apache.org/jira/browse/SPARK-34843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17310273#comment-17310273
]
Jason Yarbrough commented on SPARK-34843:
-
[~dongjoon], that makes sense. Thank
[
https://issues.apache.org/jira/browse/SPARK-34843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Yarbrough updated SPARK-34843:
Target Version/s: 3.2.0, 3.1.2, 3.0.3
> JDBCRelation columnPartition function improperly d
[
https://issues.apache.org/jira/browse/SPARK-34843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17308978#comment-17308978
]
Jason Yarbrough commented on SPARK-34843:
-
PR created: [Spark 34843 - JDBCRelati
[
https://issues.apache.org/jira/browse/SPARK-34843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Yarbrough updated SPARK-34843:
Summary: JDBCRelation columnPartition function improperly determines stride
size. Upper bo
[
https://issues.apache.org/jira/browse/SPARK-34843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Yarbrough updated SPARK-34843:
Description:
Currently, in JDBCRelation (line 123), the stride size is calculated as follo
[
https://issues.apache.org/jira/browse/SPARK-34843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17308343#comment-17308343
]
Jason Yarbrough edited comment on SPARK-34843 at 3/25/21, 4:21 AM:
---
[
https://issues.apache.org/jira/browse/SPARK-34843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17308343#comment-17308343
]
Jason Yarbrough commented on SPARK-34843:
-
I've modified the formula slightly (r
[
https://issues.apache.org/jira/browse/SPARK-34843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Yarbrough updated SPARK-34843:
Description:
Currently, in JDBCRelation (line 123), the stride size is calculated as follo
[
https://issues.apache.org/jira/browse/SPARK-34844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17308249#comment-17308249
]
Jason Yarbrough edited comment on SPARK-34844 at 3/25/21, 12:19 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-34844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Yarbrough resolved SPARK-34844.
-
Resolution: Not A Problem
> JDBCRelation columnPartition function includes the first str
[
https://issues.apache.org/jira/browse/SPARK-34844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17308249#comment-17308249
]
Jason Yarbrough commented on SPARK-34844:
-
As I coded up the unit tests and chec
[
https://issues.apache.org/jira/browse/SPARK-34843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Yarbrough updated SPARK-34843:
Description:
Currently, in JDBCRelation (line 123), the stride size is calculated as follo
[
https://issues.apache.org/jira/browse/SPARK-34843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Yarbrough updated SPARK-34843:
Description:
Currently, in JDBCRelation (line 123), the stride size is calculated as follo
[
https://issues.apache.org/jira/browse/SPARK-34843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Yarbrough updated SPARK-34843:
Description:
Currently, in JDBCRelation (line 123), the stride size is calculated as follo
[
https://issues.apache.org/jira/browse/SPARK-34843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17307502#comment-17307502
]
Jason Yarbrough commented on SPARK-34843:
-
I'm definitely interested. Thank you
[
https://issues.apache.org/jira/browse/SPARK-34844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17307500#comment-17307500
]
Jason Yarbrough commented on SPARK-34844:
-
The way I'm currently supplying it is
[
https://issues.apache.org/jira/browse/SPARK-34843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17307494#comment-17307494
]
Jason Yarbrough edited comment on SPARK-34843 at 3/24/21, 1:32 AM:
---
[
https://issues.apache.org/jira/browse/SPARK-34843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Yarbrough updated SPARK-34843:
Attachment: (was: SPARK-34843.patch)
> JDBCRelation columnPartition function improperl
[
https://issues.apache.org/jira/browse/SPARK-34843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Yarbrough updated SPARK-34843:
Attachment: SPARK-34843.patch
> JDBCRelation columnPartition function improperly determine
[
https://issues.apache.org/jira/browse/SPARK-34843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Yarbrough updated SPARK-34843:
Attachment: SPARK-34843.patch
> JDBCRelation columnPartition function improperly determine
[
https://issues.apache.org/jira/browse/SPARK-34843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Yarbrough updated SPARK-34843:
Attachment: (was: SPARK-34843.patch)
> JDBCRelation columnPartition function improperl
[
https://issues.apache.org/jira/browse/SPARK-34843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17307494#comment-17307494
]
Jason Yarbrough commented on SPARK-34843:
-
Updated the formula.
> JDBCRelation
[
https://issues.apache.org/jira/browse/SPARK-34843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Yarbrough updated SPARK-34843:
Description:
Currently, in JDBCRelation (line 123), the stride size is calculated as follo
[
https://issues.apache.org/jira/browse/SPARK-34843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17307493#comment-17307493
]
Jason Yarbrough commented on SPARK-34843:
-
That's a good example! Thank you for
[
https://issues.apache.org/jira/browse/SPARK-34844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17307484#comment-17307484
]
Jason Yarbrough commented on SPARK-34844:
-
It depends on how much data skew you
[
https://issues.apache.org/jira/browse/SPARK-34843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17307477#comment-17307477
]
Jason Yarbrough commented on SPARK-34843:
-
>From what I can see, there is protec
[
https://issues.apache.org/jira/browse/SPARK-34843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Yarbrough updated SPARK-34843:
Attachment: SPARK-34843.patch
> JDBCRelation columnPartition function improperly determine
[
https://issues.apache.org/jira/browse/SPARK-34844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Yarbrough updated SPARK-34844:
Description:
Currently, columnPartition in JDBCRelation contains logic that adds the first
[
https://issues.apache.org/jira/browse/SPARK-34843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Yarbrough updated SPARK-34843:
Description:
Currently, in JDBCRelation (line 123), the stride size is calculated as follo
[
https://issues.apache.org/jira/browse/SPARK-34843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Yarbrough updated SPARK-34843:
Description:
Currently, in JDBCRelation (line 123), the stride size is calculated as follo
[
https://issues.apache.org/jira/browse/SPARK-34843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Yarbrough updated SPARK-34843:
Description:
Currently, in JDBCRelation (line 123), the stride size is calculated as follo
[
https://issues.apache.org/jira/browse/SPARK-34843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Yarbrough updated SPARK-34843:
Description:
Currently, in JDBCRelation (line 123), the stride size is calculated as follo
Jason Yarbrough created SPARK-34844:
---
Summary: JDBCRelation columnPartition function includes the first
stride in the lower partition
Key: SPARK-34844
URL: https://issues.apache.org/jira/browse/SPARK-34844
Jason Yarbrough created SPARK-34843:
---
Summary: JDBCRelation columnPartition function improperly
determines stride size
Key: SPARK-34843
URL: https://issues.apache.org/jira/browse/SPARK-34843
Project
42 matches
Mail list logo
