[jira] [Commented] (SPARK-15689) Data source API v2

2019-10-09 Thread Rafael (Jira)
[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16947794#comment-16947794 ] Rafael commented on SPARK-15689: Could you clarify whether 4 item from the original list

[jira] [Commented] (SPARK-15689) Data source API v2

2018-10-02 Thread Geoff Freeman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16636307#comment-16636307 ] Geoff Freeman commented on SPARK-15689: --- Thanks Wenchen. I was hoping that we migh

[jira] [Commented] (SPARK-15689) Data source API v2

2018-10-01 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16634871#comment-16634871 ] Wenchen Fan commented on SPARK-15689: - So {{SupportsReportPartitioning}} is not powe

[jira] [Commented] (SPARK-15689) Data source API v2

2018-10-01 Thread Geoff Freeman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16634650#comment-16634650 ] Geoff Freeman commented on SPARK-15689: --- I'm having trouble figuring out how to ex

[jira] [Commented] (SPARK-15689) Data source API v2

2018-07-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16549724#comment-16549724 ] Reynold Xin commented on SPARK-15689: - Is there an umbrella ticket on improving the

[jira] [Commented] (SPARK-15689) Data source API v2

2017-11-01 Thread Russell Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16234899#comment-16234899 ] Russell Spitzer commented on SPARK-15689: - I think knowing whether or not the cou

[jira] [Commented] (SPARK-15689) Data source API v2

2017-11-01 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16234892#comment-16234892 ] Wenchen Fan commented on SPARK-15689: - Spark wants to get `unhandledFilters` first so

[jira] [Commented] (SPARK-15689) Data source API v2

2017-11-01 Thread Russell Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16234820#comment-16234820 ] Russell Spitzer commented on SPARK-15689: - It does not, we can tell that a count

[jira] [Commented] (SPARK-15689) Data source API v2

2017-11-01 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16234811#comment-16234811 ] Wenchen Fan commented on SPARK-15689: - how would a count(agg function) exist in filte

[jira] [Commented] (SPARK-15689) Data source API v2

2017-11-01 Thread Russell Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16234640#comment-16234640 ] Russell Spitzer commented on SPARK-15689: - Something I just noticed, it may be he

[jira] [Commented] (SPARK-15689) Data source API v2

2017-10-29 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224224#comment-16224224 ] Wenchen Fan commented on SPARK-15689: - ah missed this one, reopen this ticket. My con

[jira] [Commented] (SPARK-15689) Data source API v2

2017-10-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224122#comment-16224122 ] Reynold Xin commented on SPARK-15689: - Why not put all of them as subtasks here? Als

[jira] [Commented] (SPARK-15689) Data source API v2

2017-10-29 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16223988#comment-16223988 ] Wenchen Fan commented on SPARK-15689: - The basic read/write interfaces are done, I'm

[jira] [Commented] (SPARK-15689) Data source API v2

2017-09-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153834#comment-16153834 ] Apache Spark commented on SPARK-15689: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-15689) Data source API v2

2017-09-05 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153709#comment-16153709 ] Yanbo Liang commented on SPARK-15689: - [~cloud_fan] Great doc! I like the direction t

[jira] [Commented] (SPARK-15689) Data source API v2

2017-08-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16145309#comment-16145309 ] Reynold Xin commented on SPARK-15689: - That seems like an issue orthogonal to the API

[jira] [Commented] (SPARK-15689) Data source API v2

2017-08-29 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16145304#comment-16145304 ] Thomas Graves commented on SPARK-15689: --- I haven't had a chance to look at this, so

[jira] [Commented] (SPARK-15689) Data source API v2

2017-08-23 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139479#comment-16139479 ] Wenchen Fan commented on SPARK-15689: - yea, `LogicalPlan` is an internal concept and

[jira] [Commented] (SPARK-15689) Data source API v2

2017-08-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16138607#comment-16138607 ] Reynold Xin commented on SPARK-15689: - Not the author but my guess is that the other

[jira] [Commented] (SPARK-15689) Data source API v2

2017-08-23 Thread Andrew Ash (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16138509#comment-16138509 ] Andrew Ash commented on SPARK-15689: Can the authors of this document add a section c

[jira] [Commented] (SPARK-15689) Data source API v2

2017-08-23 Thread Liang Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137998#comment-16137998 ] Liang Chen commented on SPARK-15689: Cool! Very look forward to API V2 > Data sourc

[jira] [Commented] (SPARK-15689) Data source API v2

2017-08-23 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137985#comment-16137985 ] Wenchen Fan commented on SPARK-15689: - yea, we plan to. > Data source API v2 > -

[jira] [Commented] (SPARK-15689) Data source API v2

2017-08-22 Thread Liang Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137982#comment-16137982 ] Liang Chen commented on SPARK-15689: Thanks for the doc. all these features will be c

[jira] [Commented] (SPARK-15689) Data source API v2

2017-08-17 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16130863#comment-16130863 ] Wenchen Fan commented on SPARK-15689: - good doc attached! > Data source API v2 > ---

[jira] [Commented] (SPARK-15689) Data source API v2

2017-08-17 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16130494#comment-16130494 ] Dongjoon Hyun commented on SPARK-15689: --- Thank you for the document, too! > Data s

[jira] [Commented] (SPARK-15689) Data source API v2

2017-08-17 Thread Russell Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16130355#comment-16130355 ] Russell Spitzer commented on SPARK-15689: - Thanks [~cloud_fan] for posting the de

[jira] [Commented] (SPARK-15689) Data source API v2

2017-06-16 Thread Russell Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16052321#comment-16052321 ] Russell Spitzer commented on SPARK-15689: - I've been trying to work with making C