[jira] [Commented] (SPARK-9325) Support `collect` on DataFrame columns

[ https://issues.apache.org/jira/browse/SPARK-9325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15159928#comment-15159928 ] Oscar D. Lara Yejas commented on SPARK-9325: Hi, folks. I have created a PR for this. A

[jira] [Commented] (SPARK-9325) Support `collect` on DataFrame columns

[ https://issues.apache.org/jira/browse/SPARK-9325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15159917#comment-15159917 ] Apache Spark commented on SPARK-9325: - User 'olarayej' has created a pull request for this issue:

[jira] [Commented] (SPARK-9325) Support `collect` on DataFrame columns

[ https://issues.apache.org/jira/browse/SPARK-9325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025611#comment-15025611 ] Hossein Falaki commented on SPARK-9325: --- To help R users and not open up the API, how about adding

[jira] [Commented] (SPARK-9325) Support `collect` on DataFrame columns

[ https://issues.apache.org/jira/browse/SPARK-9325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14970917#comment-14970917 ] Russell Pierce commented on SPARK-9325: --- You're right, Spark had been producing an error because the

[jira] [Commented] (SPARK-9325) Support `collect` on DataFrame columns

[ https://issues.apache.org/jira/browse/SPARK-9325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14945446#comment-14945446 ] Felix Cheung commented on SPARK-9325: - My comment was on collect(df$Age). As I've stated,

[jira] [Commented] (SPARK-9325) Support `collect` on DataFrame columns

[ https://issues.apache.org/jira/browse/SPARK-9325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14942345#comment-14942345 ] Russell Pierce commented on SPARK-9325: --- >From an outside perspective, I'll +1 this. In an earlier

[jira] [Commented] (SPARK-9325) Support `collect` on DataFrame columns

[ https://issues.apache.org/jira/browse/SPARK-9325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14942556#comment-14942556 ] Russell Pierce commented on SPARK-9325: --- I'll try again in 1.5 in a few days and see. I took

[jira] [Commented] (SPARK-9325) Support `collect` on DataFrame columns

[ https://issues.apache.org/jira/browse/SPARK-9325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14942535#comment-14942535 ] Reynold Xin commented on SPARK-9325: But isn't this just collect(select(df, df$col)) ? > Support

[jira] [Commented] (SPARK-9325) Support `collect` on DataFrame columns

[ https://issues.apache.org/jira/browse/SPARK-9325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904913#comment-14904913 ] Narine Kokhlikyan commented on SPARK-9325: -- Hi everyone, how far are are you with this feature.

[jira] [Commented] (SPARK-9325) Support `collect` on DataFrame columns

[ https://issues.apache.org/jira/browse/SPARK-9325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14743759#comment-14743759 ] Shivaram Venkataraman commented on SPARK-9325: -- Thanks [~felixcheung] for investigating into

[jira] [Commented] (SPARK-9325) Support `collect` on DataFrame columns

[ https://issues.apache.org/jira/browse/SPARK-9325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14744170#comment-14744170 ] Reynold Xin commented on SPARK-9325: Do you want to support collect(df$Age + 1) ? > Support

[jira] [Commented] (SPARK-9325) Support `collect` on DataFrame columns

[ https://issues.apache.org/jira/browse/SPARK-9325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14744254#comment-14744254 ] Davies Liu commented on SPARK-9325: --- I would -1 on this. I'm worried that once we have

[jira] [Commented] (SPARK-9325) Support `collect` on DataFrame columns

[ https://issues.apache.org/jira/browse/SPARK-9325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14744167#comment-14744167 ] Shivaram Venkataraman commented on SPARK-9325: -- Just `collect` and maybe `head`. This is just

[jira] [Commented] (SPARK-9325) Support `collect` on DataFrame columns

[ https://issues.apache.org/jira/browse/SPARK-9325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14744175#comment-14744175 ] Shivaram Venkataraman commented on SPARK-9325: -- Hmm not necessarily. If `df$newAge <- df$Age

[jira] [Commented] (SPARK-9325) Support `collect` on DataFrame columns

[ https://issues.apache.org/jira/browse/SPARK-9325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14744136#comment-14744136 ] Reynold Xin commented on SPARK-9325: Are you only going to add collect, or are you going to add

[jira] [Commented] (SPARK-9325) Support `collect` on DataFrame columns

[ https://issues.apache.org/jira/browse/SPARK-9325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742860#comment-14742860 ] Felix Cheung commented on SPARK-9325: - This turns out to be not straightforward. Since Column captures

[jira] [Commented] (SPARK-9325) Support `collect` on DataFrame columns

[ https://issues.apache.org/jira/browse/SPARK-9325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14707120#comment-14707120 ] Shivaram Venkataraman commented on SPARK-9325: -- Yeah that sounds good

[jira] [Commented] (SPARK-9325) Support `collect` on DataFrame columns

[ https://issues.apache.org/jira/browse/SPARK-9325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14707136#comment-14707136 ] Felix Cheung commented on SPARK-9325: - I'll take a shot Support `collect` on

[jira] [Commented] (SPARK-9325) Support `collect` on DataFrame columns

[ https://issues.apache.org/jira/browse/SPARK-9325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14707075#comment-14707075 ] Felix Cheung commented on SPARK-9325: - So we should add collect and head to Column?