[jira] [Commented] (SPARK-26858) Vectorized gapplyCollect, Arrow optimization in native R function execution

[ https://issues.apache.org/jira/browse/SPARK-26858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16790340#comment-16790340 ] Hyukjin Kwon commented on SPARK-26858: -- Here is the initial try I made,

[jira] [Commented] (SPARK-26858) Vectorized gapplyCollect, Arrow optimization in native R function execution

[ https://issues.apache.org/jira/browse/SPARK-26858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16773381#comment-16773381 ] Hyukjin Kwon commented on SPARK-26858: -- Oh, I see. Sorry there was misunderstanding. I think you're

[jira] [Commented] (SPARK-26858) Vectorized gapplyCollect, Arrow optimization in native R function execution

[ https://issues.apache.org/jira/browse/SPARK-26858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16773284#comment-16773284 ] Bryan Cutler commented on SPARK-26858: -- {quote} (One other possibility I was thinking about batches

[jira] [Commented] (SPARK-26858) Vectorized gapplyCollect, Arrow optimization in native R function execution

[ https://issues.apache.org/jira/browse/SPARK-26858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16772578#comment-16772578 ] Hyukjin Kwon commented on SPARK-26858: -- {quote} Back on your sequence diagram at step (9), does R

[jira] [Commented] (SPARK-26858) Vectorized gapplyCollect, Arrow optimization in native R function execution

[ https://issues.apache.org/jira/browse/SPARK-26858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16772570#comment-16772570 ] Hyukjin Kwon commented on SPARK-26858: -- Yes .. that's matched with what I was thinking. Thanks for

[jira] [Commented] (SPARK-26858) Vectorized gapplyCollect, Arrow optimization in native R function execution

[ https://issues.apache.org/jira/browse/SPARK-26858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16772266#comment-16772266 ] Bryan Cutler commented on SPARK-26858: -- [~hyukjin.kwon] actually {{pyarrow.Table.from_batches}}

[jira] [Commented] (SPARK-26858) Vectorized gapplyCollect, Arrow optimization in native R function execution

[ https://issues.apache.org/jira/browse/SPARK-26858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771507#comment-16771507 ] Hyukjin Kwon commented on SPARK-26858: -- {quote} If I understand, this is the case where Spark

[jira] [Commented] (SPARK-26858) Vectorized gapplyCollect, Arrow optimization in native R function execution

[ https://issues.apache.org/jira/browse/SPARK-26858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771494#comment-16771494 ] Felix Cheung commented on SPARK-26858: -- If I understand, this is the case where Spark actually

[jira] [Commented] (SPARK-26858) Vectorized gapplyCollect, Arrow optimization in native R function execution

[ https://issues.apache.org/jira/browse/SPARK-26858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16766946#comment-16766946 ] Hyukjin Kwon commented on SPARK-26858: -- I am going to leave the try I made here soon. My fix is

[jira] [Commented] (SPARK-26858) Vectorized gapplyCollect, Arrow optimization in native R function execution

[ https://issues.apache.org/jira/browse/SPARK-26858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16766943#comment-16766943 ] Hyukjin Kwon commented on SPARK-26858: -- BTW, just for clarification, in case of the way 1., the

[jira] [Commented] (SPARK-26858) Vectorized gapplyCollect, Arrow optimization in native R function execution

[ https://issues.apache.org/jira/browse/SPARK-26858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16766941#comment-16766941 ] Hyukjin Kwon commented on SPARK-26858: -- cc [~felixcheung], [~shivaram], [~r...@databricks.com],