[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15337728#comment-15337728
]
Sean Owen commented on SPARK-6817:
--
No, the best thing is just bulk-changing the issues t
[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15337525#comment-15337525
]
Shivaram Venkataraman commented on SPARK-6817:
--
I think all the ones we need
[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15264954#comment-15264954
]
Shivaram Venkataraman commented on SPARK-6817:
--
I just merged https://issues.
[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15264836#comment-15264836
]
Michael Armbrust commented on SPARK-6817:
-
[~shivaram] Sill trying to get any of t
[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15110359#comment-15110359
]
Sun Rui commented on SPARK-6817:
for dapply(), user can call repartition() to set an appro
[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15110299#comment-15110299
]
Felix Cheung commented on SPARK-6817:
-
Thanks for putting together on the doc [~sunrui
[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15108098#comment-15108098
]
Sun Rui commented on SPARK-6817:
I wrote an implementation document at
https://docs.googl
[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15108097#comment-15108097
]
Sun Rui commented on SPARK-6817:
Moved SQL UDF related stuff to SPARK-12918.
> DataFrame
[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15101805#comment-15101805
]
Sun Rui commented on SPARK-6817:
Spark is now supporting vectorized execution via Columnar
[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097723#comment-15097723
]
Sun Rui commented on SPARK-6817:
OK. I will follow the design of the original design doc,
[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097712#comment-15097712
]
Antonio Piccolboni commented on SPARK-6817:
---
Thanks!
> DataFrame UDFs in R
> --
[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097560#comment-15097560
]
Sun Rui commented on SPARK-6817:
https://github.com/apache/spark/blob/master/sql/core/src/
[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097552#comment-15097552
]
Antonio Piccolboni commented on SPARK-6817:
---
I need to see the code to understan
[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097458#comment-15097458
]
Sun Rui commented on SPARK-6817:
projecting batching rows for UDF are implmentation optimi
[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15096738#comment-15096738
]
Antonio Piccolboni commented on SPARK-6817:
---
So I am not sure row-orientation me
[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095868#comment-15095868
]
Sun Rui commented on SPARK-6817:
If we think that column-oriented UDF is more important, I
[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095860#comment-15095860
]
Sun Rui commented on SPARK-6817:
I agree R's efficiency comes from vectorization. Here UDF
[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095776#comment-15095776
]
Antonio Piccolboni commented on SPARK-6817:
---
My question made sense only wrt the
[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095756#comment-15095756
]
Weiqiang Zhuang commented on SPARK-6817:
We did see both apply use cases. But the
[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095747#comment-15095747
]
Reynold Xin commented on SPARK-6817:
Please take a look at the original design doc for
[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095745#comment-15095745
]
Sun Rui commented on SPARK-6817:
[~rxin] Row-oriented R UDF is for SQL and is similar to P
[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095734#comment-15095734
]
Jeff Zhang commented on SPARK-6817:
---
+1 on block based API, UDF would usually call other
[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095721#comment-15095721
]
Reynold Xin commented on SPARK-6817:
[~sunrui]
Why are you focusing on a row-based AP
[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095600#comment-15095600
]
Sun Rui commented on SPARK-6817:
[~shivaram] I first focus on the row-based UDF functional
[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095594#comment-15095594
]
Sun Rui commented on SPARK-6817:
[~piccolbo] I am not sure If I understand your meaning. T
[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095590#comment-15095590
]
Sun Rui commented on SPARK-6817:
[~mpollock], this PR will support row-based UDF. UDF oper
[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095588#comment-15095588
]
Sun Rui commented on SPARK-6817:
Attached the first draft design doc, please review and gi
[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15064664#comment-15064664
]
Matt Pollock commented on SPARK-6817:
-
Will this only support UDFs that operate on a f
[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15061420#comment-15061420
]
Antonio Piccolboni commented on SPARK-6817:
---
Will this form of partition-UDF ava
[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059658#comment-15059658
]
Sun Rui commented on SPARK-6817:
Start working on it
> DataFrame UDFs in R
>
[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14987101#comment-14987101
]
Michael Armbrust commented on SPARK-6817:
-
Should we bump this now that we are pas
[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720845#comment-14720845
]
Shivaram Venkataraman commented on SPARK-6817:
--
The idea behind having `dappl
[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14717079#comment-14717079
]
Indrajit commented on SPARK-6817:
--
Here are some suggestions on the proposed API. If the
[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14711972#comment-14711972
]
Shivaram Venkataraman commented on SPARK-6817:
--
I've created a design doc for
[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593823#comment-14593823
]
Aleksander Eskilson commented on SPARK-6817:
Makes sense, thanks for the clari
[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592087#comment-14592087
]
Shivaram Venkataraman commented on SPARK-6817:
--
I think there are two separat
[
https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14591984#comment-14591984
]
Aleksander Eskilson commented on SPARK-6817:
It looks like this issue also rel
37 matches
Mail list logo
