[jira] [Commented] (ARROW-11120) [Python][R] Prove out plumbing to pass data between Python and R using rpy2

2021-01-25 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17271224#comment-17271224 ] Joris Van den Bossche commented on ARROW-11120: --- A few notes to clarify wh

[jira] [Commented] (ARROW-11120) [Python][R] Prove out plumbing to pass data between Python and R using rpy2

2021-01-24 Thread Laurent (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17270998#comment-17270998 ] Laurent commented on ARROW-11120: - For what is worth, calling the pyarrow table's `combi

[jira] [Commented] (ARROW-11120) [Python][R] Prove out plumbing to pass data between Python and R using rpy2

2021-01-24 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17270988#comment-17270988 ] Wes McKinney commented on ARROW-11120: -- We have a C iterator protocol for communica

[jira] [Commented] (ARROW-11120) [Python][R] Prove out plumbing to pass data between Python and R using rpy2

2021-01-24 Thread Laurent (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17270975#comment-17270975 ] Laurent commented on ARROW-11120: - > 2200 chunks sounds really too much for 270K rows. I

[jira] [Commented] (ARROW-11120) [Python][R] Prove out plumbing to pass data between Python and R using rpy2

2021-01-24 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17270946#comment-17270946 ] Antoine Pitrou commented on ARROW-11120: 2200 chunks sounds really too much for

[jira] [Commented] (ARROW-11120) [Python][R] Prove out plumbing to pass data between Python and R using rpy2

2021-01-24 Thread Laurent (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17270940#comment-17270940 ] Laurent commented on ARROW-11120: - I looked briefly into it and the issue might be cause

[jira] [Commented] (ARROW-11120) [Python][R] Prove out plumbing to pass data between Python and R using rpy2

2021-01-24 Thread Laurent (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17270923#comment-17270923 ] Laurent commented on ARROW-11120: - I now have unit tests (coverage 90+%) for that first

[jira] [Commented] (ARROW-11120) [Python][R] Prove out plumbing to pass data between Python and R using rpy2

2021-01-09 Thread Laurent (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261997#comment-17261997 ] Laurent commented on ARROW-11120: - [~npr] I think I understand where I did not understan

[jira] [Commented] (ARROW-11120) [Python][R] Prove out plumbing to pass data between Python and R using rpy2

2021-01-08 Thread Laurent (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261629#comment-17261629 ] Laurent commented on ARROW-11120: - Yes, I know that R6 classes inherit from R environmen

[jira] [Commented] (ARROW-11120) [Python][R] Prove out plumbing to pass data between Python and R using rpy2

2021-01-08 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261619#comment-17261619 ] Neal Richardson commented on ARROW-11120: - In any case, you can get at that func

[jira] [Commented] (ARROW-11120) [Python][R] Prove out plumbing to pass data between Python and R using rpy2

2021-01-08 Thread Laurent (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261613#comment-17261613 ] Laurent commented on ARROW-11120: - Oh, then I did not stress enough that this repos is e

[jira] [Commented] (ARROW-11120) [Python][R] Prove out plumbing to pass data between Python and R using rpy2

2021-01-08 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261604#comment-17261604 ] Neal Richardson commented on ARROW-11120: - All I'm saying is that in your code,

[jira] [Commented] (ARROW-11120) [Python][R] Prove out plumbing to pass data between Python and R using rpy2

2021-01-08 Thread Laurent (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261595#comment-17261595 ] Laurent commented on ARROW-11120: - [~npr] Disclaimer: I am the author of a large part `r

[jira] [Commented] (ARROW-11120) [Python][R] Prove out plumbing to pass data between Python and R using rpy2

2021-01-08 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261399#comment-17261399 ] Neal Richardson commented on ARROW-11120: - I don't think you need rpy2-R6 for th

[jira] [Commented] (ARROW-11120) [Python][R] Prove out plumbing to pass data between Python and R using rpy2

2021-01-07 Thread Laurent (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17260962#comment-17260962 ] Laurent commented on ARROW-11120: - [~apitrou]: I am happy to contribute it back if you t

[jira] [Commented] (ARROW-11120) [Python][R] Prove out plumbing to pass data between Python and R using rpy2

2021-01-07 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17260759#comment-17260759 ] Wes McKinney commented on ARROW-11120: -- It seems like it would be more maintainable

[jira] [Commented] (ARROW-11120) [Python][R] Prove out plumbing to pass data between Python and R using rpy2

2021-01-06 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17259538#comment-17259538 ] Antoine Pitrou commented on ARROW-11120: Hmm... perhaps? But then why do we have

[jira] [Commented] (ARROW-11120) [Python][R] Prove out plumbing to pass data between Python and R using rpy2

2021-01-06 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17259536#comment-17259536 ] Joris Van den Bossche commented on ARROW-11120: --- I assume it is something

[jira] [Commented] (ARROW-11120) [Python][R] Prove out plumbing to pass data between Python and R using rpy2

2021-01-06 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17259533#comment-17259533 ] Antoine Pitrou commented on ARROW-11120: Is this something you plan to contribut

[jira] [Commented] (ARROW-11120) [Python][R] Prove out plumbing to pass data between Python and R using rpy2

2021-01-05 Thread Laurent (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17259365#comment-17259365 ] Laurent commented on ARROW-11120: - Thanks to all. I think that I got it working. I still

[jira] [Commented] (ARROW-11120) [Python][R] Prove out plumbing to pass data between Python and R using rpy2

2021-01-04 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17258268#comment-17258268 ] Antoine Pitrou commented on ARROW-11120: [~lgautier] Yes, this looks correct. Al

[jira] [Commented] (ARROW-11120) [Python][R] Prove out plumbing to pass data between Python and R using rpy2

2021-01-04 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17258261#comment-17258261 ] Joris Van den Bossche commented on ARROW-11120: --- I am not that familiar wi

[jira] [Commented] (ARROW-11120) [Python][R] Prove out plumbing to pass data between Python and R using rpy2

2021-01-04 Thread Laurent (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17258221#comment-17258221 ] Laurent commented on ARROW-11120: - [~jorisvandenbossche] Thanks. I did confuse a few thi

[jira] [Commented] (ARROW-11120) [Python][R] Prove out plumbing to pass data between Python and R using rpy2

2021-01-04 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17258106#comment-17258106 ] Joris Van den Bossche commented on ARROW-11120: --- [~lgautier] Your summary

[jira] [Commented] (ARROW-11120) [Python][R] Prove out plumbing to pass data between Python and R using rpy2

2021-01-03 Thread Laurent (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17257853#comment-17257853 ] Laurent commented on ARROW-11120: - If the Cython-to-cffi bit can be figured out, it coul

[jira] [Commented] (ARROW-11120) [Python][R] Prove out plumbing to pass data between Python and R using rpy2

2021-01-03 Thread Laurent (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17257843#comment-17257843 ] Laurent commented on ARROW-11120: - I looked at it. It seems that all all that is needed