[
https://issues.apache.org/jira/browse/SPARK-19489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16610798#comment-16610798
]
Wes McKinney commented on SPARK-19489:
--
Since there's a native Rust library for Arrow in
[
https://issues.apache.org/jira/browse/SPARK-21375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589288#comment-16589288
]
Wes McKinney commented on SPARK-21375:
--
Seems there might be some requirements that need to be
[
https://issues.apache.org/jira/browse/SPARK-24760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16553315#comment-16553315
]
Wes McKinney commented on SPARK-24760:
--
If data comes to Spark from pandas, any "NaN" values should
[
https://issues.apache.org/jira/browse/SPARK-19552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269357#comment-16269357
]
Wes McKinney commented on SPARK-19552:
--
Is there anyone who might be able to help with upgrading
[
https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16195874#comment-16195874
]
Wes McKinney commented on SPARK-1:
--
Hm, I'm not sure that using a MultiIndex is the right
[
https://issues.apache.org/jira/browse/SPARK-21552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106532#comment-16106532
]
Wes McKinney commented on SPARK-21552:
--
cc @cpcloud -- I linked some associated issues in Arrow
[
https://issues.apache.org/jira/browse/SPARK-21552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106532#comment-16106532
]
Wes McKinney edited comment on SPARK-21552 at 7/30/17 3:40 PM:
---
cc
[
https://issues.apache.org/jira/browse/SPARK-21375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100371#comment-16100371
]
Wes McKinney edited comment on SPARK-21375 at 7/25/17 5:10 PM:
---
What is the
[
https://issues.apache.org/jira/browse/SPARK-21375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100371#comment-16100371
]
Wes McKinney commented on SPARK-21375:
--
What is the summary of how you're handling the time zone
[
https://issues.apache.org/jira/browse/SPARK-20960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16039648#comment-16039648
]
Wes McKinney commented on SPARK-20960:
--
[~cloud_fan] this will be very exciting to have as a
[
https://issues.apache.org/jira/browse/SPARK-18924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009818#comment-16009818
]
Wes McKinney commented on SPARK-18924:
--
[~deanchen] once R bindings for Arrow are in ship shape,
[
https://issues.apache.org/jira/browse/SPARK-18924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009783#comment-16009783
]
Wes McKinney edited comment on SPARK-18924 at 5/14/17 4:00 PM:
---
I can also
[
https://issues.apache.org/jira/browse/SPARK-18924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009783#comment-16009783
]
Wes McKinney commented on SPARK-18924:
--
I can also with this, particularly on the C++ side. I was
[
https://issues.apache.org/jira/browse/SPARK-19489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15858577#comment-15858577
]
Wes McKinney commented on SPARK-19489:
--
I'm really glad to see this is becoming a priority in 2017.
[
https://issues.apache.org/jira/browse/SPARK-10057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15847242#comment-15847242
]
Wes McKinney commented on SPARK-10057:
--
I have been having a really horrible time trying to get
[
https://issues.apache.org/jira/browse/SPARK-13946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15275807#comment-15275807
]
Wes McKinney commented on SPARK-13946:
--
The expression {{F.count(sdf2.foo)}} derives from a
[
https://issues.apache.org/jira/browse/SPARK-13946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15270847#comment-15270847
]
Wes McKinney commented on SPARK-13946:
--
{{import pyspark.sql.functions as F}}
> PySpark DataFrames
[
https://issues.apache.org/jira/browse/SPARK-13943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15211208#comment-15211208
]
Wes McKinney commented on SPARK-13943:
--
As I tried to explain on the mailing list, the general
Wes McKinney created SPARK-13943:
Summary: The behavior of sum(booleantype) in Spark DataFrames is
not intuitive
Key: SPARK-13943
URL: https://issues.apache.org/jira/browse/SPARK-13943
Project: Spark
Wes McKinney created SPARK-13946:
Summary: PySpark DataFrames allows you to silently use aggregate
expressions derived from different table expressions
Key: SPARK-13946
URL:
Wes McKinney created SPARK-13947:
Summary: PySpark DataFrames: The error message from using an
invalid table reference is not clear
Key: SPARK-13947
URL: https://issues.apache.org/jira/browse/SPARK-13947
[
https://issues.apache.org/jira/browse/SPARK-13534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15171273#comment-15171273
]
Wes McKinney commented on SPARK-13534:
--
SPARK-13391 would need to have its scope more narrowly
[
https://issues.apache.org/jira/browse/SPARK-13534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wes McKinney updated SPARK-13534:
-
Description:
The current code path for accessing Spark DataFrame data in Python using
PySpark
Wes McKinney created SPARK-13534:
Summary: Implement Apache Arrow serializer for Spark DataFrame for
use in DataFrame.toPandas
Key: SPARK-13534
URL: https://issues.apache.org/jira/browse/SPARK-13534
[
https://issues.apache.org/jira/browse/SPARK-13391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157309#comment-15157309
]
Wes McKinney commented on SPARK-13391:
--
I published some analysis on this subject:
[
https://issues.apache.org/jira/browse/SPARK-13391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155268#comment-15155268
]
Wes McKinney commented on SPARK-13391:
--
Indeed, one of the major motivations of Arrow (for Python
[
https://issues.apache.org/jira/browse/SPARK-7035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522165#comment-14522165
]
Wes McKinney commented on SPARK-7035:
-
[~rxin] asked me to comment on this issue.
I
[
https://issues.apache.org/jira/browse/SPARK-7035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522188#comment-14522188
]
Wes McKinney commented on SPARK-7035:
-
It's not a bad idea, but I really don't see the
28 matches
Mail list logo
