[jira] [Commented] (SPARK-8348) Add in operator to DataFrame Column
[
https://issues.apache.org/jira/browse/SPARK-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593086#comment-14593086
]
Reynold Xin commented on SPARK-8348:
[~yuu.ishik...@gmail.com] can you also add the Python version?
Add in operator to DataFrame Column
---
Key: SPARK-8348
URL: https://issues.apache.org/jira/browse/SPARK-8348
Project: Spark
Issue Type: New Feature
Components: SparkR, SQL
Reporter: Xiangrui Meng
Assignee: Yu Ishikawa
Fix For: 1.5.0
It is convenient to add in operator to column, so we can filter values in a
set.
{code}
df.filter(col(brand).in(dell, sony))
{code}
In R, the operator should be `%in%`.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-8348) Add in operator to DataFrame Column
[
https://issues.apache.org/jira/browse/SPARK-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593109#comment-14593109
]
Yu Ishikawa commented on SPARK-8348:
will do
Add in operator to DataFrame Column
---
Key: SPARK-8348
URL: https://issues.apache.org/jira/browse/SPARK-8348
Project: Spark
Issue Type: New Feature
Components: SparkR, SQL
Reporter: Xiangrui Meng
Assignee: Yu Ishikawa
Fix For: 1.5.0
It is convenient to add in operator to column, so we can filter values in a
set.
{code}
df.filter(col(brand).in(dell, sony))
{code}
In R, the operator should be `%in%`.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-8348) Add in operator to DataFrame Column
[
https://issues.apache.org/jira/browse/SPARK-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14592043#comment-14592043
]
Shivaram Venkataraman commented on SPARK-8348:
--
[~yuu.ishik...@gmail.com] Thanks for posting the gist -- Lets continue this
conversation in the new JIRA SPARK-8431
Add in operator to DataFrame Column
---
Key: SPARK-8348
URL: https://issues.apache.org/jira/browse/SPARK-8348
Project: Spark
Issue Type: New Feature
Components: SparkR, SQL
Reporter: Xiangrui Meng
It is convenient to add in operator to column, so we can filter values in a
set.
{code}
df.filter(col(brand).in(dell, sony))
{code}
In R, the operator should be `%in%`.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-8348) Add in operator to DataFrame Column
[
https://issues.apache.org/jira/browse/SPARK-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14591421#comment-14591421
]
Yu Ishikawa commented on SPARK-8348:
As [~rxin] said, we will add the R stuff later. So I will create another issue
for that soon.
https://github.com/apache/spark/pull/6824#issuecomment-113053359
Add in operator to DataFrame Column
---
Key: SPARK-8348
URL: https://issues.apache.org/jira/browse/SPARK-8348
Project: Spark
Issue Type: New Feature
Components: SparkR, SQL
Reporter: Xiangrui Meng
It is convenient to add in operator to column, so we can filter values in a
set.
{code}
df.filter(col(brand).in(dell, sony))
{code}
In R, the operator should be `%in%`.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-8348) Add in operator to DataFrame Column
[
https://issues.apache.org/jira/browse/SPARK-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590880#comment-14590880
]
Yu Ishikawa commented on SPARK-8348:
Hi [~shivaram], Thank you for letting me know another PR to add operations into
SparkR.
Can I ask you a couple of questions about adding a new operator? Those added
operations doesn't include any method to deal with array or list. I am having
trouble with how I can deal with array or list in arguments to call a Java
method. The gist includes the details of code and error messages. Please check
it.
https://gist.github.com/yu-iskw/ba249f79ef338ff86967
Anyway, {{filter(df, age in (19))}} can work without problems. But How do I
implement {{%in%}} in SparkR?
Add in operator to DataFrame Column
---
Key: SPARK-8348
URL: https://issues.apache.org/jira/browse/SPARK-8348
Project: Spark
Issue Type: New Feature
Components: SparkR, SQL
Reporter: Xiangrui Meng
It is convenient to add in operator to column, so we can filter values in a
set.
{code}
df.filter(col(brand).in(dell, sony))
{code}
In R, the operator should be `%in%`.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-8348) Add in operator to DataFrame Column
[
https://issues.apache.org/jira/browse/SPARK-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14585613#comment-14585613
]
Apache Spark commented on SPARK-8348:
-
User 'yu-iskw' has created a pull request for this issue:
https://github.com/apache/spark/pull/6824
Add in operator to DataFrame Column
---
Key: SPARK-8348
URL: https://issues.apache.org/jira/browse/SPARK-8348
Project: Spark
Issue Type: New Feature
Components: SparkR, SQL
Reporter: Xiangrui Meng
It is convenient to add in operator to column, so we can filter values in a
set.
{code}
df.filter(col(brand).in(dell, sony))
{code}
In R, the operator should be `%in%`.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-8348) Add in operator to DataFrame Column
[
https://issues.apache.org/jira/browse/SPARK-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14584862#comment-14584862
]
Xiangrui Meng commented on SPARK-8348:
--
cc [~falaki]
Add in operator to DataFrame Column
---
Key: SPARK-8348
URL: https://issues.apache.org/jira/browse/SPARK-8348
Project: Spark
Issue Type: New Feature
Components: SQL
Reporter: Xiangrui Meng
It is convenient to add in operator to column, so we can filter values in a
set.
{code}
df.filter(col(brand).in(dell, sony))
{code}
In R, the operator should be `%in%`.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
