[
https://issues.apache.org/jira/browse/SPARK-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17172226#comment-17172226
]
Yu Gan commented on SPARK-12741:
Aha, I came across the similar issue. My sql is
select
[
https://issues.apache.org/jira/browse/SPARK-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15242596#comment-15242596
]
Sean Owen commented on SPARK-12741:
---
master = the latest code on the master branch.
> DataFrame count
[
https://issues.apache.org/jira/browse/SPARK-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15242132#comment-15242132
]
Stephane Maarek commented on SPARK-12741:
-
Hi Sean,
What do you mean by the behavior on master?
[
https://issues.apache.org/jira/browse/SPARK-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240811#comment-15240811
]
Sean Owen commented on SPARK-12741:
---
Yes, and I couldn't reproduce your test case. The question is a)
[
https://issues.apache.org/jira/browse/SPARK-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240808#comment-15240808
]
Sasi commented on SPARK-12741:
--
I test it on Spark 1.5.2 latest version and got the same results.
>
[
https://issues.apache.org/jira/browse/SPARK-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240804#comment-15240804
]
Sean Owen commented on SPARK-12741:
---
I mean it's a little better to write your test case here than link
[
https://issues.apache.org/jira/browse/SPARK-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15238769#comment-15238769
]
Sean Owen commented on SPARK-12741:
---
Please try vs master, and please inline your test case here.
>
[
https://issues.apache.org/jira/browse/SPARK-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15238723#comment-15238723
]
Stephane Maarek commented on SPARK-12741:
-
can we please re-open the issue?
> DataFrame count
[
https://issues.apache.org/jira/browse/SPARK-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15227885#comment-15227885
]
Sasi commented on SPARK-12741:
--
Thanks Stephane, its the same issue.
> DataFrame count method return wrong
[
https://issues.apache.org/jira/browse/SPARK-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15227688#comment-15227688
]
Stephane Maarek commented on SPARK-12741:
-
Hi,
May be related to:
[
https://issues.apache.org/jira/browse/SPARK-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110523#comment-15110523
]
Sasi commented on SPARK-12741:
--
I changed the way I used the DataFrame from my last ticket.
Now, I have
[
https://issues.apache.org/jira/browse/SPARK-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110553#comment-15110553
]
Sasi commented on SPARK-12741:
--
Create new DataFame didn't resolve the issue.
I still think its bug.
[
https://issues.apache.org/jira/browse/SPARK-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110584#comment-15110584
]
Sasi commented on SPARK-12741:
--
I checked my DB which is Aerospike, and I got the same results of my
[
https://issues.apache.org/jira/browse/SPARK-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110563#comment-15110563
]
Sasi commented on SPARK-12741:
--
If I'm running the following code:
{code}
dataFrame.where("...").count()
[
https://issues.apache.org/jira/browse/SPARK-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110572#comment-15110572
]
Sean Owen commented on SPARK-12741:
---
I can't reproduce this. I always get the same count and collect
[
https://issues.apache.org/jira/browse/SPARK-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110503#comment-15110503
]
Sasi commented on SPARK-12741:
--
I updated the report, can you verify it again.
Thanks!
Sasi
> DataFrame
[
https://issues.apache.org/jira/browse/SPARK-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110613#comment-15110613
]
Sasi commented on SPARK-12741:
--
Addtional update:
If I use the following code, then I get the same length
[
https://issues.apache.org/jira/browse/SPARK-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110511#comment-15110511
]
Sean Owen commented on SPARK-12741:
---
I recall from other JIRAs that you're not updating the DataFrame /
[
https://issues.apache.org/jira/browse/SPARK-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110701#comment-15110701
]
Sasi commented on SPARK-12741:
--
That's not what I meant.
I just set an example for each case, SQL way and
[
https://issues.apache.org/jira/browse/SPARK-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110762#comment-15110762
]
Sean Owen commented on SPARK-12741:
---
OK, that's what you wrote at the outset though. Then I can't
[
https://issues.apache.org/jira/browse/SPARK-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110676#comment-15110676
]
Sean Owen commented on SPARK-12741:
---
Wait, is this what you mean? "select count(*) ..." returns 1 row,
21 matches
Mail list logo
