[jira] [Commented] (SPARK-9865) Flaky SparkR test: test_sparkSQL.R: sample on a DataFrame
[ https://issues.apache.org/jira/browse/SPARK-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995838#comment-14995838 ] Apache Spark commented on SPARK-9865: - User 'felixcheung' has created a pull request for this issue: https://github.com/apache/spark/pull/9549 > Flaky SparkR test: test_sparkSQL.R: sample on a DataFrame > - > > Key: SPARK-9865 > URL: https://issues.apache.org/jira/browse/SPARK-9865 > Project: Spark > Issue Type: Bug > Components: SparkR >Reporter: Davies Liu > > 1. Failure (at test_sparkSQL.R#525): sample on a DataFrame > - > count(sampled3) < 3 isn't true > Error: Test failures > Execution halted > https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1468/console -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-9865) Flaky SparkR test: test_sparkSQL.R: sample on a DataFrame
[ https://issues.apache.org/jira/browse/SPARK-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14969536#comment-14969536 ] Weiqiang Zhuang commented on SPARK-9865: Just FYI, I also got this test failure a couple of time. > Flaky SparkR test: test_sparkSQL.R: sample on a DataFrame > - > > Key: SPARK-9865 > URL: https://issues.apache.org/jira/browse/SPARK-9865 > Project: Spark > Issue Type: Bug > Components: SparkR >Reporter: Davies Liu > > 1. Failure (at test_sparkSQL.R#525): sample on a DataFrame > - > count(sampled3) < 3 isn't true > Error: Test failures > Execution halted > https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1468/console -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-9865) Flaky SparkR test: test_sparkSQL.R: sample on a DataFrame
[ https://issues.apache.org/jira/browse/SPARK-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693814#comment-14693814 ] Shivaram Venkataraman commented on SPARK-9865: -- So we sample 10% in a DataFrame with 3 rows and expect to get less than 3 rows. I guess there is a very small chance that you still get back 3 rows. One fix for this might be to just sample 1% ? [~davies] Do you have any other fix in mind ? Flaky SparkR test: test_sparkSQL.R: sample on a DataFrame - Key: SPARK-9865 URL: https://issues.apache.org/jira/browse/SPARK-9865 Project: Spark Issue Type: Bug Components: SparkR Reporter: Davies Liu 1. Failure (at test_sparkSQL.R#525): sample on a DataFrame - count(sampled3) 3 isn't true Error: Test failures Execution halted https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1468/console -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org