[GitHub] spark pull request: [SPARK-4734][Streaming]limit the file Dstream ...
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/3597 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4734][Streaming]limit the file Dstream ...
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/3597#issuecomment-77874151 Mind closing this PR? I do not think this change is right for Spark. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4734][Streaming]limit the file Dstream ...
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/3597#issuecomment-65792502 See my comments in https://issues.apache.org/jira/browse/SPARK-4734 as to why I don't think this is a good idea. In particular, this solution clearly has the potential to lose data and not process files, as well as changing the Spark Streaming semantics. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4734][Streaming]limit the file Dstream ...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3597#issuecomment-65750952 [Test build #24172 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24172/consoleFull) for PR 3597 at commit [`77ab6a6`](https://github.com/apache/spark/commit/77ab6a619444bd4e2d40da21f441b1d918798700). * This patch **passes all tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4734][Streaming]limit the file Dstream ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3597#issuecomment-65750956 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/24172/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org