Github user tdas commented on the pull request:
https://github.com/apache/spark/pull/2132#issuecomment-54376326
@Leolh Any thoughts on @mateiz and my comments?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your proj
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2132#issuecomment-54694392
Can one of the admins verify this patch?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project d
GitHub user Leolh opened a pull request:
https://github.com/apache/spark/pull/2132
[SPARK-3228][Streaming]
When I use DStream to save files to hdfs, it will create a directory and a
empty file named "_SUCCESS" for each job which made in the batch duration.
But if there are no da
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2132#issuecomment-53385634
Can one of the admins verify this patch?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your pro
Github user mateiz commented on the pull request:
https://github.com/apache/spark/pull/2132#issuecomment-53622923
When would the RDD not have any partitions? It seems that if you use a
reduce, updateStateByKey, or anything like that, we will always have
partitions, so this won't save
Github user tdas commented on the pull request:
https://github.com/apache/spark/pull/2132#issuecomment-53946301
Can you please add a title to the PR. And also, this is a tricky change as
this actually changes the user-perceived behavior of saveAsXXXFile. If someone
has set up a system
Github user tdas commented on the pull request:
https://github.com/apache/spark/pull/2132#issuecomment-62487590
If you are unable to update this patch, then mind closing this patch?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub
Github user Leolh closed the pull request at:
https://github.com/apache/spark/pull/2132
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabl
