Github user zsxwing closed the pull request at:
https://github.com/apache/spark/pull/6588
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is ena
Github user zsxwing commented on the pull request:
https://github.com/apache/spark/pull/6588#issuecomment-173306853
Let me just close it. Maybe visit later.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user srowen commented on the pull request:
https://github.com/apache/spark/pull/6588#issuecomment-173247330
@zsxwing is this stalled now? It doesn't look like this will proceed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitH
Github user tdas commented on the pull request:
https://github.com/apache/spark/pull/6588#issuecomment-152904148
Good point!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabl
Github user gprivitera commented on the pull request:
https://github.com/apache/spark/pull/6588#issuecomment-152747300
@zsxwing : your solution is not going to work on S3, since
`org.apache.hadoop.fs.FileStatus.getModificationTime()` always returns `0L` on
directories in S3.
---
If
Github user gprivitera commented on the pull request:
https://github.com/apache/spark/pull/6588#issuecomment-149517366
@tdas : any update on this PR? Is there anything that should be done yet?
---
If your project is set up for it, you can reply to this email and have your
reply appear
Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/6588#issuecomment-136896153
@tdas @zsxwing any updates on this? Is this targeted for 1.6 now?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitH
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/6588#issuecomment-121072182
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not h
Github user huitseeker commented on a diff in the pull request:
https://github.com/apache/spark/pull/6588#discussion_r34438876
--- Diff:
streaming/src/main/scala/org/apache/spark/streaming/dstream/FileInputDStream.scala
---
@@ -179,10 +187,55 @@ class FileInputDStream[K, V, F <: N
Github user zsxwing commented on the pull request:
https://github.com/apache/spark/pull/6588#issuecomment-118889735
> @zsxwing Do you have any further plan about this PR ? When is it going to
be merged?
>
> Thanks.
@tdas will look at this one soon. I think this one sh
Github user GordonWang commented on the pull request:
https://github.com/apache/spark/pull/6588#issuecomment-117976501
@zsxwing Do you have any further plan about this PR ? When is it going to
be merged?
Thanks.
---
If your project is set up for it, you can reply to this ema
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/6588#issuecomment-117724789
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/6588#issuecomment-117724559
[Test build #36271 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36271/console)
for PR 6588 at commit
[`d7f42c2`](https://github.
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/6588#issuecomment-117708618
[Test build #36271 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36271/consoleFull)
for PR 6588 at commit
[`d7f42c2`](https://gith
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/6588#issuecomment-117708299
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not h
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/6588#issuecomment-117708333
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user wangxiaojing commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-114396317
@andrewor14 ok.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user wangxiaojing closed the pull request at:
https://github.com/apache/spark/pull/2765
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature i
Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-113316861
Hi @wangxiaojing it seems that #6588 is an updated version of this PR.
Would you mind closing this patch since it no longer merges cleanly with master?
---
If your p
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/6588#issuecomment-108009327
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/6588#issuecomment-108009312
[Test build #33990 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33990/consoleFull)
for PR 6588 at commit
[`2d85159`](https://git
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/6588#issuecomment-107978434
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not h
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/6588#issuecomment-107978880
[Test build #33990 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33990/consoleFull)
for PR 6588 at commit
[`2d85159`](https://gith
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/6588#issuecomment-107978473
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
GitHub user zsxwing opened a pull request:
https://github.com/apache/spark/pull/6588
[SPARK-3586][streaming]Support nested directories in Spark Streaming
Closes #2765
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/zsxwing/spark p
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/2765#discussion_r31466854
--- Diff:
streaming/src/main/scala/org/apache/spark/streaming/dstream/FileInputDStream.scala
---
@@ -223,6 +266,11 @@ class FileInputDStream[K, V, F <: NewInput
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/2765#discussion_r31429608
--- Diff:
streaming/src/main/scala/org/apache/spark/streaming/dstream/FileInputDStream.scala
---
@@ -223,6 +266,11 @@ class FileInputDStream[K, V, F <: NewIn
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/2765#discussion_r31428558
--- Diff:
streaming/src/main/scala/org/apache/spark/streaming/dstream/FileInputDStream.scala
---
@@ -183,8 +189,46 @@ class FileInputDStream[K, V, F <: NewIn
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/2765#discussion_r31427177
--- Diff:
streaming/src/main/scala/org/apache/spark/streaming/dstream/FileInputDStream.scala
---
@@ -183,8 +189,46 @@ class FileInputDStream[K, V, F <: NewIn
Github user zsxwing commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-107278995
@wangxiaojing could you update this PR? It conflicts with master
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub a
Github user erfangc commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-107060825
This feature would definitely be helpful. Thanks to @wangxiaojing and
whoever continuing to work on PR!
---
If your project is set up for it, you can reply to this emai
Github user lisendong commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-101661190
@wangxiaojing would you continue work on this PR, I need this feature:-)
---
If your project is set up for it, you can reply to this email and have your
reply appear o
Github user srowen commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-96776750
Do you mind closing this PR? It seems like it is not being worked on.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHu
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-96770167
Can one of the admins verify this patch?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your pro
Github user srowen commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-77388969
I don't think an additional switch helps; a depth parameter is the right
way to specify the depth. I also don't think it's a configuration parameter as
it is specific to t
Github user wangxiaojing commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-77104507
@srowen There is two possible solution,no API change.
1.Adding a switch Whether to monitor files in subdirectories,Defaults
to false will monitor the direct
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/2765#discussion_r25684896
--- Diff:
streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaStreamingContext.scala
---
@@ -293,6 +302,34 @@ class JavaStreamingContext(val ssc:
Github user srowen commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-76939929
This is getting better. I am still concerned about the MiMa excludes. There
should be no API changes, so, there should be no excludes. Those are still in
this PR.
Github user wangxiaojing commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-76891500
@srowen Can we test this again please ?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your proje
Github user wangxiaojing commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-76871502
@srowen This PR does not affect
·org.apache.spark.JavaAPISuite.aggregateByKey·. Please test this again,
thanks.
---
If your project is set up for it, you can re
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-76676922
[Test build #28161 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28161/consoleFull)
for PR 2765 at commit
[`2068255`](https://gith
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-76676933
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-76671073
[Test build #28161 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28161/consoleFull)
for PR 2765 at commit
[`2068255`](https://githu
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-76514804
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-76514803
[Test build #28115 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28115/consoleFull)
for PR 2765 at commit
[`beaed4c`](https://gith
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-76514746
[Test build #28114 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28114/consoleFull)
for PR 2765 at commit
[`348657e`](https://gith
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-76514748
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-76513278
[Test build #28115 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28115/consoleFull)
for PR 2765 at commit
[`beaed4c`](https://githu
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-76512835
[Test build #28114 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28114/consoleFull)
for PR 2765 at commit
[`348657e`](https://githu
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/2765#discussion_r25502824
--- Diff: python/pyspark/streaming/tests.py ---
@@ -446,7 +446,7 @@ def test_queue_stream(self):
def test_text_file_stream(self):
d = temp
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/2765#discussion_r25502765
--- Diff: project/MimaExcludes.scala ---
@@ -83,7 +83,16 @@ object MimaExcludes {
// SPARK-2757
ProblemFilters.exclude[Incompa
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/2765#discussion_r25502811
--- Diff: python/pyspark/streaming/context.py ---
@@ -260,6 +260,12 @@ def textFileStream(self, directory):
"""
return DStream(self._j
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/2765#discussion_r25502732
--- Diff:
streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaStreamingContext.scala
---
@@ -279,13 +289,14 @@ class JavaStreamingContext(val ssc
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/2765#discussion_r25502749
--- Diff:
streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaStreamingContext.scala
---
@@ -309,12 +321,13 @@ class JavaStreamingContext(val ssc
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/2765#discussion_r25502448
--- Diff:
streaming/src/test/scala/org/apache/spark/streaming/InputStreamsSuite.scala ---
@@ -278,11 +294,14 @@ class InputStreamsSuite extends TestSuiteBase w
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/2765#discussion_r25502300
--- Diff:
streaming/src/main/scala/org/apache/spark/streaming/dstream/FileInputDStream.scala
---
@@ -173,8 +180,48 @@ class FileInputDStream[K, V, F <: NewInp
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/2765#discussion_r25502255
--- Diff:
streaming/src/main/scala/org/apache/spark/streaming/dstream/FileInputDStream.scala
---
@@ -173,8 +180,48 @@ class FileInputDStream[K, V, F <: NewInp
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-76376480
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-76376474
[Test build #28062 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28062/consoleFull)
for PR 2765 at commit
[`6620143`](https://gith
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-76363323
[Test build #28062 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28062/consoleFull)
for PR 2765 at commit
[`6620143`](https://githu
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/2765#discussion_r25226058
--- Diff:
streaming/src/test/java/org/apache/spark/streaming/JavaAPISuite.java ---
@@ -1739,7 +1739,11 @@ public Integer call(String s) throws Exception {
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/2765#discussion_r25066204
--- Diff:
streaming/src/test/java/org/apache/spark/streaming/JavaAPISuite.java ---
@@ -1739,7 +1739,11 @@ public Integer call(String s) throws Exception {
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/2765#discussion_r25066177
--- Diff:
streaming/src/main/scala/org/apache/spark/streaming/dstream/FileInputDStream.scala
---
@@ -34,8 +34,10 @@ import org.apache.spark.util.{TimeStampedH
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/2765#discussion_r25066151
--- Diff:
streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaStreamingContext.scala
---
@@ -204,9 +204,10 @@ class JavaStreamingContext(val ssc:
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/2765#discussion_r25066019
--- Diff: docs/streaming-programming-guide.md ---
@@ -659,6 +659,7 @@ methods for creating DStreams from files and Akka
actors as input sources.
+ On
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/2765#discussion_r25066040
--- Diff: python/pyspark/streaming/context.py ---
@@ -242,14 +242,14 @@ def socketTextStream(self, hostname, port,
storageLevel=StorageLevel.MEMORY_AND_
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/2765#discussion_r25065970
--- Diff: docs/streaming-programming-guide.md ---
@@ -641,17 +641,17 @@ methods for creating DStreams from files and Akka
actors as input sources.
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/2765#discussion_r25066028
--- Diff: examples/src/main/python/streaming/hdfs_wordcount.py ---
@@ -39,7 +39,7 @@
sc = SparkContext(appName="PythonStreamingHDFSWordCount")
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/2765#discussion_r25066003
--- Diff: docs/streaming-programming-guide.md ---
@@ -641,17 +641,17 @@ methods for creating DStreams from files and Akka
actors as input sources.
Github user srowen commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-75228839
@wangxiaojing I'd like to revive this PR and get it committed. There have
been a number of requests for this functionality, and several JIRAs and PRs
about it. Would you b
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-72163009
[Test build #26383 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26383/consoleFull)
for PR 2765 at commit
[`dbb6aa0`](https://gith
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-72163013
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-72158225
[Test build #26383 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26383/consoleFull)
for PR 2765 at commit
[`dbb6aa0`](https://githu
Github user wangxiaojing commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-70437483
@tdas
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
ena
Github user wangxiaojing commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-69854635
@tdas
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
ena
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-69693994
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/25
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-69693990
[Test build #25454 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25454/consoleFull)
for PR 2765 at commit
[`dad1748`](https://gith
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-69689987
[Test build #25454 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25454/consoleFull)
for PR 2765 at commit
[`dad1748`](https://githu
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-69563246
[Test build #25411 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25411/consoleFull)
for PR 2765 at commit
[`4c0e261`](https://gith
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-69563254
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/25
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-69556749
[Test build #25411 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25411/consoleFull)
for PR 2765 at commit
[`4c0e261`](https://githu
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-69533545
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/25
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-69533541
[Test build #25398 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25398/consoleFull)
for PR 2765 at commit
[`1764c34`](https://gith
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-69531261
[Test build #25398 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25398/consoleFull)
for PR 2765 at commit
[`1764c34`](https://githu
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-69318962
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/25
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-69318958
[Test build #25316 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25316/consoleFull)
for PR 2765 at commit
[`dc847c0`](https://gith
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/2765#discussion_r22708454
--- Diff:
streaming/src/main/scala/org/apache/spark/streaming/StreamingContext.scala ---
@@ -327,6 +327,7 @@ class StreamingContext private[streaming] (
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/2765#discussion_r22707922
--- Diff:
streaming/src/main/scala/org/apache/spark/streaming/StreamingContext.scala ---
@@ -335,8 +336,8 @@ class StreamingContext private[streaming] (
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/2765#discussion_r22707861
--- Diff:
streaming/src/main/scala/org/apache/spark/streaming/StreamingContext.scala ---
@@ -355,8 +357,13 @@ class StreamingContext private[streaming] (
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-69311867
[Test build #25316 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25316/consoleFull)
for PR 2765 at commit
[`dc847c0`](https://githu
Github user tdas commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-69311769
Jenkins, this is ok to test.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have th
Github user wangxiaojing commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-69288062
@tdas rebase the latest master and update.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your pr
Github user wangxiaojing commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-69169225
@tdas Thanks a lot . I fix them.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does
Github user tdas commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-69073812
@wangxiaojing This PR has merge conflicts. Could you fix them?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well
Github user tdas commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-69071318
Jenkins this is OK to test
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
GitHub user wangxiaojing reopened a pull request:
https://github.com/apache/spark/pull/2765
[SPARK-3586][streaming]Support nested directories in Spark Streaming
For text files, the method streamingContext.textFileStream(dataDirectory).
The improvement of the streaming to Support
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-68998328
Can one of the admins verify this patch?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your pro
Github user wangxiaojing closed the pull request at:
https://github.com/apache/spark/pull/2765
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature i
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-68036643
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/24
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2765#issuecomment-68036640
[Test build #24770 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24770/consoleFull)
for PR 2765 at commit
[`ce86bcc`](https://gith
1 - 100 of 171 matches
Mail list logo
