Github user harishreedharan commented on the pull request:
https://github.com/apache/spark/pull/807#issuecomment-49704453
Thanks for taking a look Patrick. The reason this really is not going into
Flume itself is that Flume sinks are push model (this sink is hacking around
it). For no
Github user pwendell commented on the pull request:
https://github.com/apache/spark/pull/807#issuecomment-49703872
Hey folks - I just took a light pass on this.
One thing I'm a bit confused about - the sink here is not really specific
to Spark at all (there is no dependency on
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r15200789
--- Diff:
external/flume/src/main/scala/org/apache/spark/streaming/flume/EventTransformer.scala
---
@@ -0,0 +1,72 @@
+/*
+ * Licensed to the Apache Softw
Github user tdas commented on the pull request:
https://github.com/apache/spark/pull/807#issuecomment-49674136
Yeah, and also the hacky script is not seeing the "private[streaming]" in
the line before "class FlumePollingInputDStream". I had added that before I
knew these corner cases
Github user harishreedharan commented on the pull request:
https://github.com/apache/spark/pull/807#issuecomment-49673909
Looks like a missing ASF header in JavaFlumePollingStreamSuite
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitH
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/807#issuecomment-49673605
QA results for PR 807:- This patch FAILED unit tests.- This patch
merges cleanly- This patch adds the following public classes
(experimental):class SparkSink extends Abstr
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/807#issuecomment-49673590
QA tests have started for PR 807. This patch merges cleanly. View
progress:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/16932/consoleFull
---
If y
Github user tdas commented on the pull request:
https://github.com/apache/spark/pull/807#issuecomment-49673187
Jenkins, add to whitelist.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user tdas commented on the pull request:
https://github.com/apache/spark/pull/807#issuecomment-49673163
Jenkins, test this please.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user harishreedharan commented on the pull request:
https://github.com/apache/spark/pull/807#issuecomment-46806458
@tdas - Have you gotten a chance to take a look at this? Thanks!
---
If your project is set up for it, you can reply to this email and have your
reply appear on Gi
Github user harishreedharan commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13900807
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,432 @@
+/*
+ * Licensed to the Apache
Github user harishreedharan commented on the pull request:
https://github.com/apache/spark/pull/807#issuecomment-46398801
@tdas Use the following configuration file to start flume:
agent.sources = seqGenSrc
agent.channels = memoryChannel
agent.sinks = spark
# F
Github user tdas commented on the pull request:
https://github.com/apache/spark/pull/807#issuecomment-46257182
@harishreedharan The SparkSink is looking quite good. Had more minor
comments. I am yet to look at the Spark Streaming receiver side. Let me know
about instructions to run t
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13838902
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,432 @@
+/*
+ * Licensed to the Apache Software Fo
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13838881
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,432 @@
+/*
+ * Licensed to the Apache Software Fo
Github user harishreedharan commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13838603
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,432 @@
+/*
+ * Licensed to the Apache
Github user harishreedharan commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13838567
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,432 @@
+/*
+ * Licensed to the Apache
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13838534
--- Diff:
external/flume/src/main/scala/org/apache/spark/streaming/flume/FlumePollingInputDStream.scala
---
@@ -0,0 +1,189 @@
+/*
+ * Licensed to the Apa
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13838530
--- Diff:
external/flume/src/main/scala/org/apache/spark/streaming/flume/FlumePollingInputDStream.scala
---
@@ -0,0 +1,189 @@
+/*
+ * Licensed to the Apa
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13838518
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,432 @@
+/*
+ * Licensed to the Apache Software Fo
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13838498
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,432 @@
+/*
+ * Licensed to the Apache Software Fo
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13838400
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,432 @@
+/*
+ * Licensed to the Apache Software Fo
Github user harishreedharan commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13838182
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,432 @@
+/*
+ * Licensed to the Apache
Github user harishreedharan commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13838021
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,432 @@
+/*
+ * Licensed to the Apache
Github user harishreedharan commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13835151
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,432 @@
+/*
+ * Licensed to the Apache
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13834803
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,432 @@
+/*
+ * Licensed to the Apache Software Fo
Github user harishreedharan commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13835087
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,432 @@
+/*
+ * Licensed to the Apache
Github user harishreedharan commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13835462
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,432 @@
+/*
+ * Licensed to the Apache
Github user harishreedharan commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13835062
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,432 @@
+/*
+ * Licensed to the Apache
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13835028
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,432 @@
+/*
+ * Licensed to the Apache Software Fo
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13835043
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,432 @@
+/*
+ * Licensed to the Apache Software Fo
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13834950
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,432 @@
+/*
+ * Licensed to the Apache Software Fo
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13834698
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,432 @@
+/*
+ * Licensed to the Apache Software Fo
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13834027
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,432 @@
+/*
+ * Licensed to the Apache Software Fo
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13833989
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,432 @@
+/*
+ * Licensed to the Apache Software Fo
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13833934
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,432 @@
+/*
+ * Licensed to the Apache Software Fo
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13833907
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,432 @@
+/*
+ * Licensed to the Apache Software Fo
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13833797
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,432 @@
+/*
+ * Licensed to the Apache Software Fo
Github user harishreedharan commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13826375
--- Diff:
external/flume/src/main/scala/org/apache/spark/streaming/flume/EventTransformer.scala
---
@@ -0,0 +1,72 @@
+/*
+ * Licensed to the A
Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13825922
--- Diff:
external/flume/src/main/scala/org/apache/spark/streaming/flume/EventTransformer.scala
---
@@ -0,0 +1,72 @@
+/*
+ * Licensed to the Apache S
Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13825936
--- Diff:
external/flume/src/main/scala/org/apache/spark/streaming/flume/EventTransformer.scala
---
@@ -0,0 +1,72 @@
+/*
+ * Licensed to the Apache S
Github user harishreedharan commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13823887
--- Diff:
external/flume/src/main/scala/org/apache/spark/streaming/flume/EventTransformer.scala
---
@@ -0,0 +1,72 @@
+/*
+ * Licensed to the A
Github user harishreedharan commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13823899
--- Diff:
external/flume/src/main/scala/org/apache/spark/streaming/flume/EventTransformer.scala
---
@@ -0,0 +1,72 @@
+/*
+ * Licensed to the A
Github user joyyoj commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13740438
--- Diff:
external/flume/src/main/scala/org/apache/spark/streaming/flume/EventTransformer.scala
---
@@ -0,0 +1,72 @@
+/*
+ * Licensed to the Apache Sof
Github user joyyoj commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13740434
--- Diff:
external/flume/src/main/scala/org/apache/spark/streaming/flume/EventTransformer.scala
---
@@ -0,0 +1,72 @@
+/*
+ * Licensed to the Apache Sof
Github user joyyoj commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13740432
--- Diff:
external/flume/src/main/scala/org/apache/spark/streaming/flume/EventTransformer.scala
---
@@ -0,0 +1,72 @@
+/*
+ * Licensed to the Apache Sof
Github user harishreedharan commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13477267
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache
Github user harishreedharan commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13477246
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13473781
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache Software Fo
Github user harishreedharan commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13473354
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13473226
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache Software Fo
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13473209
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache Software Fo
Github user harishreedharan commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13473153
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13472548
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache Software Fo
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13472527
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache Software Fo
Github user harishreedharan commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13471458
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache
Github user harishreedharan commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13471223
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache
Github user harishreedharan commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13471152
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache
Github user harishreedharan commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13471158
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache
Github user harishreedharan commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13471124
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache
Github user harishreedharan commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13471098
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache
Github user harishreedharan commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13471064
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13467510
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache Software Fo
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13467330
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache Software Fo
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13467223
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache Software Fo
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13466929
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache Software Fo
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13466881
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache Software Fo
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13466605
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache Software Fo
Github user harishreedharan commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13466499
--- Diff:
external/flume/src/main/scala/org/apache/spark/streaming/flume/FlumePollingInputDStream.scala
---
@@ -0,0 +1,165 @@
+/*
+ * Licensed
Github user harishreedharan commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13466394
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13466403
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache Software Fo
Github user harishreedharan commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13466337
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache
Github user harishreedharan commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13466244
--- Diff: external/flume-sink/src/main/avro/sparkflume.avdl ---
@@ -0,0 +1,40 @@
+/**
+ * Licensed to the Apache Software Foundation (ASF) under
Github user harishreedharan commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13466211
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache
Github user harishreedharan commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13466181
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13466097
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache Software Fo
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13466106
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache Software Fo
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13466028
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache Software Fo
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13465816
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache Software Fo
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13465751
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache Software Fo
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13463759
--- Diff: external/flume-sink/src/main/avro/sparkflume.avdl ---
@@ -0,0 +1,40 @@
+/**
+ * Licensed to the Apache Software Foundation (ASF) under one
+
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13463949
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache Software Fo
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13463876
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache Software Fo
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13455872
--- Diff:
external/flume/src/main/scala/org/apache/spark/streaming/flume/FlumePollingInputDStream.scala
---
@@ -0,0 +1,165 @@
+/*
+ * Licensed to the Apa
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13426078
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache Software Fo
Github user harishreedharan commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13426044
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache
Github user harishreedharan commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13426021
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13419975
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache Software Fo
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r13419880
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache Software Fo
Github user harishreedharan commented on the pull request:
https://github.com/apache/spark/pull/807#issuecomment-44081376
The latest commit adds support for polling several flume agents.
---
If your project is set up for it, you can reply to this email and have your
reply appear on Gi
Github user harishreedharan commented on the pull request:
https://github.com/apache/spark/pull/807#issuecomment-44043821
I am going to update this to support polling from multiple Flume agents
rather than just one.
---
If your project is set up for it, you can reply to this email an
Github user harishreedharan commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r12802646
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache
Github user harishreedharan commented on the pull request:
https://github.com/apache/spark/pull/807#issuecomment-43526213
The latest commit should fix the build issue.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If yo
Github user harishreedharan commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r12802607
--- Diff: external/flume-sink/pom.xml ---
@@ -0,0 +1,82 @@
+
--- End diff --
The sink will be deployed to a Flume agent and not within
Github user harishreedharan commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r12802518
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache
Github user harishreedharan commented on the pull request:
https://github.com/apache/spark/pull/807#issuecomment-43524979
Thanks for the comments @srowen!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project do
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r12781257
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache Software
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r12781207
--- Diff:
external/flume-sink/src/main/scala/org/apache/spark/flume/sink/SparkSink.scala
---
@@ -0,0 +1,392 @@
+/*
+ * Licensed to the Apache Software
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/807#discussion_r12781197
--- Diff: external/flume-sink/pom.xml ---
@@ -0,0 +1,82 @@
+
--- End diff --
Pardon for jumping in with comments, but why a new module instead o
Github user harishreedharan commented on the pull request:
https://github.com/apache/spark/pull/807#issuecomment-43470341
Not sure why the build failed with a dependency resolution issue. It seems
to work locally when I do sbt assembly locally. Does the order of modules
specified in t
1 - 100 of 108 matches
Mail list logo
