[
https://issues.apache.org/jira/browse/SPARK-12775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15096550#comment-15096550
]
Cody Koeninger commented on SPARK-12775:
Couldn't find leader offsets ... because
[
https://issues.apache.org/jira/browse/SPARK-12693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089306#comment-15089306
]
Cody Koeninger commented on SPARK-12693:
If an executor is given a range of kakfa
[
https://issues.apache.org/jira/browse/SPARK-12693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15088725#comment-15088725
]
Cody Koeninger commented on SPARK-12693:
What is your actual use case for changin
[
https://issues.apache.org/jira/browse/SPARK-10963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15076536#comment-15076536
]
Cody Koeninger commented on SPARK-10963:
There's a nonzero chance that the 0.9 in
[
https://issues.apache.org/jira/browse/SPARK-12524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15071884#comment-15071884
]
Cody Koeninger commented on SPARK-12524:
mapPartitions is just giving you an iter
[
https://issues.apache.org/jira/browse/SPARK-12524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15071872#comment-15071872
]
Cody Koeninger commented on SPARK-12524:
Why can't you just use mapPartitions?
>
[
https://issues.apache.org/jira/browse/SPARK-11045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15069101#comment-15069101
]
Cody Koeninger commented on SPARK-11045:
Direct stream isn't doing any caching un
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062313#comment-15062313
]
Cody Koeninger commented on SPARK-12177:
Honestly SSL / auth is the only compelli
[
https://issues.apache.org/jira/browse/SPARK-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048938#comment-15048938
]
Cody Koeninger commented on SPARK-9059:
---
To be clear, I think SPARK-8389 should make
[
https://issues.apache.org/jira/browse/SPARK-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048904#comment-15048904
]
Cody Koeninger edited comment on SPARK-9059 at 12/9/15 4:19 PM:
[
https://issues.apache.org/jira/browse/SPARK-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048904#comment-15048904
]
Cody Koeninger commented on SPARK-9059:
---
HasOffsetRanges is explained here
http://s
[
https://issues.apache.org/jira/browse/SPARK-6051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048895#comment-15048895
]
Cody Koeninger commented on SPARK-6051:
---
Responded on the mailing list, but for post
[
https://issues.apache.org/jira/browse/SPARK-12203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048879#comment-15048879
]
Cody Koeninger commented on SPARK-12203:
Commented on the PR. I don't think this
[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046975#comment-15046975
]
Cody Koeninger commented on SPARK-12177:
I really think this needs to be handled
[
https://issues.apache.org/jira/browse/SPARK-12103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger reopened SPARK-12103:
PR for doc change:
https://github.com/apache/spark/pull/10132
> KafkaUtils createStream with
[
https://issues.apache.org/jira/browse/SPARK-12103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038084#comment-15038084
]
Cody Koeninger commented on SPARK-12103:
On the off chance you're acting in good
[
https://issues.apache.org/jira/browse/SPARK-12103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15037986#comment-15037986
]
Cody Koeninger commented on SPARK-12103:
Knowing that kafka messages have a key a
[
https://issues.apache.org/jira/browse/SPARK-12103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15037773#comment-15037773
]
Cody Koeninger commented on SPARK-12103:
A cursory review of the Kafka project do
[
https://issues.apache.org/jira/browse/SPARK-12002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029058#comment-15029058
]
Cody Koeninger commented on SPARK-12002:
Just to be clear, this is a only an issu
[
https://issues.apache.org/jira/browse/SPARK-11693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004072#comment-15004072
]
Cody Koeninger commented on SPARK-11693:
You've under-provisioned Kafka storage a
[
https://issues.apache.org/jira/browse/SPARK-10320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004052#comment-15004052
]
Cody Koeninger commented on SPARK-10320:
This is for practical purposes blocked o
[
https://issues.apache.org/jira/browse/SPARK-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004050#comment-15004050
]
Cody Koeninger commented on SPARK-11698:
That looks like a reasonable way to solv
[
https://issues.apache.org/jira/browse/SPARK-11211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14971834#comment-14971834
]
Cody Koeninger commented on SPARK-11211:
In an attempt to replicate, I used the f
[
https://issues.apache.org/jira/browse/SPARK-11195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14971783#comment-14971783
]
Cody Koeninger commented on SPARK-11195:
I'm seeing this on 1.5.1 as well
> Exce
[
https://issues.apache.org/jira/browse/SPARK-11045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14952444#comment-14952444
]
Cody Koeninger commented on SPARK-11045:
Direct stream partitions are 1:1 with ka
[
https://issues.apache.org/jira/browse/SPARK-11045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14952373#comment-14952373
]
Cody Koeninger commented on SPARK-11045:
What you're saying doesn't address my po
[
https://issues.apache.org/jira/browse/SPARK-11045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14952299#comment-14952299
]
Cody Koeninger commented on SPARK-11045:
"in Receiver based model, the number of
[
https://issues.apache.org/jira/browse/SPARK-11045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951877#comment-14951877
]
Cody Koeninger commented on SPARK-11045:
The comments regarding parallelism are n
Cody Koeninger created SPARK-10963:
--
Summary: Make KafkaCluster api public
Key: SPARK-10963
URL: https://issues.apache.org/jira/browse/SPARK-10963
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945091#comment-14945091
]
Cody Koeninger commented on SPARK-5569:
---
The gist I originally posted, linked at the
[
https://issues.apache.org/jira/browse/SPARK-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14937483#comment-14937483
]
Cody Koeninger commented on SPARK-9472:
---
I'd suggest patching your distribution then
[
https://issues.apache.org/jira/browse/SPARK-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14936866#comment-14936866
]
Cody Koeninger commented on SPARK-9472:
---
You can get around this by passing in the h
[
https://issues.apache.org/jira/browse/SPARK-10732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14903231#comment-14903231
]
Cody Koeninger edited comment on SPARK-10732 at 9/22/15 7:02 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-10732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14903231#comment-14903231
]
Cody Koeninger commented on SPARK-10732:
Yeah, even if that gets implemented it w
[
https://issues.apache.org/jira/browse/SPARK-10732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14903110#comment-14903110
]
Cody Koeninger commented on SPARK-10732:
As I already said, kafka's implementatio
[
https://issues.apache.org/jira/browse/SPARK-10734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14903106#comment-14903106
]
Cody Koeninger commented on SPARK-10734:
as I explained in SPARK-10732 , kafka's
[
https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14902692#comment-14902692
]
Cody Koeninger commented on SPARK-5569:
---
I'm still not clear on what you're doing in
[
https://issues.apache.org/jira/browse/SPARK-10732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14902648#comment-14902648
]
Cody Koeninger commented on SPARK-10732:
It doesn't make sense to decouple this f
[
https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14901435#comment-14901435
]
Cody Koeninger commented on SPARK-5569:
---
Yeah, spark-streaming can be marked as prov
[
https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14901364#comment-14901364
]
Cody Koeninger commented on SPARK-5569:
---
You can typically use sbt's merge strategy
[
https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14901106#comment-14901106
]
Cody Koeninger commented on SPARK-5569:
---
The direct stream doesn't save offset range
[
https://issues.apache.org/jira/browse/SPARK-10320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14790843#comment-14790843
]
Cody Koeninger commented on SPARK-10320:
I don't think there's much benefit to mu
[
https://issues.apache.org/jira/browse/SPARK-10320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14726076#comment-14726076
]
Cody Koeninger commented on SPARK-10320:
You would supply a function, similar to
[
https://issues.apache.org/jira/browse/SPARK-10320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725719#comment-14725719
]
Cody Koeninger commented on SPARK-10320:
So if you're changing topics in an event
[
https://issues.apache.org/jira/browse/SPARK-10320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14724113#comment-14724113
]
Cody Koeninger commented on SPARK-10320:
It's possible this might be solvable wit
[
https://issues.apache.org/jira/browse/SPARK-10320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-10320:
---
Summary: Kafka Support new topic subscriptions without requiring restart of
the streaming con
[
https://issues.apache.org/jira/browse/SPARK-10320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14724074#comment-14724074
]
Cody Koeninger commented on SPARK-10320:
" If you restart the job and specify a n
[
https://issues.apache.org/jira/browse/SPARK-10320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14717342#comment-14717342
]
Cody Koeninger commented on SPARK-10320:
As I said on the list, the best way to d
[
https://issues.apache.org/jira/browse/SPARK-6249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14697188#comment-14697188
]
Cody Koeninger commented on SPARK-6249:
---
If you want an api that has imprecise seman
[
https://issues.apache.org/jira/browse/SPARK-9947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14697193#comment-14697193
]
Cody Koeninger commented on SPARK-9947:
---
Didn't you already say that you were saving
[
https://issues.apache.org/jira/browse/SPARK-9947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14697166#comment-14697166
]
Cody Koeninger commented on SPARK-9947:
---
You can't re-use checkpoint data across app
[
https://issues.apache.org/jira/browse/SPARK-9947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14697098#comment-14697098
]
Cody Koeninger commented on SPARK-9947:
---
You already have access to offsets and can
[
https://issues.apache.org/jira/browse/SPARK-6249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14695939#comment-14695939
]
Cody Koeninger commented on SPARK-6249:
---
Regarding streaming stats, those should be
[
https://issues.apache.org/jira/browse/SPARK-6249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14695929#comment-14695929
]
Cody Koeninger commented on SPARK-6249:
---
https://github.com/koeninger/kafka-exactly-
[
https://issues.apache.org/jira/browse/SPARK-9780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14681886#comment-14681886
]
Cody Koeninger commented on SPARK-9780:
---
Makes sense, traveling currently but I'll p
[
https://issues.apache.org/jira/browse/SPARK-9476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679380#comment-14679380
]
Cody Koeninger commented on SPARK-9476:
---
The stacktraces you posted don't contain an
[
https://issues.apache.org/jira/browse/SPARK-9476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649123#comment-14649123
]
Cody Koeninger commented on SPARK-9476:
---
Those all look like info or warn level log
Cody Koeninger created SPARK-9475:
-
Summary: Consistent hadoop config for external/*
Key: SPARK-9475
URL: https://issues.apache.org/jira/browse/SPARK-9475
Project: Spark
Issue Type: Sub-task
Cody Koeninger created SPARK-9473:
-
Summary: Consistent hadoop config for SQL
Key: SPARK-9473
URL: https://issues.apache.org/jira/browse/SPARK-9473
Project: Spark
Issue Type: Sub-task
Cody Koeninger created SPARK-9474:
-
Summary: Consistent hadoop config for core
Key: SPARK-9474
URL: https://issues.apache.org/jira/browse/SPARK-9474
Project: Spark
Issue Type: Sub-task
Cody Koeninger created SPARK-9472:
-
Summary: Consistent hadoop config for streaming
Key: SPARK-9472
URL: https://issues.apache.org/jira/browse/SPARK-9472
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14646113#comment-14646113
]
Cody Koeninger commented on SPARK-9434:
---
If you want to submit a PR with doc changes
[
https://issues.apache.org/jira/browse/SPARK-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14646043#comment-14646043
]
Cody Koeninger commented on SPARK-9434:
---
Dmitry, the nabble link you posted indicate
[
https://issues.apache.org/jira/browse/SPARK-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635179#comment-14635179
]
Cody Koeninger commented on SPARK-9215:
---
I left some comments in the doc.
Is Chris
[
https://issues.apache.org/jira/browse/SPARK-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14632476#comment-14632476
]
Cody Koeninger commented on SPARK-9059:
---
How is this different from SPARK-8390 ?
I
[
https://issues.apache.org/jira/browse/SPARK-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615056#comment-14615056
]
Cody Koeninger commented on SPARK-8833:
---
this basic idea has been discussed before a
[
https://issues.apache.org/jira/browse/SPARK-8389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594196#comment-14594196
]
Cody Koeninger commented on SPARK-8389:
---
Have you guys been looking at SPARK-8337 ,
[
https://issues.apache.org/jira/browse/SPARK-8389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14591170#comment-14591170
]
Cody Koeninger commented on SPARK-8389:
---
Static type doesn't really matter since it'
[
https://issues.apache.org/jira/browse/SPARK-8390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14590720#comment-14590720
]
Cody Koeninger commented on SPARK-8390:
---
Did we actually want to update the wordcoun
[
https://issues.apache.org/jira/browse/SPARK-8337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588517#comment-14588517
]
Cody Koeninger commented on SPARK-8337:
---
So one thing to keep in mind is that if the
[
https://issues.apache.org/jira/browse/SPARK-8389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588404#comment-14588404
]
Cody Koeninger commented on SPARK-8389:
---
So on the java side, just so I'm clear, are
[
https://issues.apache.org/jira/browse/SPARK-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588211#comment-14588211
]
Cody Koeninger commented on SPARK-7122:
---
It's certainly your prerogative to wait for
[
https://issues.apache.org/jira/browse/SPARK-8389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588202#comment-14588202
]
Cody Koeninger commented on SPARK-8389:
---
There's already a ticket for the Python sid
Cody Koeninger created SPARK-8127:
-
Summary: KafkaRDD optimize count() take() isEmpty()
Key: SPARK-8127
URL: https://issues.apache.org/jira/browse/SPARK-8127
Project: Spark
Issue Type: Improv
[
https://issues.apache.org/jira/browse/SPARK-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14572059#comment-14572059
]
Cody Koeninger commented on SPARK-7122:
---
If you can try out this patch https://githu
[
https://issues.apache.org/jira/browse/SPARK-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14571675#comment-14571675
]
Cody Koeninger commented on SPARK-7122:
---
Try doing something very straightforward in
[
https://issues.apache.org/jira/browse/SPARK-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14571454#comment-14571454
]
Cody Koeninger commented on SPARK-7122:
---
Nicolas, do you have an actual compilable p
[
https://issues.apache.org/jira/browse/SPARK-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569254#comment-14569254
]
Cody Koeninger commented on SPARK-7122:
---
Am I reading this correctly that you're onl
[
https://issues.apache.org/jira/browse/SPARK-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569125#comment-14569125
]
Cody Koeninger commented on SPARK-7122:
---
That number of tasks sounds normal for that
[
https://issues.apache.org/jira/browse/SPARK-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14567917#comment-14567917
]
Cody Koeninger commented on SPARK-7122:
---
So if you're setting up a 2 second batch st
[
https://issues.apache.org/jira/browse/SPARK-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14567865#comment-14567865
]
Cody Koeninger commented on SPARK-7122:
---
When you say it's getting behind, how are y
[
https://issues.apache.org/jira/browse/SPARK-7827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14556631#comment-14556631
]
Cody Koeninger commented on SPARK-7827:
---
As TD said, it looks like it did retry 4 ti
[
https://issues.apache.org/jira/browse/SPARK-7255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520403#comment-14520403
]
Cody Koeninger commented on SPARK-7255:
---
I think that should be fine to document, th
[
https://issues.apache.org/jira/browse/SPARK-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14511092#comment-14511092
]
Cody Koeninger commented on SPARK-7122:
---
Does this actually have anything to do with
[
https://issues.apache.org/jira/browse/SPARK-6431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14481266#comment-14481266
]
Cody Koeninger commented on SPARK-6431:
---
I think this got mis-diagnosed on the maili
[
https://issues.apache.org/jira/browse/SPARK-6569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14394457#comment-14394457
]
Cody Koeninger commented on SPARK-6569:
---
Keep in mind that this message is in KafkaR
[
https://issues.apache.org/jira/browse/SPARK-6569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14384038#comment-14384038
]
Cody Koeninger commented on SPARK-6569:
---
I set it as warn because an empty batch can
[
https://issues.apache.org/jira/browse/SPARK-6434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14371330#comment-14371330
]
Cody Koeninger commented on SPARK-6434:
---
Yeah, I didn't notice alberto had also crea
Cody Koeninger created SPARK-6434:
-
Summary: [Streaming][Kafka] CreateDirectStream for empty topics
Key: SPARK-6434
URL: https://issues.apache.org/jira/browse/SPARK-6434
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-6249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355561#comment-14355561
]
Cody Koeninger commented on SPARK-6249:
---
First, I don't think setting group.id shoul
[
https://issues.apache.org/jira/browse/SPARK-2808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14316937#comment-14316937
]
Cody Koeninger commented on SPARK-2808:
---
I'm also kind of curious what the motivatio
[
https://issues.apache.org/jira/browse/SPARK-4964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14290747#comment-14290747
]
Cody Koeninger commented on SPARK-4964:
---
Design doc at
https://docs.google.com/a/da
[
https://issues.apache.org/jira/browse/SPARK-4960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14265570#comment-14265570
]
Cody Koeninger commented on SPARK-4960:
---
At that point, it sounds like you're talkin
[
https://issues.apache.org/jira/browse/SPARK-4960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14260144#comment-14260144
]
Cody Koeninger commented on SPARK-4960:
---
You're saying for an implementation that cu
[
https://issues.apache.org/jira/browse/SPARK-4964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14258670#comment-14258670
]
Cody Koeninger commented on SPARK-4964:
---
Usage example of the dstream for the transa
Cody Koeninger created SPARK-4964:
-
Summary: Exactly-once semantics for Kafka
Key: SPARK-4964
URL: https://issues.apache.org/jira/browse/SPARK-4964
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254100#comment-14254100
]
Cody Koeninger commented on SPARK-3146:
---
This is a real problem for production use,
[
https://issues.apache.org/jira/browse/SPARK-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14252397#comment-14252397
]
Cody Koeninger commented on SPARK-3146:
---
((K, V), (topicAndPartition, offset)) is al
[
https://issues.apache.org/jira/browse/SPARK-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14252299#comment-14252299
]
Cody Koeninger commented on SPARK-3146:
---
Yes, for the specific case of kafka, regard
[
https://issues.apache.org/jira/browse/SPARK-4122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14252261#comment-14252261
]
Cody Koeninger commented on SPARK-4122:
---
+1 for the idea of making this write from b
301 - 400 of 410 matches
Mail list logo