[
https://issues.apache.org/jira/browse/SPARK-18475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15679472#comment-15679472
]
Cody Koeninger edited comment on SPARK-18475 at 11/19/16 4:02 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-18475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15679472#comment-15679472
]
Cody Koeninger commented on SPARK-18475:
Yes, an RDD does have an ordering guaran
[
https://issues.apache.org/jira/browse/SPARK-18475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15674459#comment-15674459
]
Cody Koeninger commented on SPARK-18475:
This has come up several times, and my a
[
https://issues.apache.org/jira/browse/SPARK-18386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15654308#comment-15654308
]
Cody Koeninger commented on SPARK-18386:
That should work. There may be dependen
[
https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15654295#comment-15654295
]
Cody Koeninger commented on SPARK-18057:
I definitely do not want another copy-pa
Cody Koeninger created SPARK-18386:
--
Summary: Batch mode SQL source for Kafka
Key: SPARK-18386
URL: https://issues.apache.org/jira/browse/SPARK-18386
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-18371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15649638#comment-15649638
]
Cody Koeninger commented on SPARK-18371:
Thanks for digging into this. The other
[
https://issues.apache.org/jira/browse/SPARK-18258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15638555#comment-15638555
]
Cody Koeninger commented on SPARK-18258:
Sure, added, let me know if I'm missing
[
https://issues.apache.org/jira/browse/SPARK-18258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-18258:
---
Description:
Transactional "exactly-once" semantics for output require storing an offset
ide
[
https://issues.apache.org/jira/browse/SPARK-18258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15637621#comment-15637621
]
Cody Koeninger commented on SPARK-18258:
So one obvious one is that if wherever c
[
https://issues.apache.org/jira/browse/SPARK-18258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15637576#comment-15637576
]
Cody Koeninger commented on SPARK-18258:
The sink doesn't have to reason about eq
Cody Koeninger created SPARK-18272:
--
Summary: Test topic addition for subscribePattern on Kafka DStream
and Structured Stream
Key: SPARK-18272
URL: https://issues.apache.org/jira/browse/SPARK-18272
P
[
https://issues.apache.org/jira/browse/SPARK-18258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-18258:
---
Description:
Transactional "exactly-once" semantics for output require storing an offset
ide
Cody Koeninger created SPARK-18258:
--
Summary: Sinks need access to offset representation
Key: SPARK-18258
URL: https://issues.apache.org/jira/browse/SPARK-18258
Project: Spark
Issue Type: Im
[
https://issues.apache.org/jira/browse/SPARK-17938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15629332#comment-15629332
]
Cody Koeninger commented on SPARK-17938:
Direct stream isn't a receiver, receiver
[
https://issues.apache.org/jira/browse/SPARK-18212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15627838#comment-15627838
]
Cody Koeninger commented on SPARK-18212:
So here's a heavily excerpted version of
[
https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15626774#comment-15626774
]
Cody Koeninger commented on SPARK-17935:
Some other things to think about:
- are
[
https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15612663#comment-15612663
]
Cody Koeninger commented on SPARK-17935:
So the main thing to point out is that K
[
https://issues.apache.org/jira/browse/SPARK-17829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15610399#comment-15610399
]
Cody Koeninger commented on SPARK-17829:
I'm not telling you to do it that way, j
[
https://issues.apache.org/jira/browse/SPARK-17829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15609653#comment-15609653
]
Cody Koeninger commented on SPARK-17829:
Have you considered using a typeclass?
Cody Koeninger created SPARK-18057:
--
Summary: Update structured streaming kafka from 10.0.1 to 10.1.0
Key: SPARK-18057
URL: https://issues.apache.org/jira/browse/SPARK-18057
Project: Spark
I
[
https://issues.apache.org/jira/browse/SPARK-18056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-18056:
---
Description: There are a couple of relevant KIPs here,
https://archive.apache.org/dist/kafka/
Cody Koeninger created SPARK-18056:
--
Summary: Update KafkaDStreams from 10.0.1 to 10.1.0
Key: SPARK-18056
URL: https://issues.apache.org/jira/browse/SPARK-18056
Project: Spark
Issue Type: Im
[
https://issues.apache.org/jira/browse/SPARK-17829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15593000#comment-15593000
]
Cody Koeninger commented on SPARK-17829:
At least with regard to kafka offsets, i
Cody Koeninger created SPARK-18033:
--
Summary: Deprecate TaskContext.partitionId
Key: SPARK-18033
URL: https://issues.apache.org/jira/browse/SPARK-18033
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15586417#comment-15586417
]
Cody Koeninger commented on SPARK-17147:
If that's something you're seeing regula
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15586397#comment-15586397
]
Cody Koeninger commented on SPARK-17147:
Then no, this issue is unlikely to affec
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17147:
---
Summary: Spark Streaming Kafka 0.10 Consumer Can't Handle Non-consecutive
Offsets (i.e. Log C
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15584172#comment-15584172
]
Cody Koeninger commented on SPARK-17147:
Well, are you using compacted topics?
>
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15578894#comment-15578894
]
Cody Koeninger commented on SPARK-17812:
As you just said yourself, assign doesn'
[
https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15578141#comment-15578141
]
Cody Koeninger commented on SPARK-17935:
Why is this in kafka-0-8, when we haven'
[
https://issues.apache.org/jira/browse/SPARK-17938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15578133#comment-15578133
]
Cody Koeninger commented on SPARK-17938:
There was pretty extensive discussion of
[
https://issues.apache.org/jira/browse/SPARK-17813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15577037#comment-15577037
]
Cody Koeninger commented on SPARK-17813:
To be clear, the current direct stream (
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17812:
---
Description:
Right now you can only run a Streaming Query starting from either the earliest
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15577022#comment-15577022
]
Cody Koeninger commented on SPARK-17812:
Assign is useful, otherwise you have no
[
https://issues.apache.org/jira/browse/SPARK-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17937:
---
Description:
Possible events for which offsets are needed:
# New partition is discovered
# Of
[
https://issues.apache.org/jira/browse/SPARK-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17937:
---
Description:
Possible events for which offsets are needed:
# New partition is discovered
# Of
[
https://issues.apache.org/jira/browse/SPARK-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17937:
---
Description:
Possible events for which offsets are needed:
# New partition is discovered
# Of
[
https://issues.apache.org/jira/browse/SPARK-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17937:
---
Description:
Possible events for which offsets are needed:
# New partition is discovered
# Of
[
https://issues.apache.org/jira/browse/SPARK-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17937:
---
Description:
Possible events for which offsets are needed:
# New partition is discovered
# Of
[
https://issues.apache.org/jira/browse/SPARK-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17937:
---
Description:
Possible events for which offsets are needed:
# New partition is discovered
# Of
[
https://issues.apache.org/jira/browse/SPARK-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17937:
---
Description:
Possible events for which offsets are needed:
# New partition is discovered
# Of
[
https://issues.apache.org/jira/browse/SPARK-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17937:
---
Description:
Possible events for which offsets are needed:
# *New partition* is discovered
#
[
https://issues.apache.org/jira/browse/SPARK-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17937:
---
Description:
Possible events for which offsets are needed:
# *New partition* is discovered
#
[
https://issues.apache.org/jira/browse/SPARK-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17937:
---
Description:
Possible events for which offsets are needed:
# New partition is discovered
# Of
[
https://issues.apache.org/jira/browse/SPARK-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17937:
---
Description:
Possible events for which offsets are needed:
# New partition is discovered
# Of
Cody Koeninger created SPARK-17937:
--
Summary: Clarify Kafka offset semantics for Structured Streaming
Key: SPARK-17937
URL: https://issues.apache.org/jira/browse/SPARK-17937
Project: Spark
I
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573843#comment-15573843
]
Cody Koeninger commented on SPARK-17812:
So I think this is what we're agreed on:
[
https://issues.apache.org/jira/browse/SPARK-17813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573806#comment-15573806
]
Cody Koeninger commented on SPARK-17813:
So issues to be worked out here (assumin
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573766#comment-15573766
]
Cody Koeninger commented on SPARK-17812:
OK, failing on start is clear (it's real
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573563#comment-15573563
]
Cody Koeninger commented on SPARK-17812:
So a short term question
- with your pro
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573479#comment-15573479
]
Cody Koeninger commented on SPARK-17812:
While some decision is better than none,
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573432#comment-15573432
]
Cody Koeninger edited comment on SPARK-17812 at 10/13/16 10:44 PM:
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573432#comment-15573432
]
Cody Koeninger commented on SPARK-17812:
If you're seriously worried that people
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573395#comment-15573395
]
Cody Koeninger edited comment on SPARK-17812 at 10/13/16 10:25 PM:
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573395#comment-15573395
]
Cody Koeninger commented on SPARK-17812:
1. we dont have lists, we have strings.
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17812:
---
Comment: was deleted
(was: One other slightly ugly thing...
{noformat}
// starting topicpart
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573166#comment-15573166
]
Cody Koeninger edited comment on SPARK-17812 at 10/13/16 9:17 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573166#comment-15573166
]
Cody Koeninger commented on SPARK-17812:
Here's my concrete suggestion:
3 mutual
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15572922#comment-15572922
]
Cody Koeninger edited comment on SPARK-17812 at 10/13/16 8:33 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573089#comment-15573089
]
Cody Koeninger commented on SPARK-17812:
One other slightly ugly thing...
{nofor
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15572922#comment-15572922
]
Cody Koeninger commented on SPARK-17812:
Sorry, I didn't see this comment until j
[
https://issues.apache.org/jira/browse/SPARK-17900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15572119#comment-15572119
]
Cody Koeninger commented on SPARK-17900:
Thanks for doing this, should make thing
[
https://issues.apache.org/jira/browse/SPARK-15408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger closed SPARK-15408.
--
Resolution: Cannot Reproduce
> Spark streaming app crashes with NotLeaderForPartitionException
[
https://issues.apache.org/jira/browse/SPARK-15272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15570221#comment-15570221
]
Cody Koeninger commented on SPARK-15272:
Checking to see if the 0.10 consumer's h
[
https://issues.apache.org/jira/browse/SPARK-15272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15570221#comment-15570221
]
Cody Koeninger edited comment on SPARK-15272 at 10/12/16 11:33 PM:
[
https://issues.apache.org/jira/browse/SPARK-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15570208#comment-15570208
]
Cody Koeninger commented on SPARK-11698:
Would a custom ConsumerStrategy for the
[
https://issues.apache.org/jira/browse/SPARK-10320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger resolved SPARK-10320.
Resolution: Fixed
Fix Version/s: 2.0.0
SPARK-12177 added the new consumer, which su
[
https://issues.apache.org/jira/browse/SPARK-9947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger closed SPARK-9947.
-
Resolution: Won't Fix
The direct DStream api already gives access to offsets, and it seems clear t
[
https://issues.apache.org/jira/browse/SPARK-8337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15570186#comment-15570186
]
Cody Koeninger commented on SPARK-8337:
---
Can this be closed, given that the subtasks
[
https://issues.apache.org/jira/browse/SPARK-5505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger closed SPARK-5505.
-
Resolution: Won't Fix
The old kafka High Level Consumer has been abandoned at this point.
SPARK-
[
https://issues.apache.org/jira/browse/SPARK-5718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger resolved SPARK-5718.
---
Resolution: Fixed
Fix Version/s: 2.0.0
SPARK-12177 added support for the native kafka o
[
https://issues.apache.org/jira/browse/SPARK-10815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15570139#comment-15570139
]
Cody Koeninger commented on SPARK-10815:
Another unfortunate thing about the Sink
[
https://issues.apache.org/jira/browse/SPARK-17344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15567457#comment-15567457
]
Cody Koeninger commented on SPARK-17344:
Given the choice between rewriting under
[
https://issues.apache.org/jira/browse/SPARK-17837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger closed SPARK-17837.
--
Resolution: Duplicate
Duplicate of SPARK-17829
> Disaster recovery of offsets from WAL
> -
[
https://issues.apache.org/jira/browse/SPARK-17344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15566244#comment-15566244
]
Cody Koeninger commented on SPARK-17344:
How long would it take CDH to distribute
[
https://issues.apache.org/jira/browse/SPARK-17853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15565559#comment-15565559
]
Cody Koeninger commented on SPARK-17853:
Good, will keep this ticket open at leas
[
https://issues.apache.org/jira/browse/SPARK-17853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15565400#comment-15565400
]
Cody Koeninger commented on SPARK-17853:
Use a different group id.
Let me know i
[
https://issues.apache.org/jira/browse/SPARK-17853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15565278#comment-15565278
]
Cody Koeninger commented on SPARK-17853:
Which version of DStream are you using,
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563285#comment-15563285
]
Cody Koeninger commented on SPARK-17812:
No, it's not covered by strict assign.
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15560925#comment-15560925
]
Cody Koeninger commented on SPARK-17812:
I want to start a pattern subscription a
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15560839#comment-15560839
]
Cody Koeninger commented on SPARK-17812:
That totally kills the usability of Subs
[
https://issues.apache.org/jira/browse/SPARK-17815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15560837#comment-15560837
]
Cody Koeninger commented on SPARK-17815:
My personal concerns about complexity ar
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15560719#comment-15560719
]
Cody Koeninger commented on SPARK-17812:
Generally agree with the direction of wh
[
https://issues.apache.org/jira/browse/SPARK-17815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15560684#comment-15560684
]
Cody Koeninger commented on SPARK-17815:
Regarding kafka consumer behavior, I'm n
Cody Koeninger created SPARK-17841:
--
Summary: Kafka 0.10 commitQueue needs to be drained
Key: SPARK-17841
URL: https://issues.apache.org/jira/browse/SPARK-17841
Project: Spark
Issue Type: Bu
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15560241#comment-15560241
]
Cody Koeninger commented on SPARK-17147:
[~graphex] My WIP is at https://github.c
[
https://issues.apache.org/jira/browse/SPARK-17815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15559911#comment-15559911
]
Cody Koeninger commented on SPARK-17815:
The WAL cannot be the only source of tru
[
https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15558572#comment-15558572
]
Cody Koeninger commented on SPARK-17147:
I talked with Sean in person about this,
[
https://issues.apache.org/jira/browse/SPARK-4960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15558557#comment-15558557
]
Cody Koeninger commented on SPARK-4960:
---
Is this idea pretty much dead at this point
[
https://issues.apache.org/jira/browse/SPARK-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger resolved SPARK-3146.
---
Resolution: Fixed
Fix Version/s: 1.3.0
> Improve the flexibility of Spark Streaming Kaf
[
https://issues.apache.org/jira/browse/SPARK-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15558550#comment-15558550
]
Cody Koeninger commented on SPARK-3146:
---
SPARK-4964 / the direct stream added a mess
[
https://issues.apache.org/jira/browse/SPARK-17837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17837:
---
Summary: Disaster recovery of offsets from WAL (was: Disaster recover of
offsets from WAL)
Cody Koeninger created SPARK-17837:
--
Summary: Disaster recover of offsets from WAL
Key: SPARK-17837
URL: https://issues.apache.org/jira/browse/SPARK-17837
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-17815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15558528#comment-15558528
]
Cody Koeninger commented on SPARK-17815:
So if you start committing offsets to ka
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15558506#comment-15558506
]
Cody Koeninger commented on SPARK-17812:
So I'm willing to do this work, mostly b
[
https://issues.apache.org/jira/browse/SPARK-17344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15558474#comment-15558474
]
Cody Koeninger commented on SPARK-17344:
I think this is premature until you have
[
https://issues.apache.org/jira/browse/SPARK-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15554160#comment-15554160
]
Cody Koeninger commented on SPARK-15406:
I think if you're already gravitating to
[
https://issues.apache.org/jira/browse/SPARK-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15554139#comment-15554139
]
Cody Koeninger commented on SPARK-15406:
When something has gone wrong, as an end
[
https://issues.apache.org/jira/browse/SPARK-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15553955#comment-15553955
]
Cody Koeninger edited comment on SPARK-15406 at 10/7/16 3:20 AM:
--
101 - 200 of 410 matches
Mail list logo