[
https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15884790#comment-15884790
]
Ofir Manor commented on SPARK-18057:
Sure - [~marmbrus] - what do you think? it resolved my Kafka
[
https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15884619#comment-15884619
]
Ofir Manor commented on SPARK-18057:
[~c...@koeninger.org] I think my previous issue with upgrading
[
https://issues.apache.org/jira/browse/SPARK-18475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688246#comment-15688246
]
Ofir Manor commented on SPARK-18475:
Cody, for me your are the main gatekeeper for everything Kafka
[
https://issues.apache.org/jira/browse/SPARK-18475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15680780#comment-15680780
]
Ofir Manor commented on SPARK-18475:
I understand, but I disagree with you. I think you are mixing
[
https://issues.apache.org/jira/browse/SPARK-18475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674628#comment-15674628
]
Ofir Manor commented on SPARK-18475:
I was just wondering if it actually works, but it seems you
[
https://issues.apache.org/jira/browse/SPARK-18475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674092#comment-15674092
]
Ofir Manor commented on SPARK-18475:
Are you sure this is working? Having a visible perf effect?
As
[
https://issues.apache.org/jira/browse/SPARK-18386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15653821#comment-15653821
]
Ofir Manor commented on SPARK-18386:
BTW [~c...@koeninger.org] - I think that filtering (by
[
https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15653415#comment-15653415
]
Ofir Manor commented on SPARK-18057:
This is great, especially if we follow up by adding reading
[
https://issues.apache.org/jira/browse/SPARK-18386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15653388#comment-15653388
]
Ofir Manor commented on SPARK-18386:
This would be really useful for me right now!
We have many
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15578699#comment-15578699
]
Ofir Manor commented on SPARK-17812:
I think Michael suggest that if you use {{startingOffsets}}
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573457#comment-15573457
]
Ofir Manor commented on SPARK-17812:
I'm with you - I warned you it is bikeshedding...
I don't have a
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573341#comment-15573341
]
Ofir Manor commented on SPARK-17812:
Thanks Cody! great to have a concrete example.
I've some
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573109#comment-15573109
]
Ofir Manor commented on SPARK-17812:
Regarding (1) - of course it is *all* data in the source, as of
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15563273#comment-15563273
]
Ofir Manor commented on SPARK-17812:
If you think it is useful, you should definitely propose
[
https://issues.apache.org/jira/browse/SPARK-17815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560906#comment-15560906
]
Ofir Manor commented on SPARK-17815:
I totally understand your concerns, and yes, I hope you will
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560865#comment-15560865
]
Ofir Manor commented on SPARK-17812:
Why? If you choose oldest, latest or by timestamp, you can
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560820#comment-15560820
]
Ofir Manor commented on SPARK-17812:
I'll have to think about it - not sure if it ever makes sense to
[
https://issues.apache.org/jira/browse/SPARK-17815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560749#comment-15560749
]
Ofir Manor commented on SPARK-17815:
Thanks Cody, this is much clearer.
(BTW - I've been bitten
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560696#comment-15560696
]
Ofir Manor edited comment on SPARK-17812 at 10/9/16 10:00 PM:
--
Cody, you are
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560696#comment-15560696
]
Ofir Manor commented on SPARK-17812:
Cody, you are absolutely right that the option naming is silly
[
https://issues.apache.org/jira/browse/SPARK-17815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560661#comment-15560661
]
Ofir Manor commented on SPARK-17815:
I hope others with better understanding of Spark internals can
[
https://issues.apache.org/jira/browse/SPARK-17815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15559549#comment-15559549
]
Ofir Manor commented on SPARK-17815:
Good, we are on the same page, no argument that SPARK-16963
[
https://issues.apache.org/jira/browse/SPARK-17815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15559541#comment-15559541
]
Ofir Manor commented on SPARK-17815:
As far as I understand, there is a clear single-point-of-truth:
[
https://issues.apache.org/jira/browse/SPARK-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15554426#comment-15554426
]
Ofir Manor commented on SPARK-15406:
Thanks Micahel for the checkpoint location explanation! I
[
https://issues.apache.org/jira/browse/SPARK-17815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553662#comment-15553662
]
Ofir Manor commented on SPARK-17815:
I think this is a good idea.There is a minor confusion here,
[
https://issues.apache.org/jira/browse/SPARK-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553613#comment-15553613
]
Ofir Manor commented on SPARK-15406:
I see three somewhat-related issues:
1. More flexibility is
[
https://issues.apache.org/jira/browse/SPARK-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553372#comment-15553372
]
Ofir Manor commented on SPARK-15406:
Thanks Michael, I'll check the JIRAs, and will also post some
[
https://issues.apache.org/jira/browse/SPARK-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553161#comment-15553161
]
Ofir Manor commented on SPARK-15406:
Alright, I do hope you all find a way to resolve this and switch
[
https://issues.apache.org/jira/browse/SPARK-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553076#comment-15553076
]
Ofir Manor commented on SPARK-15406:
Thanks Cody! I missed the activity in the subtask PR...
It is
[
https://issues.apache.org/jira/browse/SPARK-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15548350#comment-15548350
]
Ofir Manor commented on SPARK-15406:
Checking back - is there any progress on the API or code? I'll
[
https://issues.apache.org/jira/browse/SPARK-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488487#comment-15488487
]
Ofir Manor commented on SPARK-15406:
Cody, I think you are right. Now is the right time to spend a
[
https://issues.apache.org/jira/browse/SPARK-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15453412#comment-15453412
]
Ofir Manor commented on SPARK-15406:
For me - structured streaming is currently all about real window
[
https://issues.apache.org/jira/browse/SPARK-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15453289#comment-15453289
]
Ofir Manor commented on SPARK-15406:
Cody, why do you think Structured Streaming support for Kafka
33 matches
Mail list logo
