[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15579206#comment-15579206
]
Apache Spark commented on SPARK-17812:
--
User 'koeninger' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15578894#comment-15578894
]
Cody Koeninger commented on SPARK-17812:
As you just said yourself, assign doesn't mean you
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15578699#comment-15578699
]
Ofir Manor commented on SPARK-17812:
I think Michael suggest that if you use {{startingOffsets}}
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15577022#comment-15577022
]
Cody Koeninger commented on SPARK-17812:
Assign is useful, otherwise you have no way of consuming
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576840#comment-15576840
]
Michael Armbrust commented on SPARK-17812:
--
That sounds pretty good to me, with one question:
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573843#comment-15573843
]
Cody Koeninger commented on SPARK-17812:
So I think this is what we're agreed on:
Mutually
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573786#comment-15573786
]
Michael Armbrust commented on SPARK-17812:
--
Please do work on it. It might be good to update
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573766#comment-15573766
]
Cody Koeninger commented on SPARK-17812:
OK, failing on start is clear (it's really annoying in
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573677#comment-15573677
]
Michael Armbrust commented on SPARK-17812:
--
bq. with your proposed interface, what, as a user,
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573563#comment-15573563
]
Cody Koeninger commented on SPARK-17812:
So a short term question
- with your proposed interface,
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573526#comment-15573526
]
Michael Armbrust commented on SPARK-17812:
--
As far as I understand it, {{auto.offset.reset}} is
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573479#comment-15573479
]
Cody Koeninger commented on SPARK-17812:
While some decision is better than none, can you help me
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573457#comment-15573457
]
Ofir Manor commented on SPARK-17812:
I'm with you - I warned you it is bikeshedding...
I don't have a
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573459#comment-15573459
]
Michael Armbrust commented on SPARK-17812:
--
+1 to the suggested was of subscribing, and for
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573432#comment-15573432
]
Cody Koeninger commented on SPARK-17812:
If you're seriously worried that people are going to get
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573395#comment-15573395
]
Cody Koeninger commented on SPARK-17812:
1. we dont have lists, we have strings. regexes and
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573341#comment-15573341
]
Ofir Manor commented on SPARK-17812:
Thanks Cody! great to have a concrete example.
I've some
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573166#comment-15573166
]
Cody Koeninger commented on SPARK-17812:
Here's my concrete suggestion:
3 mutually exclusive
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573109#comment-15573109
]
Ofir Manor commented on SPARK-17812:
Regarding (1) - of course it is *all* data in the source, as of
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573089#comment-15573089
]
Cody Koeninger commented on SPARK-17812:
One other slightly ugly thing...
{noformat}
// starting
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572922#comment-15572922
]
Cody Koeninger commented on SPARK-17812:
Sorry, I didn't see this comment until just now.
X
21 matches
Mail list logo
