Hi Saisai, The reasons why I've originally set the goal only structured streaming is the following: * Haven't seen big interest in the DStream area for new features * Separate the concerns even if there is a need
All in all happy to port the feature to DStream if you think it worth and you can help me, because no major differences are there (at least considering this area). BR, G On Sun, Sep 30, 2018 at 4:06 AM Saisai Shao <sai.sai.s...@gmail.com> wrote: > I like this proposal. Since Kafka already provides delegation token > mechanism, we can also leverage Spark's delegation token framework to add > Kafka as a built-in support. > > BTW I think there's no much difference in support structured streaming and > DStream, maybe we can set both as goal. > > Thanks > Saisai > > Gabor Somogyi <gabor.g.somo...@gmail.com> 于2018年9月27日周四 下午7:58写道： > >> Hi all, >> >> I am writing this e-mail in order to discuss the delegation token support >> for kafka feature which is reported in SPARK-25501 >> <https://issues.apache.org/jira/browse/SPARK-25501>. I've prepared a SPIP >> <https://docs.google.com/document/d/1ouRayzaJf_N5VQtGhVq9FURXVmRpXzEEWYHob0ne3NY/edit?usp=sharing> >> for >> it. PR is on the way... >> >> Looking forward to hear your feedback. >> >> BR, >> G >> >>
