HeartSaVioR edited a comment on issue #25618: [SPARK-28908][SS]Implement Kafka
EOS sink for Structured Streaming
URL: https://github.com/apache/spark/pull/25618#issuecomment-531519195
> About a new Kafka API to resolve Kafka transaction in distributed system,
as @HeartSaVioR mentioned
HeartSaVioR edited a comment on issue #25618: [SPARK-28908][SS]Implement Kafka
EOS sink for Structured Streaming
URL: https://github.com/apache/spark/pull/25618#issuecomment-531519195
> About a new Kafka API to resolve Kafka transaction in distributed system,
as @HeartSaVioR mentioned
HeartSaVioR edited a comment on issue #25618: [SPARK-28908][SS]Implement Kafka
EOS sink for Structured Streaming
URL: https://github.com/apache/spark/pull/25618#issuecomment-531519195
> About a new Kafka API to resolve Kafka transaction in distributed system,
as @HeartSaVioR mentioned
HeartSaVioR edited a comment on issue #25618: [SPARK-28908][SS]Implement Kafka
EOS sink for Structured Streaming
URL: https://github.com/apache/spark/pull/25618#issuecomment-529881264
You might want to know that Kafka transactional producer is designed for
Kafka stream (explaining below),
HeartSaVioR edited a comment on issue #25618: [SPARK-28908][SS]Implement Kafka
EOS sink for Structured Streaming
URL: https://github.com/apache/spark/pull/25618#issuecomment-529881264
You might want to know that Kafka transactional producer is designed for
Kafka stream (explaining below),
HeartSaVioR edited a comment on issue #25618: [SPARK-28908][SS]Implement Kafka
EOS sink for Structured Streaming
URL: https://github.com/apache/spark/pull/25618#issuecomment-529881264
You might want to know that Kafka transactional producer is designed for
Kafka stream (explaining below),
HeartSaVioR edited a comment on issue #25618: [SPARK-28908][SS]Implement Kafka
EOS sink for Structured Streaming
URL: https://github.com/apache/spark/pull/25618#issuecomment-529881264
You might want to know that Kafka transactional producer fits mainly for
Kafka stream (explaining below),
HeartSaVioR edited a comment on issue #25618: [SPARK-28908][SS]Implement Kafka
EOS sink for Structured Streaming
URL: https://github.com/apache/spark/pull/25618#issuecomment-529637136
I'm not expert of Kafka (specifically how transaction works in Kafka), but
given Kafka still writes
HeartSaVioR edited a comment on issue #25618: [SPARK-28908][SS]Implement Kafka
EOS sink for Structured Streaming
URL: https://github.com/apache/spark/pull/25618#issuecomment-529637136
I'm not expert of Kafka (specifically how transaction works in Kafka), but
given Kafka still writes
HeartSaVioR edited a comment on issue #25618: [SPARK-28908][SS]Implement Kafka
EOS sink for Structured Streaming
URL: https://github.com/apache/spark/pull/25618#issuecomment-529637136
I'm not expert of Kafka (specifically how transaction works in Kafka), but
given Kafka still writes
HeartSaVioR edited a comment on issue #25618: [SPARK-28908][SS]Implement Kafka
EOS sink for Structured Streaming
URL: https://github.com/apache/spark/pull/25618#issuecomment-526593592
Well, someone could say it as 2PC since the behavior is similar, but
generally 2PC assumes coordinator
HeartSaVioR edited a comment on issue #25618: [SPARK-28908][SS]Implement Kafka
EOS sink for Structured Streaming
URL: https://github.com/apache/spark/pull/25618#issuecomment-526593592
Well, someone could say it as 2PC since the behavior is similar, but
generally 2PC assumes coordinator
HeartSaVioR edited a comment on issue #25618: [SPARK-28908][SS]Implement Kafka
EOS sink for Structured Streaming
URL: https://github.com/apache/spark/pull/25618#issuecomment-526436430
Spark doesn't have semantics of 2PC natively as you've seen DSv2 API - If I
understand correctly, Spark
HeartSaVioR edited a comment on issue #25618: [SPARK-28908][SS]Implement Kafka
EOS sink for Structured Streaming
URL: https://github.com/apache/spark/pull/25618#issuecomment-526436430
Spark doesn't have semantics of 2PC natively as you've seen DSv2 API - Spark
HDFS sink doesn't leverage
HeartSaVioR edited a comment on issue #25618: [SPARK-28908][SS]Implement Kafka
EOS sink for Structured Streaming
URL: https://github.com/apache/spark/pull/25618#issuecomment-526394910
Just skimmed the design doc (need to take a look deeply on fault tolerance)
and it's basically known
HeartSaVioR edited a comment on issue #25618: [SPARK-28908][SS]Implement Kafka
EOS sink for Structured Streaming
URL: https://github.com/apache/spark/pull/25618#issuecomment-526394910
Just skimmed the design doc (need to take a look deeply on fault tolerance)
and it's basically known
HeartSaVioR edited a comment on issue #25618: [SPARK-28908][SS]Implement Kafka
EOS sink for Structured Streaming
URL: https://github.com/apache/spark/pull/25618#issuecomment-526394910
Just skimmed the design doc (need to take a look deeply on fault tolerance)
and it's basically known
HeartSaVioR edited a comment on issue #25618: [SPARK-28908][SS]Implement Kafka
EOS sink for Structured Streaming
URL: https://github.com/apache/spark/pull/25618#issuecomment-526394910
Just skimmed the design doc (need to take a look deeply on fault tolerance)
and it's basically known
HeartSaVioR edited a comment on issue #25618: [SPARK-28908][SS]Implement Kafka
EOS sink for Structured Streaming
URL: https://github.com/apache/spark/pull/25618#issuecomment-526394910
Just skimmed the design doc (need to take a look deeply on fault tolerance)
and it's basically known
19 matches
Mail list logo
