[GitHub] spark pull request #22282: [SPARK-23539][SS] Add support for Kafka headers i...

Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/spark/pull/22282#discussion_r215092933 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaWriteTask.scala --- @@ -88,7 +92,30 @@ private[kafka010] abstract c

[GitHub] spark pull request #22282: [SPARK-23539][SS] Add support for Kafka headers i...

Github user dongjinleekr commented on a diff in the pull request: https://github.com/apache/spark/pull/22282#discussion_r214856258 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaWriteTask.scala --- @@ -88,7 +92,30 @@ private[kafka010] abstract

[GitHub] spark pull request #22282: [SPARK-23539][SS] Add support for Kafka headers i...

Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/spark/pull/22282#discussion_r214629265 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaWriteTask.scala --- @@ -88,7 +92,30 @@ private[kafka010] abstract c

[GitHub] spark pull request #22282: [SPARK-23539][SS] Add support for Kafka headers i...

Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/spark/pull/22282#discussion_r214638140 --- Diff: external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaMicroBatchSourceSuite.scala --- @@ -1254,6 +1254,9 @@ abstract clas

[GitHub] spark pull request #22282: [SPARK-23539][SS] Add support for Kafka headers i...

Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/spark/pull/22282#discussion_r214646749 --- Diff: external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaMicroBatchSourceSuite.scala --- @@ -1254,6 +1254,9 @@ abstract clas

[GitHub] spark pull request #22282: [SPARK-23539][SS] Add support for Kafka headers i...

Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/spark/pull/22282#discussion_r214618743 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaRecordToUnsafeRowConverter.scala --- @@ -44,6 +44,11 @@ private[kaf

[GitHub] spark pull request #22282: [SPARK-23539][SS] Add support for Kafka headers i...

Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/spark/pull/22282#discussion_r214635480 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaWriteTask.scala --- @@ -88,7 +92,30 @@ private[kafka010] abstract c

[GitHub] spark pull request #22282: [SPARK-23539][SS] Add support for Kafka headers i...

Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/spark/pull/22282#discussion_r214622654 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSource.scala --- @@ -293,7 +294,12 @@ private[kafka010] class Kafka

[GitHub] spark pull request #22282: [SPARK-23539][SS] Add support for Kafka headers i...

Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/spark/pull/22282#discussion_r214622600 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaRelation.scala --- @@ -115,7 +116,12 @@ private[kafka010] class Kaf

[GitHub] spark pull request #22282: [SPARK-23539][SS] Add support for Kafka headers i...

Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/spark/pull/22282#discussion_r214639674 --- Diff: external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaRelationSuite.scala --- @@ -136,6 +142,19 @@ class KafkaRelationSui

[GitHub] spark pull request #22282: [SPARK-23539][SS] Add support for Kafka headers i...

Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/spark/pull/22282#discussion_r214632570 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaWriteTask.scala --- @@ -88,7 +92,30 @@ private[kafka010] abstract c

[GitHub] spark pull request #22282: [SPARK-23539][SS] Add support for Kafka headers i...

Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/spark/pull/22282#discussion_r214640616 --- Diff: external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaSinkSuite.scala --- @@ -59,14 +59,23 @@ class KafkaSinkSuite extend

[GitHub] spark pull request #22282: [SPARK-23539][SS] Add support for Kafka headers i...

Github user dongjinleekr commented on a diff in the pull request: https://github.com/apache/spark/pull/22282#discussion_r214345393 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeArrayData.java --- @@ -473,17 +474,6 @@ public static UnsafeArray

[GitHub] spark pull request #22282: [SPARK-23539][SS] Add support for Kafka headers i...

Github user dongjinleekr commented on a diff in the pull request: https://github.com/apache/spark/pull/22282#discussion_r214345173 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaWriteTask.scala --- @@ -131,9 +158,25 @@ private[kafka010] abstrac

[GitHub] spark pull request #22282: [SPARK-23539][SS] Add support for Kafka headers i...

Github user dongjinleekr commented on a diff in the pull request: https://github.com/apache/spark/pull/22282#discussion_r214198620 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaWriteTask.scala --- @@ -131,9 +158,25 @@ private[kafka010] abstrac

[GitHub] spark pull request #22282: [SPARK-23539][SS] Add support for Kafka headers i...

Github user xuanyuanking commented on a diff in the pull request: https://github.com/apache/spark/pull/22282#discussion_r214084903 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeArrayData.java --- @@ -473,17 +474,6 @@ public static UnsafeArray

[GitHub] spark pull request #22282: [SPARK-23539][SS] Add support for Kafka headers i...

Github user tedyu commented on a diff in the pull request: https://github.com/apache/spark/pull/22282#discussion_r214073971 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaWriteTask.scala --- @@ -131,9 +158,25 @@ private[kafka010] abstract class

[GitHub] spark pull request #22282: [SPARK-23539][SS] Add support for Kafka headers i...

Github user xuanyuanking commented on a diff in the pull request: https://github.com/apache/spark/pull/22282#discussion_r214075761 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeArrayData.java --- @@ -473,17 +474,6 @@ public static UnsafeArray

[GitHub] spark pull request #22282: [SPARK-23539][SS] Add support for Kafka headers i...

GitHub user dongjinleekr opened a pull request: https://github.com/apache/spark/pull/22282 [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming ## What changes were proposed in this pull request? This update adds support for Kafka Headers functionality in