[ https://issues.apache.org/jira/browse/SPARK-20597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jacek Laskowski updated SPARK-20597: ------------------------------------ Description: 1. {{KafkaSourceProvider}} supports {{topic}} option that sets the Kafka topic to save a DataFrame to. 1. {{KafkaSourceProvider}} can use {{topic}} column to assign rows to Kafka topics for writing but what seems quite interesting is to support {{start(path: String)}} as the least precedence option in which {{path}} would designate the default topic when no other options are used. {code} df.writeStream.format("kafka").start(path = "topic") {code} See http://apache-spark-developers-list.1001551.n3.nabble.com/KafkaSourceProvider-Why-topic-option-and-column-without-reverting-to-path-as-the-least-priority-td21458.html for discussion > KafkaSourceProvider falls back on path as synonym for topic > ----------------------------------------------------------- > > Key: SPARK-20597 > URL: https://issues.apache.org/jira/browse/SPARK-20597 > Project: Spark > Issue Type: Improvement > Components: Structured Streaming > Affects Versions: 2.2.0 > Reporter: Jacek Laskowski > Priority: Trivial > > 1. {{KafkaSourceProvider}} supports {{topic}} option that sets the Kafka > topic to save a DataFrame to. > 1. {{KafkaSourceProvider}} can use {{topic}} column to assign rows to Kafka > topics for writing > but what seems quite interesting is to support {{start(path: String)}} as the > least precedence option in which {{path}} would designate the default topic > when no other options are used. > {code} > df.writeStream.format("kafka").start(path = "topic") > {code} > See > http://apache-spark-developers-list.1001551.n3.nabble.com/KafkaSourceProvider-Why-topic-option-and-column-without-reverting-to-path-as-the-least-priority-td21458.html > for discussion -- This message was sent by Atlassian JIRA (v6.3.15#6346) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org