Re: unable to stream kafka messages

2017-08-24 Thread cbowden
the messages into kafka. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/unable-to-stream-kafka-messages-tp28537p29107.html Sent from the Apache Spark User List mailing list archive at Nabble.com

Re: unable to stream kafka messages

2017-03-27 Thread Michael Armbrust
.option("kafka.bootstrap.servers", >>>>>>> bootstrapServers) >>>>>>> .option(subscribeType, topics) >>>>>>> .load() >>>>>>>

Re: unable to stream kafka messages

2017-03-27 Thread kaniska Mandal
gt;>>> GROUP BY location"; >>>>>>Dataset countsByLocation = spark.sql(sql); >>>>>> >>>>>> StreamingQuery query = >>>>>> countsByLocation.writeStream() >>>>>> .outputMode("complete") >>>>>> .format("console") >>>>>> .start(); >>>>>> >>>>>> query.awaitTermination(); >>>>>> >>>>>> -- >>>>>> >>>>>> *Tweet * >>>>>> >>>>>> Tweet.java - has public constructor and getter / setter methods >>>>>> >>>>>> public class Tweet implements Serializable{ >>>>>> >>>>>> private String tweetId; >>>>>> private String tweetText; >>>>>> private String location; >>>>>> private String timestamp; >>>>>> >>>>>> public Tweet(){ >>>>>> >>>>>> } >>>>>> . >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> *pom.xml * >>>>>> >>>>>> >>>>>> >>>>>> org.apache.spark >>>>>> spark-core_2.10 >>>>>> 2.1.0 >>>>>> >>>>>> >>>>>> org.apache.spark >>>>>> spark-streaming_2.10 >>>>>> 2.1.0 >>>>>> >>>>>> >>>>>> org.apache.spark >>>>>> spark-streaming-ka >>>>>> fka-0-8_2.10 >>>>>> 2.1.0 >>>>>> >>>>>> >>>>>> org.apache.spark >>>>>> spark-sql_2.10 >>>>>> 2.1.0 >>>>>> >>>>>> >>>>>> org.apache.spark >>>>>> spark-sql-kafka-0-10_2.10 >>>>>> 2.1.0 >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> View this message in context: http://apache-spark-user-list. >>>>>> 1001560.n3.nabble.com/unable-to-stream-kafka-messages-tp28537.html >>>>>> Sent from the Apache Spark User List mailing list archive at >>>>>> Nabble.com. >>>>>> >>>>>> - >>>>>> To unsubscribe e-mail: user-unsubscr...@spark.apache.org >>>>>> >>>>>> >>>>> >>>> >>> >> >

Re: unable to stream kafka messages

2017-03-27 Thread Michael Armbrust
le") >>>>> .start(); >>>>> >>>>> query.awaitTermination(); >>>>> >>>>> -- >>>>> >>>>> *Tweet * >>>>> >>>>> Tweet.java - has public constructor and getter / setter methods >>>>> >>>>> public class Tweet implements Serializable{ >>>>> >>>>> private String tweetId; >>>>> private String tweetText; >>>>> private String location; >>>>> private String timestamp; >>>>> >>>>> public Tweet(){ >>>>> >>>>> } >>>>> . >>>>> >>>>> >>>>> >>>>> >>>>> *pom.xml * >>>>> >>>>> >>>>> >>>>> org.apache.spark >>>>> spark-core_2.10 >>>>> 2.1.0 >>>>> >>>>> >>>>> org.apache.spark >>>>> spark-streaming_2.10 >>>>> 2.1.0 >>>>> >>>>> >>>>> org.apache.spark >>>>> spark-streaming-ka >>>>> fka-0-8_2.10 >>>>> 2.1.0 >>>>> >>>>> >>>>> org.apache.spark >>>>> spark-sql_2.10 >>>>> 2.1.0 >>>>> >>>>> >>>>> org.apache.spark >>>>> spark-sql-kafka-0-10_2.10 >>>>> 2.1.0 >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> View this message in context: http://apache-spark-user-list. >>>>> 1001560.n3.nabble.com/unable-to-stream-kafka-messages-tp28537.html >>>>> Sent from the Apache Spark User List mailing list archive at >>>>> Nabble.com. >>>>> >>>>> - >>>>> To unsubscribe e-mail: user-unsubscr...@spark.apache.org >>>>> >>>>> >>>> >>> >> >

Re: unable to stream kafka messages

2017-03-27 Thread kaniska Mandal
query.awaitTermination(); >>>> >>>> -- >>>> >>>> *Tweet * >>>> >>>> Tweet.java - has public constructor and

Re: unable to stream kafka messages

2017-03-27 Thread Michael Armbrust
gt;>> >>> public class Tweet implements Serializable{ >>> >>> private String tweetId; >>> private String tweetText; >>> private String location; >>> private String timestamp; >>> >>> public Tweet(

Re: unable to stream kafka messages

2017-03-24 Thread kaniska Mandal
>> org.apache.spark >> spark-core_2.10 >> 2.1.0 >> >> >> org.apache.spark >> spark-stre

Re: unable to stream kafka messages

2017-03-24 Thread Michael Armbrust
gt; spark-streaming- > kafka-0-8_2.10 > 2.1.0 > > > org.apache.spark > spark-sql_2.10 > 2.1.0 > > > org.apache.spark > spark-sql-kafka-0-10_2.10 > 2.1.0 > > > > > > > -- > View this message in context: http://apache-spark-user-list. > 1001560.n3.nabble.com/unable-to-stream-kafka-messages-tp28537.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > - > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > >

unable to stream kafka messages

2017-03-24 Thread kaniska
park spark-sql-kafka-0-10_2.10 2.1.0 -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/unable-to-stream-kafka-messages-tp28537.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe e-mail: user-unsubscr...@spark.apache.org