Re: org.apache.nifi.spark.NiFiReceiver and spark spark.streaming.receiver.maxRate

2017-09-18 Thread Andrew Grande
A typical production setup is to use Kafka in the middle. Andrew On Mon, Sep 18, 2017, 3:02 AM Margus Roo wrote: > Hi > > I need to take flow with Spark streaming from Nifi port. As we know > Spark supports spark.streaming.receiver.maxRate and > spark.streaming.receiver.backpressure > > Seems t

org.apache.nifi.spark.NiFiReceiver and spark spark.streaming.receiver.maxRate

2017-09-18 Thread Margus Roo
Hi I need to take flow with Spark streaming from Nifi port. As we know Spark supports spark.streaming.receiver.maxRate and spark.streaming.receiver.backpressure Seems that org.apache.nifi.spark.NiFiReceiver does support it at all. https://github.com/apache/nifi/tree/master/nifi-external/nifi