1 seems like its spending a lot of time in R (slicing the data I guess?) and
not with Spark
2 could you write it into a csv file locally and then read it from Spark?
From: ayan guha
Sent: Monday, October 8, 2018 11:21 PM
To: user
Subject: SparkR issue
Hi
We
Hello all,
Am using spark-2.3.0 and hadoop-2.7.4.
I have spark streaming application which listens to kafka topic, does some
transformation and writes to Oracle database using JDBC client.
Read events from Kafka as shown below;
m_oKafkaEvents =
