Hi,
    I'm testing Beam on Spark.
    I use spark example code WordCount processing 1G data file, cost 1 minutes.
    However, I use Beam example code WordCount processing the same file, cost 
30minutes.
    My Spark parameter is :  --deploy-mode client  --executor-memory 1g 
--num-executors 1 --driver-memory 1g
    My Spark version is 2.3.1,  Beam version is 2.5
    Is there any optimization method?
Thank you.


Reply via email to