Re: Reasonable performance numbers?

2015-09-25 Thread Adrian Tanase
To: "user@spark.apache.org<mailto:user@spark.apache.org>" Cc: "Krumm, Greg" Subject: Reasonable performance numbers? Hello, I am doing performance testing with Spark Streaming. I want to know if the throughput numbers I am encountering are reasonable for the power of my cluster and

Reasonable performance numbers?

2015-09-24 Thread Young, Matthew T
Hello, I am doing performance testing with Spark Streaming. I want to know if the throughput numbers I am encountering are reasonable for the power of my cluster and Spark's performance characteristics. My job has the following processing steps: 1. Read 600 Byte JSON strings from a 7