Re: Improving system design logging in spark

2016-04-21 Thread Ali Tootoonchian
node. If the block time is bigger than our expectation, from system design, we cannot identify which component is weakest link, storage or network. -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Improving-system-design-logging-in-spark-tp17291p17308

Re: Improving system design logging in spark

2016-04-20 Thread Takeshi Yamamuro
; when >> it fetches data from disk. >> 5. Average Network bandwidth: Average network throughput for each task >> when >> it fetches data from remote nodes. >> >> >> >> >> -- >> View this message in context: >&g

Re: Improving system design logging in spark

2016-04-20 Thread Ted Yu
it fetches data from disk. > 5. Average Network bandwidth: Average network throughput for each task when > it fetches data from remote nodes. > > > > > -- > View this message in context: > http://apache-spark-developers-list.1001551.n3.nabble.com/Improving-system-design

Improving system design logging in spark

2016-04-20 Thread atootoonchian
.nabble.com/Improving-system-design-logging-in-spark-tp17291.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com. - To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional commands, e-mail: dev