Re: metrics not reported by spark-cassandra-connector

2016-02-23 Thread Sa Xiao
Hi Yin, Thanks for your reply. I didn't realize there is a specific mailing list for spark-Cassandra-connector. I will ask there. Thanks! -Sa On Tuesday, February 23, 2016, Yin Yang wrote: > Hi, Sa: > Have you asked on spark-cassandra-connector mailing list ? > > Seems you

metrics not reported by spark-cassandra-connector

2016-02-23 Thread Sa Xiao
Hi there, I am trying to enable the metrics collection by spark-cassandra-connector, following the instruction here: https://github.com/datastax/spark-cassandra-connector/blob/master/doc/11_metrics.md However, I was not able to see any metrics reported. I'm using

Task hung on SocketInputStream.socketRead0 when reading large a mount of data from AWS S3

2015-12-07 Thread Sa Xiao
Hi, We encounter a problem very similar to this one: https://www.mail-archive.com/search?l=user@spark.apache.org=subject:%22Spark+task+hangs+infinitely+when+accessing+S3+from+AWS%22=newest=1 When reading large amount of data from S3, one or several tasks hung. It doesn't happen every time,