Re: Can anyone edit JIRAs SPARK-19191 to SPARK-19202?

2017-01-13 Thread Artur Sukhenko
87890.html> On Fri, Jan 13, 2017 at 4:35 PM Sean Owen wrote: > Yes, I'm asking about a specific range: 19191 - 19202. These seem to be > the ones created during the downtime. Most are duplicates or incomplete. > > On Fri, Jan 13, 2017 at 2:32 PM Artur Sukhenko > wrote: >

Re: Can anyone edit JIRAs SPARK-19191 to SPARK-19202?

2017-01-13 Thread Artur Sukhenko
gt; > Yes, I certainly know how resolving issues works but it's suddenly today > only working for a subset of issues, and I bet it's related to the JIRA > problems this week. > > On Fri, Jan 13, 2017 at 1:55 PM Artur Sukhenko > wrote: > > Hello Sean, > > I can

Re: Can anyone edit JIRAs SPARK-19191 to SPARK-19202?

2017-01-13 Thread Artur Sukhenko
-19190 was similarly borked but closed by its owner. > -- -- Artur Sukhenko

[Spark Thriftserver] connection timeout option?

2016-11-23 Thread Artur Sukhenko
available parameter which can achieve idle timeout results for spark(thrift server) ? Will this require a new development or if its even possible ? Sincerely, Artur -- -- Artur Sukhenko

Re: Is it possible to pass "-javaagent=customAgent.jar" into spark as a JAVA_OPTS

2016-11-23 Thread Artur Sukhenko
rom spark > to my agent. I wanted to know if anyone has tried this and if so what > environment variable do I need to set ? > > Do I set: $SPARK_DAEMON_JAVA_OPTS ?? > > > http://docs.oracle.com/javase/7/docs/api/java/lang/instrument/package-summary.html > > > Thank you, > Zak Hassan > > -- -- Artur Sukhenko

Re: NodeManager heap size with ExternalShuffleService

2016-11-16 Thread Artur Sukhenko
er 15, 2016 at 12:45:57 PM, Artur Sukhenko ( artur.sukhe...@gmail.com) wrote: Hello guys, When you enable ExternalShuffleService (spark-shuffle) in NodeManager, there are no suggestions of increasing NM heap size in Spark docs or anywhere else, shouldn't we include this in spark's docume

NodeManager heap size with ExternalShuffleService

2016-11-15 Thread Artur Sukhenko
ase of its GC pauses spark can become very slow when tasks are doing shuffle. I don't think users are aware of NM becoming bottleneck. Sincerely, Artur Sukhenko -- -- Artur Sukhenko

Re: shuffle files not deleted after executor restarted

2016-09-02 Thread Artur Sukhenko
ed > anymore, we want them to be deleted instead of taking up valuable SSD space. > > Not very familiar with external shuffle service though. Is it going to > help in this case? -:) > > 在 2016年9月2日,下午5:40,Artur Sukhenko 写道: > > Hi Yang, > > Isn't external shuffle

Re: shuffle files not deleted after executor restarted

2016-09-02 Thread Artur Sukhenko
fe > to delete the old directory manually only leaving the newest one? > > Here is the executor’s local directory. > > > Any advice on this? > > Thanks. > > Yang > > > > > - > To unsubscribe e-mail: dev-unsubscr...@spark.apache.org > > > -- -- Artur Sukhenko

Remaining folders in .sparkStaging directory after app was killed

2016-08-29 Thread Artur Sukhenko
, the only way to clean them is to manually remove them from hdfs? --- Sincerely, Artur Sukhenko