Re: [VOTE] Release Apache Spark 2.4.1 (RC8)

2019-03-19 Thread Darcy Shen
-1 please backpoart SPARK-27160, a correctness issue about ORC native reader. see https://github.com/apache/spark/pull/24092 On Wed, 20 Mar 2019 06:21:29 +0800 DB Tsai wrote Please vote on releasing the following candidate as Apache Spark version 2.4.1. The vote is

[VOTE] Release Apache Spark 2.4.1 (RC8)

2019-03-19 Thread DB Tsai
Please vote on releasing the following candidate as Apache Spark version 2.4.1. The vote is open until March 23 PST and passes if a majority +1 PMC votes are cast, with a minimum of 3 +1 votes. [ ] +1 Release this package as Apache Spark 2.4.1 [ ] -1 Do not release this package because ... To

Re: [VOTE] [SPARK-24615] SPIP: Accelerator-aware Scheduling

2019-03-19 Thread Jörn Franke
Also on AWS and probably some more cloud providers > Am 19.03.2019 um 19:45 schrieb Steve Loughran : > > > you might want to look at the work on FPGA resources; again it should just be > a resource available by a scheduler. Key thing is probably just to keep the > docs generic > >

Re: [VOTE] [SPARK-24615] SPIP: Accelerator-aware Scheduling

2019-03-19 Thread Steve Loughran
you might want to look at the work on FPGA resources; again it should just be a resource available by a scheduler. Key thing is probably just to keep the docs generic https://hadoop.apache.org/docs/r3.1.0/hadoop-yarn/hadoop-yarn-site/UsingFPGA.html I don't know where you get those FPGAs to play

Re: [VOTE] [SPARK-24615] SPIP: Accelerator-aware Scheduling

2019-03-19 Thread Xiangrui Meng
Sean, thanks for your input and making a pass on the updated SPIP! As the next step, how about having a remote meeting to discuss the remaining topics? I started a doodle poll here . Due to time constraint, I suggest limiting the attendees to committers

Re: [VOTE] [SPARK-24615] SPIP: Accelerator-aware Scheduling

2019-03-19 Thread Sean Owen
This looks like a great level of detail. The broad strokes look good to me. I'm happy with just about any story around what to do with Mesos GPU support now, but might at least deserve a mention: does the existing Mesos config simply become a deprecated alias for the

Re: [build system] jenkins wedged again, rebooting master node

2019-03-19 Thread Imran Rashid
seems wedged again? sorry for the bad news Shane, thanks for all the work on fixing it On Mon, Mar 18, 2019 at 4:02 PM shane knapp wrote: > ok, i dug through the logs and noticed that rsyslogd was dropping messages > to do imuxsock being spammed by postfix... which i then tracked down to >