Re: spark messing up handling of native dependency code?

I read http://techblog.applift.com/upgrading-spark an conducted further research. I think there is some problem with the class loader. Unfortunately, so far, I did not get it to work. Georg Heiler schrieb am Sa., 3. Juni 2017 um 08:27 Uhr: > When tested without any parallelism the same problem

[VOTE] Apache Spark 2.2.0 (RC4)

Please vote on releasing the following candidate as Apache Spark version 2.2.0. The vote is open until Thurs, June 8th, 2017 at 12:00 PST and passes if a majority of at least 3 +1 PMC votes are cast. [ ] +1 Release this package as Apache Spark 2.2.0 [ ] -1 Do not release this package because ...

Re: [VOTE] Apache Spark 2.2.0 (RC4)

Xiao opened a blocker on 2.2.0 this morning: SPARK-20980 Rename the option `wholeFile` to `multiLine` for JSON and CSV I don't see that this should block? We still have 7 Critical issues: SPARK-20520 R streaming tests failed on Windows SPARK-20512 SparkR 2.2 QA: Programming guide, migration gui

Re: [VOTE] Apache Spark 2.2.0 (RC4)

I commented on that JIRA, I don't think that should block the release. We can support both options long term if this vote passes. Looks like the remaining JIRAs are doc/website updates that can happen after the vote or QA that should be done on this RC. I think we are ready to start testing this

Re: [VOTE] Apache Spark 2.2.0 (RC4)

Hi, Michael. Can we be more clear on deprecation messages in 2.2.0-RC4 documentation? > Spark runs on Java 8+, Python 2.6+/3.4+ and R 3.1+. -> Python 2.7+ ? https://issues.apache.org/jira/browse/SPARK-12661 (Status: `Open`, Target Version: `2.2.0`, Label: `ReleaseNotes`) > Note that su

Re: [VOTE] Apache Spark 2.2.0 (RC4)

(I apologize for going on about this, but I've asked ~4 times: could you make the URLs here in the form email HTTPS URLs? It sounds minor, but we're asking people to verify the integrity of software and hashes, and this is the one case where it is actually important.) The "2.2" JIRAs don't look li

Re: [VOTE] Apache Spark 2.2.0 (RC4)

On the latest Ubuntu, Java 8, with -Phive -Phadoop-2.7 -Pyarn, this passes all tests. It's looking good, pending a double-check on the outstanding JIRA questions. All the hashes and sigs are correct. On Mon, Jun 5, 2017 at 8:15 PM Michael Armbrust wrote: > Please vote on releasing the following

Re: [VOTE] Apache Spark 2.2.0 (RC4)

Apologies for messing up the https urls. My mistake. I'll try to get it right next time. Regarding the readiness of this and previous RCs. I did cut RC1 & RC2 knowing that they were unlikely to pass. That said, I still think these early RCs are valuable. I know several users that wanted to tes

Spark on Kubernetes: Birds-of-a-Feather Session 12:50pm 6/6

Come learn about the community development project to add a native Kubernetes scheduling back-end to Apache Spark! Meet contributors and network with community members interested in running Spark on Kubernetes. Learn how to run Spark jobs on your Kubernetes cluster; find out how to contribute to t

RE: Spark on Kubernetes: Birds-of-a-Feather Session 12:50pm 6/6

HI Erik, Can you please share the details (Timezone, Webex Details)? Thanks, Deepu Raj From: Erik Erlandson [mailto:eerla...@redhat.com] Sent: Tuesday, 6 June 2017 10:28 AM To: dev@spark.apache.org Subject: Spark on Kubernetes: Birds-of-a-Feather Session 12:50pm 6/6 Come learn about the communi

Re: Spark on Kubernetes: Birds-of-a-Feather Session 12:50pm 6/6

Very much looking forward to this session! Raj, it's a spark summit session: https://spark-summit.org/2017/schedule/ 12:50 PM Lunch BoF Discussion-Deep Learning on Apache Spark - Jason Dai (Intel) There are increasing interest and applicatio

Re: [VOTE] Apache Spark 2.2.0 (RC4)

+1 (non-binding) I tested it on Ubuntu 16.04 and OpenJDK8 on ppc64le. All of the tests for core have passed. $ java -version openjdk version "1.8.0_111" OpenJDK Runtime Environment (build 1.8.0_111-8u111-b14-2ubuntu0.16.04.2-b14) OpenJDK 64-Bit Server VM (build 25.111-b14, mixed mode) $ build/m