Re: [VOTE] Spark 2.3.0 (RC3)

-1 for me as we elevated https://issues.apache.org/jira/browse/SPARK-23377 to a Blocker. It should be fixed before release. On Thu, 15 Feb 2018 at 07:25 Holden Karau wrote: > If this is a blocker in your view then the vote thread is an important > place to mention it.

Re: [VOTE] Spark 2.3.0 (RC3)

If this is a blocker in your view then the vote thread is an important place to mention it. I'm not super sure all of the places these methods are used so I'll defer to srowen and folks, but for the ML related implications in the past we've allowed people to set the hashing function when we've

Re: [VOTE] Spark 2.3.0 (RC3)

I was advised to post here in the discussion at GitHub. I do not know what to do about the problem that discussions dispersing in two places. -- Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ - To

Re: [VOTE] Spark 2.3.0 (RC3)

So it's currently tagged as minor and under consideration for 2.4.0. Do you think this priority is incorrect? This doesn't seem like a regression or a correctness issue so normally we wouldn't hold the release. Of course your free to vote how you choose, just providing some additional context

Re: Why python cluster mode is not supported in standalone cluster?

+dev mailing list(since i didn't get a response from user DL) On Tue, Feb 13, 2018 at 12:20 PM, Ashwin Sai Shankar wrote: > Hi Spark users! > I noticed that spark doesn't allow python apps to run in cluster mode in > spark standalone cluster. Does anyone know the reason? I

Re: A new external catalog

Newbie question: I want to add system/integration tests for the new functionality. There are a set of existing tests around Spark Catalog that I can leverage. Great. The provider I’m writing is backed by a web service though which is part of an AWS account. I can write the tests using a mocked

Apache EU Roadshow CFP Closing Soon (23 February)

Hello Everyone This is an initial reminder to let you all know that we are holding an Apache EU Roadshow co-located with FOSS Backstage in Berlin on 13^th and 14^th June 2018. https://s.apache.org/tCHx The Call for Proposals (CFP) for the Apache EU Roadshow is currently open and will close

Re: [VOTE] Spark 2.3.0 (RC3)

I'm -1 because of this issue. I want to fix the hashing implementation in FeatureHasher before FeatureHasher released in 2.3.0. https://issues.apache.org/jira/browse/SPARK-23381 https://github.com/apache/spark/pull/20568 I will fix it soon. -- Sent from:

Re: A new external catalog

Thanks a lot Steve. I’ll go through the Jira’s you linked in detail. I took a quick look and am sufficiently scared for now. I had run into that warning from the S3 stream before. Sigh. From: Steve Loughran Date: Tuesday, February 13, 2018 at 5:01 PM To: "Tayyebi,

Re: Regarding NimbusDS JOSE JWT jar 3.9 security vulnerability

Hi Steve, While we are building spark 2.1 version this particular JWT jar is getting added as part of transitive dependency of Hadoop-auth-2.7.2 project. I discussed with one of the Hadoop pmc, he will analyse the impact of this particular issue in Hadoop . Once I will get more information I

Re: Regarding NimbusDS JOSE JWT jar 3.9 security vulnerability

might be coming in transitively https://issues.apache.org/jira/browse/HADOOP-14799 On 13 Feb 2018, at 18:18, PJ Fanning > wrote: Hi Sujith, I didn't find the nimbusds dependency in any spark 2.2 jars. Maybe I missed something. Could you tell us