Fwd: Spark 2.4.4, RPC encryption and Python

2020-01-19 Thread Luca Toscano
Hi everybody, trying to ask the same question in dev@ since it would be helpful some info about how to debug this :) Thanks in advance, Luca -- Forwarded message - Da: Luca Toscano Date: gio 16 gen 2020 alle ore 09:16 Subject: Spark 2.4.4, RPC encryption and Python To: Hi

Correctness and data loss issues

2020-01-19 Thread Dongjoon Hyun
Hi, All. According to our policy, "Correctness and data loss issues should be considered Blockers". - http://spark.apache.org/contributing.html Since we are close to branch-3.0 cut, I want to ask your opinions on the following correctness and data loss issues. SPARK-30218 Columns used

Re: [Discuss] Metrics Support for DS V2

2020-01-19 Thread Sandeep Katta
Please send me the patch , I will apply and test. On Fri, 17 Jan 2020 at 10:33 PM, Ryan Blue wrote: > We've implemented these metrics in the RDD (for input metrics) and in the > v2 DataWritingSparkTask. That approach gives you the same metrics in the > stage views that you get with v1 sources,