Re: Adding JIRA ID as the prefix for the test case name

2019-11-21 Thread Hyukjin Kwon
I opened a PR - https://github.com/apache/spark-website/pull/232 2019년 11월 19일 (화) 오전 9:22, Hyukjin Kwon 님이 작성: > Let me document as below in few days: > > 1. For Python and Java, write a single comment that starts with JIRA ID > and short description, e.g. (SPARK-X: test blah blah) > 2. For

Re: Enabling fully disaggregated shuffle on Spark

2019-11-21 Thread Peter Rudenko
Hi, Peter from Mellanox here. Would be interested in this event. I've been working on accelerating Spark shuffle using RDMA (Remote direct memory access) technologies. Now we're in the process of releasing SparkUCX (https://github.com/openucx/sparkucx) - Spark shuffle acceleration based on the UCX