Re: [DISCUSS] Multiple columns adding/replacing support in PySpark DataFrame API

2021-04-29 Thread Saurabh Chawla
using the reflection code like this. or make changes in the code to merge the project with existing project in the plan, instead of adding the new project every time we call the "withColumn". +1 for exposing the *withColumns* Regards Saurabh Chawla On Thu, Apr 22, 2021 at 1:03 PM Yikun

Re: Spark master build hangs using parallel build option in maven

2020-01-17 Thread Saurabh Chawla
3 in master branch compared to spark 2.4.3. Not sure if it's due to some bug in maven version used in master or some new change added in the master branch that prevent the parallel build. Regards Saurabh Chawla On Sat, Jan 18, 2020 at 2:19 AM Sean Owen wrote: > I don't believe you can use a

Spark master build hangs using parallel build option in maven

2020-01-17 Thread Saurabh Chawla
from compile) (version managed from 1.3) [DEBUG]com.novocode:junit-interface:jar:0.11:test [DEBUG] org.scala-sbt:test-interface:jar:1.0:test [DEBUG] updateExcludesInDeps() I'll be very grateful if someone could help. Regards Saurabh Chawla