Re: IDEA compile fail but sbt test succeed

in arguments to *-parameters) private def doReturn(value: Any) = org.mockito.Mockito.doReturn(value, Seq.empty: _*) | | AlphaBetaGo | | alphabet...@163.com | -- Pasha Finkelshteyn Developer Advocate @ JetBrains - To unsubscribe e

Re: Spark Architecture Question

Hi Renganathan, Not quite. It strongly depends on your usage of UDFs defined in any manner — as UDF object or just lambdas. If you have ones — they may and will be called on executors too. On 21/07/29 05:17, Renganathan Mutthiah wrote: > Hi, > > I have read in many materials (including from the

Re: Apache Spark

Hi Andrey, It looks like you may contact Databricks for that. Also it would be easier for non-russian spaekers to respond you if your name would be written in English. On 21/01/26 12:41PM, Синий Андрей wrote: > Hello! > > We plan to use Apache Spark software in our organization, can I purchase

Re: Need your help!! (URGENT Code works fine when submitted as java main but part of data missing when running as Spark-Submit)

Hi Rachana, Couls you please provide us with mre details: Minimal repro Spark version Java version Scala version On 20/07/21 08:27AM, Rachana Srivastava wrote: > I am unable to identify the root cause of why my code is missing data when I > run as spark-submit but the code works fine when I

Re: Kotlin Spark API

Hi Stephen, Thank you so much for finding time for looking at our examples! Yes, we've tried to implement as clean design of API as possible and are constantly looking for ways to make it even more readable, clear and friendly. And as Maria already stated we welcome any feedback! On 20/07/14

Re: Running Apache Spark Streaming on the GraalVM Native Image

Hi Ivo, I believe there's absolutely no way that Spark will work on GraalVM Native Image because Spark generates code and loads classes in runtime, while GraalVM Native Image works only in closed world and has no any way to load classes which are not present in classpath at compie time. On

Re: Different execution results with wholestage codegen on and off

Here[1] it is, please review [1] https://issues.apache.org/jira/browse/SPARK-31854 On 20/05/27 10:21PM, Xiao Li wrote: > Thanks for reporting it. Please open a JIRA with a test case. > > Cheers, > > Xiao > > On Wed, May 27, 2020 at 1:42 PM Pasha Finkelshteyn < > p

Different execution results with wholestage codegen on and off

Hi folks, I'm implementing Kotlin bindings for Spark and faced strange problem. In one cornercase Spark works differently when wholestage codegen is on or off. Does it look like bug ot expected behavior? -- Regards, Pasha Big Data Tools @ JetBrains signature.asc Description: PGP signature