Re: NoClassDefFoundError: scala/Product$class

How are you depending on that org.bdgenomics.adam library? Maybe you're pulling the 2.11 version of that.

Add python library

" > Have you looked into this article? https://medium.com/@SSKahani/pyspark-applications-dependencies-99415e0df987 " This is weird ! I was hanging out here https://machinelearningmastery.com/start-here/. When I came across this post. The weird part is I was just wondering how I can take one

[pyspark 2.3+] Add scala library to pyspark app and use to derive columns

Hi All, I have a use case where I need to utilize java/scala for regex mapping (as lookbehinds are not well supported with python).. However our entire code is python based so was wondering if there's a suggested way of creating a scala/java lib and use that within pyspark.. I came across this,

Unsubscribe

Re: NoClassDefFoundError: scala/Product$class

Spark 3 supports only Scala 2.12. This actually sounds like third party library is compiled for 2.11 or something. On Fri, Jun 5, 2020 at 11:11 PM charles_cai <1620075...@qq.com> wrote: > Hi Pol, > > thanks for your suggestion, I am going to use Spark-3.0.0 for GPU > acceleration,so I update the

Re: Add python library with native code

Great, thank you Masood, will look into it. Regards, Stone On Fri, Jun 5, 2020 at 7:47 PM Masood Krohy wrote: > Not totally sure it's gonna help your use case, but I'd recommend that you > consider these too: > >- pex A library and tool for >