[Announcement] Analytics Zoo 0.5 release

Hi all, We are happy to announce the 0.5 release of Analytics Zoo , a unified Analytics + AI platform for *distributed TensorFlow, Keras & BigDL on Apache Spark*; some of the notable new features in this release are: - tfpark

Re: A basic question

Thank you so much Deepak. Let me implement and update you. Hope it works. Any short-comings I need to consider or take care of ? Regards, Shyam On Mon, Jun 17, 2019 at 12:39 PM Deepak Sharma wrote: > You can follow this example: > >

Re: Filter cannot be pushed via a Join

Hi, Can I ask which is the version of SPARK you are using? And in what environment? Regards, Gourav On Fri, Jun 14, 2019 at 5:14 PM William Wong wrote: > Dear all, > > I created two tables. > > scala> spark.sql("CREATE TABLE IF NOT EXISTS table1(id string, val string) > USING PARQUET"); >

Re: Exposing JIRA issue types at GitHub PRs

Dongjoon, I think it's useful. Thanks for adding it! On Mon, Jun 17, 2019 at 8:05 AM Dongjoon Hyun wrote: > Thank you, Hyukjin ! > > On Sun, Jun 16, 2019 at 4:12 PM Hyukjin Kwon wrote: > >> Labels look good and useful. >> >> On Sat, 15 Jun 2019, 02:36 Dongjoon Hyun, >> wrote: >> >>> Now, you

Re: Spark read csv option - capture exception in a column in permissive mode

You can sort of hack this by reading it as an RDD[String] and trying to implement a custom parser i.e. Val rddRows = rdd.map parseMyCols Def parseMyCols(rawVal: String) : Row = { parse(rawVal) match { case Success(parsedRowValues) = > Row(parsedRowValues :+ “”: _*) case Failure(exception) =>

Re: A basic question

You can follow this example: https://docs.spring.io/spring-hadoop/docs/current/reference/html/springandhadoop-spark.html On Mon, Jun 17, 2019 at 12:27 PM Shyam P wrote: > I am developing a spark job using java1.8v. > > Is it possible to write a spark app using spring-boot technology? > Did

A basic question

I am developing a spark job using java1.8v. Is it possible to write a spark app using spring-boot technology? Did anyone tried it ? if so how it should be done? Regards, Shyam

Re: Exposing JIRA issue types at GitHub PRs

Thank you, Hyukjin ! On Sun, Jun 16, 2019 at 4:12 PM Hyukjin Kwon wrote: > Labels look good and useful. > > On Sat, 15 Jun 2019, 02:36 Dongjoon Hyun, wrote: > >> Now, you can see the exposed component labels (ordered by the number of >> PRs) here and click the component to search. >> >>