Re: MatrixUDT and VectorUDT in Spark ML

2018-05-30 Thread Dongjin Lee
How is this issue going? Is there any Jira ticket about this? Thanks, Dongjin On Sat, Mar 24, 2018 at 1:39 PM, Himanshu Mohan < himanshu.mo...@aexp.com.invalid> wrote: > I agree > > > > > > > > Thanks > > Himanshu > > > > *From:* Li Jin [mailto:ice.xell...@gmail.com] > *Sent:* Friday, March 23,

Re: Spark version for Mesos 0.27.0

2018-05-30 Thread Thodoris Zois
Hello, I need Mesos 0.27 for specific purposes and unfortunately I can’t use a newer version. Did you find anything? Could it be Spark 1.6? Except that, from which version Spark supports dynamic allocation on Mesos? - Thodoris > On 25 May 2018, at 16:06, Jacek Laskowski wrote: > > Hi, >

Spark on Kubernetes plan for 2.4

2018-05-30 Thread Yinan Li
On behalf of folks who work on Spark on Kubernetes, I would like to share a doc on the plan for Spark on Kubernetes features and changes for the upcoming 2.4 release. Please take a look if you are interested.

Re: Unable to alter partition. The transaction for alter partition did not commit successfully.

2018-05-30 Thread naresh Goud
What are you doing? Give more details o what are you doing On Wed, May 30, 2018 at 12:58 PM Arun Hive wrote: > > Hi > > While running my spark job component i am getting the following exception. > Requesting for your help on this: > Spark core version - > spark-core_2.10-2.1.1 > > Spark

[VOTE] SPIP ML Pipelines in R

2018-05-30 Thread Hossein
Hi, I started discussion thread for a new R package to expose MLlib pipelines in R . To

Re: [SQL] Purpose of RuntimeReplaceable unevaluable unary expressions?

2018-05-30 Thread Reynold Xin
SQL expressions? On Wed, May 30, 2018 at 11:09 AM Jacek Laskowski wrote: > Hi, > > I've been exploring RuntimeReplaceable expressions [1] and have been > wondering what their purpose is. > > Quoting the scaladoc [2]: > > > An expression that gets replaced at runtime (currently by the optimizer)

[SQL] Purpose of RuntimeReplaceable unevaluable unary expressions?

2018-05-30 Thread Jacek Laskowski
Hi, I've been exploring RuntimeReplaceable expressions [1] and have been wondering what their purpose is. Quoting the scaladoc [2]: > An expression that gets replaced at runtime (currently by the optimizer) into a different expression for evaluation. This is mainly used to provide compatibility

Re: Unable to alter partition. The transaction for alter partition did not commit successfully.

2018-05-30 Thread Arun Hive
Hi  While running my spark job component i am getting the following exception. Requesting for your help on this:Spark core version - spark-core_2.10-2.1.1 Spark streaming version -spark-streaming_2.10-2.1.1 Spark hive version -spark-hive_2.10-2.1.1 2018-05-28 00:08:04,317  

Closing IPC connection

2018-05-30 Thread Arun Hive
Hi, While running my spark job component i am getting the following exception. Requesting for your help on this:Spark core version - spark-core_2.10-2.1.1 Spark streaming version -spark-streaming_2.10-2.1.1 Spark hive version -spark-hive_2.10-2.1.1 b-executor-0] DEBUG (Client.java:428) - The

Re: Revisiting Online serving of Spark models?

2018-05-30 Thread Denny Lee
I most likely will not be able to join SF next week but definitely up for a session after Summit in Seattle to dive further into this, eh?! On Wed, May 30, 2018 at 9:32 AM Felix Cheung wrote: > Hi! > > Thank you! Let’s meet then > > June 6 4pm > > Moscone West Convention Center > 800 Howard

Re: Revisiting Online serving of Spark models?

2018-05-30 Thread Felix Cheung
Hi! Thank you! Let’s meet then June 6 4pm Moscone West Convention Center 800 Howard Street, San Francisco, CA 94103 Ground floor (outside of conference area - should be available for all) - we will meet and decide where to go (Would not send invite because that would be too much noise for