Re: A question about creating persistent table when in-memory catalog is used

2017-01-26 Thread Shuai Lin
ning has been resolved. Please fetch the latest master. You are unable > to create such a hive serde table without Hive support. > > Thanks, > > Xiao Li > > > 2017-01-23 0:01 GMT-08:00 Shuai Lin <linshuai2...@gmail.com>: > >> Cool, thanks for the info. &g

A question about creating persistent table when in-memory catalog is used

2017-01-22 Thread Shuai Lin
f there are other good reasons for the current logic. If not, I would propose to raise an error when creating the table in the first place. Thanks! Regards, Shuai Lin (@lins05)

Re: What is mainly different from a UDT and a spark internal type that ExpressionEncoder recognized?

2017-01-02 Thread Shuai Lin
Disclaimer: I'm not a spark guru, and what's written below are some notes I took when reading spark source code, so I could be wrong, in which case I'd appreciate a lot if someone could correct me. > > Let me rephrase this. How does the SparkSQL engine call the codegen APIs > to > do the job of

Re: SPARK-18689: A proposal for priority based app scheduling utilizing linux cgroups.

2016-12-03 Thread Shuai Lin
Sorry but I don't get the scope of the problem from your description. Seems it's an improvement for spark standalone scheduler (i.e. not for yarn or mesos)? On Sat, Dec 3, 2016 at 4:27 AM, Hegner, Travis wrote: > Hello, > > > I've just created a JIRA to open up