Re: Why don't we imp some adaptive learning rate methods, such as adadelat, adam?

2016-12-11 Thread Liang-Chi Hsieh
Hi, There is a plan to add this into Spark ML. Please check out https://issues.apache.org/jira/browse/SPARK-18023. You can also follow this jira to get the latest update. - Liang-Chi Hsieh | @viirya Spark Technology Center http://www.spark.tc/ -- View this message in context:

Re: Question about SPARK-11374 (skip.header.line.count)

2016-12-11 Thread Dongjoon Hyun
Thank you for the opinion, Mingjie and Liang-Chi. Dongjoon. On Sun, Dec 11, 2016 at 5:42 PM, Liang-Chi Hsieh wrote: > Hi Dongjoon, > > I know some people only use Spark SQL with SQL syntax not Dataset API. So I > think it should be useful to provide a way to do this in SQL. >

Re: Question about SPARK-11374 (skip.header.line.count)

2016-12-11 Thread Liang-Chi Hsieh
Hi Dongjoon, I know some people only use Spark SQL with SQL syntax not Dataset API. So I think it should be useful to provide a way to do this in SQL. - Liang-Chi Hsieh | @viirya Spark Technology Center -- View this message in context:

Re: Wrting data from Spark streaming to AWS Redshift?

2016-12-11 Thread kant kodali
@shyla a side question: What does Redshift can do that Spark cannot do? Trying to understand your use case. On Fri, Dec 9, 2016 at 8:47 PM, ayan guha wrote: > Ideally, saving data to external sources should not be any different. give > the write options as stated in the