[jira] [Assigned] (SPARK-8187) date/time function: date_sub

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8187: --- Assignee: (was: Apache Spark) > date/time function: date_sub > --

[jira] [Assigned] (SPARK-8185) date/time function: datediff

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8185: --- Assignee: (was: Apache Spark) > date/time function: datediff > --

[jira] [Commented] (SPARK-8185) date/time function: datediff

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583058#comment-14583058 ] Apache Spark commented on SPARK-8185: - User 'adrian-wang' has created a pull request f

[jira] [Assigned] (SPARK-8186) date/time function: date_add

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8186: --- Assignee: Apache Spark > date/time function: date_add > > >

[jira] [Commented] (SPARK-8187) date/time function: date_sub

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583060#comment-14583060 ] Apache Spark commented on SPARK-8187: - User 'adrian-wang' has created a pull request f

[jira] [Commented] (SPARK-8186) date/time function: date_add

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583059#comment-14583059 ] Apache Spark commented on SPARK-8186: - User 'adrian-wang' has created a pull request f

[jira] [Assigned] (SPARK-8186) date/time function: date_add

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8186: --- Assignee: (was: Apache Spark) > date/time function: date_add > --

[jira] [Assigned] (SPARK-8187) date/time function: date_sub

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8187: --- Assignee: Apache Spark > date/time function: date_sub > > >

[jira] [Assigned] (SPARK-8185) date/time function: datediff

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8185: --- Assignee: Apache Spark > date/time function: datediff > > >

[jira] [Assigned] (SPARK-7284) Update streaming documentation for Spark 1.4.0 release

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7284: --- Assignee: Apache Spark (was: Tathagata Das) > Update streaming documentation for Spark 1.4.0

[jira] [Commented] (SPARK-7284) Update streaming documentation for Spark 1.4.0 release

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583054#comment-14583054 ] Apache Spark commented on SPARK-7284: - User 'tdas' has created a pull request for this

[jira] [Assigned] (SPARK-7284) Update streaming documentation for Spark 1.4.0 release

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7284: --- Assignee: Tathagata Das (was: Apache Spark) > Update streaming documentation for Spark 1.4.0

[jira] [Commented] (SPARK-7289) Combine Limit and Sort to avoid total ordering

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583042#comment-14583042 ] Apache Spark commented on SPARK-7289: - User 'cloud-fan' has created a pull request for

[jira] [Commented] (SPARK-7267) Push down Project when it's child is Limit

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583041#comment-14583041 ] Apache Spark commented on SPARK-7267: - User 'cloud-fan' has created a pull request for

[jira] [Commented] (SPARK-8234) misc function: md5

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583034#comment-14583034 ] Apache Spark commented on SPARK-8234: - User 'qiansl127' has created a pull request for

[jira] [Assigned] (SPARK-8234) misc function: md5

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8234: --- Assignee: (was: Apache Spark) > misc function: md5 > -- > >

[jira] [Assigned] (SPARK-8234) misc function: md5

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8234: --- Assignee: Apache Spark > misc function: md5 > -- > > Key: SPA

[jira] [Assigned] (SPARK-8323) Remove mapOutputTracker field in TaskSchedulerImpl

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8323: --- Assignee: (was: Apache Spark) > Remove mapOutputTracker field in TaskSchedulerImpl >

[jira] [Commented] (SPARK-8323) Remove mapOutputTracker field in TaskSchedulerImpl

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583033#comment-14583033 ] Apache Spark commented on SPARK-8323: - User 'yufan-liu' has created a pull request for

[jira] [Assigned] (SPARK-8323) Remove mapOutputTracker field in TaskSchedulerImpl

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8323: --- Assignee: Apache Spark > Remove mapOutputTracker field in TaskSchedulerImpl > ---

[jira] [Created] (SPARK-8323) Remove mapOutputTracker field in TaskSchedulerImpl

2015-06-11 Thread patrickliu (JIRA)
patrickliu created SPARK-8323: - Summary: Remove mapOutputTracker field in TaskSchedulerImpl Key: SPARK-8323 URL: https://issues.apache.org/jira/browse/SPARK-8323 Project: Spark Issue Type: Improv

[jira] [Resolved] (SPARK-6566) Update Spark to use the latest version of Parquet libraries

2015-06-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6566. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 5889 [https://github.com/

[jira] [Commented] (SPARK-8311) saveAsTextFile with Hadoop1 could lead to errors

2015-06-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14582977#comment-14582977 ] Shivaram Venkataraman commented on SPARK-8311: -- Yeah it looks very similar. I

[jira] [Commented] (SPARK-8322) EC2 script not fully updated for 1.4.0 release

2015-06-11 Thread Mark Smith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14582971#comment-14582971 ] Mark Smith commented on SPARK-8322: --- This is the backport to branch-1.4 > EC2 script no

[jira] [Commented] (SPARK-8322) EC2 script not fully updated for 1.4.0 release

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14582970#comment-14582970 ] Apache Spark commented on SPARK-8322: - User 'markmsmith' has created a pull request fo

[jira] [Updated] (SPARK-7862) Query would hang when the using script has error output in SparkSQL

2015-06-11 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7862: Assignee: zhichao-li > Query would hang when the using script has error output in SparkSQL >

[jira] [Commented] (SPARK-7442) Spark 1.3.1 / Hadoop 2.6 prebuilt pacakge has broken S3 filesystem access

2015-06-11 Thread Peng Cheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14582965#comment-14582965 ] Peng Cheng commented on SPARK-7442: --- Still not fixed in 1.4.0 ... reverting to hadoop 2.

[jira] [Resolved] (SPARK-7862) Query would hang when the using script has error output in SparkSQL

2015-06-11 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-7862. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6404 [https:/

[jira] [Issue Comment Deleted] (SPARK-8322) EC2 script not fully updated for 1.4.0 release

2015-06-11 Thread Mark Smith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Smith updated SPARK-8322: -- Comment: was deleted (was: This should probably also be back-ported from master to the 1.4 branch, but

[jira] [Resolved] (SPARK-8317) Do not push sort into shuffle in Exchange operator

2015-06-11 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-8317. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6772 [https:/

[jira] [Commented] (SPARK-8322) EC2 script not fully updated for 1.4.0 release

2015-06-11 Thread Mark Smith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14582948#comment-14582948 ] Mark Smith commented on SPARK-8322: --- This should probably also be back-ported from maste

[jira] [Assigned] (SPARK-8322) EC2 script not fully updated for 1.4.0 release

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8322: --- Assignee: Apache Spark > EC2 script not fully updated for 1.4.0 release > ---

[jira] [Updated] (SPARK-8322) EC2 script not fully updated for 1.4.0 release

2015-06-11 Thread Mark Smith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Smith updated SPARK-8322: -- Target Version/s: (was: 1.4.0) Fix Version/s: (was: 1.4.0) > EC2 script not fully updated f

[jira] [Commented] (SPARK-8322) EC2 script not fully updated for 1.4.0 release

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14582942#comment-14582942 ] Apache Spark commented on SPARK-8322: - User 'markmsmith' has created a pull request fo

[jira] [Assigned] (SPARK-8322) EC2 script not fully updated for 1.4.0 release

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8322: --- Assignee: (was: Apache Spark) > EC2 script not fully updated for 1.4.0 release >

[jira] [Commented] (SPARK-8322) EC2 script not fully updated for 1.4.0 release

2015-06-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14582937#comment-14582937 ] Sean Owen commented on SPARK-8322: -- Related to SPARK-8310. You'll probably want a PR for

[jira] [Created] (SPARK-8322) EC2 script not fully updated for 1.4.0 release

2015-06-11 Thread Mark Smith (JIRA)
Mark Smith created SPARK-8322: - Summary: EC2 script not fully updated for 1.4.0 release Key: SPARK-8322 URL: https://issues.apache.org/jira/browse/SPARK-8322 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-8311) saveAsTextFile with Hadoop1 could lead to errors

2015-06-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8311. -- Resolution: Duplicate Yes 95% sure that's a duplicate > saveAsTextFile with Hadoop1 could lead to error

[jira] [Commented] (SPARK-8318) Spark Streaming Starter JIRAs

2015-06-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14582929#comment-14582929 ] Sean Owen commented on SPARK-8318: -- Minor, but doesn't Component + label = starter alread

[jira] [Created] (SPARK-8321) Authorization Support(on all operations not only DDL) in Spark Sql

2015-06-11 Thread Sunil (JIRA)
Sunil created SPARK-8321: Summary: Authorization Support(on all operations not only DDL) in Spark Sql Key: SPARK-8321 URL: https://issues.apache.org/jira/browse/SPARK-8321 Project: Spark Issue Type:

[jira] [Commented] (SPARK-7768) Make user-defined type (UDT) API public

2015-06-11 Thread Patrick Grandjean (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14582871#comment-14582871 ] Patrick Grandjean commented on SPARK-7768: -- Registering UDTs for existing classes

[jira] [Commented] (SPARK-8120) Typos in warning message in sql/types.py

2015-06-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14582857#comment-14582857 ] Joseph K. Bradley commented on SPARK-8120: -- Hm, I must have not looked carefully.

[jira] [Closed] (SPARK-8120) Typos in warning message in sql/types.py

2015-06-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-8120. Resolution: Not A Problem > Typos in warning message in sql/types.py > -

[jira] [Assigned] (SPARK-8240) string function: concat

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8240: --- Assignee: Cheng Hao (was: Apache Spark) > string function: concat > ---

[jira] [Assigned] (SPARK-8240) string function: concat

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8240: --- Assignee: Apache Spark (was: Cheng Hao) > string function: concat > ---

[jira] [Commented] (SPARK-8240) string function: concat

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14582849#comment-14582849 ] Apache Spark commented on SPARK-8240: - User 'adrian-wang' has created a pull request f

[jira] [Assigned] (SPARK-8241) string function: concat_ws

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8241: --- Assignee: Apache Spark (was: Cheng Hao) > string function: concat_ws > -

[jira] [Commented] (SPARK-8241) string function: concat_ws

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14582850#comment-14582850 ] Apache Spark commented on SPARK-8241: - User 'adrian-wang' has created a pull request f

[jira] [Assigned] (SPARK-8241) string function: concat_ws

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8241: --- Assignee: Cheng Hao (was: Apache Spark) > string function: concat_ws > -

[jira] [Commented] (SPARK-8129) Securely pass auth secrets to executors in standalone cluster mode

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14582832#comment-14582832 ] Apache Spark commented on SPARK-8129: - User 'kanzhang' has created a pull request for

[jira] [Commented] (SPARK-6892) Recovery from checkpoint will also reuse the application id when write eventLog in yarn-cluster mode

2015-06-11 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14582829#comment-14582829 ] Tathagata Das commented on SPARK-6892: -- [~hshreedharan] Could you take a look at this

[jira] [Commented] (SPARK-8297) Scheduler backend is not notified in case node fails in YARN

2015-06-11 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14582796#comment-14582796 ] Saisai Shao commented on SPARK-8297: OK, thanks [~mridulm80], I will take a try, from

[jira] [Commented] (SPARK-8120) Typos in warning message in sql/types.py

2015-06-11 Thread Jihun Kang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14582797#comment-14582797 ] Jihun Kang commented on SPARK-8120: --- I think it works as expected. I had a following out

[jira] [Assigned] (SPARK-8319) Update logic related to key ordering in shuffle dependencies

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8319: --- Assignee: Apache Spark (was: Josh Rosen) > Update logic related to key ordering in shuffle d

[jira] [Commented] (SPARK-8319) Update logic related to key ordering in shuffle dependencies

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14582788#comment-14582788 ] Apache Spark commented on SPARK-8319: - User 'JoshRosen' has created a pull request for

[jira] [Assigned] (SPARK-8319) Update logic related to key ordering in shuffle dependencies

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8319: --- Assignee: Josh Rosen (was: Apache Spark) > Update logic related to key ordering in shuffle d

[jira] [Updated] (SPARK-7158) collect and take return different results

2015-06-11 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7158: Assignee: Cheng Hao > collect and take return different results > --

[jira] [Updated] (SPARK-8319) Update logic related to key ordering in shuffle dependencies

2015-06-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-8319: -- Summary: Update logic related to key ordering in shuffle dependencies (was: Update several pieces of sh

[jira] [Resolved] (SPARK-7158) collect and take return different results

2015-06-11 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-7158. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 5714 [https:/

[jira] [Commented] (SPARK-5575) Artificial neural networks for MLlib deep learning

2015-06-11 Thread Alexander Ulanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14582768#comment-14582768 ] Alexander Ulanov commented on SPARK-5575: - Hi Janani, There is already an implem

[jira] [Updated] (SPARK-8319) Update several pieces of shuffle logic related to key orderings

2015-06-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-8319: -- Summary: Update several pieces of shuffle logic related to key orderings (was: Enable Tungsten shuffle

[jira] [Updated] (SPARK-8319) Enable Tungsten shuffle manager for some shuffles that specify key orderings

2015-06-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-8319: -- Description: The Tungsten ShuffleManager falls back to regular SortShuffleManager whenever the shuffle

[jira] [Updated] (SPARK-8319) Enable Tungsten shuffle manager for some shuffles that specify key orderings

2015-06-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-8319: -- Description: The Tungsten ShuffleManager falls back to regular SortShuffleManager whenever the shuffle

[jira] [Updated] (SPARK-8318) Spark Streaming Starter JIRAs

2015-06-11 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-8318: - Description: This is a master JIRA to collect together all starter tasks related to Spark Streamin

[jira] [Updated] (SPARK-8319) Enable Tungsten shuffle manager for some shuffles that specify key orderings

2015-06-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-8319: -- Component/s: SQL > Enable Tungsten shuffle manager for some shuffles that specify key orderings > --

[jira] [Updated] (SPARK-8318) Spark Streaming Starter JIRAs

2015-06-11 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-8318: - Labels: starter (was: ) > Spark Streaming Starter JIRAs > - > >

[jira] [Created] (SPARK-8320) Add example in streaming programming guide that shows union of multiple input streams

2015-06-11 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-8320: Summary: Add example in streaming programming guide that shows union of multiple input streams Key: SPARK-8320 URL: https://issues.apache.org/jira/browse/SPARK-8320 P

[jira] [Created] (SPARK-8319) Enable Tungsten shuffle manager for some shuffles that specify key orderings

2015-06-11 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-8319: - Summary: Enable Tungsten shuffle manager for some shuffles that specify key orderings Key: SPARK-8319 URL: https://issues.apache.org/jira/browse/SPARK-8319 Project: Spark

[jira] [Created] (SPARK-8318) Spark Streaming Starter JIRAs

2015-06-11 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-8318: Summary: Spark Streaming Starter JIRAs Key: SPARK-8318 URL: https://issues.apache.org/jira/browse/SPARK-8318 Project: Spark Issue Type: Bug Compone

[jira] [Commented] (SPARK-8311) saveAsTextFile with Hadoop1 could lead to errors

2015-06-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14582741#comment-14582741 ] Patrick Wendell commented on SPARK-8311: Is this related to or the same as SPARK-8

[jira] [Comment Edited] (SPARK-5493) Support proxy users under kerberos

2015-06-11 Thread Jesika Haria (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14582720#comment-14582720 ] Jesika Haria edited comment on SPARK-5493 at 6/12/15 12:20 AM: -

[jira] [Commented] (SPARK-8317) Do not push sort into shuffle in Exchange operator

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14582724#comment-14582724 ] Apache Spark commented on SPARK-8317: - User 'JoshRosen' has created a pull request for

[jira] [Assigned] (SPARK-8317) Do not push sort into shuffle in Exchange operator

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8317: --- Assignee: Josh Rosen (was: Apache Spark) > Do not push sort into shuffle in Exchange operato

[jira] [Assigned] (SPARK-8317) Do not push sort into shuffle in Exchange operator

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8317: --- Assignee: Apache Spark (was: Josh Rosen) > Do not push sort into shuffle in Exchange operato

[jira] [Commented] (SPARK-5493) Support proxy users under kerberos

2015-06-11 Thread Jesika Haria (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14582720#comment-14582720 ] Jesika Haria commented on SPARK-5493: - Trying to support impersonation with the pyspar

[jira] [Resolved] (SPARK-8208) math function: ceiling

2015-06-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8208. Resolution: Fixed Fix Version/s: 1.5.0 > math function: ceiling > -- > >

[jira] [Resolved] (SPARK-8211) math function: radians

2015-06-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8211. Resolution: Fixed Fix Version/s: 1.5.0 > math function: radians > -- > >

[jira] [Resolved] (SPARK-8251) string function: alias upper / ucase

2015-06-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8251. Resolution: Fixed Fix Version/s: 1.5.0 > string function: alias upper / ucase > -

[jira] [Resolved] (SPARK-8229) conditional function: isnotnull

2015-06-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8229. Resolution: Fixed Fix Version/s: 1.5.0 > conditional function: isnotnull > --

[jira] [Resolved] (SPARK-8216) math function: rename log -> ln

2015-06-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8216. Resolution: Fixed Fix Version/s: 1.5.0 > math function: rename log -> ln > --

[jira] [Resolved] (SPARK-8225) math function: alias sign / signum

2015-06-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8225. Resolution: Fixed Fix Version/s: 1.5.0 > math function: alias sign / signum > ---

[jira] [Resolved] (SPARK-8228) conditional function: isnull

2015-06-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8228. Resolution: Fixed Fix Version/s: 1.5.0 > conditional function: isnull > -

[jira] [Resolved] (SPARK-8222) math function: alias power / pow

2015-06-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8222. Resolution: Fixed Fix Version/s: 1.5.0 > math function: alias power / pow > -

[jira] [Resolved] (SPARK-8219) math function: negative

2015-06-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8219. Resolution: Fixed Fix Version/s: 1.5.0 > math function: negative > --- >

[jira] [Resolved] (SPARK-8210) math function: degrees

2015-06-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8210. Resolution: Fixed Fix Version/s: 1.5.0 > math function: degrees > -- > >

[jira] [Resolved] (SPARK-8250) string function: alias lower/lcase

2015-06-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8250. Resolution: Fixed Fix Version/s: 1.5.0 > string function: alias lower/lcase > ---

[jira] [Resolved] (SPARK-8205) conditional function: nvl

2015-06-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8205. Resolution: Fixed Fix Version/s: 1.5.0 > conditional function: nvl >

[jira] [Resolved] (SPARK-8201) conditional function: if

2015-06-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8201. Resolution: Fixed Fix Version/s: 1.5.0 > conditional function: if >

[jira] [Resolved] (SPARK-7824) Collapsing operator reordering and constant folding into a single batch to push down the single side.

2015-06-11 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-7824. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6351 [https:/

[jira] [Updated] (SPARK-7824) Collapsing operator reordering and constant folding into a single batch to push down the single side.

2015-06-11 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7824: Assignee: Zhongshuai Pei > Collapsing operator reordering and constant folding into a single

[jira] [Commented] (SPARK-7780) The intercept in LogisticRegressionWithLBFGS should not be regularized

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14582707#comment-14582707 ] Apache Spark commented on SPARK-7780: - User 'holdenk' has created a pull request for t

[jira] [Assigned] (SPARK-8316) Upgrade Maven to 3.3.3

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8316: --- Assignee: Apache Spark > Upgrade Maven to 3.3.3 > -- > >

[jira] [Commented] (SPARK-8316) Upgrade Maven to 3.3.3

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14582701#comment-14582701 ] Apache Spark commented on SPARK-8316: - User 'nchammas' has created a pull request for

[jira] [Assigned] (SPARK-8316) Upgrade Maven to 3.3.3

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8316: --- Assignee: (was: Apache Spark) > Upgrade Maven to 3.3.3 > -- > >

[jira] [Created] (SPARK-8317) Do not push sort into shuffle in Exchange operator

2015-06-11 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-8317: - Summary: Do not push sort into shuffle in Exchange operator Key: SPARK-8317 URL: https://issues.apache.org/jira/browse/SPARK-8317 Project: Spark Issue Type: Improv

[jira] [Comment Edited] (SPARK-8301) Improve UTF8String substring/startsWith/endsWith/contains performance

2015-06-11 Thread Tarek Auel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14582691#comment-14582691 ] Tarek Auel edited comment on SPARK-8301 at 6/11/15 11:45 PM: -

[jira] [Commented] (SPARK-8301) Improve UTF8String substring/startsWith/endsWith/contains performance

2015-06-11 Thread Tarek Auel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14582691#comment-14582691 ] Tarek Auel commented on SPARK-8301: --- Another approach could be: (0 until b.length).fora

[jira] [Created] (SPARK-8316) Upgrade Maven to 3.3.3

2015-06-11 Thread Nicholas Chammas (JIRA)
Nicholas Chammas created SPARK-8316: --- Summary: Upgrade Maven to 3.3.3 Key: SPARK-8316 URL: https://issues.apache.org/jira/browse/SPARK-8316 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-7157) Add approximate stratified sampling to DataFrame

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14582684#comment-14582684 ] Apache Spark commented on SPARK-7157: - User 'mengxr' has created a pull request for th

[jira] [Assigned] (SPARK-7157) Add approximate stratified sampling to DataFrame

2015-06-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7157: --- Assignee: Xiangrui Meng (was: Apache Spark) > Add approximate stratified sampling to DataFra

  1   2   3   >