[jira] [Assigned] (SPARK-12771) Improve code generation for CaseWhen

2016-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12771: Assignee: (was: Apache Spark) > Improve code generation for CaseWhen > ---

[jira] [Commented] (SPARK-12771) Improve code generation for CaseWhen

2016-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095790#comment-15095790 ] Apache Spark commented on SPARK-12771: -- User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-12771) Improve code generation for CaseWhen

2016-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12771: Assignee: Apache Spark > Improve code generation for CaseWhen > --

[jira] [Comment Edited] (SPARK-6817) DataFrame UDFs in R

2016-01-12 Thread Antonio Piccolboni (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095776#comment-15095776 ] Antonio Piccolboni edited comment on SPARK-6817 at 1/13/16 7:41 AM:

[jira] [Commented] (SPARK-6817) DataFrame UDFs in R

2016-01-12 Thread Antonio Piccolboni (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095776#comment-15095776 ] Antonio Piccolboni commented on SPARK-6817: --- My question made sense only wrt the

[jira] [Created] (SPARK-12800) Subtle bug on Spark Yarn Client under Kerberos Security Mode

2016-01-12 Thread Chester (JIRA)
Chester created SPARK-12800: --- Summary: Subtle bug on Spark Yarn Client under Kerberos Security Mode Key: SPARK-12800 URL: https://issues.apache.org/jira/browse/SPARK-12800 Project: Spark Issue Typ

[jira] [Created] (SPARK-12799) Simplify various string output for expressions

2016-01-12 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-12799: --- Summary: Simplify various string output for expressions Key: SPARK-12799 URL: https://issues.apache.org/jira/browse/SPARK-12799 Project: Spark Issue Type: Sub-

[jira] [Commented] (SPARK-6817) DataFrame UDFs in R

2016-01-12 Thread Weiqiang Zhuang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095756#comment-15095756 ] Weiqiang Zhuang commented on SPARK-6817: We did see both apply use cases. But the

[jira] [Commented] (SPARK-6817) DataFrame UDFs in R

2016-01-12 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095747#comment-15095747 ] Reynold Xin commented on SPARK-6817: Please take a look at the original design doc for

[jira] [Commented] (SPARK-6817) DataFrame UDFs in R

2016-01-12 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095745#comment-15095745 ] Sun Rui commented on SPARK-6817: [~rxin] Row-oriented R UDF is for SQL and is similar to P

[jira] [Comment Edited] (SPARK-6817) DataFrame UDFs in R

2016-01-12 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095734#comment-15095734 ] Jeff Zhang edited comment on SPARK-6817 at 1/13/16 7:09 AM: +1

[jira] [Commented] (SPARK-6817) DataFrame UDFs in R

2016-01-12 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095734#comment-15095734 ] Jeff Zhang commented on SPARK-6817: --- +1 on block based API, UDF would usually call other

[jira] [Comment Edited] (SPARK-6817) DataFrame UDFs in R

2016-01-12 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095721#comment-15095721 ] Reynold Xin edited comment on SPARK-6817 at 1/13/16 6:58 AM: -

[jira] [Comment Edited] (SPARK-6817) DataFrame UDFs in R

2016-01-12 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095721#comment-15095721 ] Reynold Xin edited comment on SPARK-6817 at 1/13/16 6:57 AM: -

[jira] [Comment Edited] (SPARK-6817) DataFrame UDFs in R

2016-01-12 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095721#comment-15095721 ] Reynold Xin edited comment on SPARK-6817 at 1/13/16 6:57 AM: -

[jira] [Commented] (SPARK-6817) DataFrame UDFs in R

2016-01-12 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095721#comment-15095721 ] Reynold Xin commented on SPARK-6817: [~sunrui] Why are you focusing on a row-based AP

[jira] [Commented] (SPARK-12692) Scala style: check no white space before comma and colon

2016-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095714#comment-15095714 ] Apache Spark commented on SPARK-12692: -- User 'sarutak' has created a pull request fo

[jira] [Assigned] (SPARK-12796) initial prototype: projection/filter/range

2016-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12796: Assignee: Apache Spark (was: Davies Liu) > initial prototype: projection/filter/range > -

[jira] [Commented] (SPARK-12796) initial prototype: projection/filter/range

2016-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095710#comment-15095710 ] Apache Spark commented on SPARK-12796: -- User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-12796) initial prototype: projection/filter/range

2016-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12796: Assignee: Davies Liu (was: Apache Spark) > initial prototype: projection/filter/range > -

[jira] [Created] (SPARK-12798) Broadcast hash join

2016-01-12 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12798: -- Summary: Broadcast hash join Key: SPARK-12798 URL: https://issues.apache.org/jira/browse/SPARK-12798 Project: Spark Issue Type: New Feature Reporter:

[jira] [Created] (SPARK-12797) Aggregation without grouping keys

2016-01-12 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12797: -- Summary: Aggregation without grouping keys Key: SPARK-12797 URL: https://issues.apache.org/jira/browse/SPARK-12797 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-12796) initial prototype: projection/filter/range

2016-01-12 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12796: -- Summary: initial prototype: projection/filter/range Key: SPARK-12796 URL: https://issues.apache.org/jira/browse/SPARK-12796 Project: Spark Issue Type: New Featur

[jira] [Updated] (SPARK-12795) Whole stage codegen

2016-01-12 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12795: --- Description: Whole stage codegen is used by some modern MPP databases to archive great performance.

[jira] [Commented] (SPARK-4226) SparkSQL - Add support for subqueries in predicates

2016-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095695#comment-15095695 ] Apache Spark commented on SPARK-4226: - User 'davies' has created a pull request for th

[jira] [Updated] (SPARK-12795) Whole stage codegen

2016-01-12 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12795: --- Summary: Whole stage codegen (was: Compile multiple operator into a single Java function to avoid th

[jira] [Created] (SPARK-12795) Compile multiple operator into a single Java function to avoid the overhead from materialize rows and Scala iterator

2016-01-12 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12795: -- Summary: Compile multiple operator into a single Java function to avoid the overhead from materialize rows and Scala iterator Key: SPARK-12795 URL: https://issues.apache.org/jira/brow

[jira] [Updated] (SPARK-12373) Type coercion rule of dividing two decimal values may choose an intermediate precision that does not have enough number of digits at the left of decimal point

2016-01-12 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12373: - Target Version/s: 2.0.0 (was: 1.6.1, 2.0.0) > Type coercion rule of dividing two decimal values may choo

[jira] [Resolved] (SPARK-12558) AnalysisException when multiple functions applied in GROUP BY clause

2016-01-12 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-12558. -- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved by pull request 1

[jira] [Updated] (SPARK-12558) AnalysisException when multiple functions applied in GROUP BY clause

2016-01-12 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12558: - Assignee: Dilip Biswal > AnalysisException when multiple functions applied in GROUP BY clause > -

[jira] [Comment Edited] (SPARK-12172) Consider removing SparkR internal RDD APIs

2016-01-12 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095605#comment-15095605 ] Sun Rui edited comment on SPARK-12172 at 1/13/16 4:50 AM: -- As Sp

[jira] [Commented] (SPARK-12172) Consider removing SparkR internal RDD APIs

2016-01-12 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095605#comment-15095605 ] Sun Rui commented on SPARK-12172: - As Spark is migrating from RDD API to Dataset API, aft

[jira] [Commented] (SPARK-6817) DataFrame UDFs in R

2016-01-12 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095600#comment-15095600 ] Sun Rui commented on SPARK-6817: [~shivaram] I first focus on the row-based UDF functional

[jira] [Created] (SPARK-12794) Support Defining and Registration of R UDF

2016-01-12 Thread Sun Rui (JIRA)
Sun Rui created SPARK-12794: --- Summary: Support Defining and Registration of R UDF Key: SPARK-12794 URL: https://issues.apache.org/jira/browse/SPARK-12794 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-12793) Support R UDF Evaluation

2016-01-12 Thread Sun Rui (JIRA)
Sun Rui created SPARK-12793: --- Summary: Support R UDF Evaluation Key: SPARK-12793 URL: https://issues.apache.org/jira/browse/SPARK-12793 Project: Spark Issue Type: Sub-task Components: Spa

[jira] [Created] (SPARK-12792) Refactor RRDD to support R UDF

2016-01-12 Thread Sun Rui (JIRA)
Sun Rui created SPARK-12792: --- Summary: Refactor RRDD to support R UDF Key: SPARK-12792 URL: https://issues.apache.org/jira/browse/SPARK-12792 Project: Spark Issue Type: Sub-task Component

[jira] [Commented] (SPARK-6817) DataFrame UDFs in R

2016-01-12 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095594#comment-15095594 ] Sun Rui commented on SPARK-6817: [~piccolbo] I am not sure If I understand your meaning. T

[jira] [Commented] (SPARK-6817) DataFrame UDFs in R

2016-01-12 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095590#comment-15095590 ] Sun Rui commented on SPARK-6817: [~mpollock], this PR will support row-based UDF. UDF oper

[jira] [Commented] (SPARK-6817) DataFrame UDFs in R

2016-01-12 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095588#comment-15095588 ] Sun Rui commented on SPARK-6817: Attached the first draft design doc, please review and gi

[jira] [Updated] (SPARK-6817) DataFrame UDFs in R

2016-01-12 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sun Rui updated SPARK-6817: --- Attachment: SparkR UDF Design Documentation v1.pdf > DataFrame UDFs in R > --- > >

[jira] [Assigned] (SPARK-12791) Simplify CaseWhen by breaking "branches" into "conditions" and "values"

2016-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12791: Assignee: Apache Spark (was: Reynold Xin) > Simplify CaseWhen by breaking "branches" into

[jira] [Commented] (SPARK-12791) Simplify CaseWhen by breaking "branches" into "conditions" and "values"

2016-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095537#comment-15095537 ] Apache Spark commented on SPARK-12791: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-12791) Simplify CaseWhen by breaking "branches" into "conditions" and "values"

2016-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12791: Assignee: Reynold Xin (was: Apache Spark) > Simplify CaseWhen by breaking "branches" into

[jira] [Created] (SPARK-12791) Simplify CaseWhen by breaking "branches" into "conditions" and "values"

2016-01-12 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-12791: --- Summary: Simplify CaseWhen by breaking "branches" into "conditions" and "values" Key: SPARK-12791 URL: https://issues.apache.org/jira/browse/SPARK-12791 Project: Spark

[jira] [Created] (SPARK-12790) Remove HistoryServer old multiple files format

2016-01-12 Thread Andrew Or (JIRA)
Andrew Or created SPARK-12790: - Summary: Remove HistoryServer old multiple files format Key: SPARK-12790 URL: https://issues.apache.org/jira/browse/SPARK-12790 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-10538) java.lang.NegativeArraySizeException during join

2016-01-12 Thread mayxine (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mayxine updated SPARK-10538: Attachment: java.lang.NegativeArraySizeException.png > java.lang.NegativeArraySizeException during join > -

[jira] [Resolved] (SPARK-12788) Simplify BooleanEquality by using casts

2016-01-12 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12788. - Resolution: Fixed Fix Version/s: 2.0.0 > Simplify BooleanEquality by using casts > ---

[jira] [Comment Edited] (SPARK-12635) More efficient (column batch) serialization for Python/R

2016-01-12 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095494#comment-15095494 ] Sun Rui edited comment on SPARK-12635 at 1/13/16 2:35 AM: -- [~dse

[jira] [Commented] (SPARK-12635) More efficient (column batch) serialization for Python/R

2016-01-12 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095494#comment-15095494 ] Sun Rui commented on SPARK-12635: - [~dselivanov] PySpark uses pickle and CloudPickle on p

[jira] [Resolved] (SPARK-12785) Implement columnar in memory representation

2016-01-12 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12785. - Resolution: Fixed Assignee: Nong Li Fix Version/s: 2.0.0 > Implement columnar in

[jira] [Commented] (SPARK-12728) Integrate SQL generation feature with native view

2016-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095478#comment-15095478 ] Apache Spark commented on SPARK-12728: -- User 'liancheng' has created a pull request

[jira] [Assigned] (SPARK-12728) Integrate SQL generation feature with native view

2016-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12728: Assignee: (was: Apache Spark) > Integrate SQL generation feature with native view > --

[jira] [Assigned] (SPARK-12728) Integrate SQL generation feature with native view

2016-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12728: Assignee: Apache Spark > Integrate SQL generation feature with native view > -

[jira] [Commented] (SPARK-12692) Scala style: check no white space before comma and colon

2016-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095425#comment-15095425 ] Apache Spark commented on SPARK-12692: -- User 'sarutak' has created a pull request fo

[jira] [Updated] (SPARK-9835) Iteratively reweighted least squares solver for GLMs

2016-01-12 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9835: - Shepherd: Xiangrui Meng Target Version/s: (was: ) > Iteratively reweighted least squ

[jira] [Commented] (SPARK-12650) No means to specify Xmx settings for SparkSubmit in yarn-cluster mode

2016-01-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095354#comment-15095354 ] Marcelo Vanzin commented on SPARK-12650: Can you try the other one ({{SPARK_SUBMI

[jira] [Commented] (SPARK-12789) Support order by index

2016-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095325#comment-15095325 ] Apache Spark commented on SPARK-12789: -- User 'zhichao-li' has created a pull request

[jira] [Assigned] (SPARK-12789) Support order by index

2016-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12789: Assignee: (was: Apache Spark) > Support order by index > -- > >

[jira] [Assigned] (SPARK-12789) Support order by index

2016-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12789: Assignee: Apache Spark > Support order by index > -- > >

[jira] [Updated] (SPARK-12558) AnalysisException when multiple functions applied in GROUP BY clause

2016-01-12 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12558: - Target Version/s: 1.6.1, 2.0.0 > AnalysisException when multiple functions applied in GROUP BY clause > -

[jira] [Created] (SPARK-12789) Support order by index

2016-01-12 Thread zhichao-li (JIRA)
zhichao-li created SPARK-12789: -- Summary: Support order by index Key: SPARK-12789 URL: https://issues.apache.org/jira/browse/SPARK-12789 Project: Spark Issue Type: Bug Components: SQL

[jira] [Commented] (SPARK-12788) Simplify BooleanEquality by using casts

2016-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095322#comment-15095322 ] Apache Spark commented on SPARK-12788: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-12788) Simplify BooleanEquality by using casts

2016-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12788: Assignee: Reynold Xin (was: Apache Spark) > Simplify BooleanEquality by using casts > ---

[jira] [Assigned] (SPARK-12788) Simplify BooleanEquality by using casts

2016-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12788: Assignee: Apache Spark (was: Reynold Xin) > Simplify BooleanEquality by using casts > ---

[jira] [Created] (SPARK-12788) Simplify BooleanEquality by using casts

2016-01-12 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-12788: --- Summary: Simplify BooleanEquality by using casts Key: SPARK-12788 URL: https://issues.apache.org/jira/browse/SPARK-12788 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-10066) Can't create HiveContext with spark-shell or spark-sql on snapshot

2016-01-12 Thread Amir Gur (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095282#comment-15095282 ] Amir Gur commented on SPARK-10066: -- Issue still need a resolution. SPARK-10528 has more

[jira] [Commented] (SPARK-10528) spark-shell throws java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable.

2016-01-12 Thread Amir Gur (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095277#comment-15095277 ] Amir Gur commented on SPARK-10528: -- Also SPARK-10066 seems the same, possibly another du

[jira] [Updated] (SPARK-12626) MLlib 2.0 Roadmap

2016-01-12 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-12626: -- Description: This is a master list for MLlib improvements we plan to have in Spark 2.0. Please

[jira] [Commented] (SPARK-12265) Spark calls System.exit inside driver instead of throwing exception

2016-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095195#comment-15095195 ] Apache Spark commented on SPARK-12265: -- User 'nraychaudhuri' has created a pull requ

[jira] [Updated] (SPARK-12626) MLlib 2.0 Roadmap

2016-01-12 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-12626: -- Description: This is a master list for MLlib improvements we plan to have in Spark 2.0. Please

[jira] [Assigned] (SPARK-12265) Spark calls System.exit inside driver instead of throwing exception

2016-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12265: Assignee: (was: Apache Spark) > Spark calls System.exit inside driver instead of throw

[jira] [Assigned] (SPARK-12265) Spark calls System.exit inside driver instead of throwing exception

2016-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12265: Assignee: Apache Spark > Spark calls System.exit inside driver instead of throwing excepti

[jira] [Updated] (SPARK-10388) Public dataset loader interface

2016-01-12 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10388: -- Target Version/s: 2.0.0 (was: ) > Public dataset loader interface > --

[jira] [Commented] (SPARK-12645) SparkR support hash function

2016-01-12 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095186#comment-15095186 ] Yin Huai commented on SPARK-12645: -- I have reverted it from branch 1.6 (see https://git

[jira] [Resolved] (SPARK-12645) SparkR support hash function

2016-01-12 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-12645. -- Resolution: Fixed > SparkR support hash function > - > > K

[jira] [Commented] (SPARK-12403) "Simba Spark ODBC Driver 1.0" not working with 1.5.2 anymore

2016-01-12 Thread Lunen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095178#comment-15095178 ] Lunen commented on SPARK-12403: --- Hi Guys. Thanks for replies. I tried adding the database n

[jira] [Commented] (SPARK-10910) spark.{executor,driver}.userClassPathFirst don't work for kryo (probably others)

2016-01-12 Thread John Vines (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095177#comment-15095177 ] John Vines commented on SPARK-10910: snappy-java is another one > spark.{executor,dr

[jira] [Resolved] (SPARK-12426) Docker JDBC integration tests are failing again

2016-01-12 Thread Mark Grover (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Grover resolved SPARK-12426. - Resolution: Fixed Thanks Sean! Marking this as resolved since all the necessary information is n

[jira] [Comment Edited] (SPARK-12650) No means to specify Xmx settings for SparkSubmit in yarn-cluster mode

2016-01-12 Thread John Vines (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15094189#comment-15094189 ] John Vines edited comment on SPARK-12650 at 1/12/16 10:52 PM: -

[jira] [Created] (SPARK-12787) Dataset to support custom encoder

2016-01-12 Thread Muthu Jayakumar (JIRA)
Muthu Jayakumar created SPARK-12787: --- Summary: Dataset to support custom encoder Key: SPARK-12787 URL: https://issues.apache.org/jira/browse/SPARK-12787 Project: Spark Issue Type: New Featu

[jira] [Resolved] (SPARK-12658) Revert SPARK-12511

2016-01-12 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-12658. -- Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 2.0.0 Resolved by https

[jira] [Resolved] (SPARK-12652) Upgrade py4j to the incoming version 0.9.1

2016-01-12 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-12652. -- Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 2.0.0 > Upgrade py4j to

[jira] [Resolved] (SPARK-12657) Revert SPARK-12617

2016-01-12 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-12657. -- Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 2.0.0 Resolved by https

[jira] [Comment Edited] (SPARK-12430) Temporary folders do not get deleted after Task completes causing problems with disk space.

2016-01-12 Thread Fede Bar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095075#comment-15095075 ] Fede Bar edited comment on SPARK-12430 at 1/12/16 10:20 PM: H

[jira] [Assigned] (SPARK-12724) SQL generation support for persisted data source relations

2016-01-12 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian reassigned SPARK-12724: -- Assignee: Cheng Lian > SQL generation support for persisted data source relations > --

[jira] [Resolved] (SPARK-12724) SQL generation support for persisted data source relations

2016-01-12 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-12724. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10712 [https://github.

[jira] [Comment Edited] (SPARK-12430) Temporary folders do not get deleted after Task completes causing problems with disk space.

2016-01-12 Thread Fede Bar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095075#comment-15095075 ] Fede Bar edited comment on SPARK-12430 at 1/12/16 10:15 PM: H

[jira] [Comment Edited] (SPARK-12430) Temporary folders do not get deleted after Task completes causing problems with disk space.

2016-01-12 Thread Fede Bar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095075#comment-15095075 ] Fede Bar edited comment on SPARK-12430 at 1/12/16 10:14 PM: H

[jira] [Commented] (SPARK-12430) Temporary folders do not get deleted after Task completes causing problems with disk space.

2016-01-12 Thread Fede Bar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095075#comment-15095075 ] Fede Bar commented on SPARK-12430: -- Hi Jean-Baptiste, Thank for following up. I did not

[jira] [Assigned] (SPARK-12784) Spark UI IndexOutOfBoundsException with dynamic allocation

2016-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12784: Assignee: Apache Spark (was: Shixiong Zhu) > Spark UI IndexOutOfBoundsException with dyna

[jira] [Assigned] (SPARK-12784) Spark UI IndexOutOfBoundsException with dynamic allocation

2016-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12784: Assignee: Shixiong Zhu (was: Apache Spark) > Spark UI IndexOutOfBoundsException with dyna

[jira] [Commented] (SPARK-12784) Spark UI IndexOutOfBoundsException with dynamic allocation

2016-01-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095070#comment-15095070 ] Apache Spark commented on SPARK-12784: -- User 'zsxwing' has created a pull request fo

[jira] [Commented] (SPARK-12781) MLib FPGrowth does not scale to large numbers of frequent items

2016-01-12 Thread Raj Tiwari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095058#comment-15095058 ] Raj Tiwari commented on SPARK-12781: Thanks Sean. I will take this to the user group.

[jira] [Closed] (SPARK-12779) StringIndexer should handle null

2016-01-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang closed SPARK-12779. - Resolution: Duplicate > StringIndexer should handle null > > >

[jira] [Commented] (SPARK-12779) StringIndexer should handle null

2016-01-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095057#comment-15095057 ] Feynman Liang commented on SPARK-12779: --- Yep you're right, thanks! > StringIndexer

[jira] [Updated] (SPARK-12783) Dataset map

2016-01-12 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12783: - Assignee: Wenchen Fan Target Version/s: 1.6.1, 2.0.0 Priority: Cri

[jira] [Commented] (SPARK-12777) Dataset fields can't be Scala tuples

2016-01-12 Thread Chris Jansen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095056#comment-15095056 ] Chris Jansen commented on SPARK-12777: -- Nope, this is just in normal code. Although

[jira] [Comment Edited] (SPARK-12784) Spark UI IndexOutOfBoundsException with dynamic allocation

2016-01-12 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095043#comment-15095043 ] Shixiong Zhu edited comment on SPARK-12784 at 1/12/16 9:58 PM:

[jira] [Commented] (SPARK-12779) StringIndexer should handle null

2016-01-12 Thread Jia Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095048#comment-15095048 ] Jia Li commented on SPARK-12779: Hi, I believe this is the same issue as https://issues.

[jira] [Commented] (SPARK-12426) Docker JDBC integration tests are failing again

2016-01-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095047#comment-15095047 ] Sean Owen commented on SPARK-12426: --- Done. > Docker JDBC integration tests are failing

  1   2   3   >