[jira] [Assigned] (SPARK-9303) Decimal should use java.math.Decimal directly instead of via Scala wrapper

2015-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9303: --- Assignee: Josh Rosen (was: Apache Spark) Decimal should use java.math.Decimal directly

[jira] [Commented] (SPARK-9303) Decimal should use java.math.Decimal directly instead of via Scala wrapper

2015-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639987#comment-14639987 ] Apache Spark commented on SPARK-9303: - User 'JoshRosen' has created a pull request for

[jira] [Assigned] (SPARK-9303) Decimal should use java.math.Decimal directly instead of via Scala wrapper

2015-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9303: --- Assignee: Apache Spark (was: Josh Rosen) Decimal should use java.math.Decimal directly

[jira] [Assigned] (SPARK-9200) Don't implicitly cast non-atomic types to string type

2015-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9200: --- Assignee: (was: Apache Spark) Don't implicitly cast non-atomic types to string type

[jira] [Assigned] (SPARK-9200) Don't implicitly cast non-atomic types to string type

2015-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9200: --- Assignee: Apache Spark Don't implicitly cast non-atomic types to string type

[jira] [Commented] (SPARK-9200) Don't implicitly cast non-atomic types to string type

2015-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14640001#comment-14640001 ] Apache Spark commented on SPARK-9200: - User 'rxin' has created a pull request for this

[jira] [Resolved] (SPARK-9294) cleanup comments, code style, naming typo for the new aggregation

2015-07-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9294. Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 1.5.0 cleanup comments,

[jira] [Commented] (SPARK-9255) Timestamp handling incorrect for Spark 1.4.1 on Linux

2015-07-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14640048#comment-14640048 ] Sean Owen commented on SPARK-9255: -- Can you clarify how you build and run your Spark

[jira] [Commented] (SPARK-9097) Tasks are not completed but the number of executor is zero

2015-07-24 Thread KaiXinXIaoLei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14640046#comment-14640046 ] KaiXinXIaoLei commented on SPARK-9097: -- [~srowen], This problem, I analysis code

[jira] [Created] (SPARK-9305) Rename org.apache.spark.Row to Item

2015-07-24 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9305: -- Summary: Rename org.apache.spark.Row to Item Key: SPARK-9305 URL: https://issues.apache.org/jira/browse/SPARK-9305 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-9305) Rename org.apache.spark.Row to Item

2015-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14640060#comment-14640060 ] Apache Spark commented on SPARK-9305: - User 'rxin' has created a pull request for this

[jira] [Commented] (SPARK-9304) Improve backwards compatibility of SPARK-8401

2015-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14640087#comment-14640087 ] Apache Spark commented on SPARK-9304: - User 'srowen' has created a pull request for

[jira] [Assigned] (SPARK-9304) Improve backwards compatibility of SPARK-8401

2015-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9304: --- Assignee: Apache Spark (was: Michael Allman) Improve backwards compatibility of SPARK-8401

[jira] [Created] (SPARK-9303) Decimal should use java.math.Decimal directly instead of via Scala wrapper

2015-07-24 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-9303: - Summary: Decimal should use java.math.Decimal directly instead of via Scala wrapper Key: SPARK-9303 URL: https://issues.apache.org/jira/browse/SPARK-9303 Project: Spark

[jira] [Created] (SPARK-9306) SortMergeJoin crashes when trying to join on unsortable columns

2015-07-24 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-9306: - Summary: SortMergeJoin crashes when trying to join on unsortable columns Key: SPARK-9306 URL: https://issues.apache.org/jira/browse/SPARK-9306 Project: Spark

[jira] [Assigned] (SPARK-9305) Rename org.apache.spark.Row to Item

2015-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9305: --- Assignee: Apache Spark (was: Reynold Xin) Rename org.apache.spark.Row to Item

[jira] [Assigned] (SPARK-9305) Rename org.apache.spark.Row to Item

2015-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9305: --- Assignee: Reynold Xin (was: Apache Spark) Rename org.apache.spark.Row to Item

[jira] [Updated] (SPARK-9248) Closing curly-braces should always be on their own line

2015-07-24 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Ishikawa updated SPARK-9248: --- Description: Closing curly-braces should always be on their own line For example, {noformat}

[jira] [Updated] (SPARK-9292) Analysis should check that join conditions' data types are booleans

2015-07-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9292: --- Issue Type: Sub-task (was: Bug) Parent: SPARK-8947 Analysis should check that join

[jira] [Updated] (SPARK-9293) Analysis should detect when set operations are performed on tables with different numbers of columns

2015-07-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9293: --- Issue Type: Sub-task (was: Bug) Parent: SPARK-8947 Analysis should detect when set

[jira] [Updated] (SPARK-9295) Analysis should detect sorting on unsupported column types

2015-07-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9295: --- Issue Type: Sub-task (was: Bug) Parent: SPARK-8947 Analysis should detect sorting on

[jira] [Commented] (SPARK-9069) Remove unlimited DecimalType

2015-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639985#comment-14639985 ] Apache Spark commented on SPARK-9069: - User 'davies' has created a pull request for

[jira] [Created] (SPARK-9304) Improve backwards compatibility of SPARK-8401

2015-07-24 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-9304: -- Summary: Improve backwards compatibility of SPARK-8401 Key: SPARK-9304 URL: https://issues.apache.org/jira/browse/SPARK-9304 Project: Spark Issue Type:

[jira] [Commented] (SPARK-9304) Improve backwards compatibility of SPARK-8401

2015-07-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14640029#comment-14640029 ] Sean Owen commented on SPARK-9304: -- That's fine. I didn't perceive this part as an API

[jira] [Comment Edited] (SPARK-9097) Tasks are not completed but the number of executor is zero

2015-07-24 Thread KaiXinXIaoLei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14640046#comment-14640046 ] KaiXinXIaoLei edited comment on SPARK-9097 at 7/24/15 7:07 AM:

[jira] [Commented] (SPARK-9277) SparseVector constructor must throw an error when declared number of elements less than array lenght

2015-07-24 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14640055#comment-14640055 ] Manoj Kumar commented on SPARK-9277: I have labelled this as started. Will fix this in

[jira] [Updated] (SPARK-9277) SparseVector constructor must throw an error when declared number of elements less than array lenght

2015-07-24 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Kumar updated SPARK-9277: --- Labels: starter (was: ) SparseVector constructor must throw an error when declared number of

[jira] [Updated] (SPARK-9307) Logging: Make it either stable or private[spark]

2015-07-24 Thread Santiago M. Mola (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santiago M. Mola updated SPARK-9307: Description: org.apache.spark.Logging is a public class that is quite easy to include from

[jira] [Resolved] (SPARK-9264) When dealing with Union/Intersect/Except, we cast FloatType/DoubleType to the wrong DecimalType

2015-07-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9264. Resolution: Fixed Fix Version/s: 1.5.0 When dealing with Union/Intersect/Except, we cast

[jira] [Resolved] (SPARK-9069) Remove unlimited DecimalType

2015-07-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9069. Resolution: Fixed Fix Version/s: 1.5.0 Remove unlimited DecimalType

[jira] [Created] (SPARK-9307) Logging: Make it either stable or private[spark]

2015-07-24 Thread Santiago M. Mola (JIRA)
Santiago M. Mola created SPARK-9307: --- Summary: Logging: Make it either stable or private[spark] Key: SPARK-9307 URL: https://issues.apache.org/jira/browse/SPARK-9307 Project: Spark Issue

[jira] [Commented] (SPARK-9248) Closing curly-braces should always be on their own line

2015-07-24 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14640074#comment-14640074 ] Yu Ishikawa commented on SPARK-9248: Yeah - sorry for not explaining enough.

[jira] [Updated] (SPARK-9280) New HiveContext object unexpectedly loads configuration settings from history

2015-07-24 Thread Tien-Dung LE (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tien-Dung LE updated SPARK-9280: Affects Version/s: 1.4.1 New HiveContext object unexpectedly loads configuration settings from

[jira] [Commented] (SPARK-9308) ml.NaiveBayesModel support predicting class probabilities

2015-07-24 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14640303#comment-14640303 ] Yanbo Liang commented on SPARK-9308: Yes, It can reuse that code. But the core problem

[jira] [Created] (SPARK-9326) Spark never closes the lock file used to prevent concurrent downloads

2015-07-24 Thread Kay Ousterhout (JIRA)
Kay Ousterhout created SPARK-9326: - Summary: Spark never closes the lock file used to prevent concurrent downloads Key: SPARK-9326 URL: https://issues.apache.org/jira/browse/SPARK-9326 Project: Spark

[jira] [Updated] (SPARK-6129) Create MLlib metrics user guide with algorithm definitions and complete code examples.

2015-07-24 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Seth Hendrickson updated SPARK-6129: Summary: Create MLlib metrics user guide with algorithm definitions and complete code

[jira] [Assigned] (SPARK-9312) The multiclass logistic regression and the OneVsRest model do not provide predictive probability (confidence factor) along with the prediction

2015-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9312: --- Assignee: (was: Apache Spark) The multiclass logistic regression and the OneVsRest

[jira] [Created] (SPARK-9322) Add rbind as a synonym for `unionAll`

2015-07-24 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-9322: Summary: Add rbind as a synonym for `unionAll` Key: SPARK-9322 URL: https://issues.apache.org/jira/browse/SPARK-9322 Project: Spark Issue

[jira] [Updated] (SPARK-9255) Timestamp handling incorrect for Spark 1.4.1 on Linux

2015-07-24 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Wu updated SPARK-9255: --- Attachment: (was: timestamp_bug.zip) Timestamp handling incorrect for Spark 1.4.1 on Linux

[jira] [Commented] (SPARK-9255) Timestamp handling incorrect for Spark 1.4.1 on Linux

2015-07-24 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14641175#comment-14641175 ] Paul Wu commented on SPARK-9255: Related https://issues.apache.org/jira/browse/SPARK-9058,

[jira] [Updated] (SPARK-9307) Logging: Make it either stable or private[spark]

2015-07-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9307: - Component/s: Spark Core Logging: Make it either stable or private[spark]

[jira] [Updated] (SPARK-8703) Add CountVectorizer as a ml transformer to convert document to words count vector

2015-07-24 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-8703: --- Issue Type: Sub-task (was: New Feature) Parent: SPARK-8521 Add CountVectorizer as a

[jira] [Updated] (SPARK-9303) Decimal should use java.math.Decimal directly instead of via Scala wrapper

2015-07-24 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-9303: -- Assignee: (was: Josh Rosen) Decimal should use java.math.Decimal directly instead of via Scala

[jira] [Commented] (SPARK-6129) Create MLlib metrics user guide with algorithm definitions and complete code examples.

2015-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14641277#comment-14641277 ] Apache Spark commented on SPARK-6129: - User 'sethah' has created a pull request for

[jira] [Updated] (SPARK-9277) SparseVector constructor must throw an error when declared number of elements less than array length

2015-07-24 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9277: - Summary: SparseVector constructor must throw an error when declared number of elements

[jira] [Created] (SPARK-9329) complex type support in Tungsten

2015-07-24 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9329: -- Summary: complex type support in Tungsten Key: SPARK-9329 URL: https://issues.apache.org/jira/browse/SPARK-9329 Project: Spark Issue Type: Umbrella

[jira] [Commented] (SPARK-9331) Indent generated code properly when dumping them in debug code or exception mode

2015-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14641297#comment-14641297 ] Apache Spark commented on SPARK-9331: - User 'rxin' has created a pull request for this