[jira] [Resolved] (SPARK-12215) User guide section for KMeans in spark.ml

2015-12-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-12215. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved

[jira] [Commented] (SPARK-12350) VectorAssembler#transform() initially throws an exception

2015-12-16 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060500#comment-15060500 ] Jakob Odersky commented on SPARK-12350: --- You're right, somewhere in the huge stack

[jira] [Resolved] (SPARK-12310) Add write.json and write.parquet for SparkR

2015-12-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12310. --- Resolution: Fixed Assignee: Yanbo Liang (was: Apache Spark) F

[jira] [Commented] (SPARK-12054) Consider nullable in codegen

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060489#comment-15060489 ] Apache Spark commented on SPARK-12054: -- User 'davies' has created a pull request for

[jira] [Updated] (SPARK-12318) Save mode in SparkR should be error by default

2015-12-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12318: -- Assignee: Jeff Zhang > Save mode in SparkR should be error by default > ---

[jira] [Resolved] (SPARK-12318) Save mode in SparkR should be error by default

2015-12-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12318. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Commented] (SPARK-12345) Mesos cluster mode is broken

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060475#comment-15060475 ] Apache Spark commented on SPARK-12345: -- User 'tnachen' has created a pull request fo

[jira] [Resolved] (SPARK-8745) Remove GenerateProjection

2015-12-16 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8745. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10316 [https://github.com

[jira] [Created] (SPARK-12372) Unary operator "-" fails for MLlib vectors

2015-12-16 Thread Christos Iraklis Tsatsoulis (JIRA)
Christos Iraklis Tsatsoulis created SPARK-12372: --- Summary: Unary operator "-" fails for MLlib vectors Key: SPARK-12372 URL: https://issues.apache.org/jira/browse/SPARK-12372 Project: Spar

[jira] [Commented] (SPARK-10951) Support private S3 repositories using spark-submit via --repositories flag

2015-12-16 Thread Jerry Lam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060451#comment-15060451 ] Jerry Lam commented on SPARK-10951: --- Any change to have this feature in 1.6? :) > Supp

[jira] [Resolved] (SPARK-12324) The documentation sidebar does not collapse properly

2015-12-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-12324. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved

[jira] [Updated] (SPARK-12324) The documentation sidebar does not collapse properly

2015-12-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-12324: -- Target Version/s: 1.6.1, 2.0.0 > The documentation sidebar does not collapse properly >

[jira] [Updated] (SPARK-12345) Mesos cluster mode is broken

2015-12-16 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12345: -- Summary: Mesos cluster mode is broken (was: Mesos cluster mode is broken when SPARK_HOME is set) > Me

[jira] [Updated] (SPARK-12345) Mesos cluster mode is broken when SPARK_HOME is set

2015-12-16 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12345: -- Summary: Mesos cluster mode is broken when SPARK_HOME is set (was: Mesos cluster mode is broken) > Me

[jira] [Commented] (SPARK-12360) Support using 64-bit long type in SparkR

2015-12-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060381#comment-15060381 ] Shivaram Venkataraman commented on SPARK-12360: --- The lack of 64 bit numbers

[jira] [Assigned] (SPARK-12371) Make sure Dataset nullability conforms to its underlying logical plan

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12371: Assignee: Apache Spark (was: Cheng Lian) > Make sure Dataset nullability conforms to its

[jira] [Created] (SPARK-12371) Make sure Dataset nullability conforms to its underlying logical plan

2015-12-16 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-12371: -- Summary: Make sure Dataset nullability conforms to its underlying logical plan Key: SPARK-12371 URL: https://issues.apache.org/jira/browse/SPARK-12371 Project: Spark

[jira] [Commented] (SPARK-12289) Support UnsafeRow in TakeOrderedAndProject/Limit

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060287#comment-15060287 ] Apache Spark commented on SPARK-12289: -- User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-12289) Support UnsafeRow in TakeOrderedAndProject/Limit

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12289: Assignee: Apache Spark > Support UnsafeRow in TakeOrderedAndProject/Limit > --

[jira] [Commented] (SPARK-12368) Better doc for the binary classification evaluator' metricName

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060279#comment-15060279 ] Apache Spark commented on SPARK-12368: -- User 'BenFradet' has created a pull request

[jira] [Resolved] (SPARK-6936) SQLContext.sql() caused deadlock in multi-thread env

2015-12-16 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-6936. - Resolution: Fixed Fix Version/s: 1.5.0 > SQLContext.sql() caused deadlock in multi-

[jira] [Commented] (SPARK-12345) Mesos cluster mode is broken

2015-12-16 Thread Iulian Dragos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060236#comment-15060236 ] Iulian Dragos commented on SPARK-12345: --- I'd prefer filtering it at at the submit s

[jira] [Commented] (SPARK-12345) Mesos cluster mode is broken

2015-12-16 Thread Luc Bourlier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060239#comment-15060239 ] Luc Bourlier commented on SPARK-12345: -- I tested our usual test cases with my change

[jira] [Created] (SPARK-12370) Documentation should link to examples from its own release version

2015-12-16 Thread Brian London (JIRA)
Brian London created SPARK-12370: Summary: Documentation should link to examples from its own release version Key: SPARK-12370 URL: https://issues.apache.org/jira/browse/SPARK-12370 Project: Spark

[jira] [Updated] (SPARK-12370) Documentation should link to examples from its own release version

2015-12-16 Thread Brian London (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian London updated SPARK-12370: - Issue Type: Improvement (was: Bug) > Documentation should link to examples from its own release

[jira] [Commented] (SPARK-9042) Spark SQL incompatibility if security is enforced on the Hive warehouse

2015-12-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060223#comment-15060223 ] Sean Owen commented on SPARK-9042: -- OK, could be. I'm updating this by request from more

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

2015-12-16 Thread Tom Waterhouse (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060218#comment-15060218 ] Tom Waterhouse commented on SPARK-12177: SSL is very important for our deployment

[jira] [Commented] (SPARK-9042) Spark SQL incompatibility if security is enforced on the Hive warehouse

2015-12-16 Thread Charmee Patel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060219#comment-15060219 ] Charmee Patel commented on SPARK-9042: -- Yes, we can take it back to cloudera land. I

[jira] [Commented] (SPARK-11478) ML StringIndexer return inconsistent schema

2015-12-16 Thread Wojciech Jurczyk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060210#comment-15060210 ] Wojciech Jurczyk commented on SPARK-11478: -- Any progress on this, [~yanboliang]?

[jira] [Comment Edited] (SPARK-12179) Spark SQL get different result with the same code

2015-12-16 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060217#comment-15060217 ] Davies Liu edited comment on SPARK-12179 at 12/16/15 4:04 PM: -

[jira] [Commented] (SPARK-12179) Spark SQL get different result with the same code

2015-12-16 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060217#comment-15060217 ] Davies Liu commented on SPARK-12179: Which version of Spark are you using? > Spark

[jira] [Updated] (SPARK-12369) DataFrameReader fails on globbing parquet paths

2015-12-16 Thread Yana Kadiyska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yana Kadiyska updated SPARK-12369: -- Description: Start with a list of parquet paths where some or all do not exist: {noformat} val

[jira] [Commented] (SPARK-12179) Spark SQL get different result with the same code

2015-12-16 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060213#comment-15060213 ] Davies Liu commented on SPARK-12179: I think this UDF is not thread safe, rowNum and

[jira] [Updated] (SPARK-12369) DataFrameReader fails on globbing parquet paths

2015-12-16 Thread Yana Kadiyska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yana Kadiyska updated SPARK-12369: -- Summary: DataFrameReader fails on globbing parquet paths (was: ataFrameReader fails on globbin

[jira] [Created] (SPARK-12369) ataFrameReader fails on globbing parquet paths

2015-12-16 Thread Yana Kadiyska (JIRA)
Yana Kadiyska created SPARK-12369: - Summary: ataFrameReader fails on globbing parquet paths Key: SPARK-12369 URL: https://issues.apache.org/jira/browse/SPARK-12369 Project: Spark Issue Type:

[jira] [Commented] (SPARK-9042) Spark SQL incompatibility if security is enforced on the Hive warehouse

2015-12-16 Thread Andrew Ray (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060208#comment-15060208 ] Andrew Ray commented on SPARK-9042: --- Sean, I think there are a couple issues going on he

[jira] [Updated] (SPARK-12293) Support UnsafeRow in LocalTableScan

2015-12-16 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12293: --- Assignee: Liang-Chi Hsieh (was: Apache Spark) > Support UnsafeRow in LocalTableScan > --

[jira] [Updated] (SPARK-12288) Support UnsafeRow in Coalesce/Except/Intersect

2015-12-16 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12288: --- Assignee: Xiao Li > Support UnsafeRow in Coalesce/Except/Intersect >

[jira] [Commented] (SPARK-9042) Spark SQL incompatibility if security is enforced on the Hive warehouse

2015-12-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060201#comment-15060201 ] Sean Owen commented on SPARK-9042: -- Yea, this is coming from our support. (Can we take th

[jira] [Commented] (SPARK-9042) Spark SQL incompatibility if security is enforced on the Hive warehouse

2015-12-16 Thread Charmee Patel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060196#comment-15060196 ] Charmee Patel commented on SPARK-9042: -- Sentry plugin is only managing access to HDFS

[jira] [Commented] (SPARK-9042) Spark SQL incompatibility if security is enforced on the Hive warehouse

2015-12-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060185#comment-15060185 ] Sean Owen commented on SPARK-9042: -- As I say -- AFAIK this problem is resolved by enablin

[jira] [Updated] (SPARK-12368) Better doc for the binary classification evaluator' metricName

2015-12-16 Thread Benjamin Fradet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Fradet updated SPARK-12368: Summary: Better doc for the binary classification evaluator' metricName (was: Better doc f

[jira] [Commented] (SPARK-9042) Spark SQL incompatibility if security is enforced on the Hive warehouse

2015-12-16 Thread Charmee Patel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060177#comment-15060177 ] Charmee Patel commented on SPARK-9042: -- I don't agree with closing this issue. We h

[jira] [Commented] (SPARK-12368) Better doc for the binary classification evaluator setMetricName method

2015-12-16 Thread Benjamin Fradet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060167#comment-15060167 ] Benjamin Fradet commented on SPARK-12368: - I've started working on this. > Bette

[jira] [Created] (SPARK-12368) Better doc for the binary classification evaluator setMetricName method

2015-12-16 Thread Benjamin Fradet (JIRA)
Benjamin Fradet created SPARK-12368: --- Summary: Better doc for the binary classification evaluator setMetricName method Key: SPARK-12368 URL: https://issues.apache.org/jira/browse/SPARK-12368 Project

[jira] [Comment Edited] (SPARK-12345) Mesos cluster mode is broken

2015-12-16 Thread Luc Bourlier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060153#comment-15060153 ] Luc Bourlier edited comment on SPARK-12345 at 12/16/15 3:33 PM: ---

[jira] [Commented] (SPARK-12345) Mesos cluster mode is broken

2015-12-16 Thread Luc Bourlier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060153#comment-15060153 ] Luc Bourlier commented on SPARK-12345: -- I have almost the same fix, which is the sam

[jira] [Assigned] (SPARK-12349) Make spark.ml PCAModel load backwards compatible

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12349: Assignee: (was: Apache Spark) > Make spark.ml PCAModel load backwards compatible > ---

[jira] [Assigned] (SPARK-12349) Make spark.ml PCAModel load backwards compatible

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12349: Assignee: Apache Spark > Make spark.ml PCAModel load backwards compatible > --

[jira] [Assigned] (SPARK-12349) Make spark.ml PCAModel load backwards compatible

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12349: Assignee: (was: Apache Spark) > Make spark.ml PCAModel load backwards compatible > ---

[jira] [Assigned] (SPARK-12349) Make spark.ml PCAModel load backwards compatible

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12349: Assignee: Apache Spark > Make spark.ml PCAModel load backwards compatible > --

[jira] [Commented] (SPARK-12345) Mesos cluster mode is broken

2015-12-16 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060035#comment-15060035 ] Saisai Shao commented on SPARK-12345: - Here is the one solution (https://github.com/

[jira] [Assigned] (SPARK-12349) Make spark.ml PCAModel load backwards compatible

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12349: Assignee: Apache Spark > Make spark.ml PCAModel load backwards compatible > --

[jira] [Commented] (SPARK-11759) Spark task on mesos with docker fails with sh: 1: /opt/spark/bin/spark-class: not found

2015-12-16 Thread Iulian Dragos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060020#comment-15060020 ] Iulian Dragos commented on SPARK-11759: --- Are you using 1.6.0 release candidates, or

[jira] [Assigned] (SPARK-12349) Make spark.ml PCAModel load backwards compatible

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12349: Assignee: (was: Apache Spark) > Make spark.ml PCAModel load backwards compatible > ---

[jira] [Commented] (SPARK-10625) Spark SQL JDBC read/write is unable to handle JDBC Drivers that adds unserializable objects into connection properties

2015-12-16 Thread Chandra Sekhar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059959#comment-15059959 ] Chandra Sekhar commented on SPARK-10625: Hi I built spark with the pull request n

[jira] [Commented] (SPARK-12345) Mesos cluster mode is broken

2015-12-16 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059954#comment-15059954 ] Saisai Shao commented on SPARK-12345: - Having a quick test by not exporting {{SPARK_H

[jira] [Commented] (SPARK-12345) Mesos cluster mode is broken

2015-12-16 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059937#comment-15059937 ] Saisai Shao commented on SPARK-12345: - I think by default Spark Mesos implementation

[jira] [Commented] (SPARK-10618) Refactoring and adding test for Mesos coarse-grained Scheduler

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059905#comment-15059905 ] Apache Spark commented on SPARK-10618: -- User 'SleepyThread' has created a pull reque

[jira] [Updated] (SPARK-12367) NoSuchElementException during prediction with Random Forest Regressor

2015-12-16 Thread Eugene Morozov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Morozov updated SPARK-12367: --- Description: I'm consistently getting "java.util.NoSuchElementException: key not found: 1.0"

[jira] [Updated] (SPARK-12367) NoSuchElementException during prediction with Random Forest Regressor

2015-12-16 Thread Eugene Morozov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Morozov updated SPARK-12367: --- Attachment: complete-stack-trace.log input.gz CodeThatGivesANo

[jira] [Created] (SPARK-12367) NoSuchElementException during prediction with Random Forest Regressor

2015-12-16 Thread Eugene Morozov (JIRA)
Eugene Morozov created SPARK-12367: -- Summary: NoSuchElementException during prediction with Random Forest Regressor Key: SPARK-12367 URL: https://issues.apache.org/jira/browse/SPARK-12367 Project: Sp

[jira] [Created] (SPARK-12366) IllegalArgumentException: requirement failed: File not found: ...sql/catalyst/expressions/GeneratedClass.class when df.show

2015-12-16 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-12366: --- Summary: IllegalArgumentException: requirement failed: File not found: ...sql/catalyst/expressions/GeneratedClass.class when df.show Key: SPARK-12366 URL: https://issues.apa

[jira] [Commented] (SPARK-12365) Use ShutdownHookManager where Runtime.getRuntime.addShutdownHook() is called

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059861#comment-15059861 ] Apache Spark commented on SPARK-12365: -- User 'ted-yu' has created a pull request for

[jira] [Assigned] (SPARK-12365) Use ShutdownHookManager where Runtime.getRuntime.addShutdownHook() is called

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12365: Assignee: Apache Spark > Use ShutdownHookManager where Runtime.getRuntime.addShutdownHook(

[jira] [Created] (SPARK-12365) Use ShutdownHookManager where Runtime.getRuntime.addShutdownHook() is called

2015-12-16 Thread Ted Yu (JIRA)
Ted Yu created SPARK-12365: -- Summary: Use ShutdownHookManager where Runtime.getRuntime.addShutdownHook() is called Key: SPARK-12365 URL: https://issues.apache.org/jira/browse/SPARK-12365 Project: Spark

[jira] [Resolved] (SPARK-10114) Add optional getters to the spark.sql.Row

2015-12-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10114. --- Resolution: Duplicate > Add optional getters to the spark.sql.Row > -

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

2015-12-16 Thread Nikita Tarasenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059840#comment-15059840 ] Nikita Tarasenko commented on SPARK-12177: -- Current implementation doesn't inclu

[jira] [Assigned] (SPARK-12364) Add ML example for SparkR

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12364: Assignee: Apache Spark > Add ML example for SparkR > - > >

[jira] [Assigned] (SPARK-12364) Add ML example for SparkR

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12364: Assignee: (was: Apache Spark) > Add ML example for SparkR > -

[jira] [Commented] (SPARK-12364) Add ML example for SparkR

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059835#comment-15059835 ] Apache Spark commented on SPARK-12364: -- User 'yanboliang' has created a pull request

[jira] [Created] (SPARK-12364) Add ML example for SparkR

2015-12-16 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-12364: --- Summary: Add ML example for SparkR Key: SPARK-12364 URL: https://issues.apache.org/jira/browse/SPARK-12364 Project: Spark Issue Type: Improvement Com

[jira] [Resolved] (SPARK-5269) BlockManager.dataDeserialize always creates a new serializer instance

2015-12-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5269. -- Resolution: Won't Fix Assignee: (was: Matt Cheah) > BlockManager.dataDeserialize always create

[jira] [Commented] (SPARK-12180) DataFrame.join() in PySpark gives misleading exception when column name exists on both side

2015-12-16 Thread Daniel Thomas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059816#comment-15059816 ] Daniel Thomas commented on SPARK-12180: --- Here is the code. Without renaming the col

[jira] [Commented] (SPARK-12345) Mesos cluster mode is broken

2015-12-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059812#comment-15059812 ] Sean Owen commented on SPARK-12345: --- Yeah, but why is {{SPARK_HOME}} copied across mach

[jira] [Comment Edited] (SPARK-12350) VectorAssembler#transform() initially throws an exception

2015-12-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059788#comment-15059788 ] Yanbo Liang edited comment on SPARK-12350 at 12/16/15 10:15 AM: ---

[jira] [Commented] (SPARK-12350) VectorAssembler#transform() initially throws an exception

2015-12-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059788#comment-15059788 ] Yanbo Liang commented on SPARK-12350: - I can reproduce this issue, but it not caused

[jira] [Commented] (SPARK-12345) Mesos cluster mode is broken

2015-12-16 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059778#comment-15059778 ] Saisai Shao commented on SPARK-12345: - A simple solution is to change the scripts to

[jira] [Commented] (SPARK-12345) Mesos cluster mode is broken

2015-12-16 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059769#comment-15059769 ] Stavros Kontopoulos commented on SPARK-12345: - Adding to [~dragos].(Mesos

[jira] [Commented] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

2015-12-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059763#comment-15059763 ] Yanbo Liang commented on SPARK-12363: - cc [~mengxr] [~josephkb] [~viirya] Would you m

[jira] [Comment Edited] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

2015-12-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059753#comment-15059753 ] Yanbo Liang edited comment on SPARK-12363 at 12/16/15 9:41 AM:

[jira] [Comment Edited] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

2015-12-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059753#comment-15059753 ] Yanbo Liang edited comment on SPARK-12363 at 12/16/15 9:40 AM:

[jira] [Updated] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

2015-12-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12363: Component/s: (was: GraphX) > PowerIterationClustering test case failed if we deprecated KMeans.

[jira] [Comment Edited] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

2015-12-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059753#comment-15059753 ] Yanbo Liang edited comment on SPARK-12363 at 12/16/15 9:38 AM:

[jira] [Commented] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

2015-12-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059753#comment-15059753 ] Yanbo Liang commented on SPARK-12363: - After I removed [this line|https://github.com

[jira] [Created] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

2015-12-16 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-12363: --- Summary: PowerIterationClustering test case failed if we deprecated KMeans.setRuns Key: SPARK-12363 URL: https://issues.apache.org/jira/browse/SPARK-12363 Project: Spar

[jira] [Assigned] (SPARK-12346) GLM summary crashes with NoSuchElementException if attributes are missing names

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12346: Assignee: (was: Apache Spark) > GLM summary crashes with NoSuchElementException if att

[jira] [Assigned] (SPARK-12346) GLM summary crashes with NoSuchElementException if attributes are missing names

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12346: Assignee: Apache Spark > GLM summary crashes with NoSuchElementException if attributes are

[jira] [Updated] (SPARK-10620) Look into whether accumulator mechanism can replace TaskMetrics

2015-12-16 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10620: Assignee: (was: Andrew Or) > Look into whether accumulator mechanism can replace TaskMetrics >

[jira] [Assigned] (SPARK-12361) Should set PYSPARK_DRIVER_PYTHON before python test

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12361: Assignee: (was: Apache Spark) > Should set PYSPARK_DRIVER_PYTHON before python test >

[jira] [Assigned] (SPARK-12361) Should set PYSPARK_DRIVER_PYTHON before python test

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12361: Assignee: Apache Spark > Should set PYSPARK_DRIVER_PYTHON before python test > ---

[jira] [Commented] (SPARK-12345) Mesos cluster mode is broken

2015-12-16 Thread Iulian Dragos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059717#comment-15059717 ] Iulian Dragos commented on SPARK-12345: --- There's isn't any {{SPARK_HOME}} set on an

[jira] [Commented] (SPARK-12346) GLM summary crashes with NoSuchElementException if attributes are missing names

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059710#comment-15059710 ] Apache Spark commented on SPARK-12346: -- User 'ericl' has created a pull request for

[jira] [Closed] (SPARK-9379) org.apache.spark.sql.catalyst.SqlParser should be extensible easily

2015-12-16 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-9379. -- Resolution: Invalid I'm closing this ticket because we are going to remove the existing parser soon and

[jira] [Commented] (SPARK-6936) SQLContext.sql() caused deadlock in multi-thread env

2015-12-16 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059703#comment-15059703 ] Reynold Xin commented on SPARK-6936: Is this still a problem on the latest Spark? I th

[jira] [Resolved] (SPARK-8585) Support LATERAL VIEW in Spark SQL parser

2015-12-16 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8585. Resolution: Duplicate > Support LATERAL VIEW in Spark SQL parser > -

[jira] [Updated] (SPARK-12362) Create a full-fledged built-in SQL parser

2015-12-16 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12362: Summary: Create a full-fledged built-in SQL parser (was: Inline a full-fledged SQL parser) > Crea

[jira] [Created] (SPARK-12362) Inline a full-fledged SQL parser

2015-12-16 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-12362: --- Summary: Inline a full-fledged SQL parser Key: SPARK-12362 URL: https://issues.apache.org/jira/browse/SPARK-12362 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-12361) Should set PYSPARK_DRIVER_PYTHON before python test

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12361: Assignee: (was: Apache Spark) > Should set PYSPARK_DRIVER_PYTHON before python test >

[jira] [Assigned] (SPARK-12361) Should set PYSPARK_DRIVER_PYTHON before python test

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12361: Assignee: Apache Spark > Should set PYSPARK_DRIVER_PYTHON before python test > ---

<    1   2   3   4   >