[jira] [Commented] (SPARK-16007) Empty DataFrame created with spark.read.csv() does not respect user specified schema

[ https://issues.apache.org/jira/browse/SPARK-16007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363825#comment-15363825 ] Reynold Xin commented on SPARK-16007: - Is this done yet? > Empty DataFrame created with

[jira] [Updated] (SPARK-16007) Empty DataFrame created with spark.read.csv() does not respect user specified schema

[ https://issues.apache.org/jira/browse/SPARK-16007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16007: Target Version/s: 2.1.0 (was: 2.0.0) > Empty DataFrame created with spark.read.csv() does not

[jira] [Commented] (SPARK-16387) Reserved SQL words are not escaped by JDBC writer

[ https://issues.apache.org/jira/browse/SPARK-16387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363817#comment-15363817 ] Dongjoon Hyun commented on SPARK-16387: --- Then, could you make a PR for this? > Reserved SQL words

[jira] [Commented] (SPARK-16387) Reserved SQL words are not escaped by JDBC writer

[ https://issues.apache.org/jira/browse/SPARK-16387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363802#comment-15363802 ] Lev commented on SPARK-16387: - JdbcDialect class has a functionality that allows DB-dependent quotation.

[jira] [Resolved] (SPARK-16389) Remove useless `MetastoreRelation` from `SparkHiveWriterContainer` and `SparkHiveDynamicPartitionWriterContainer`

[ https://issues.apache.org/jira/browse/SPARK-16389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-16389. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14062

[jira] [Resolved] (SPARK-16340) In regexp_replace function column and/or column expression should also allowed as replacement.

[ https://issues.apache.org/jira/browse/SPARK-16340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16340. - Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.1.0 > In

[jira] [Commented] (SPARK-16340) In regexp_replace function column and/or column expression should also allowed as replacement.

[ https://issues.apache.org/jira/browse/SPARK-16340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363775#comment-15363775 ] Mukul Garg commented on SPARK-16340: I have checked the PR. This is what I have request. Thanks for

[jira] [Commented] (SPARK-16371) IS NOT NULL clause gives false for nested not empty column

[ https://issues.apache.org/jira/browse/SPARK-16371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363768#comment-15363768 ] Hyukjin Kwon commented on SPARK-16371: -- Sorry for being noisy, here is the Scala version {code}

[jira] [Comment Edited] (SPARK-16371) IS NOT NULL clause gives false for nested not empty column

[ https://issues.apache.org/jira/browse/SPARK-16371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363757#comment-15363757 ] Hyukjin Kwon edited comment on SPARK-16371 at 7/6/16 4:34 AM: -- Here is

[jira] [Commented] (SPARK-16371) IS NOT NULL clause gives false for nested not empty column

[ https://issues.apache.org/jira/browse/SPARK-16371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363757#comment-15363757 ] Hyukjin Kwon commented on SPARK-16371: -- Here is shorter codes {code} from pyspark.sql.functions

[jira] [Updated] (SPARK-16389) Remove useless `MetastoreRelation` from `SparkHiveWriterContainer` and `SparkHiveDynamicPartitionWriterContainer`

[ https://issues.apache.org/jira/browse/SPARK-16389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-16389: Assignee: Xiao Li > Remove useless `MetastoreRelation` from `SparkHiveWriterContainer` and >

[jira] [Commented] (SPARK-15730) [Spark SQL] the value of 'hiveconf' parameter in Spark-sql CLI don't take effect in spark-sql session

[ https://issues.apache.org/jira/browse/SPARK-15730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363691#comment-15363691 ] Yi Zhou commented on SPARK-15730: - Thanks a lot [~chenghao] and [~yhuai] ! > [Spark SQL] the value of

[jira] [Commented] (SPARK-16387) Reserved SQL words are not escaped by JDBC writer

[ https://issues.apache.org/jira/browse/SPARK-16387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363682#comment-15363682 ] Dongjoon Hyun commented on SPARK-16387: --- Hi, `escaping` sounds possible, but it is not an easy

[jira] [Updated] (SPARK-16286) Implement stack table generating function

[ https://issues.apache.org/jira/browse/SPARK-16286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-16286: Assignee: Dongjoon Hyun > Implement stack table generating function >

[jira] [Resolved] (SPARK-16286) Implement stack table generating function

[ https://issues.apache.org/jira/browse/SPARK-16286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-16286. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14033

[jira] [Assigned] (SPARK-16389) Remove useless `MetastoreRelation` from `SparkHiveWriterContainer` and `SparkHiveDynamicPartitionWriterContainer`

[ https://issues.apache.org/jira/browse/SPARK-16389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16389: Assignee: (was: Apache Spark) > Remove useless `MetastoreRelation` from

[jira] [Commented] (SPARK-16389) Remove useless `MetastoreRelation` from `SparkHiveWriterContainer` and `SparkHiveDynamicPartitionWriterContainer`

[ https://issues.apache.org/jira/browse/SPARK-16389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363594#comment-15363594 ] Apache Spark commented on SPARK-16389: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16389) Remove useless `MetastoreRelation` from `SparkHiveWriterContainer` and `SparkHiveDynamicPartitionWriterContainer`

[ https://issues.apache.org/jira/browse/SPARK-16389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16389: Assignee: Apache Spark > Remove useless `MetastoreRelation` from

[jira] [Updated] (SPARK-15761) pyspark shell should load if PYSPARK_DRIVER_PYTHON is ipython an Python3

[ https://issues.apache.org/jira/browse/SPARK-15761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15761: Fix Version/s: (was: 2.0.1) 2.0.0 > pyspark shell should load if

[jira] [Updated] (SPARK-16182) Utils.scala -- terminateProcess() should call Process.destroyForcibly() if and only if Process.destroy() fails

[ https://issues.apache.org/jira/browse/SPARK-16182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16182: Fix Version/s: (was: 2.0.1) 2.0.0 > Utils.scala -- terminateProcess()

[jira] [Created] (SPARK-16389) Remove useless `MetastoreRelation` from `SparkHiveWriterContainer` and `SparkHiveDynamicPartitionWriterContainer`

Xiao Li created SPARK-16389: --- Summary: Remove useless `MetastoreRelation` from `SparkHiveWriterContainer` and `SparkHiveDynamicPartitionWriterContainer` Key: SPARK-16389 URL:

[jira] [Updated] (SPARK-16353) Intended javadoc options are not honored for Java unidoc

[ https://issues.apache.org/jira/browse/SPARK-16353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16353: Fix Version/s: (was: 2.0.1) 2.0.0 > Intended javadoc options are not

[jira] [Commented] (SPARK-16382) YARN - Dynamic allocation with spark.executor.instances should increase max executors.

[ https://issues.apache.org/jira/browse/SPARK-16382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363592#comment-15363592 ] Saisai Shao commented on SPARK-16382: - I would suggest to fail and complain. Max usually specifies

[jira] [Assigned] (SPARK-16388) Remove spark.sql.nativeView and spark.sql.nativeView.canonical config

[ https://issues.apache.org/jira/browse/SPARK-16388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16388: Assignee: Apache Spark (was: Reynold Xin) > Remove spark.sql.nativeView and

[jira] [Assigned] (SPARK-16388) Remove spark.sql.nativeView and spark.sql.nativeView.canonical config

[ https://issues.apache.org/jira/browse/SPARK-16388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16388: Assignee: Reynold Xin (was: Apache Spark) > Remove spark.sql.nativeView and

[jira] [Commented] (SPARK-16388) Remove spark.sql.nativeView and spark.sql.nativeView.canonical config

[ https://issues.apache.org/jira/browse/SPARK-16388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363585#comment-15363585 ] Apache Spark commented on SPARK-16388: -- User 'rxin' has created a pull request for this issue:

[jira] [Created] (SPARK-16388) Remove spark.sql.nativeView and spark.sql.nativeView.canonical config

Reynold Xin created SPARK-16388: --- Summary: Remove spark.sql.nativeView and spark.sql.nativeView.canonical config Key: SPARK-16388 URL: https://issues.apache.org/jira/browse/SPARK-16388 Project: Spark

[jira] [Commented] (SPARK-16371) IS NOT NULL clause gives false for nested not empty column

[ https://issues.apache.org/jira/browse/SPARK-16371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363548#comment-15363548 ] Hyukjin Kwon commented on SPARK-16371: -- [~maver1ck] [~proflin] I could reproduce this. I will try to

[jira] [Commented] (SPARK-16367) Wheelhouse Support for PySpark

[ https://issues.apache.org/jira/browse/SPARK-16367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363509#comment-15363509 ] Jeff Zhang commented on SPARK-16367: Preparing the wheelhouse seems time consuming to me especially

[jira] [Commented] (SPARK-16367) Wheelhouse Support for PySpark

[ https://issues.apache.org/jira/browse/SPARK-16367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363513#comment-15363513 ] Jeff Zhang commented on SPARK-16367: Oh, happen to find this project to build local python package

[jira] [Resolved] (SPARK-16348) pyspark.ml MLSerDe should be called using full classpath

[ https://issues.apache.org/jira/browse/SPARK-16348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-16348. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 14023

[jira] [Resolved] (SPARK-16385) NoSuchMethodException thrown by Utils.waitForProcess

[ https://issues.apache.org/jira/browse/SPARK-16385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-16385. Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 2.0.0 >

[jira] [Resolved] (SPARK-16383) Remove `SessionState.executeSql`

[ https://issues.apache.org/jira/browse/SPARK-16383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16383. - Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.1.0 > Remove

[jira] [Resolved] (SPARK-16359) unidoc workaround for multiple kafka versions

[ https://issues.apache.org/jira/browse/SPARK-16359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-16359. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 14041

[jira] [Resolved] (SPARK-15730) [Spark SQL] the value of 'hiveconf' parameter in Spark-sql CLI don't take effect in spark-sql session

[ https://issues.apache.org/jira/browse/SPARK-15730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15730. - Resolution: Fixed Assignee: Cheng Hao Fix Version/s: 2.0.0 > [Spark SQL] the

[jira] [Commented] (SPARK-16340) In regexp_replace function column and/or column expression should also allowed as replacement.

[ https://issues.apache.org/jira/browse/SPARK-16340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363482#comment-15363482 ] Dongjoon Hyun commented on SPARK-16340: --- Please check if the PR is what you want. :) BTW, it will

[jira] [Commented] (SPARK-16340) In regexp_replace function column and/or column expression should also allowed as replacement.

[ https://issues.apache.org/jira/browse/SPARK-16340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363478#comment-15363478 ] Apache Spark commented on SPARK-16340: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-16340) In regexp_replace function column and/or column expression should also allowed as replacement.

[ https://issues.apache.org/jira/browse/SPARK-16340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16340: Assignee: (was: Apache Spark) > In regexp_replace function column and/or column

[jira] [Assigned] (SPARK-16340) In regexp_replace function column and/or column expression should also allowed as replacement.

[ https://issues.apache.org/jira/browse/SPARK-16340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16340: Assignee: Apache Spark > In regexp_replace function column and/or column expression

[jira] [Commented] (SPARK-16340) In regexp_replace function column and/or column expression should also allowed as replacement.

[ https://issues.apache.org/jira/browse/SPARK-16340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363469#comment-15363469 ] Dongjoon Hyun commented on SPARK-16340: --- Hi, [~mukul.ga...@gmail.com]. I'll make a PR for this

[jira] [Updated] (SPARK-16387) Reserved SQL words are not escaped by JDBC writer

[ https://issues.apache.org/jira/browse/SPARK-16387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lev updated SPARK-16387: Summary: Reserved SQL words are not escaped by JDBC writer (was: Reserved words are not escaped for JDBC writer)

[jira] [Created] (SPARK-16387) Reserved words are not escaped for JDBC writer

Lev created SPARK-16387: --- Summary: Reserved words are not escaped for JDBC writer Key: SPARK-16387 URL: https://issues.apache.org/jira/browse/SPARK-16387 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-16377) Spark MLlib: MultilayerPerceptronClassifier - error while training

[ https://issues.apache.org/jira/browse/SPARK-16377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363458#comment-15363458 ] Mikhail Shiryaev commented on SPARK-16377: -- The original issue with

[jira] [Commented] (SPARK-16240) model loading backward compatibility for ml.clustering.LDA

[ https://issues.apache.org/jira/browse/SPARK-16240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363454#comment-15363454 ] Joseph K. Bradley commented on SPARK-16240: --- +1 for adding special logic in the loading code.

[jira] [Comment Edited] (SPARK-16334) [SQL] SQL query on parquet table java.lang.ArrayIndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-16334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363438#comment-15363438 ] Vladimir Ivanov edited comment on SPARK-16334 at 7/5/16 11:13 PM: -- Hi,

[jira] [Commented] (SPARK-16334) [SQL] SQL query on parquet table java.lang.ArrayIndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-16334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363438#comment-15363438 ] Vladimir Ivanov commented on SPARK-16334: - Hi, we discovered problem with the same stacktrace in

[jira] [Commented] (SPARK-16384) FROM_UNIXTIME reports incorrect days

[ https://issues.apache.org/jira/browse/SPARK-16384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363420#comment-15363420 ] Dongjoon Hyun commented on SPARK-16384: --- It's the behavior of Java `SimpleDateFormat`. Hive also

[jira] [Commented] (SPARK-16384) FROM_UNIXTIME reports incorrect days

[ https://issues.apache.org/jira/browse/SPARK-16384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363418#comment-15363418 ] Dongjoon Hyun commented on SPARK-16384: --- Hi, [~epanastasi] That is not a bug. You should use

[jira] [Commented] (SPARK-11857) Remove Mesos fine-grained mode subject to discussions

[ https://issues.apache.org/jira/browse/SPARK-11857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363410#comment-15363410 ] Michael Gummelt commented on SPARK-11857: - Thanks! > Remove Mesos fine-grained mode subject to

[jira] [Updated] (SPARK-16386) SQLContext and HiveContext parse a query string differently

[ https://issues.apache.org/jira/browse/SPARK-16386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hao Ren updated SPARK-16386: Description: I just want to figure out why the two contexts behavior differently even on a simple query.

[jira] [Updated] (SPARK-16386) SQLContext and HiveContext parse a query string differently

[ https://issues.apache.org/jira/browse/SPARK-16386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hao Ren updated SPARK-16386: Description: I just want to figure out why the two contexts behavior differently even on a simple query.

[jira] [Created] (SPARK-16386) SQLContext and HiveContext parse a query string differently

Hao Ren created SPARK-16386: --- Summary: SQLContext and HiveContext parse a query string differently Key: SPARK-16386 URL: https://issues.apache.org/jira/browse/SPARK-16386 Project: Spark Issue

[jira] [Updated] (SPARK-16386) SQLContext and HiveContext parse a query string differently

[ https://issues.apache.org/jira/browse/SPARK-16386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hao Ren updated SPARK-16386: Description: I just want to figure out why the two contexts behavior differently even on a simple query.

[jira] [Commented] (SPARK-11857) Remove Mesos fine-grained mode subject to discussions

[ https://issues.apache.org/jira/browse/SPARK-11857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363404#comment-15363404 ] Adam McElwee commented on SPARK-11857: -- Nah, carry on. I'm not using spark at the new job, so I

[jira] [Updated] (SPARK-16324) regexp_extract should doc that it returns empty string when match fails

[ https://issues.apache.org/jira/browse/SPARK-16324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16324: -- Issue Type: Improvement (was: Bug) Summary: regexp_extract should doc that it returns empty

[jira] [Updated] (SPARK-15909) PySpark classpath uri incorrectly set

[ https://issues.apache.org/jira/browse/SPARK-15909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15909: -- Priority: Minor (was: Major) This is another instance of something that isn't generally supported --

[jira] [Updated] (SPARK-15804) Manually added metadata not saving with parquet

[ https://issues.apache.org/jira/browse/SPARK-15804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15804: -- Fix Version/s: (was: 2.0.0) > Manually added metadata not saving with parquet >

[jira] [Resolved] (SPARK-16098) Multiclass SVM Learning

[ https://issues.apache.org/jira/browse/SPARK-16098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16098. --- Resolution: Won't Fix > Multiclass SVM Learning > --- > > Key:

[jira] [Commented] (SPARK-11857) Remove Mesos fine-grained mode subject to discussions

[ https://issues.apache.org/jira/browse/SPARK-11857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363367#comment-15363367 ] Michael Gummelt commented on SPARK-11857: - I'll give [~amcelwee] a couple days to respond.

[jira] [Commented] (SPARK-15730) [Spark SQL] the value of 'hiveconf' parameter in Spark-sql CLI don't take effect in spark-sql session

[ https://issues.apache.org/jira/browse/SPARK-15730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363355#comment-15363355 ] Apache Spark commented on SPARK-15730: -- User 'yhuai' has created a pull request for this issue:

[jira] [Commented] (SPARK-11857) Remove Mesos fine-grained mode subject to discussions

[ https://issues.apache.org/jira/browse/SPARK-11857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363345#comment-15363345 ] Michael Gummelt commented on SPARK-11857: - For completeness, here's my theoretical analysis to

[jira] [Commented] (SPARK-11857) Remove Mesos fine-grained mode subject to discussions

[ https://issues.apache.org/jira/browse/SPARK-11857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363331#comment-15363331 ] Reynold Xin commented on SPARK-11857: - Michael can you submit a pull request to log deprecation and

[jira] [Commented] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363324#comment-15363324 ] Sean Owen commented on SPARK-16379: --- Of course we'd all like to never have bugs. Nobody makes bugs on

[jira] [Issue Comment Deleted] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-16379: Comment: was deleted (was: > We have a bug and need to address it in the best way

[jira] [Commented] (SPARK-11857) Remove Mesos fine-grained mode subject to discussions

[ https://issues.apache.org/jira/browse/SPARK-11857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363321#comment-15363321 ] Michael Gummelt commented on SPARK-11857: - [~amcelwee] Do you have any more input on this issue.

[jira] [Comment Edited] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363302#comment-15363302 ] Stavros Kontopoulos edited comment on SPARK-16379 at 7/5/16 9:49 PM: -

[jira] [Commented] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363314#comment-15363314 ] Stavros Kontopoulos commented on SPARK-16379: - > Nobody is suggesting knowingly making a

[jira] [Commented] (SPARK-11857) Remove Mesos fine-grained mode subject to discussions

[ https://issues.apache.org/jira/browse/SPARK-11857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363311#comment-15363311 ] Michael Gummelt commented on SPARK-11857: - I endorse the deprecation. Fine-grained mode would be

[jira] [Reopened] (SPARK-11857) Remove Mesos fine-grained mode subject to discussions

[ https://issues.apache.org/jira/browse/SPARK-11857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt reopened SPARK-11857: - > Remove Mesos fine-grained mode subject to discussions >

[jira] [Commented] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363305#comment-15363305 ] Stavros Kontopoulos commented on SPARK-16379: - > We have a bug and need to address it in the

[jira] [Commented] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363303#comment-15363303 ] Sean Owen commented on SPARK-16379: --- It's true, I can't say for sure the problem exists without that

[jira] [Commented] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363302#comment-15363302 ] Stavros Kontopoulos commented on SPARK-16379: - There was no bug previously in the scheduler.

[jira] [Comment Edited] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363289#comment-15363289 ] Michael Gummelt edited comment on SPARK-16379 at 7/5/16 9:35 PM: - I say

[jira] [Comment Edited] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363289#comment-15363289 ] Michael Gummelt edited comment on SPARK-16379 at 7/5/16 9:34 PM: - I say

[jira] [Commented] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363296#comment-15363296 ] Sean Owen commented on SPARK-16379: --- I don't think it's even a bad practice, any more than using

[jira] [Comment Edited] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363289#comment-15363289 ] Michael Gummelt edited comment on SPARK-16379 at 7/5/16 9:33 PM: - I say

[jira] [Comment Edited] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363289#comment-15363289 ] Michael Gummelt edited comment on SPARK-16379 at 7/5/16 9:31 PM: - I say

[jira] [Commented] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363290#comment-15363290 ] Michael Gummelt commented on SPARK-16379: - Hmmm, since that's a different lock, I don't see the

[jira] [Commented] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363289#comment-15363289 ] Michael Gummelt commented on SPARK-16379: - I say we add a new lock to synchronize on and be done

[jira] [Comment Edited] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363278#comment-15363278 ] Stavros Kontopoulos edited comment on SPARK-16379 at 7/5/16 9:27 PM: -

[jira] [Comment Edited] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363278#comment-15363278 ] Stavros Kontopoulos edited comment on SPARK-16379 at 7/5/16 9:26 PM: -

[jira] [Commented] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363278#comment-15363278 ] Stavros Kontopoulos commented on SPARK-16379: - Ok we can be flexible thats not the issue. A

[jira] [Commented] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363272#comment-15363272 ] Sean Owen commented on SPARK-16379: --- Yes, but that is what I am arguing. Above you said it should be

[jira] [Comment Edited] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363270#comment-15363270 ] Stavros Kontopoulos edited comment on SPARK-16379 at 7/5/16 9:18 PM: -

[jira] [Commented] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363269#comment-15363269 ] Sean Owen commented on SPARK-16379: --- Oh I also meant this as the existing workaround:

[jira] [Commented] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363270#comment-15363270 ] Stavros Kontopoulos commented on SPARK-16379: - > Arguably it's "synchronized" that is the

[jira] [Commented] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363266#comment-15363266 ] Sean Owen commented on SPARK-16379: --- I mean this:

[jira] [Comment Edited] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363258#comment-15363258 ] Michael Gummelt edited comment on SPARK-16379 at 7/5/16 9:15 PM: - > it's

[jira] [Commented] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363256#comment-15363256 ] Michael Gummelt commented on SPARK-16379: - > The previous code also involved acquiring a lock

[jira] [Commented] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363258#comment-15363258 ] Michael Gummelt commented on SPARK-16379: - > The previous code also involved acquiring a lock

[jira] [Issue Comment Deleted] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt updated SPARK-16379: Comment: was deleted (was: > The previous code also involved acquiring a lock Link? I

[jira] [Commented] (SPARK-16363) Spark-submit doesn't work with IAM Roles

[ https://issues.apache.org/jira/browse/SPARK-16363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363249#comment-15363249 ] Ewan Leith commented on SPARK-16363: I'm not sure this is a major issue, but try running with the

[jira] [Commented] (SPARK-15425) Disallow cartesian joins by default

[ https://issues.apache.org/jira/browse/SPARK-15425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363218#comment-15363218 ] Apache Spark commented on SPARK-15425: -- User 'rxin' has created a pull request for this issue:

[jira] [Commented] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363199#comment-15363199 ] Sean Owen commented on SPARK-16379: --- I don't agree with that logic; it's entirely possible that code

[jira] [Commented] (SPARK-16367) Wheelhouse Support for PySpark

[ https://issues.apache.org/jira/browse/SPARK-16367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363189#comment-15363189 ] Semet commented on SPARK-16367: --- This is where the magic of wheels lies: - look at

[jira] [Assigned] (SPARK-16385) NoSuchMethodException thrown by Utils.waitForProcess

[ https://issues.apache.org/jira/browse/SPARK-16385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16385: Assignee: (was: Apache Spark) > NoSuchMethodException thrown by Utils.waitForProcess

[jira] [Commented] (SPARK-16385) NoSuchMethodException thrown by Utils.waitForProcess

[ https://issues.apache.org/jira/browse/SPARK-16385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363154#comment-15363154 ] Apache Spark commented on SPARK-16385: -- User 'vanzin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16385) NoSuchMethodException thrown by Utils.waitForProcess

[ https://issues.apache.org/jira/browse/SPARK-16385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16385: Assignee: Apache Spark > NoSuchMethodException thrown by Utils.waitForProcess >

[jira] [Created] (SPARK-16385) NoSuchMethodException thrown by Utils.waitForProcess

Marcelo Vanzin created SPARK-16385: -- Summary: NoSuchMethodException thrown by Utils.waitForProcess Key: SPARK-16385 URL: https://issues.apache.org/jira/browse/SPARK-16385 Project: Spark

[jira] [Commented] (SPARK-16385) NoSuchMethodException thrown by Utils.waitForProcess

[ https://issues.apache.org/jira/browse/SPARK-16385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363153#comment-15363153 ] Marcelo Vanzin commented on SPARK-16385: Here's what I see when running unit tests on java 7:

  1   2   3   >