[jira] [Commented] (SPARK-21866) SPIP: Image support in Spark

2017-10-22 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16214673#comment-16214673 ] Weichen Xu commented on SPARK-21866: [~josephkb] The datasource API has advantage of expoloiting SQL

[jira] [Commented] (SPARK-22331) Strength consistency for supporting string params: case-insensitive or not

2017-10-22 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16214667#comment-16214667 ] yuhao yang commented on SPARK-22331: cc [~WeichenXu123] > Strength consistency for supporting string

[jira] [Created] (SPARK-22331) Strength consistency for supporting string params: case-insensitive or not

2017-10-22 Thread yuhao yang (JIRA)
yuhao yang created SPARK-22331: -- Summary: Strength consistency for supporting string params: case-insensitive or not Key: SPARK-22331 URL: https://issues.apache.org/jira/browse/SPARK-22331 Project:

[jira] [Commented] (SPARK-22281) Handle R method breaking signature changes

2017-10-22 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16214663#comment-16214663 ] Shivaram Venkataraman commented on SPARK-22281: --- Thanks for looking into this

[jira] [Commented] (SPARK-22308) Support unit tests of spark code using ScalaTest using suites other than FunSuite

2017-10-22 Thread Nathan Kronenfeld (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16214601#comment-16214601 ] Nathan Kronenfeld commented on SPARK-22308: --- ok, the documentation is taken out... I'll make a

[jira] [Closed] (SPARK-22272) killing task may cause the executor progress hang because of the JVM bug

2017-10-22 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao closed SPARK-22272. --- > killing task may cause the executor progress hang because of the JVM bug >

[jira] [Resolved] (SPARK-22272) killing task may cause the executor progress hang because of the JVM bug

2017-10-22 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved SPARK-22272. - Resolution: Won't Fix > killing task may cause the executor progress hang because of the JVM bug

[jira] [Commented] (SPARK-22272) killing task may cause the executor progress hang because of the JVM bug

2017-10-22 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16214569#comment-16214569 ] Saisai Shao commented on SPARK-22272: - Setting "spark.file.transferTo" to "false" will potentially

[jira] [Commented] (SPARK-22319) SparkSubmit calls getFileStatus before calling loginUserFromKeytab

2017-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16214552#comment-16214552 ] Apache Spark commented on SPARK-22319: -- User 'sjrand' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22319) SparkSubmit calls getFileStatus before calling loginUserFromKeytab

2017-10-22 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reassigned SPARK-22319: --- Assignee: Steven Rand > SparkSubmit calls getFileStatus before calling loginUserFromKeytab

[jira] [Resolved] (SPARK-22319) SparkSubmit calls getFileStatus before calling loginUserFromKeytab

2017-10-22 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved SPARK-22319. - Resolution: Fixed Fix Version/s: 2.3.0 > SparkSubmit calls getFileStatus before calling

[jira] [Updated] (SPARK-22319) SparkSubmit calls getFileStatus before calling loginUserFromKeytab

2017-10-22 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-22319: Affects Version/s: 2.2.0 > SparkSubmit calls getFileStatus before calling loginUserFromKeytab >

[jira] [Commented] (SPARK-22330) Linear containsKey operation for serialized maps.

2017-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16214472#comment-16214472 ] Apache Spark commented on SPARK-22330: -- User 'Whoosh' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22330) Linear containsKey operation for serialized maps.

2017-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22330: Assignee: (was: Apache Spark) > Linear containsKey operation for serialized maps. >

[jira] [Assigned] (SPARK-22330) Linear containsKey operation for serialized maps.

2017-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22330: Assignee: Apache Spark > Linear containsKey operation for serialized maps. >

[jira] [Created] (SPARK-22330) Linear containsKey operation for serialized maps.

2017-10-22 Thread Alexander (JIRA)
Alexander created SPARK-22330: - Summary: Linear containsKey operation for serialized maps. Key: SPARK-22330 URL: https://issues.apache.org/jira/browse/SPARK-22330 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-22281) Handle R method breaking signature changes

2017-10-22 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16214431#comment-16214431 ] Felix Cheung commented on SPARK-22281: -- tried a few things. If we remove the {code} @param {code}

[jira] [Assigned] (SPARK-22329) Use NEVER_INFER for `spark.sql.hive.caseSensitiveInferenceMode` by default

2017-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22329: Assignee: Apache Spark > Use NEVER_INFER for `spark.sql.hive.caseSensitiveInferenceMode`

[jira] [Assigned] (SPARK-22329) Use NEVER_INFER for `spark.sql.hive.caseSensitiveInferenceMode` by default

2017-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22329: Assignee: (was: Apache Spark) > Use NEVER_INFER for

[jira] [Commented] (SPARK-22329) Use NEVER_INFER for `spark.sql.hive.caseSensitiveInferenceMode` by default

2017-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16214410#comment-16214410 ] Apache Spark commented on SPARK-22329: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-22329) Use NEVER_INFER for `spark.sql.hive.caseSensitiveInferenceMode` by default

2017-10-22 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-22329: - Summary: Use NEVER_INFER for `spark.sql.hive.caseSensitiveInferenceMode` by default Key: SPARK-22329 URL: https://issues.apache.org/jira/browse/SPARK-22329

[jira] [Commented] (SPARK-22284) Code of class \"org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificUnsafeProjection\" grows beyond 64 KB

2017-10-22 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16214332#comment-16214332 ] Kazuaki Ishizaki commented on SPARK-22284: -- Yes, there was a similar ticket that was solved.

[jira] [Updated] (SPARK-2620) case class cannot be used as key for reduce

2017-10-22 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-2620: -- Affects Version/s: 2.2.0 > case class cannot be used as key for reduce >

[jira] [Assigned] (SPARK-17902) collect() ignores stringsAsFactors

2017-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17902: Assignee: (was: Apache Spark) > collect() ignores stringsAsFactors >

[jira] [Commented] (SPARK-17902) collect() ignores stringsAsFactors

2017-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16214263#comment-16214263 ] Apache Spark commented on SPARK-17902: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-17902) collect() ignores stringsAsFactors

2017-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17902: Assignee: Apache Spark > collect() ignores stringsAsFactors >

[jira] [Commented] (SPARK-22142) Move Flume support behind a profile

2017-10-22 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16214238#comment-16214238 ] Hyukjin Kwon commented on SPARK-22142: -- Let me leave a link to dev mailing list -

[jira] [Commented] (SPARK-22272) killing task may cause the executor progress hang because of the JVM bug

2017-10-22 Thread roncenzhao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16214220#comment-16214220 ] roncenzhao commented on SPARK-22272: I think the simple way is to set 'spark.file.transferTo' false.